-- Logs begin at Sun 2022-06-05 07:38:03 UTC, end at Sun 2022-06-05 09:12:45 UTC. -- Jun 05 08:12:28.054695 n-d-844739-1 systemd[1]: Starting Devstack devstack@n-api.service... Jun 05 08:12:28.063689 n-d-844739-1 devstack@n-api.service[103893]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 05 08:12:28.065679 n-d-844739-1 devstack@n-api.service[103893]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Jun 5 08:12:28 2022] *** Jun 05 08:12:28.065679 n-d-844739-1 devstack@n-api.service[103893]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 05 08:12:28.065679 n-d-844739-1 devstack@n-api.service[103893]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 05 08:12:28.065679 n-d-844739-1 devstack@n-api.service[103893]: nodename: n-d-844739-1 Jun 05 08:12:28.065679 n-d-844739-1 devstack@n-api.service[103893]: machine: x86_64 Jun 05 08:12:28.065679 n-d-844739-1 devstack@n-api.service[103893]: clock source: unix Jun 05 08:12:28.065679 n-d-844739-1 devstack@n-api.service[103893]: pcre jit disabled Jun 05 08:12:28.065679 n-d-844739-1 devstack@n-api.service[103893]: detected number of CPU cores: 4 Jun 05 08:12:28.065679 n-d-844739-1 devstack@n-api.service[103893]: current working directory: / Jun 05 08:12:28.065679 n-d-844739-1 devstack@n-api.service[103893]: detected binary path: /usr/bin/uwsgi-core Jun 05 08:12:28.066276 n-d-844739-1 devstack@n-api.service[103893]: your processes number limit is 47680 Jun 05 08:12:28.066276 n-d-844739-1 devstack@n-api.service[103893]: your memory page size is 4096 bytes Jun 05 08:12:28.066276 n-d-844739-1 devstack@n-api.service[103893]: detected max file descriptor number: 2048 Jun 05 08:12:28.066276 n-d-844739-1 devstack@n-api.service[103893]: lock engine: pthread robust mutexes Jun 05 08:12:28.066276 n-d-844739-1 devstack@n-api.service[103893]: thunder lock: enabled Jun 05 08:12:28.066276 n-d-844739-1 devstack@n-api.service[103893]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 05 08:12:28.066276 n-d-844739-1 devstack@n-api.service[103893]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 05 08:12:28.110379 n-d-844739-1 devstack@n-api.service[103893]: Python main interpreter initialized at 0x55c3b01759c0 Jun 05 08:12:28.110379 n-d-844739-1 devstack@n-api.service[103893]: python threads support enabled Jun 05 08:12:28.110379 n-d-844739-1 devstack@n-api.service[103893]: your server socket listen backlog is limited to 100 connections Jun 05 08:12:28.110379 n-d-844739-1 devstack@n-api.service[103893]: your mercy for graceful operations on workers is 90 seconds Jun 05 08:12:28.110802 n-d-844739-1 devstack@n-api.service[103893]: mapped 403077 bytes (393 KB) for 2 cores Jun 05 08:12:28.110802 n-d-844739-1 devstack@n-api.service[103893]: *** Operational MODE: preforking *** Jun 05 08:12:28.111040 n-d-844739-1 devstack@n-api.service[103893]: *** uWSGI is running in multiple interpreter mode *** Jun 05 08:12:28.111040 n-d-844739-1 devstack@n-api.service[103893]: spawned uWSGI master process (pid: 103893) Jun 05 08:12:28.111220 n-d-844739-1 systemd[1]: Started Devstack devstack@n-api.service. Jun 05 08:12:28.111761 n-d-844739-1 devstack@n-api.service[103893]: spawned uWSGI worker 1 (pid: 103894, cores: 1) Jun 05 08:12:28.112120 n-d-844739-1 devstack@n-api.service[103893]: spawned uWSGI worker 2 (pid: 103895, cores: 1) Jun 05 08:12:28.112280 n-d-844739-1 devstack@n-api.service[103893]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 05 08:12:29.358432 n-d-844739-1 devstack@n-api.service[103894]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 05 08:12:29.359601 n-d-844739-1 devstack@n-api.service[103895]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 05 08:12:30.101025 n-d-844739-1 devstack@n-api.service[103895]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 05 08:12:30.101025 n-d-844739-1 devstack@n-api.service[103895]: from cryptography.utils import int_from_bytes Jun 05 08:12:30.101353 n-d-844739-1 devstack@n-api.service[103895]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 05 08:12:30.101353 n-d-844739-1 devstack@n-api.service[103895]: from cryptography.utils import int_from_bytes Jun 05 08:12:30.112323 n-d-844739-1 devstack@n-api.service[103894]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 05 08:12:30.112323 n-d-844739-1 devstack@n-api.service[103894]: from cryptography.utils import int_from_bytes Jun 05 08:12:30.112654 n-d-844739-1 devstack@n-api.service[103894]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 05 08:12:30.112654 n-d-844739-1 devstack@n-api.service[103894]: from cryptography.utils import int_from_bytes Jun 05 08:12:32.820498 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 05 08:12:32.821048 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 05 08:12:32.821274 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 05 08:12:32.821641 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 05 08:12:32.821900 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 05 08:12:32.822293 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.822622 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.822948 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.823275 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.823610 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.823792 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 05 08:12:32.824190 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.824285 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 05 08:12:32.824365 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.824572 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.824658 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 05 08:12:32.824902 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.824996 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 05 08:12:32.825166 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.825251 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 05 08:12:32.825486 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.825652 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.826409 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-844739-1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.826745 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.826892 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.827055 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.827220 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.827369 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.827542 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.827691 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.827873 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.828003 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.828238 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.828367 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.828558 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.828678 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.828877 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.829178 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.829285 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.829450 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.829625 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.829761 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.829937 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.830084 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-844739-1 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.830251 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.830404 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.830592 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.830722 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.830909 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.831035 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.831221 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.831359 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.831556 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.831682 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.831859 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.831995 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.832207 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.832357 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.832521 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.832710 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.832921 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-844739-1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.833056 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.833243 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.833375 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.833561 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.833692 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.833879 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.834013 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.834207 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.834337 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.834511 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.834644 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.834831 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.834957 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.835131 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.835255 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.835450 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.835594 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.835739 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.835939 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.836149 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.836276 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-844739-1 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.836463 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.836604 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.836773 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.836906 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.837083 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.837214 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.837384 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.837507 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.837699 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.837832 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.838010 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.838143 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.838331 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.838456 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.838638 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.838775 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.838942 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.839065 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.839186 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.839305 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.839489 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.839621 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.839812 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.839935 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.840158 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.840295 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.840483 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.840621 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.840742 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.840872 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.840999 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.841129 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.841300 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.841618 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.841861 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.842002 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.842155 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.842303 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.842462 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.842601 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.842798 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.842925 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.843058 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.843202 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.843334 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.843464 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.843617 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.843743 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.843939 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.844118 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.844254 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.844380 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.844500 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.844622 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.844752 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.844953 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.845079 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.845267 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.845400 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.845610 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.845744 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.845941 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.846066 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.846219 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.846344 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.846531 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.846658 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.846831 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.846955 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.847133 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.847258 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.847438 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.847565 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.847753 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.847886 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.848090 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.848219 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.848415 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.848544 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.848721 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.848847 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.849029 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.849161 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.849351 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.849476 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.849656 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.849781 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.849962 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.850097 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.850218 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.850339 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.850503 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.850636 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.850811 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.850944 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.851129 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.851266 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.851439 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.851571 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.851749 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.851886 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.852074 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.852215 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.852384 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.852518 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.852696 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.852914 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.853048 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.853170 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.853291 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.853410 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.853539 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.853662 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.853817 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.853942 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.854119 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.854245 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.854436 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.854563 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.854739 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.854866 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.855042 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.855171 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.855344 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.855470 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.855637 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.855770 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.855942 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.856102 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.856272 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.856399 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.856577 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.856702 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.856905 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.857147 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.857286 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.857524 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.857719 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.857845 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.858026 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.858159 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.858336 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.858470 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.858641 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.858766 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.858945 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.859083 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.859262 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.859388 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.859582 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.859709 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.859889 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.860023 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.860234 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.860357 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.860512 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.860651 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.860816 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.860950 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.861133 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.861271 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.861424 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.861549 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.861726 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.861861 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.862030 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.862154 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.862331 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.862466 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.862631 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.862767 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.862937 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.863052 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.863238 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.863338 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.863535 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.863634 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.863846 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.863941 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.864169 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.864261 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.864473 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.864562 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.864786 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.864871 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.865088 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.865173 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.865388 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.865483 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.865687 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.865773 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.865985 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.866072 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.866284 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.866372 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.866582 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.866691 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.866879 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.867031 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.867186 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.867367 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.867506 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.867694 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.867821 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.868010 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.868167 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.868350 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.868478 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.868657 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.868790 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.868956 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.869086 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.869270 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:12:32.869396 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.869582 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.869706 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.869904 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.870030 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.870228 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.870366 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.870538 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.870673 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.870866 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.871008 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.871181 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.871314 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.871495 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.871629 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.871805 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.871937 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.872151 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.872307 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.872998 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.873296 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.873432 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.873656 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.873782 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.874001 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.874133 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.874349 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.874482 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.874668 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.874795 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.874990 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.875114 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.875316 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.875441 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.875629 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.875753 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.875942 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.876129 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.876272 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.876397 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.876581 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.876712 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.876897 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.877035 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.877222 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.877345 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.877538 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.877661 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.877848 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.877982 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.878166 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.878290 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.878482 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.878615 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.878799 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.878933 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.879117 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.879240 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.879433 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.879569 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.879742 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.879876 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.880062 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.880201 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.880383 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.880521 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.880700 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.880834 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.881019 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.881146 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.881328 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.881453 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.881641 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.881766 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.881948 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.882073 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.882255 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.882380 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.882561 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.882687 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.882869 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.882996 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.883171 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.883401 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.883538 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.883669 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.883792 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.883912 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.884119 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.884261 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.884432 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.884559 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.884747 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.884873 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.885061 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.885194 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.885368 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.885494 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.885677 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.885803 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.885980 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.886115 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.886282 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.886410 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.886583 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.886709 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.886889 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.887023 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.887188 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.887304 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.887502 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.887628 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.887814 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.887953 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.888238 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.888861 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.889152 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.889479 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.889621 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.889798 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.889924 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.890112 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.890238 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.890426 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.890566 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.890737 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.890864 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.891043 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.891169 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.891356 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.891490 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.891691 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.891816 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.891959 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.892104 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.892333 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.892472 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.892642 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.892781 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.892948 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.893074 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.893268 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.893416 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.893603 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.893731 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.893852 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.893974 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.894156 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.894283 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.894463 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.894590 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.894774 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.894907 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.895089 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.895224 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.895397 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.895524 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.895719 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.895846 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.896032 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.896222 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.896347 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.896468 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.896673 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.896880 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.897005 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.897134 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.897277 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.897396 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.897598 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.897732 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.897910 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.898034 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.898220 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.898346 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.898524 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.898658 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.898832 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.898958 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.899134 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.899251 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.899440 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.899575 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.899743 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.899869 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.900064 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.900209 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.900382 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.900509 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.900689 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.900815 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.900992 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.901119 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.901296 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.901686 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.901864 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.901989 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.902186 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.902312 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.902495 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.902621 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.902799 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.902924 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.903102 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.903228 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.903404 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.903537 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.903842 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.903971 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.904376 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.904727 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.904888 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.905073 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.905200 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.905416 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.905542 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.905736 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.905871 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.906060 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.906193 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.906375 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.906500 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.906690 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.906817 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.907000 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.907133 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.907310 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.907437 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.907621 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.907746 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.907930 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.908122 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.908275 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.908402 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.908589 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.908715 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.908908 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.909034 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.909216 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.909352 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.909538 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.909665 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.909849 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.909975 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.910169 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.910304 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.910473 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.910599 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.910785 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.910911 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.911099 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.911233 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.911425 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.911552 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.911737 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.911862 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.912074 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.912216 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.912390 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.912516 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.912704 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.912839 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.913014 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.913141 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.913323 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.913456 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.913632 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.913771 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.913973 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.914108 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.914238 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.914361 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.914546 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.914680 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.914862 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.914996 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.915173 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.915298 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.915485 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.915655 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.915799 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.915921 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.916118 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.916245 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.916424 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.916563 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.916737 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.916892 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.917052 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.917176 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.917368 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.917501 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.917677 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.917804 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.917986 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.918111 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.918303 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.918441 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.918613 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.918738 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.918925 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.919050 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.919238 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.919426 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.919709 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.920024 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.920172 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.920358 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.920484 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.920691 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.920818 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.921008 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.921134 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.921318 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.921444 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.921627 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.921759 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.921930 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.922055 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.922244 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.922382 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.922551 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.922684 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.922856 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.922992 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.923159 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.923299 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.923469 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.923594 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.923790 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.923939 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.924154 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.924295 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.924420 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.924549 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.924729 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.924863 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.925031 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.925165 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.925340 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.925466 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.925657 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.925789 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.925964 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.926089 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.926265 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.926390 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.926569 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.926701 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.926897 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.927022 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.927194 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.927332 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.927500 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.927626 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.927802 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.927929 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.928167 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.928306 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.928442 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.928573 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.928733 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.928867 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.929044 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.929168 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.929350 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.929614 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.929741 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.929955 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.930088 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.930263 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.930395 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.930569 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.930695 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.930876 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.931009 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.931183 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.931309 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.931491 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.931617 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.931798 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.931931 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.932142 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.932281 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.932450 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.932589 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.932757 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.932884 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.933064 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.933189 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.933365 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.933493 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.933674 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.933799 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.933985 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.934112 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.934324 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.934546 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.934673 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.934882 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.935541 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.935782 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.936096 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.936381 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.936691 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.937012 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.937322 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.937641 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.937952 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.938279 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.938591 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.938900 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.939025 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.939207 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.939514 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.939744 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.939877 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.940131 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.940271 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.940483 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.940609 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.940835 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.940963 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.941178 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.941309 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.941488 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.941620 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.941797 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.941932 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.942126 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.942258 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.942436 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.942570 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.942746 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.942873 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.943055 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.943181 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.943367 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.943499 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.943678 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.943802 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.943987 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.944140 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.944329 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.944464 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.944640 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.944749 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.944950 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.945047 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.945256 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.945360 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.945562 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.945656 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.945876 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.945972 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.946182 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.946277 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.946498 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.946593 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.946805 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.946907 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.947114 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.947215 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.947423 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.947525 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.947724 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.947817 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.948028 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.948156 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.948355 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.948450 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.948667 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.948761 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.948976 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.949064 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.949297 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.949383 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.949606 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.949701 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.949918 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.950016 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.950226 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.950313 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.950540 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.951181 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.951390 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.951699 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.951944 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.952031 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.952296 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.952386 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.952608 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.952695 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.952919 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.953019 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.953234 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.953321 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.953540 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.953625 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.953844 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.953930 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.954162 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.954250 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.954477 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.954565 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.954790 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.954877 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.955097 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.955191 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.955402 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.955491 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.955708 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.955793 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.956010 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.956132 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.956352 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.956439 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.956663 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.956962 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.957050 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.957265 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.957484 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.957580 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.957871 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.958057 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.958175 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.958484 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.958639 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.958787 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.959100 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.959222 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.959410 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.959717 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.959802 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.960023 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.960351 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.960450 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.960660 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.960962 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.961055 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.961287 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.961584 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.961672 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.961892 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.962126 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.962211 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.962495 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.962680 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.962790 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.963117 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.963280 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.963401 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.963674 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.963766 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.964028 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.964133 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.964355 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.964431 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.964668 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.964938 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.965064 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.965064 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.965557 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.965662 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.965775 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.965880 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.966007 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.966119 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.966456 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.966927 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.967130 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.967247 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.967351 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.967553 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.967667 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.967861 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.968030 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.968212 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.968370 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.968526 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.968691 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.968833 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.969028 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.969137 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.969355 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.969448 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.969680 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.969781 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.970026 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.970158 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.970348 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.970443 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.970682 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.970778 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.970996 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.971092 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.971312 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.971398 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.971625 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.971720 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.971937 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.972024 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.972280 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.972367 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.972582 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.972680 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.972898 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.972991 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.973209 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.973303 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.973520 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.973616 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.973823 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.973910 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.974126 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.974220 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.974445 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.974534 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.974754 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.974841 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.975063 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.975149 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.975375 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.975462 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.975693 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.975780 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.976013 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.976159 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.976340 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.976429 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.976646 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.976734 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.976957 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.977052 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.977263 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.977348 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.977574 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.977660 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.977884 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.978016 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.978195 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.978324 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.978507 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.978649 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.978817 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.978964 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.979129 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.979286 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.979446 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.979606 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.979751 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.979930 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.980083 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.980280 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.980395 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.980595 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.980695 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.981013 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.981099 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.981322 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.981416 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.981627 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.981722 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.981985 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.982300 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.982614 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.982932 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.983265 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.983578 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.983890 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.984238 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.984442 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.984646 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.984788 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.984962 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.985126 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.985294 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.985455 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.985723 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.985909 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.986044 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.986238 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.986357 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.986564 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.986782 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.986953 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.987103 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.987191 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.987420 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.987506 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.987749 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.987882 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.988098 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.988188 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.988432 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.988519 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.988745 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.988844 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.989066 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.989153 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.989383 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.989469 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.989715 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.989810 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.990046 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.990133 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.990354 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.990438 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.990669 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.990756 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.990978 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.991063 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.991294 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.991378 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.991609 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.991702 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.991915 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.992009 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.992268 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.992356 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.992578 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.992675 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.992903 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.992998 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.993315 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.993401 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.993627 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.993712 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.993936 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.994024 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.994266 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.994351 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.994584 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.994679 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.994903 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.994990 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.995216 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.995309 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.995527 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.995622 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.995858 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.995951 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.996197 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.996296 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.996514 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.996609 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.996824 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.996918 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.997137 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.997223 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.997957 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.998259 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.998462 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.998966 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.999289 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.999654 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.999760 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:32.999991 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.000273 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.000413 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.000672 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.000838 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.001005 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.001331 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.001432 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.001673 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.001929 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.002092 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.002431 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.002578 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.002752 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.002893 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.003088 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.003249 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.003407 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.003549 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.003718 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.003912 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.004183 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.004351 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.004501 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.004651 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.004879 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.004969 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.005277 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.005472 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.005590 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.005962 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.006109 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.006289 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.006440 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.006657 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.006812 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.006959 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.007106 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.007236 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.007424 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.007560 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.007759 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.007855 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.008122 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.008262 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.008465 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.008555 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.008787 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.008881 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.009107 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.009195 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.009414 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.009508 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.009734 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.009820 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.010042 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.010129 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.010347 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.010441 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.010652 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.010742 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.010956 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.011051 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.011268 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.011355 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.011587 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.011673 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.011909 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.012097 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.012263 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.012419 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.012598 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.012753 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.012910 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.013096 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.013945 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.014264 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.014354 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.014580 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.014704 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.014931 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.015031 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.015246 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.015334 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.015590 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.015684 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.015921 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.016009 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.016276 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.016379 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.016592 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.016728 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.016901 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.017047 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.017209 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.017306 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.017515 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.017610 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.017824 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.017912 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.018128 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.018222 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.018431 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.018530 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.018732 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.018819 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.019055 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.019143 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.019360 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.019456 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.019682 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.019769 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.019990 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.020098 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.020346 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.020433 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.020670 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.020758 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.021007 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.021229 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.021353 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.021575 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.021701 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.021896 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.021992 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.022218 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.022314 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.022538 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.022627 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.022860 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.022946 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.023180 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.023275 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.023499 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.023585 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.023811 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.023896 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.024150 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.024241 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.024469 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.024557 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.024783 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.024870 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.025095 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.025184 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.025409 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.025496 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.025722 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.025809 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.026029 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.026117 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.026341 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.026691 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.026918 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.027016 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.027231 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.027327 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.027620 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.027774 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.027945 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.028135 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.028284 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.028456 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.028607 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.028804 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.028958 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.029280 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.029554 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.029661 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.029880 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.029970 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.030201 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.030288 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.030516 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.030604 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.030830 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.030917 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.031143 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.031233 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.031455 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.031543 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.031773 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.031866 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.032118 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.032220 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.032448 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.032535 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.032781 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.032876 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.033098 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.033185 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.033416 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.033501 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.033727 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.033821 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.034041 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.034259 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.034398 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.034582 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.034716 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.034922 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.035016 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.035257 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.035345 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.035590 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.035690 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.035913 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.036006 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.036252 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.036342 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.036564 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.036666 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.036878 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.036973 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.037188 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.037275 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.037494 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.037593 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.037802 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.037889 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.038107 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.038194 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.038416 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.038539 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.038736 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.038822 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.039047 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.039142 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.039373 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.039461 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.039685 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.039779 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.039999 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.040246 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.040348 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.040607 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.040842 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.040935 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.041160 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.041264 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.041491 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.041579 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.041816 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.041903 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.042143 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.042244 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.042457 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.042551 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.042770 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.042857 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.043085 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.043184 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.043394 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.043480 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.043699 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.043785 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.044007 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.044127 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.044863 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.044961 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.045207 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.045523 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.045626 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.045835 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.045954 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.046151 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.046269 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.046461 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.046729 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.046818 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.047057 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.047150 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.047368 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.047454 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.047684 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.047898 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.047992 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.048277 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.048366 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.048594 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.048690 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.048918 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.049004 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.049227 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.049315 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.049544 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.049633 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.049851 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.049945 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.050163 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.050255 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.050466 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.050552 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.050771 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.050864 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.051080 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.051177 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.051386 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.051473 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.051690 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.051784 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.051995 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.052103 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.052329 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.052418 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.052639 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.052725 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.052942 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.053043 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.053252 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.053339 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.053561 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.053647 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.053887 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.053985 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.054190 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.054278 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.054494 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.054581 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.054798 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.054894 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.055110 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.055398 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.055485 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.055704 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.055789 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.056008 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.056116 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.056334 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.056421 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.056643 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.056778 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.056947 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.057034 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.057255 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.057343 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.057557 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.057652 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.057866 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.057954 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.058170 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.058264 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.058476 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.058577 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.058831 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.058918 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.059156 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.059252 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.059461 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.059556 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.059762 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.059856 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.060697 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.061024 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.061185 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.061426 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.061514 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.061747 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.061833 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.062066 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.062227 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.062387 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.062474 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.062704 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.062799 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.063027 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.063122 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.063376 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.063577 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.063704 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.063914 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.064073 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.064265 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.064388 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.064601 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.064715 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.064931 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.065030 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.065237 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.065324 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.065542 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.065629 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.065847 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.065943 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.066171 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.066266 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.066482 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.066570 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.066790 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.066885 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.067098 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.067222 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.067404 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.067603 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.067700 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.067927 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.068014 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.068282 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.068371 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.068612 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.068712 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.068916 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.069012 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.069223 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.069312 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.069532 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.069626 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.069838 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.069936 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.070143 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.070237 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.070456 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.070545 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.070794 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.070880 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.071112 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.071241 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.071427 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.071521 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.071738 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.071824 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.072068 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.072157 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.072381 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.072476 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.072688 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.072774 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.072994 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.073089 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.073301 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.073387 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.073615 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.073701 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.073929 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.074023 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.074245 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.074330 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.074549 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.074635 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.074858 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.074951 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.075170 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.075256 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.075482 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.075590 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.075844 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.076179 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.076434 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.076603 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.076755 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.076920 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.077082 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.077235 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.077407 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.077547 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.077721 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.077860 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.078042 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.078169 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.078353 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.078485 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.078681 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.078795 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.079073 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.079161 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.079401 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.079524 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.079710 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.079805 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.080013 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.080163 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.080343 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.080429 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.080646 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.080745 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] nova_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.080953 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.081040 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] nova_sys_admin.group = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.081269 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.081357 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] nova_sys_admin.helper_command = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.081577 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.081672 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] nova_sys_admin.logger_name = oslo_privsep.daemon {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.081879 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.081965 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] nova_sys_admin.thread_pool_size = 4 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.082182 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.082267 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] nova_sys_admin.user = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.082488 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.082582 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.082789 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.082875 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.083090 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.083231 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.083392 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.083480 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.083694 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.083788 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.084006 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.084170 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.084332 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.084421 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.084635 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.084722 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.084938 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.085025 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.085240 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.085328 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.085541 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.085667 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.085842 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.085987 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.086148 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.086304 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.086447 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.086624 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.086748 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.086939 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.087049 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.087255 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.087341 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.087571 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.087659 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.087905 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.087992 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.088260 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.088348 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] nova_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.088575 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.088663 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] nova_sys_admin.group = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.088881 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] nova_sys_admin.helper_command = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.088968 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.089197 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] nova_sys_admin.logger_name = oslo_privsep.daemon {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.089284 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.089506 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] nova_sys_admin.thread_pool_size = 4 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.089654 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.089809 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] nova_sys_admin.user = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.089896 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.090141 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.090226 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.090453 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.090548 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.090773 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.090861 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.091082 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.091200 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.091447 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.091764 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.091945 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.092105 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.092300 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.092415 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.092626 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.092736 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.092950 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.093071 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.093266 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.093404 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.093575 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.093721 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.093907 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.094059 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.094222 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.094391 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.094533 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.094744 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.094838 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.095064 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.095151 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.095417 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.095513 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.095723 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.095810 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.096060 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.096191 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.096390 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.096478 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.096691 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.096778 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.096939 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 05 08:12:33.097026 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.097317 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.097633 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.097946 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.098256 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.098585 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.098893 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.099201 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.099604 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.099918 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.100268 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.100585 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.100899 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.101224 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.101548 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.101853 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.102175 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.102498 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.102841 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.103152 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.103494 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.103825 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.104168 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.104479 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.104781 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:12:33.105022 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 05 08:12:33.157220 n-d-844739-1 devstack@n-api.service[103895]: INFO dbcounter [None req-f20dff55-035f-4fbd-996a-7c1edcaf7976 None None] Registered counter for database nova_api Jun 05 08:12:33.166334 n-d-844739-1 devstack@n-api.service[103894]: INFO dbcounter [None req-f15213d0-22ba-48ce-8d2c-18a99c05a11f None None] Registered counter for database nova_api Jun 05 08:12:33.176984 n-d-844739-1 devstack@n-api.service[103895]: DEBUG oslo_db.sqlalchemy.engines [None req-f20dff55-035f-4fbd-996a-7c1edcaf7976 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 05 08:12:33.183510 n-d-844739-1 devstack@n-api.service[103895]: DEBUG dbcounter [-] [103895] Writer thread running {{(pid=103895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 05 08:12:33.186886 n-d-844739-1 devstack@n-api.service[103894]: DEBUG oslo_db.sqlalchemy.engines [None req-f15213d0-22ba-48ce-8d2c-18a99c05a11f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103894) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 05 08:12:33.193347 n-d-844739-1 devstack@n-api.service[103894]: DEBUG dbcounter [-] [103894] Writer thread running {{(pid=103894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 05 08:12:33.242255 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.context [None req-f20dff55-035f-4fbd-996a-7c1edcaf7976 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ceb8701a-c729-4596-86e5-c56dbc5a8933(cell1) {{(pid=103895) load_cells /opt/stack/nova/nova/context.py:464}} Jun 05 08:12:33.246374 n-d-844739-1 devstack@n-api.service[103895]: DEBUG oslo_concurrency.lockutils [None req-f20dff55-035f-4fbd-996a-7c1edcaf7976 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:12:33.248143 n-d-844739-1 devstack@n-api.service[103895]: DEBUG oslo_concurrency.lockutils [None req-f20dff55-035f-4fbd-996a-7c1edcaf7976 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:12:33.248942 n-d-844739-1 devstack@n-api.service[103895]: DEBUG oslo_concurrency.lockutils [None req-f20dff55-035f-4fbd-996a-7c1edcaf7976 None None] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:12:33.250889 n-d-844739-1 devstack@n-api.service[103895]: DEBUG oslo_concurrency.lockutils [None req-f20dff55-035f-4fbd-996a-7c1edcaf7976 None None] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:12:33.251124 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.context [None req-f15213d0-22ba-48ce-8d2c-18a99c05a11f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ceb8701a-c729-4596-86e5-c56dbc5a8933(cell1) {{(pid=103894) load_cells /opt/stack/nova/nova/context.py:464}} Jun 05 08:12:33.252905 n-d-844739-1 devstack@n-api.service[103895]: INFO dbcounter [None req-f20dff55-035f-4fbd-996a-7c1edcaf7976 None None] Registered counter for database nova_cell0 Jun 05 08:12:33.255205 n-d-844739-1 devstack@n-api.service[103894]: DEBUG oslo_concurrency.lockutils [None req-f15213d0-22ba-48ce-8d2c-18a99c05a11f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:12:33.256803 n-d-844739-1 devstack@n-api.service[103894]: DEBUG oslo_concurrency.lockutils [None req-f15213d0-22ba-48ce-8d2c-18a99c05a11f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:12:33.256992 n-d-844739-1 devstack@n-api.service[103895]: INFO dbcounter [None req-f20dff55-035f-4fbd-996a-7c1edcaf7976 None None] Registered counter for database nova_cell1 Jun 05 08:12:33.257675 n-d-844739-1 devstack@n-api.service[103894]: DEBUG oslo_concurrency.lockutils [None req-f15213d0-22ba-48ce-8d2c-18a99c05a11f None None] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:12:33.259632 n-d-844739-1 devstack@n-api.service[103894]: DEBUG oslo_concurrency.lockutils [None req-f15213d0-22ba-48ce-8d2c-18a99c05a11f None None] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:12:33.261653 n-d-844739-1 devstack@n-api.service[103894]: INFO dbcounter [None req-f15213d0-22ba-48ce-8d2c-18a99c05a11f None None] Registered counter for database nova_cell0 Jun 05 08:12:33.264909 n-d-844739-1 devstack@n-api.service[103895]: DEBUG oslo_db.sqlalchemy.engines [None req-f20dff55-035f-4fbd-996a-7c1edcaf7976 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 05 08:12:33.266168 n-d-844739-1 devstack@n-api.service[103895]: DEBUG oslo_db.sqlalchemy.engines [None req-f20dff55-035f-4fbd-996a-7c1edcaf7976 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 05 08:12:33.266834 n-d-844739-1 devstack@n-api.service[103894]: INFO dbcounter [None req-f15213d0-22ba-48ce-8d2c-18a99c05a11f None None] Registered counter for database nova_cell1 Jun 05 08:12:33.272852 n-d-844739-1 devstack@n-api.service[103895]: DEBUG dbcounter [-] [103895] Writer thread running {{(pid=103895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 05 08:12:33.274059 n-d-844739-1 devstack@n-api.service[103894]: DEBUG oslo_db.sqlalchemy.engines [None req-f15213d0-22ba-48ce-8d2c-18a99c05a11f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103894) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 05 08:12:33.274184 n-d-844739-1 devstack@n-api.service[103895]: DEBUG dbcounter [-] [103895] Writer thread running {{(pid=103895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 05 08:12:33.277934 n-d-844739-1 devstack@n-api.service[103894]: DEBUG oslo_db.sqlalchemy.engines [None req-f15213d0-22ba-48ce-8d2c-18a99c05a11f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103894) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 05 08:12:33.281036 n-d-844739-1 devstack@n-api.service[103894]: DEBUG dbcounter [-] [103894] Writer thread running {{(pid=103894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 05 08:12:33.420904 n-d-844739-1 devstack@n-api.service[103895]: INFO dbcounter [None req-f20dff55-035f-4fbd-996a-7c1edcaf7976 None None] Registered counter for database nova_cell0 Jun 05 08:12:33.423088 n-d-844739-1 devstack@n-api.service[103894]: DEBUG dbcounter [-] [103894] Writer thread running {{(pid=103894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 05 08:12:33.429554 n-d-844739-1 devstack@n-api.service[103895]: DEBUG oslo_db.sqlalchemy.engines [None req-f20dff55-035f-4fbd-996a-7c1edcaf7976 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 05 08:12:33.431818 n-d-844739-1 devstack@n-api.service[103894]: INFO dbcounter [None req-f15213d0-22ba-48ce-8d2c-18a99c05a11f None None] Registered counter for database nova_cell0 Jun 05 08:12:33.433851 n-d-844739-1 devstack@n-api.service[103895]: DEBUG dbcounter [-] [103895] Writer thread running {{(pid=103895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 05 08:12:33.441092 n-d-844739-1 devstack@n-api.service[103894]: DEBUG oslo_db.sqlalchemy.engines [None req-f15213d0-22ba-48ce-8d2c-18a99c05a11f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103894) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 05 08:12:33.445413 n-d-844739-1 devstack@n-api.service[103894]: DEBUG dbcounter [-] [103894] Writer thread running {{(pid=103894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 05 08:12:33.893943 n-d-844739-1 devstack@n-api.service[103895]: WARNING keystonemiddleware.auth_token [None req-f20dff55-035f-4fbd-996a-7c1edcaf7976 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 05 08:12:33.894748 n-d-844739-1 devstack@n-api.service[103894]: WARNING keystonemiddleware.auth_token [None req-f15213d0-22ba-48ce-8d2c-18a99c05a11f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 05 08:12:33.901214 n-d-844739-1 devstack@n-api.service[103895]: WARNING keystonemiddleware.auth_token [None req-f20dff55-035f-4fbd-996a-7c1edcaf7976 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 05 08:12:33.902258 n-d-844739-1 devstack@n-api.service[103894]: WARNING keystonemiddleware.auth_token [None req-f15213d0-22ba-48ce-8d2c-18a99c05a11f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 05 08:12:34.126039 n-d-844739-1 devstack@n-api.service[103895]: WARNING keystonemiddleware.auth_token [None req-f20dff55-035f-4fbd-996a-7c1edcaf7976 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 05 08:12:34.127697 n-d-844739-1 devstack@n-api.service[103894]: WARNING keystonemiddleware.auth_token [None req-f15213d0-22ba-48ce-8d2c-18a99c05a11f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 05 08:12:34.132016 n-d-844739-1 devstack@n-api.service[103895]: WARNING keystonemiddleware.auth_token [None req-f20dff55-035f-4fbd-996a-7c1edcaf7976 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 05 08:12:34.133642 n-d-844739-1 devstack@n-api.service[103894]: WARNING keystonemiddleware.auth_token [None req-f15213d0-22ba-48ce-8d2c-18a99c05a11f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 05 08:12:34.137134 n-d-844739-1 devstack@n-api.service[103895]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c3b01759c0 pid: 103895 (default app) Jun 05 08:12:34.139254 n-d-844739-1 devstack@n-api.service[103894]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c3b01759c0 pid: 103894 (default app) Jun 05 08:12:34.140202 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-f20dff55-035f-4fbd-996a-7c1edcaf7976 None None] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:12:34.141378 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-f20dff55-035f-4fbd-996a-7c1edcaf7976 None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002098 Jun 05 08:12:34.141805 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Sun Jun 5 08:12:34 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:13:53.556680 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-f15213d0-22ba-48ce-8d2c-18a99c05a11f None None] Calling method '>' {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:13:53.557902 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-f15213d0-22ba-48ce-8d2c-18a99c05a11f None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001986 Jun 05 08:13:53.558562 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 1/2] 10.222.0.33 () {54 vars in 930 bytes} [Sun Jun 5 08:13:53 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:13:53.570069 n-d-844739-1 devstack@n-api.service[103895]: DEBUG dbcounter [-] [103895] Writing DB stats nova_api:SELECT=3 {{(pid=103895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:13:53.570944 n-d-844739-1 devstack@n-api.service[103895]: DEBUG dbcounter [-] [103895] Writing DB stats nova_cell0:SELECT=3 {{(pid=103895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:13:53.571940 n-d-844739-1 devstack@n-api.service[103895]: DEBUG dbcounter [-] [103895] Writing DB stats nova_cell1:SELECT=3 {{(pid=103895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:13:53.572716 n-d-844739-1 devstack@n-api.service[103895]: DEBUG dbcounter [-] [103895] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:13:54.035484 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-d599b9a4-7d9b-4b97-9741-171c67ab3225 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:13:54.067457 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-d599b9a4-7d9b-4b97-9741-171c67ab3225 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.502432 Jun 05 08:13:54.068217 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 2/3] 10.222.0.33 () {60 vars in 1291 bytes} [Sun Jun 5 08:13:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:13:56.392404 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-f15213d0-22ba-48ce-8d2c-18a99c05a11f None None] Calling method '>' {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:13:56.393419 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-f15213d0-22ba-48ce-8d2c-18a99c05a11f None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jun 05 08:13:56.393830 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 2/4] 10.222.0.33 () {54 vars in 930 bytes} [Sun Jun 5 08:13:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:13:56.465487 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-18efec27-8777-4128-88ba-04bc4cfa51c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "id": "c1", "rxtx_factor": 1.0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "cirros256", "swap": 0}} {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:13:56.487029 n-d-844739-1 devstack@n-api.service[103895]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:13:56.487029 n-d-844739-1 devstack@n-api.service[103895]: warnings.warn(msg) Jun 05 08:13:56.514702 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-18efec27-8777-4128-88ba-04bc4cfa51c6 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.114851 Jun 05 08:13:56.515419 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 3/5] 10.222.0.33 () {64 vars in 1282 bytes} [Sun Jun 5 08:13:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:13:56.753959 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-bd68e615-d815-4b4e-b741-cb86e17ef21b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:13:56.756420 n-d-844739-1 devstack@n-api.service[103894]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:13:56.756420 n-d-844739-1 devstack@n-api.service[103894]: warnings.warn(msg) Jun 05 08:13:56.759066 n-d-844739-1 devstack@n-api.service[103894]: DEBUG dbcounter [-] [103894] Writing DB stats nova_api:SELECT=3 {{(pid=103894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:13:56.760021 n-d-844739-1 devstack@n-api.service[103894]: DEBUG dbcounter [-] [103894] Writing DB stats nova_cell0:SELECT=3 {{(pid=103894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:13:56.760944 n-d-844739-1 devstack@n-api.service[103894]: DEBUG dbcounter [-] [103894] Writing DB stats nova_cell1:SELECT=3 {{(pid=103894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:13:56.761820 n-d-844739-1 devstack@n-api.service[103894]: DEBUG dbcounter [-] [103894] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:13:56.834230 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-bd68e615-d815-4b4e-b741-cb86e17ef21b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.310565 Jun 05 08:13:56.834760 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 3/6] 10.222.0.33 () {64 vars in 1335 bytes} [Sun Jun 5 08:13:56 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:13:59.175025 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-18efec27-8777-4128-88ba-04bc4cfa51c6 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:13:59.176070 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-18efec27-8777-4128-88ba-04bc4cfa51c6 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jun 05 08:13:59.176633 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 4/7] 10.222.0.33 () {54 vars in 930 bytes} [Sun Jun 5 08:13:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:13:59.289668 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-1ffa2486-0b1f-4677-9ec6-ea251fb546f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "name": "ds512M", "disk": 5, "rxtx_factor": 1.0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:13:59.307418 n-d-844739-1 devstack@n-api.service[103894]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:13:59.307418 n-d-844739-1 devstack@n-api.service[103894]: warnings.warn(msg) Jun 05 08:13:59.332336 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-1ffa2486-0b1f-4677-9ec6-ea251fb546f4 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.150061 Jun 05 08:13:59.332897 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 4/8] 10.222.0.33 () {64 vars in 1282 bytes} [Sun Jun 5 08:13:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:13:59.345698 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-6bdaaf8d-e8b0-47f7-b183-fb09a7e6cd6d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:13:59.347501 n-d-844739-1 devstack@n-api.service[103895]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:13:59.347501 n-d-844739-1 devstack@n-api.service[103895]: warnings.warn(msg) Jun 05 08:13:59.401210 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-6bdaaf8d-e8b0-47f7-b183-fb09a7e6cd6d admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.059309 Jun 05 08:13:59.408060 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 5/9] 10.222.0.33 () {64 vars in 1335 bytes} [Sun Jun 5 08:13:59 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:14:01.802893 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-1ffa2486-0b1f-4677-9ec6-ea251fb546f4 admin admin] Calling method '>' {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:01.803931 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-1ffa2486-0b1f-4677-9ec6-ea251fb546f4 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jun 05 08:14:01.804628 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 5/10] 10.222.0.33 () {54 vars in 930 bytes} [Sun Jun 5 08:14:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:14:01.913350 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-9f0bc55d-2c1a-4f38-9655-7e7ecb551e49 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 1024, "swap": 0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds1G", "disk": 10, "rxtx_factor": 1.0}} {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:14:01.968859 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-9f0bc55d-2c1a-4f38-9655-7e7ecb551e49 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.152912 Jun 05 08:14:01.969650 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 6/11] 10.222.0.33 () {64 vars in 1282 bytes} [Sun Jun 5 08:14:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:14:01.982181 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-ce2476ae-c6dd-40dc-94f8-984367c820fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:14:02.021338 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-ce2476ae-c6dd-40dc-94f8-984367c820fd admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043488 Jun 05 08:14:02.036153 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 6/12] 10.222.0.33 () {64 vars in 1335 bytes} [Sun Jun 5 08:14:01 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:14:04.622526 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-9f0bc55d-2c1a-4f38-9655-7e7ecb551e49 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:04.624279 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-9f0bc55d-2c1a-4f38-9655-7e7ecb551e49 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003017 Jun 05 08:14:04.629900 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 7/13] 10.222.0.33 () {54 vars in 930 bytes} [Sun Jun 5 08:14:04 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:14:04.701384 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-59af0c14-07e5-42cb-89ae-b4800e1d1671 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "id": "d3", "name": "ds2G", "os-flavor-access:is_public": true, "vcpus": 2, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:14:04.735199 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-59af0c14-07e5-42cb-89ae-b4800e1d1671 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.100931 Jun 05 08:14:04.736587 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 7/14] 10.222.0.33 () {64 vars in 1282 bytes} [Sun Jun 5 08:14:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:14:04.751820 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-90246c24-a0ee-4568-834f-c89ea72acdea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:14:04.819228 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-90246c24-a0ee-4568-834f-c89ea72acdea admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073204 Jun 05 08:14:04.820937 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 8/15] 10.222.0.33 () {64 vars in 1335 bytes} [Sun Jun 5 08:14:04 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:14:07.227015 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-59af0c14-07e5-42cb-89ae-b4800e1d1671 admin admin] Calling method '>' {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:07.228023 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-59af0c14-07e5-42cb-89ae-b4800e1d1671 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jun 05 08:14:07.228442 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 8/16] 10.222.0.33 () {54 vars in 930 bytes} [Sun Jun 5 08:14:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:14:07.290029 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-3590739b-9b74-4cdc-87b4-24ae6ee80c99 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "os-flavor-access:is_public": true, "id": "d4", "vcpus": 4, "name": "ds4G", "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:14:07.308725 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-3590739b-9b74-4cdc-87b4-24ae6ee80c99 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074620 Jun 05 08:14:07.309943 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 9/17] 10.222.0.33 () {64 vars in 1282 bytes} [Sun Jun 5 08:14:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:14:07.321945 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-a2ba5768-836f-415a-bb76-4279e1372a09 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:14:07.344619 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-a2ba5768-836f-415a-bb76-4279e1372a09 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026651 Jun 05 08:14:07.356503 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 9/18] 10.222.0.33 () {64 vars in 1335 bytes} [Sun Jun 5 08:14:07 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:14:09.742062 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-3590739b-9b74-4cdc-87b4-24ae6ee80c99 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:09.743084 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-3590739b-9b74-4cdc-87b4-24ae6ee80c99 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Jun 05 08:14:09.743642 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 10/19] 10.222.0.33 () {54 vars in 930 bytes} [Sun Jun 5 08:14:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:14:09.804988 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-a04fccd5-c77d-487f-bdbd-077567044719 admin admin] Calling method '>' {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:09.830226 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-a04fccd5-c77d-487f-bdbd-077567044719 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079813 Jun 05 08:14:09.831147 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 10/20] 10.222.0.33 () {60 vars in 1291 bytes} [Sun Jun 5 08:14:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:14:12.243504 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-3590739b-9b74-4cdc-87b4-24ae6ee80c99 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:12.245232 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-3590739b-9b74-4cdc-87b4-24ae6ee80c99 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002147 Jun 05 08:14:12.256731 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 11/21] 10.222.0.33 () {54 vars in 930 bytes} [Sun Jun 5 08:14:12 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:14:12.311808 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-4aa688c8-07df-4000-9563-63cd68cf6681 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "id": "1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0}} {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:14:12.336270 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-4aa688c8-07df-4000-9563-63cd68cf6681 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.083508 Jun 05 08:14:12.344558 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 11/22] 10.222.0.33 () {64 vars in 1282 bytes} [Sun Jun 5 08:14:12 2022] POST /compute/v2.1/flavors => generated 402 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:14:12.349564 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-3073348b-4da2-41e4-a0b2-e5d5ac17d3a8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:14:12.376300 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-3073348b-4da2-41e4-a0b2-e5d5ac17d3a8 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030199 Jun 05 08:14:12.392604 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 12/23] 10.222.0.33 () {64 vars in 1332 bytes} [Sun Jun 5 08:14:12 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:14:14.726876 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-4aa688c8-07df-4000-9563-63cd68cf6681 admin admin] Calling method '>' {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:14.730092 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-4aa688c8-07df-4000-9563-63cd68cf6681 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002730 Jun 05 08:14:14.730092 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 12/24] 10.222.0.33 () {54 vars in 930 bytes} [Sun Jun 5 08:14:14 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:14:14.810018 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-88994d39-7aa2-4a9c-834b-7b5c64cf4a48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "os-flavor-access:is_public": true, "ram": 2048, "name": "m1.small", "swap": 0, "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:14:14.830188 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-88994d39-7aa2-4a9c-834b-7b5c64cf4a48 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.092529 Jun 05 08:14:14.830855 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 13/25] 10.222.0.33 () {64 vars in 1282 bytes} [Sun Jun 5 08:14:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:14:14.843639 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-bcb2424a-2680-4dfd-a254-603e4ba55037 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:14:14.873584 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-bcb2424a-2680-4dfd-a254-603e4ba55037 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034271 Jun 05 08:14:14.874340 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 13/26] 10.222.0.33 () {64 vars in 1332 bytes} [Sun Jun 5 08:14:14 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:14:17.294931 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-88994d39-7aa2-4a9c-834b-7b5c64cf4a48 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:17.296328 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-88994d39-7aa2-4a9c-834b-7b5c64cf4a48 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001976 Jun 05 08:14:17.297178 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 14/27] 10.222.0.33 () {54 vars in 930 bytes} [Sun Jun 5 08:14:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:14:17.359483 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-5e57e1d8-690a-46fc-9dde-5efb0d0bd427 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 2, "disk": 40, "os-flavor-access:is_public": true, "id": "3", "swap": 0, "name": "m1.medium", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:14:17.382134 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-5e57e1d8-690a-46fc-9dde-5efb0d0bd427 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.079112 Jun 05 08:14:17.382953 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 14/28] 10.222.0.33 () {64 vars in 1282 bytes} [Sun Jun 5 08:14:17 2022] POST /compute/v2.1/flavors => generated 406 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:14:17.398658 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-2fc38a17-61e2-40ea-b99d-07ed284cf959 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:14:17.429413 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-2fc38a17-61e2-40ea-b99d-07ed284cf959 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035878 Jun 05 08:14:17.430035 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 15/29] 10.222.0.33 () {64 vars in 1332 bytes} [Sun Jun 5 08:14:17 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:14:20.012491 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-5e57e1d8-690a-46fc-9dde-5efb0d0bd427 admin admin] Calling method '>' {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:20.013726 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-5e57e1d8-690a-46fc-9dde-5efb0d0bd427 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001877 Jun 05 08:14:20.014131 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 15/30] 10.222.0.33 () {54 vars in 930 bytes} [Sun Jun 5 08:14:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:14:20.083021 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-11a48178-02f1-4b46-807b-3234c1a72bd0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "4", "name": "m1.large", "ram": 8192, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "os-flavor-access:is_public": true}} {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:14:20.103552 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-11a48178-02f1-4b46-807b-3234c1a72bd0 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.083608 Jun 05 08:14:20.104278 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 16/31] 10.222.0.33 () {64 vars in 1282 bytes} [Sun Jun 5 08:14:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 05 08:14:20.119193 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-84b88975-cf2d-4c94-8af2-86430b2eb589 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:14:20.148285 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-84b88975-cf2d-4c94-8af2-86430b2eb589 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033547 Jun 05 08:14:20.149032 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 16/32] 10.222.0.33 () {64 vars in 1332 bytes} [Sun Jun 5 08:14:20 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:14:22.502230 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-11a48178-02f1-4b46-807b-3234c1a72bd0 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:22.503277 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-11a48178-02f1-4b46-807b-3234c1a72bd0 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 05 08:14:22.503678 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 17/33] 10.222.0.33 () {54 vars in 930 bytes} [Sun Jun 5 08:14:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:14:22.563328 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-f11d28bf-cb50-47d8-9ebf-d9f4bdec4fae admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "disk": 160, "id": "5", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384}} {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:14:22.580825 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-f11d28bf-cb50-47d8-9ebf-d9f4bdec4fae admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.071157 Jun 05 08:14:22.581382 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 17/34] 10.222.0.33 () {64 vars in 1282 bytes} [Sun Jun 5 08:14:22 2022] POST /compute/v2.1/flavors => generated 408 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:14:22.593104 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-ae83f65f-c441-42cb-b03f-3e13dafbade3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:14:22.615915 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-ae83f65f-c441-42cb-b03f-3e13dafbade3 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026576 Jun 05 08:14:22.616541 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 18/35] 10.222.0.33 () {64 vars in 1332 bytes} [Sun Jun 5 08:14:22 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:14:50.478857 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-f11d28bf-cb50-47d8-9ebf-d9f4bdec4fae admin admin] Calling method '>' {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:50.479876 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-f11d28bf-cb50-47d8-9ebf-d9f4bdec4fae admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001577 Jun 05 08:14:50.480839 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 18/36] 10.222.0.33 () {54 vars in 930 bytes} [Sun Jun 5 08:14:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:14:50.491808 n-d-844739-1 devstack@n-api.service[103895]: DEBUG dbcounter [-] [103895] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:14:50.539674 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-1532168a-704b-44ca-9191-a3ea6284ad87 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:50.556895 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-1532168a-704b-44ca-9191-a3ea6284ad87 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069790 Jun 05 08:14:50.557429 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 19/37] 10.222.0.33 () {60 vars in 1291 bytes} [Sun Jun 5 08:14:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:14:51.566305 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-f11d28bf-cb50-47d8-9ebf-d9f4bdec4fae admin admin] Calling method '>' {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:51.567316 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-f11d28bf-cb50-47d8-9ebf-d9f4bdec4fae admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jun 05 08:14:51.567719 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 19/38] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Jun 5 08:14:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:14:51.781320 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-39ec3ffc-cf3e-4291-9bff-1e9ad9382101 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:51.787068 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.wsgi [None req-39ec3ffc-cf3e-4291-9bff-1e9ad9382101 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 05 08:14:51.790402 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-39ec3ffc-cf3e-4291-9bff-1e9ad9382101 admin admin] Request method failure captured: Jun 05 08:14:51.790402 n-d-844739-1 devstack@n-api.service[103895]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 05 08:14:51.790402 n-d-844739-1 devstack@n-api.service[103895]: Accept: application/json Jun 05 08:14:51.790402 n-d-844739-1 devstack@n-api.service[103895]: Accept-Encoding: gzip, deflate Jun 05 08:14:51.790402 n-d-844739-1 devstack@n-api.service[103895]: Connection: keep-alive Jun 05 08:14:51.790402 n-d-844739-1 devstack@n-api.service[103895]: Content-Length: 0 Jun 05 08:14:51.790402 n-d-844739-1 devstack@n-api.service[103895]: Host: 10.222.0.33 Jun 05 08:14:51.790402 n-d-844739-1 devstack@n-api.service[103895]: Openstack-Api-Version: compute 2.90 Jun 05 08:14:51.790402 n-d-844739-1 devstack@n-api.service[103895]: Openstack-System-Scope: None Jun 05 08:14:51.790402 n-d-844739-1 devstack@n-api.service[103895]: User-Agent: python-novaclient Jun 05 08:14:51.790402 n-d-844739-1 devstack@n-api.service[103895]: X-Auth-Token: gAAAAABinGX7dxoBhnomKR2NFaeAFsFJHyV7MOXYL_CrBij1-55dj6FsoMx8gcO3NoCgXsFU1w0r9q3pKw_w0L73Nnqa8UUKHdPe3tSFJf0dDZFLawZRXnzL5onjgAQkQkBdA2IrG-UsMxESkm_u1DTcIVrAzuZcTXEpPcioKe_0ss5xwr6a3tc Jun 05 08:14:51.790402 n-d-844739-1 devstack@n-api.service[103895]: X-Domain-Id: None Jun 05 08:14:51.790402 n-d-844739-1 devstack@n-api.service[103895]: X-Domain-Name: None Jun 05 08:14:51.790402 n-d-844739-1 devstack@n-api.service[103895]: X-Identity-Status: Confirmed Jun 05 08:14:51.790402 n-d-844739-1 devstack@n-api.service[103895]: X-Is-Admin-Project: True Jun 05 08:14:51.790402 n-d-844739-1 devstack@n-api.service[103895]: X-Openstack-Nova-Api-Version: 2.90 Jun 05 08:14:51.790402 n-d-844739-1 devstack@n-api.service[103895]: X-Project-Domain-Id: default Jun 05 08:14:51.790402 n-d-844739-1 devstack@n-api.service[103895]: X-Project-Domain-Name: Default Jun 05 08:14:51.790402 n-d-844739-1 devstack@n-api.service[103895]: X-Project-Id: 4d4ea0fc1d684b0aa494dbd66773bbf9 Jun 05 08:14:51.790402 n-d-844739-1 devstack@n-api.service[103895]: X-Project-Name: admin Jun 05 08:14:51.790402 n-d-844739-1 devstack@n-api.service[103895]: X-Role: admin,reader,member Jun 05 08:14:51.790402 n-d-844739-1 devstack@n-api.service[103895]: X-Roles: admin,reader,member Jun 05 08:14:51.792155 n-d-844739-1 devstack@n-api.service[103895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4d4ea0fc1d684b0aa494dbd66773bbf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4d4ea0fc1d684b0aa494dbd66773bbf9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4d4ea0fc1d684b0aa494dbd66773bbf9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4d4ea0fc1d684b0aa494dbd66773bbf9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:14:51.792155 n-d-844739-1 devstack@n-api.service[103895]: X-Tenant: admin Jun 05 08:14:51.792155 n-d-844739-1 devstack@n-api.service[103895]: X-Tenant-Id: 4d4ea0fc1d684b0aa494dbd66773bbf9 Jun 05 08:14:51.792155 n-d-844739-1 devstack@n-api.service[103895]: X-Tenant-Name: admin Jun 05 08:14:51.792155 n-d-844739-1 devstack@n-api.service[103895]: X-User: admin Jun 05 08:14:51.792155 n-d-844739-1 devstack@n-api.service[103895]: X-User-Domain-Id: default Jun 05 08:14:51.792155 n-d-844739-1 devstack@n-api.service[103895]: X-User-Domain-Name: Default Jun 05 08:14:51.792155 n-d-844739-1 devstack@n-api.service[103895]: X-User-Id: 884dd0b205284edcba10f79e81f60eb3 Jun 05 08:14:51.792155 n-d-844739-1 devstack@n-api.service[103895]: X-User-Name: admin Jun 05 08:14:51.792155 n-d-844739-1 devstack@n-api.service[103895]: method: > Jun 05 08:14:51.792155 n-d-844739-1 devstack@n-api.service[103895]: exception: Flavor 42 could not be found. Jun 05 08:14:51.792155 n-d-844739-1 devstack@n-api.service[103895]: action_args: {'id': '42'} Jun 05 08:14:51.792155 n-d-844739-1 devstack@n-api.service[103895]: {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:14:51.792155 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:14:51.793367 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 05 08:14:51.793367 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 05 08:14:51.793367 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 05 08:14:51.793367 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 05 08:14:51.793367 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:14:51.793367 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:14:51.793367 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 05 08:14:51.793367 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 05 08:14:51.793367 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 05 08:14:51.793367 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:14:51.793367 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 05 08:14:51.793367 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 05 08:14:51.793367 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 05 08:14:51.793367 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Jun 05 08:14:51.793367 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:14:51.793367 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Jun 05 08:14:51.793367 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:14:51.793367 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:14:51.793367 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:14:51.794465 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:14:51.794465 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:14:51.794465 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:14:51.794465 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:14:51.794465 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 05 08:14:51.794465 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:14:51.794465 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 05 08:14:51.794465 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Jun 05 08:14:51.794465 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:14:51.794465 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Jun 05 08:14:51.794465 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:14:51.794465 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:14:51.794465 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:14:51.794465 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:14:51.794465 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:14:51.794465 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 05 08:14:51.794465 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Jun 05 08:14:51.794465 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-39ec3ffc-cf3e-4291-9bff-1e9ad9382101 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:14:51.795567 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-39ec3ffc-cf3e-4291-9bff-1e9ad9382101 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063267 Jun 05 08:14:51.795567 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 20/39] 10.222.0.33 () {60 vars in 1190 bytes} [Sun Jun 5 08:14:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 05 08:14:51.801759 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-ca41221f-3008-4cb3-968d-35b5827b7db1 admin admin] Calling method '>' {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:51.804598 n-d-844739-1 devstack@n-api.service[103894]: DEBUG dbcounter [-] [103894] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:14:51.824730 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-ca41221f-3008-4cb3-968d-35b5827b7db1 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025865 Jun 05 08:14:51.825417 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 20/40] 10.222.0.33 () {60 vars in 1210 bytes} [Sun Jun 5 08:14:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:14:51.842774 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-3aab00ca-d28b-4e7c-9f85-64dfb75f1814 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:51.865806 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-3aab00ca-d28b-4e7c-9f85-64dfb75f1814 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026645 Jun 05 08:14:51.866335 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 21/41] 10.222.0.33 () {60 vars in 1210 bytes} [Sun Jun 5 08:14:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:14:51.878504 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-7537eeeb-466a-41a1-a640-568e90cf13c0 admin admin] Calling method '>' {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:51.886774 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.wsgi [None req-7537eeeb-466a-41a1-a640-568e90cf13c0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 05 08:14:51.891397 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-7537eeeb-466a-41a1-a640-568e90cf13c0 admin admin] Request method failure captured: Jun 05 08:14:51.891397 n-d-844739-1 devstack@n-api.service[103894]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 05 08:14:51.891397 n-d-844739-1 devstack@n-api.service[103894]: Accept: application/json Jun 05 08:14:51.891397 n-d-844739-1 devstack@n-api.service[103894]: Accept-Encoding: gzip, deflate Jun 05 08:14:51.891397 n-d-844739-1 devstack@n-api.service[103894]: Connection: keep-alive Jun 05 08:14:51.891397 n-d-844739-1 devstack@n-api.service[103894]: Content-Length: 0 Jun 05 08:14:51.891397 n-d-844739-1 devstack@n-api.service[103894]: Host: 10.222.0.33 Jun 05 08:14:51.891397 n-d-844739-1 devstack@n-api.service[103894]: Openstack-Api-Version: compute 2.90 Jun 05 08:14:51.891397 n-d-844739-1 devstack@n-api.service[103894]: Openstack-System-Scope: None Jun 05 08:14:51.891397 n-d-844739-1 devstack@n-api.service[103894]: User-Agent: python-novaclient Jun 05 08:14:51.891397 n-d-844739-1 devstack@n-api.service[103894]: X-Auth-Token: gAAAAABinGX7dxoBhnomKR2NFaeAFsFJHyV7MOXYL_CrBij1-55dj6FsoMx8gcO3NoCgXsFU1w0r9q3pKw_w0L73Nnqa8UUKHdPe3tSFJf0dDZFLawZRXnzL5onjgAQkQkBdA2IrG-UsMxESkm_u1DTcIVrAzuZcTXEpPcioKe_0ss5xwr6a3tc Jun 05 08:14:51.891397 n-d-844739-1 devstack@n-api.service[103894]: X-Domain-Id: None Jun 05 08:14:51.891397 n-d-844739-1 devstack@n-api.service[103894]: X-Domain-Name: None Jun 05 08:14:51.891397 n-d-844739-1 devstack@n-api.service[103894]: X-Identity-Status: Confirmed Jun 05 08:14:51.891397 n-d-844739-1 devstack@n-api.service[103894]: X-Is-Admin-Project: True Jun 05 08:14:51.891397 n-d-844739-1 devstack@n-api.service[103894]: X-Openstack-Nova-Api-Version: 2.90 Jun 05 08:14:51.891397 n-d-844739-1 devstack@n-api.service[103894]: X-Project-Domain-Id: default Jun 05 08:14:51.891397 n-d-844739-1 devstack@n-api.service[103894]: X-Project-Domain-Name: Default Jun 05 08:14:51.891397 n-d-844739-1 devstack@n-api.service[103894]: X-Project-Id: 4d4ea0fc1d684b0aa494dbd66773bbf9 Jun 05 08:14:51.891397 n-d-844739-1 devstack@n-api.service[103894]: X-Project-Name: admin Jun 05 08:14:51.891397 n-d-844739-1 devstack@n-api.service[103894]: X-Role: admin,reader,member Jun 05 08:14:51.891397 n-d-844739-1 devstack@n-api.service[103894]: X-Roles: admin,reader,member Jun 05 08:14:51.892948 n-d-844739-1 devstack@n-api.service[103894]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4d4ea0fc1d684b0aa494dbd66773bbf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4d4ea0fc1d684b0aa494dbd66773bbf9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4d4ea0fc1d684b0aa494dbd66773bbf9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4d4ea0fc1d684b0aa494dbd66773bbf9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:14:51.892948 n-d-844739-1 devstack@n-api.service[103894]: X-Tenant: admin Jun 05 08:14:51.892948 n-d-844739-1 devstack@n-api.service[103894]: X-Tenant-Id: 4d4ea0fc1d684b0aa494dbd66773bbf9 Jun 05 08:14:51.892948 n-d-844739-1 devstack@n-api.service[103894]: X-Tenant-Name: admin Jun 05 08:14:51.892948 n-d-844739-1 devstack@n-api.service[103894]: X-User: admin Jun 05 08:14:51.892948 n-d-844739-1 devstack@n-api.service[103894]: X-User-Domain-Id: default Jun 05 08:14:51.892948 n-d-844739-1 devstack@n-api.service[103894]: X-User-Domain-Name: Default Jun 05 08:14:51.892948 n-d-844739-1 devstack@n-api.service[103894]: X-User-Id: 884dd0b205284edcba10f79e81f60eb3 Jun 05 08:14:51.892948 n-d-844739-1 devstack@n-api.service[103894]: X-User-Name: admin Jun 05 08:14:51.892948 n-d-844739-1 devstack@n-api.service[103894]: method: > Jun 05 08:14:51.892948 n-d-844739-1 devstack@n-api.service[103894]: exception: Flavor 42 could not be found. Jun 05 08:14:51.892948 n-d-844739-1 devstack@n-api.service[103894]: action_args: {'id': '42'} Jun 05 08:14:51.892948 n-d-844739-1 devstack@n-api.service[103894]: {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:14:51.892948 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:14:51.893923 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 05 08:14:51.893923 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 05 08:14:51.893923 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 05 08:14:51.893923 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 05 08:14:51.893923 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:14:51.893923 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:14:51.893923 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 05 08:14:51.893923 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 05 08:14:51.893923 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 05 08:14:51.893923 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:14:51.893923 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 05 08:14:51.893923 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 05 08:14:51.893923 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 05 08:14:51.893923 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi Jun 05 08:14:51.893923 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:14:51.893923 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi Jun 05 08:14:51.893923 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:14:51.893923 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:14:51.893923 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:14:51.895264 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:14:51.895264 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:14:51.895264 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:14:51.895264 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:14:51.895264 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 05 08:14:51.895264 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:14:51.895264 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 05 08:14:51.895264 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi Jun 05 08:14:51.895264 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:14:51.895264 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi Jun 05 08:14:51.895264 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:14:51.895264 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:14:51.895264 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:14:51.895264 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:14:51.895264 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:14:51.895264 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 05 08:14:51.895264 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi Jun 05 08:14:51.895264 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-7537eeeb-466a-41a1-a640-568e90cf13c0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:14:51.896521 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-7537eeeb-466a-41a1-a640-568e90cf13c0 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.020303 Jun 05 08:14:51.896521 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 21/42] 10.222.0.33 () {60 vars in 1190 bytes} [Sun Jun 5 08:14:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 05 08:14:52.762953 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-3aab00ca-d28b-4e7c-9f85-64dfb75f1814 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:52.763957 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-3aab00ca-d28b-4e7c-9f85-64dfb75f1814 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002143 Jun 05 08:14:52.764394 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 22/43] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Jun 5 08:14:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:14:52.953577 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-5128d665-5277-4f92-9ccc-8404671e2cf3 admin admin] Calling method '>' {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:52.961154 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.wsgi [None req-5128d665-5277-4f92-9ccc-8404671e2cf3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 05 08:14:52.962689 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-5128d665-5277-4f92-9ccc-8404671e2cf3 admin admin] Request method failure captured: Jun 05 08:14:52.962689 n-d-844739-1 devstack@n-api.service[103894]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 05 08:14:52.962689 n-d-844739-1 devstack@n-api.service[103894]: Accept: application/json Jun 05 08:14:52.962689 n-d-844739-1 devstack@n-api.service[103894]: Accept-Encoding: gzip, deflate Jun 05 08:14:52.962689 n-d-844739-1 devstack@n-api.service[103894]: Connection: keep-alive Jun 05 08:14:52.962689 n-d-844739-1 devstack@n-api.service[103894]: Content-Length: 0 Jun 05 08:14:52.962689 n-d-844739-1 devstack@n-api.service[103894]: Host: 10.222.0.33 Jun 05 08:14:52.962689 n-d-844739-1 devstack@n-api.service[103894]: Openstack-Api-Version: compute 2.90 Jun 05 08:14:52.962689 n-d-844739-1 devstack@n-api.service[103894]: Openstack-System-Scope: None Jun 05 08:14:52.962689 n-d-844739-1 devstack@n-api.service[103894]: User-Agent: python-novaclient Jun 05 08:14:52.962689 n-d-844739-1 devstack@n-api.service[103894]: X-Auth-Token: gAAAAABinGX8qxH2tQId7Qwpa6_X_txwcIcXFd-EPXIGKvzntonQZVEiHjGak8lMv1lcCuhXp-lWEKVsiLNbde4G2MDPX6DPMGXZzIHeaprv0n-Ssn_-gvd8V68VoXIGJL44F_HlNOBNDHQgQfBdVLU44pIcmbUSb0n2HT-SP6myS7QLeJS4FwU Jun 05 08:14:52.962689 n-d-844739-1 devstack@n-api.service[103894]: X-Domain-Id: None Jun 05 08:14:52.962689 n-d-844739-1 devstack@n-api.service[103894]: X-Domain-Name: None Jun 05 08:14:52.962689 n-d-844739-1 devstack@n-api.service[103894]: X-Identity-Status: Confirmed Jun 05 08:14:52.962689 n-d-844739-1 devstack@n-api.service[103894]: X-Is-Admin-Project: True Jun 05 08:14:52.962689 n-d-844739-1 devstack@n-api.service[103894]: X-Openstack-Nova-Api-Version: 2.90 Jun 05 08:14:52.962689 n-d-844739-1 devstack@n-api.service[103894]: X-Project-Domain-Id: default Jun 05 08:14:52.962689 n-d-844739-1 devstack@n-api.service[103894]: X-Project-Domain-Name: Default Jun 05 08:14:52.962689 n-d-844739-1 devstack@n-api.service[103894]: X-Project-Id: 4d4ea0fc1d684b0aa494dbd66773bbf9 Jun 05 08:14:52.962689 n-d-844739-1 devstack@n-api.service[103894]: X-Project-Name: admin Jun 05 08:14:52.962689 n-d-844739-1 devstack@n-api.service[103894]: X-Role: admin,reader,member Jun 05 08:14:52.962689 n-d-844739-1 devstack@n-api.service[103894]: X-Roles: admin,reader,member Jun 05 08:14:52.964219 n-d-844739-1 devstack@n-api.service[103894]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4d4ea0fc1d684b0aa494dbd66773bbf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4d4ea0fc1d684b0aa494dbd66773bbf9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4d4ea0fc1d684b0aa494dbd66773bbf9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4d4ea0fc1d684b0aa494dbd66773bbf9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:14:52.964219 n-d-844739-1 devstack@n-api.service[103894]: X-Tenant: admin Jun 05 08:14:52.964219 n-d-844739-1 devstack@n-api.service[103894]: X-Tenant-Id: 4d4ea0fc1d684b0aa494dbd66773bbf9 Jun 05 08:14:52.964219 n-d-844739-1 devstack@n-api.service[103894]: X-Tenant-Name: admin Jun 05 08:14:52.964219 n-d-844739-1 devstack@n-api.service[103894]: X-User: admin Jun 05 08:14:52.964219 n-d-844739-1 devstack@n-api.service[103894]: X-User-Domain-Id: default Jun 05 08:14:52.964219 n-d-844739-1 devstack@n-api.service[103894]: X-User-Domain-Name: Default Jun 05 08:14:52.964219 n-d-844739-1 devstack@n-api.service[103894]: X-User-Id: 884dd0b205284edcba10f79e81f60eb3 Jun 05 08:14:52.964219 n-d-844739-1 devstack@n-api.service[103894]: X-User-Name: admin Jun 05 08:14:52.964219 n-d-844739-1 devstack@n-api.service[103894]: method: > Jun 05 08:14:52.964219 n-d-844739-1 devstack@n-api.service[103894]: exception: Flavor 84 could not be found. Jun 05 08:14:52.964219 n-d-844739-1 devstack@n-api.service[103894]: action_args: {'id': '84'} Jun 05 08:14:52.964219 n-d-844739-1 devstack@n-api.service[103894]: {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:14:52.964219 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:14:52.965999 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 05 08:14:52.965999 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 05 08:14:52.965999 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 05 08:14:52.965999 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 05 08:14:52.965999 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:14:52.965999 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:14:52.965999 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 05 08:14:52.965999 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 05 08:14:52.965999 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 05 08:14:52.965999 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:14:52.965999 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 05 08:14:52.965999 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 05 08:14:52.965999 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 05 08:14:52.965999 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi Jun 05 08:14:52.965999 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:14:52.965999 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi Jun 05 08:14:52.965999 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:14:52.965999 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:14:52.965999 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:14:52.967131 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:14:52.967131 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:14:52.967131 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:14:52.967131 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:14:52.967131 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 05 08:14:52.967131 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:14:52.967131 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 05 08:14:52.967131 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi Jun 05 08:14:52.967131 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:14:52.967131 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi Jun 05 08:14:52.967131 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:14:52.967131 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:14:52.967131 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:14:52.967131 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:14:52.967131 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:14:52.967131 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 05 08:14:52.967131 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi Jun 05 08:14:52.967131 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-5128d665-5277-4f92-9ccc-8404671e2cf3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:14:52.968196 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-5128d665-5277-4f92-9ccc-8404671e2cf3 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063622 Jun 05 08:14:52.968196 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 22/44] 10.222.0.33 () {60 vars in 1190 bytes} [Sun Jun 5 08:14:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 05 08:14:52.974391 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-b97ac2da-6570-430f-be80-f80c22f33850 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:52.988538 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-b97ac2da-6570-430f-be80-f80c22f33850 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017712 Jun 05 08:14:52.989063 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 23/45] 10.222.0.33 () {60 vars in 1210 bytes} [Sun Jun 5 08:14:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:14:52.999261 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-16d4098c-c0e2-4447-ab4a-2375d0f8cbdf admin admin] Calling method '>' {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:53.012849 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-16d4098c-c0e2-4447-ab4a-2375d0f8cbdf admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017713 Jun 05 08:14:53.013364 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 23/46] 10.222.0.33 () {60 vars in 1210 bytes} [Sun Jun 5 08:14:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:14:53.022320 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-82fca282-4442-4705-9696-58f59d530a7d admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:53.028217 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.wsgi [None req-82fca282-4442-4705-9696-58f59d530a7d admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 05 08:14:53.029949 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-82fca282-4442-4705-9696-58f59d530a7d admin admin] Request method failure captured: Jun 05 08:14:53.029949 n-d-844739-1 devstack@n-api.service[103895]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 05 08:14:53.029949 n-d-844739-1 devstack@n-api.service[103895]: Accept: application/json Jun 05 08:14:53.029949 n-d-844739-1 devstack@n-api.service[103895]: Accept-Encoding: gzip, deflate Jun 05 08:14:53.029949 n-d-844739-1 devstack@n-api.service[103895]: Connection: keep-alive Jun 05 08:14:53.029949 n-d-844739-1 devstack@n-api.service[103895]: Content-Length: 0 Jun 05 08:14:53.029949 n-d-844739-1 devstack@n-api.service[103895]: Host: 10.222.0.33 Jun 05 08:14:53.029949 n-d-844739-1 devstack@n-api.service[103895]: Openstack-Api-Version: compute 2.90 Jun 05 08:14:53.029949 n-d-844739-1 devstack@n-api.service[103895]: Openstack-System-Scope: None Jun 05 08:14:53.029949 n-d-844739-1 devstack@n-api.service[103895]: User-Agent: python-novaclient Jun 05 08:14:53.029949 n-d-844739-1 devstack@n-api.service[103895]: X-Auth-Token: gAAAAABinGX8qxH2tQId7Qwpa6_X_txwcIcXFd-EPXIGKvzntonQZVEiHjGak8lMv1lcCuhXp-lWEKVsiLNbde4G2MDPX6DPMGXZzIHeaprv0n-Ssn_-gvd8V68VoXIGJL44F_HlNOBNDHQgQfBdVLU44pIcmbUSb0n2HT-SP6myS7QLeJS4FwU Jun 05 08:14:53.029949 n-d-844739-1 devstack@n-api.service[103895]: X-Domain-Id: None Jun 05 08:14:53.029949 n-d-844739-1 devstack@n-api.service[103895]: X-Domain-Name: None Jun 05 08:14:53.029949 n-d-844739-1 devstack@n-api.service[103895]: X-Identity-Status: Confirmed Jun 05 08:14:53.029949 n-d-844739-1 devstack@n-api.service[103895]: X-Is-Admin-Project: True Jun 05 08:14:53.029949 n-d-844739-1 devstack@n-api.service[103895]: X-Openstack-Nova-Api-Version: 2.90 Jun 05 08:14:53.029949 n-d-844739-1 devstack@n-api.service[103895]: X-Project-Domain-Id: default Jun 05 08:14:53.029949 n-d-844739-1 devstack@n-api.service[103895]: X-Project-Domain-Name: Default Jun 05 08:14:53.029949 n-d-844739-1 devstack@n-api.service[103895]: X-Project-Id: 4d4ea0fc1d684b0aa494dbd66773bbf9 Jun 05 08:14:53.029949 n-d-844739-1 devstack@n-api.service[103895]: X-Project-Name: admin Jun 05 08:14:53.029949 n-d-844739-1 devstack@n-api.service[103895]: X-Role: admin,reader,member Jun 05 08:14:53.029949 n-d-844739-1 devstack@n-api.service[103895]: X-Roles: admin,reader,member Jun 05 08:14:53.031430 n-d-844739-1 devstack@n-api.service[103895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4d4ea0fc1d684b0aa494dbd66773bbf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4d4ea0fc1d684b0aa494dbd66773bbf9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4d4ea0fc1d684b0aa494dbd66773bbf9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4d4ea0fc1d684b0aa494dbd66773bbf9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:14:53.031430 n-d-844739-1 devstack@n-api.service[103895]: X-Tenant: admin Jun 05 08:14:53.031430 n-d-844739-1 devstack@n-api.service[103895]: X-Tenant-Id: 4d4ea0fc1d684b0aa494dbd66773bbf9 Jun 05 08:14:53.031430 n-d-844739-1 devstack@n-api.service[103895]: X-Tenant-Name: admin Jun 05 08:14:53.031430 n-d-844739-1 devstack@n-api.service[103895]: X-User: admin Jun 05 08:14:53.031430 n-d-844739-1 devstack@n-api.service[103895]: X-User-Domain-Id: default Jun 05 08:14:53.031430 n-d-844739-1 devstack@n-api.service[103895]: X-User-Domain-Name: Default Jun 05 08:14:53.031430 n-d-844739-1 devstack@n-api.service[103895]: X-User-Id: 884dd0b205284edcba10f79e81f60eb3 Jun 05 08:14:53.031430 n-d-844739-1 devstack@n-api.service[103895]: X-User-Name: admin Jun 05 08:14:53.031430 n-d-844739-1 devstack@n-api.service[103895]: method: > Jun 05 08:14:53.031430 n-d-844739-1 devstack@n-api.service[103895]: exception: Flavor 84 could not be found. Jun 05 08:14:53.031430 n-d-844739-1 devstack@n-api.service[103895]: action_args: {'id': '84'} Jun 05 08:14:53.031430 n-d-844739-1 devstack@n-api.service[103895]: {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:14:53.031430 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:14:53.032479 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 05 08:14:53.032479 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 05 08:14:53.032479 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 05 08:14:53.032479 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 05 08:14:53.032479 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:14:53.032479 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:14:53.032479 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 05 08:14:53.032479 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 05 08:14:53.032479 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 05 08:14:53.032479 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:14:53.032479 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 05 08:14:53.032479 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 05 08:14:53.032479 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 05 08:14:53.032479 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Jun 05 08:14:53.032479 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:14:53.032479 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Jun 05 08:14:53.032479 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:14:53.032479 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:14:53.032479 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:14:53.033726 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:14:53.033726 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:14:53.033726 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:14:53.033726 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:14:53.033726 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 05 08:14:53.033726 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:14:53.033726 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 05 08:14:53.033726 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Jun 05 08:14:53.033726 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:14:53.033726 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Jun 05 08:14:53.033726 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:14:53.033726 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:14:53.033726 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:14:53.033726 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:14:53.033726 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:14:53.033726 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 05 08:14:53.033726 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Jun 05 08:14:53.033726 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-82fca282-4442-4705-9696-58f59d530a7d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:14:53.034924 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-82fca282-4442-4705-9696-58f59d530a7d admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012465 Jun 05 08:14:53.034924 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 24/47] 10.222.0.33 () {60 vars in 1190 bytes} [Sun Jun 5 08:14:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 05 08:14:53.898459 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-16d4098c-c0e2-4447-ab4a-2375d0f8cbdf admin admin] Calling method '>' {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:53.899460 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-16d4098c-c0e2-4447-ab4a-2375d0f8cbdf admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jun 05 08:14:53.899863 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 24/48] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Jun 5 08:14:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:14:54.087669 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-bc91053f-dd41-4ada-9e10-859598317505 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:54.093921 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.wsgi [None req-bc91053f-dd41-4ada-9e10-859598317505 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 05 08:14:54.095423 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-bc91053f-dd41-4ada-9e10-859598317505 admin admin] Request method failure captured: Jun 05 08:14:54.095423 n-d-844739-1 devstack@n-api.service[103895]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 05 08:14:54.095423 n-d-844739-1 devstack@n-api.service[103895]: Accept: application/json Jun 05 08:14:54.095423 n-d-844739-1 devstack@n-api.service[103895]: Accept-Encoding: gzip, deflate Jun 05 08:14:54.095423 n-d-844739-1 devstack@n-api.service[103895]: Connection: keep-alive Jun 05 08:14:54.095423 n-d-844739-1 devstack@n-api.service[103895]: Content-Length: 0 Jun 05 08:14:54.095423 n-d-844739-1 devstack@n-api.service[103895]: Host: 10.222.0.33 Jun 05 08:14:54.095423 n-d-844739-1 devstack@n-api.service[103895]: Openstack-Api-Version: compute 2.90 Jun 05 08:14:54.095423 n-d-844739-1 devstack@n-api.service[103895]: Openstack-System-Scope: None Jun 05 08:14:54.095423 n-d-844739-1 devstack@n-api.service[103895]: User-Agent: python-novaclient Jun 05 08:14:54.095423 n-d-844739-1 devstack@n-api.service[103895]: X-Auth-Token: gAAAAABinGX93YYiKlJ8HUwWhuij3JqfpIb9ZgsOHOHUiJFz6PQwnJE76nb-intrHsO-QhGM4WQ_hlS8B3EluLNVnTkuP_mPFnXlIp_mGTbUR6mv7Nv1Lbxt5PilFvj5qdbd8-rAERB5SXE3r-8eswywVT0a0lXiHREOrQUzFFdjcn9yS8ByaVo Jun 05 08:14:54.095423 n-d-844739-1 devstack@n-api.service[103895]: X-Domain-Id: None Jun 05 08:14:54.095423 n-d-844739-1 devstack@n-api.service[103895]: X-Domain-Name: None Jun 05 08:14:54.095423 n-d-844739-1 devstack@n-api.service[103895]: X-Identity-Status: Confirmed Jun 05 08:14:54.095423 n-d-844739-1 devstack@n-api.service[103895]: X-Is-Admin-Project: True Jun 05 08:14:54.095423 n-d-844739-1 devstack@n-api.service[103895]: X-Openstack-Nova-Api-Version: 2.90 Jun 05 08:14:54.095423 n-d-844739-1 devstack@n-api.service[103895]: X-Project-Domain-Id: default Jun 05 08:14:54.095423 n-d-844739-1 devstack@n-api.service[103895]: X-Project-Domain-Name: Default Jun 05 08:14:54.095423 n-d-844739-1 devstack@n-api.service[103895]: X-Project-Id: 4d4ea0fc1d684b0aa494dbd66773bbf9 Jun 05 08:14:54.095423 n-d-844739-1 devstack@n-api.service[103895]: X-Project-Name: admin Jun 05 08:14:54.095423 n-d-844739-1 devstack@n-api.service[103895]: X-Role: admin,reader,member Jun 05 08:14:54.095423 n-d-844739-1 devstack@n-api.service[103895]: X-Roles: admin,reader,member Jun 05 08:14:54.096967 n-d-844739-1 devstack@n-api.service[103895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4d4ea0fc1d684b0aa494dbd66773bbf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4d4ea0fc1d684b0aa494dbd66773bbf9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4d4ea0fc1d684b0aa494dbd66773bbf9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4d4ea0fc1d684b0aa494dbd66773bbf9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:14:54.096967 n-d-844739-1 devstack@n-api.service[103895]: X-Tenant: admin Jun 05 08:14:54.096967 n-d-844739-1 devstack@n-api.service[103895]: X-Tenant-Id: 4d4ea0fc1d684b0aa494dbd66773bbf9 Jun 05 08:14:54.096967 n-d-844739-1 devstack@n-api.service[103895]: X-Tenant-Name: admin Jun 05 08:14:54.096967 n-d-844739-1 devstack@n-api.service[103895]: X-User: admin Jun 05 08:14:54.096967 n-d-844739-1 devstack@n-api.service[103895]: X-User-Domain-Id: default Jun 05 08:14:54.096967 n-d-844739-1 devstack@n-api.service[103895]: X-User-Domain-Name: Default Jun 05 08:14:54.096967 n-d-844739-1 devstack@n-api.service[103895]: X-User-Id: 884dd0b205284edcba10f79e81f60eb3 Jun 05 08:14:54.096967 n-d-844739-1 devstack@n-api.service[103895]: X-User-Name: admin Jun 05 08:14:54.096967 n-d-844739-1 devstack@n-api.service[103895]: method: > Jun 05 08:14:54.096967 n-d-844739-1 devstack@n-api.service[103895]: exception: Flavor 451 could not be found. Jun 05 08:14:54.096967 n-d-844739-1 devstack@n-api.service[103895]: action_args: {'id': '451'} Jun 05 08:14:54.096967 n-d-844739-1 devstack@n-api.service[103895]: {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:14:54.096967 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:14:54.097948 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 05 08:14:54.097948 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 05 08:14:54.097948 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 05 08:14:54.097948 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 05 08:14:54.097948 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:14:54.097948 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:14:54.097948 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 05 08:14:54.097948 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 05 08:14:54.097948 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 05 08:14:54.097948 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:14:54.097948 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 05 08:14:54.097948 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 05 08:14:54.097948 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 05 08:14:54.097948 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Jun 05 08:14:54.097948 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:14:54.097948 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Jun 05 08:14:54.097948 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:14:54.097948 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:14:54.097948 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:14:54.099290 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:14:54.099290 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:14:54.099290 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:14:54.099290 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:14:54.099290 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 05 08:14:54.099290 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:14:54.099290 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 05 08:14:54.099290 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Jun 05 08:14:54.099290 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:14:54.099290 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Jun 05 08:14:54.099290 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:14:54.099290 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:14:54.099290 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:14:54.099290 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:14:54.099290 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:14:54.099290 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 05 08:14:54.099290 n-d-844739-1 devstack@n-api.service[103895]: ERROR nova.api.openstack.wsgi Jun 05 08:14:54.099290 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-bc91053f-dd41-4ada-9e10-859598317505 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:14:54.100571 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-bc91053f-dd41-4ada-9e10-859598317505 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059785 Jun 05 08:14:54.100571 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 25/49] 10.222.0.33 () {60 vars in 1193 bytes} [Sun Jun 5 08:14:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 05 08:14:54.107194 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-0f6b5206-1a6e-4859-91b4-f518e6c6843e admin admin] Calling method '>' {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:54.120634 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-0f6b5206-1a6e-4859-91b4-f518e6c6843e admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017735 Jun 05 08:14:54.121226 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 25/50] 10.222.0.33 () {60 vars in 1210 bytes} [Sun Jun 5 08:14:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:14:54.130458 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-4869c77b-1bfd-4a3f-b9b0-4a4da7e51779 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:54.144381 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-4869c77b-1bfd-4a3f-b9b0-4a4da7e51779 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017391 Jun 05 08:14:54.144905 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 26/51] 10.222.0.33 () {60 vars in 1210 bytes} [Sun Jun 5 08:14:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:14:54.153925 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-16c1e9ce-a2dd-498d-99fd-5f7e4cc41493 admin admin] Calling method '>' {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:54.159541 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.wsgi [None req-16c1e9ce-a2dd-498d-99fd-5f7e4cc41493 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 05 08:14:54.161072 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-16c1e9ce-a2dd-498d-99fd-5f7e4cc41493 admin admin] Request method failure captured: Jun 05 08:14:54.161072 n-d-844739-1 devstack@n-api.service[103894]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 05 08:14:54.161072 n-d-844739-1 devstack@n-api.service[103894]: Accept: application/json Jun 05 08:14:54.161072 n-d-844739-1 devstack@n-api.service[103894]: Accept-Encoding: gzip, deflate Jun 05 08:14:54.161072 n-d-844739-1 devstack@n-api.service[103894]: Connection: keep-alive Jun 05 08:14:54.161072 n-d-844739-1 devstack@n-api.service[103894]: Content-Length: 0 Jun 05 08:14:54.161072 n-d-844739-1 devstack@n-api.service[103894]: Host: 10.222.0.33 Jun 05 08:14:54.161072 n-d-844739-1 devstack@n-api.service[103894]: Openstack-Api-Version: compute 2.90 Jun 05 08:14:54.161072 n-d-844739-1 devstack@n-api.service[103894]: Openstack-System-Scope: None Jun 05 08:14:54.161072 n-d-844739-1 devstack@n-api.service[103894]: User-Agent: python-novaclient Jun 05 08:14:54.161072 n-d-844739-1 devstack@n-api.service[103894]: X-Auth-Token: gAAAAABinGX93YYiKlJ8HUwWhuij3JqfpIb9ZgsOHOHUiJFz6PQwnJE76nb-intrHsO-QhGM4WQ_hlS8B3EluLNVnTkuP_mPFnXlIp_mGTbUR6mv7Nv1Lbxt5PilFvj5qdbd8-rAERB5SXE3r-8eswywVT0a0lXiHREOrQUzFFdjcn9yS8ByaVo Jun 05 08:14:54.161072 n-d-844739-1 devstack@n-api.service[103894]: X-Domain-Id: None Jun 05 08:14:54.161072 n-d-844739-1 devstack@n-api.service[103894]: X-Domain-Name: None Jun 05 08:14:54.161072 n-d-844739-1 devstack@n-api.service[103894]: X-Identity-Status: Confirmed Jun 05 08:14:54.161072 n-d-844739-1 devstack@n-api.service[103894]: X-Is-Admin-Project: True Jun 05 08:14:54.161072 n-d-844739-1 devstack@n-api.service[103894]: X-Openstack-Nova-Api-Version: 2.90 Jun 05 08:14:54.161072 n-d-844739-1 devstack@n-api.service[103894]: X-Project-Domain-Id: default Jun 05 08:14:54.161072 n-d-844739-1 devstack@n-api.service[103894]: X-Project-Domain-Name: Default Jun 05 08:14:54.161072 n-d-844739-1 devstack@n-api.service[103894]: X-Project-Id: 4d4ea0fc1d684b0aa494dbd66773bbf9 Jun 05 08:14:54.161072 n-d-844739-1 devstack@n-api.service[103894]: X-Project-Name: admin Jun 05 08:14:54.161072 n-d-844739-1 devstack@n-api.service[103894]: X-Role: admin,reader,member Jun 05 08:14:54.161072 n-d-844739-1 devstack@n-api.service[103894]: X-Roles: admin,reader,member Jun 05 08:14:54.162556 n-d-844739-1 devstack@n-api.service[103894]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4d4ea0fc1d684b0aa494dbd66773bbf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4d4ea0fc1d684b0aa494dbd66773bbf9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4d4ea0fc1d684b0aa494dbd66773bbf9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4d4ea0fc1d684b0aa494dbd66773bbf9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:14:54.162556 n-d-844739-1 devstack@n-api.service[103894]: X-Tenant: admin Jun 05 08:14:54.162556 n-d-844739-1 devstack@n-api.service[103894]: X-Tenant-Id: 4d4ea0fc1d684b0aa494dbd66773bbf9 Jun 05 08:14:54.162556 n-d-844739-1 devstack@n-api.service[103894]: X-Tenant-Name: admin Jun 05 08:14:54.162556 n-d-844739-1 devstack@n-api.service[103894]: X-User: admin Jun 05 08:14:54.162556 n-d-844739-1 devstack@n-api.service[103894]: X-User-Domain-Id: default Jun 05 08:14:54.162556 n-d-844739-1 devstack@n-api.service[103894]: X-User-Domain-Name: Default Jun 05 08:14:54.162556 n-d-844739-1 devstack@n-api.service[103894]: X-User-Id: 884dd0b205284edcba10f79e81f60eb3 Jun 05 08:14:54.162556 n-d-844739-1 devstack@n-api.service[103894]: X-User-Name: admin Jun 05 08:14:54.162556 n-d-844739-1 devstack@n-api.service[103894]: method: > Jun 05 08:14:54.162556 n-d-844739-1 devstack@n-api.service[103894]: exception: Flavor 451 could not be found. Jun 05 08:14:54.162556 n-d-844739-1 devstack@n-api.service[103894]: action_args: {'id': '451'} Jun 05 08:14:54.162556 n-d-844739-1 devstack@n-api.service[103894]: {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:14:54.162556 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:14:54.163564 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 05 08:14:54.163564 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 05 08:14:54.163564 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 05 08:14:54.163564 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 05 08:14:54.163564 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:14:54.163564 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:14:54.163564 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 05 08:14:54.163564 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 05 08:14:54.163564 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 05 08:14:54.163564 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:14:54.163564 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 05 08:14:54.163564 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 05 08:14:54.163564 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 05 08:14:54.163564 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi Jun 05 08:14:54.163564 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:14:54.163564 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi Jun 05 08:14:54.163564 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:14:54.163564 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:14:54.163564 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:14:54.164881 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:14:54.164881 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:14:54.164881 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:14:54.164881 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:14:54.164881 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 05 08:14:54.164881 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:14:54.164881 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 05 08:14:54.164881 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi Jun 05 08:14:54.164881 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:14:54.164881 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi Jun 05 08:14:54.164881 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:14:54.164881 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:14:54.164881 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:14:54.164881 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:14:54.164881 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:14:54.164881 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 05 08:14:54.164881 n-d-844739-1 devstack@n-api.service[103894]: ERROR nova.api.openstack.wsgi Jun 05 08:14:54.164881 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-16c1e9ce-a2dd-498d-99fd-5f7e4cc41493 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:14:54.166176 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-16c1e9ce-a2dd-498d-99fd-5f7e4cc41493 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012018 Jun 05 08:14:54.166176 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 26/52] 10.222.0.33 () {60 vars in 1193 bytes} [Sun Jun 5 08:14:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 05 08:14:55.032346 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-4869c77b-1bfd-4a3f-b9b0-4a4da7e51779 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:55.033357 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-4869c77b-1bfd-4a3f-b9b0-4a4da7e51779 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jun 05 08:14:55.033757 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 27/53] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Jun 5 08:14:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:14:55.222755 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-d0dd6d38-485f-4f9e-98ee-f7d5a1bb774f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:14:55.240379 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-d0dd6d38-485f-4f9e-98ee-f7d5a1bb774f admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070663 Jun 05 08:14:55.240931 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 27/54] 10.222.0.33 () {64 vars in 1235 bytes} [Sun Jun 5 08:14:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:14:56.142076 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-4869c77b-1bfd-4a3f-b9b0-4a4da7e51779 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:56.143083 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-4869c77b-1bfd-4a3f-b9b0-4a4da7e51779 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jun 05 08:14:56.143517 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 28/55] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Jun 5 08:14:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:14:56.335133 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-deb0796c-469c-4b1d-9130-f593b4bca4fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:14:56.351831 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-deb0796c-469c-4b1d-9130-f593b4bca4fa admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.070813 Jun 05 08:14:56.352418 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 28/56] 10.222.0.33 () {64 vars in 1235 bytes} [Sun Jun 5 08:14:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 05 08:14:57.227907 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-4869c77b-1bfd-4a3f-b9b0-4a4da7e51779 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:57.228939 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-4869c77b-1bfd-4a3f-b9b0-4a4da7e51779 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jun 05 08:14:57.229340 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 29/57] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Jun 5 08:14:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:14:57.418952 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-ce7f456f-daa0-4aa5-837a-61ea6392c991 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:14:57.435870 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-ce7f456f-daa0-4aa5-837a-61ea6392c991 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068082 Jun 05 08:14:57.436465 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 29/58] 10.222.0.33 () {64 vars in 1235 bytes} [Sun Jun 5 08:14:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:14:58.308213 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-4869c77b-1bfd-4a3f-b9b0-4a4da7e51779 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:58.309584 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-4869c77b-1bfd-4a3f-b9b0-4a4da7e51779 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001780 Jun 05 08:14:58.310025 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 30/59] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Jun 5 08:14:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:14:58.504374 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-29f40ec7-f71b-4efb-9430-919f7d75dd06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:14:58.521964 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-29f40ec7-f71b-4efb-9430-919f7d75dd06 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.075214 Jun 05 08:14:58.522458 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 30/60] 10.222.0.33 () {64 vars in 1235 bytes} [Sun Jun 5 08:14:58 2022] POST /compute/v2.1/flavors => generated 409 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:14:59.397327 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-4869c77b-1bfd-4a3f-b9b0-4a4da7e51779 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:59.398324 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-4869c77b-1bfd-4a3f-b9b0-4a4da7e51779 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jun 05 08:14:59.398715 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 31/61] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Jun 5 08:14:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:14:59.589160 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-dc9d3c61-9632-40ac-885b-3613966af1e3 admin admin] Calling method '>' {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:14:59.608643 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-dc9d3c61-9632-40ac-885b-3613966af1e3 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070592 Jun 05 08:14:59.609179 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 31/62] 10.222.0.33 () {60 vars in 1202 bytes} [Sun Jun 5 08:14:59 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:16:01.816128 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-4869c77b-1bfd-4a3f-b9b0-4a4da7e51779 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:16:01.817126 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-4869c77b-1bfd-4a3f-b9b0-4a4da7e51779 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jun 05 08:16:01.817526 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 32/63] 10.222.0.33 () {54 vars in 930 bytes} [Sun Jun 5 08:16:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:16:01.824822 n-d-844739-1 devstack@n-api.service[103894]: DEBUG dbcounter [-] [103894] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:16:01.877111 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-fe5fe392-7c7a-46e7-b8c8-a5cfe37115d0 admin admin] Calling method '>' {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:16:01.896530 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-fe5fe392-7c7a-46e7-b8c8-a5cfe37115d0 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073258 Jun 05 08:16:01.897075 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 32/64] 10.222.0.33 () {60 vars in 1291 bytes} [Sun Jun 5 08:16:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:16:01.919525 n-d-844739-1 devstack@n-api.service[103895]: DEBUG dbcounter [-] [103895] Writing DB stats nova_api:SELECT=14 {{(pid=103895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:16:01.923392 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-780a0c09-7a7d-4cce-885e-4e20b7708093 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:16:01.930882 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-780a0c09-7a7d-4cce-885e-4e20b7708093 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012762 Jun 05 08:16:01.931403 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 33/65] 10.222.0.33 () {60 vars in 1282 bytes} [Sun Jun 5 08:16:01 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:16:01.943175 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-37732b19-0fde-45e3-baad-b33da835c52c admin admin] Calling method '>' {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:16:01.950780 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-37732b19-0fde-45e3-baad-b33da835c52c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011288 Jun 05 08:16:01.951297 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 33/66] 10.222.0.33 () {60 vars in 1285 bytes} [Sun Jun 5 08:16:01 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:16:01.962340 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-23d0ea8f-da3e-4312-a287-acec925f2cb3 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:16:01.970681 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-23d0ea8f-da3e-4312-a287-acec925f2cb3 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011928 Jun 05 08:16:01.971192 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 34/67] 10.222.0.33 () {60 vars in 1285 bytes} [Sun Jun 5 08:16:01 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:16:01.983529 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-c2b73de8-fafa-4699-851a-0852429ec813 admin admin] Calling method '>' {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:16:01.991261 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-c2b73de8-fafa-4699-851a-0852429ec813 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012350 Jun 05 08:16:01.991772 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 34/68] 10.222.0.33 () {60 vars in 1282 bytes} [Sun Jun 5 08:16:01 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:21:33.566850 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-23d0ea8f-da3e-4312-a287-acec925f2cb3 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:21:33.567869 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-23d0ea8f-da3e-4312-a287-acec925f2cb3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jun 05 08:21:33.568303 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 35/69] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Jun 5 08:21:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:21:33.723806 n-d-844739-1 devstack@n-api.service[103894]: DEBUG dbcounter [-] [103894] Writing DB stats nova_api:SELECT=6 {{(pid=103894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:21:33.836258 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-c1b8b38a-2a61-4511-bf4d-25d0b768c580 admin admin] Calling method '>' {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:21:33.837938 n-d-844739-1 devstack@n-api.service[103894]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:21:33.837938 n-d-844739-1 devstack@n-api.service[103894]: warnings.warn(msg) Jun 05 08:21:33.839241 n-d-844739-1 devstack@n-api.service[103894]: DEBUG oslo_concurrency.lockutils [None req-c1b8b38a-2a61-4511-bf4d-25d0b768c580 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:21:33.839679 n-d-844739-1 devstack@n-api.service[103894]: DEBUG oslo_concurrency.lockutils [None req-c1b8b38a-2a61-4511-bf4d-25d0b768c580 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:21:33.840512 n-d-844739-1 devstack@n-api.service[103894]: DEBUG oslo_concurrency.lockutils [None req-c1b8b38a-2a61-4511-bf4d-25d0b768c580 admin admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:21:33.840933 n-d-844739-1 devstack@n-api.service[103894]: DEBUG oslo_concurrency.lockutils [None req-c1b8b38a-2a61-4511-bf4d-25d0b768c580 admin admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:21:33.880737 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-c1b8b38a-2a61-4511-bf4d-25d0b768c580 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.158489 Jun 05 08:21:33.881299 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 35/70] 10.222.0.33 () {60 vars in 1193 bytes} [Sun Jun 5 08:21:33 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:21:34.751836 n-d-844739-1 devstack@n-api.service[103895]: DEBUG nova.api.openstack.wsgi [None req-23d0ea8f-da3e-4312-a287-acec925f2cb3 admin admin] Calling method '>' {{(pid=103895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:21:34.752895 n-d-844739-1 devstack@n-api.service[103895]: INFO nova.api.openstack.requestlog [None req-23d0ea8f-da3e-4312-a287-acec925f2cb3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 05 08:21:34.753296 n-d-844739-1 devstack@n-api.service[103895]: [pid: 103895|app: 0|req: 36/71] 10.222.0.33 () {56 vars in 1074 bytes} [Sun Jun 5 08:21:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:21:34.944958 n-d-844739-1 devstack@n-api.service[103894]: DEBUG nova.api.openstack.wsgi [None req-53d7ddf9-e6b3-4152-8247-82f1a35ca270 admin admin] Calling method '>' {{(pid=103894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:21:34.946708 n-d-844739-1 devstack@n-api.service[103894]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:21:34.946708 n-d-844739-1 devstack@n-api.service[103894]: warnings.warn(msg) Jun 05 08:21:34.948085 n-d-844739-1 devstack@n-api.service[103894]: DEBUG oslo_concurrency.lockutils [None req-53d7ddf9-e6b3-4152-8247-82f1a35ca270 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:21:34.948526 n-d-844739-1 devstack@n-api.service[103894]: DEBUG oslo_concurrency.lockutils [None req-53d7ddf9-e6b3-4152-8247-82f1a35ca270 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:21:34.949328 n-d-844739-1 devstack@n-api.service[103894]: DEBUG oslo_concurrency.lockutils [None req-53d7ddf9-e6b3-4152-8247-82f1a35ca270 admin admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:21:34.949752 n-d-844739-1 devstack@n-api.service[103894]: DEBUG oslo_concurrency.lockutils [None req-53d7ddf9-e6b3-4152-8247-82f1a35ca270 admin admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:21:34.974027 n-d-844739-1 devstack@n-api.service[103894]: INFO nova.api.openstack.requestlog [None req-53d7ddf9-e6b3-4152-8247-82f1a35ca270 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.081702 Jun 05 08:21:34.974580 n-d-844739-1 devstack@n-api.service[103894]: [pid: 103894|app: 0|req: 36/72] 10.222.0.33 () {60 vars in 1193 bytes} [Sun Jun 5 08:21:34 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:22:21.699789 n-d-844739-1 systemd[1]: Stopping Devstack devstack@n-api.service... Jun 05 08:22:21.700430 n-d-844739-1 devstack@n-api.service[103893]: Sun Jun 5 08:22:21 2022 - graceful shutdown triggered... Jun 05 08:22:21.700985 n-d-844739-1 devstack@n-api.service[103895]: Gracefully killing worker 2 (pid: 103895)... Jun 05 08:22:21.701439 n-d-844739-1 devstack@n-api.service[103894]: Gracefully killing worker 1 (pid: 103894)... Jun 05 08:22:22.701538 n-d-844739-1 devstack@n-api.service[103893]: worker 1 buried after 1 seconds Jun 05 08:22:22.701947 n-d-844739-1 devstack@n-api.service[103893]: worker 2 buried after 1 seconds Jun 05 08:22:22.701947 n-d-844739-1 devstack@n-api.service[103893]: goodbye to uWSGI. Jun 05 08:22:22.703173 n-d-844739-1 systemd[1]: devstack@n-api.service: Succeeded. Jun 05 08:22:22.703757 n-d-844739-1 systemd[1]: Stopped Devstack devstack@n-api.service. Jun 05 08:22:22.706583 n-d-844739-1 systemd[1]: Starting Devstack devstack@n-api.service... Jun 05 08:22:22.719987 n-d-844739-1 devstack@n-api.service[119037]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 05 08:22:22.742365 n-d-844739-1 devstack@n-api.service[119037]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Jun 5 08:22:22 2022] *** Jun 05 08:22:22.742365 n-d-844739-1 devstack@n-api.service[119037]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 05 08:22:22.742365 n-d-844739-1 devstack@n-api.service[119037]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 05 08:22:22.742365 n-d-844739-1 devstack@n-api.service[119037]: nodename: n-d-844739-1 Jun 05 08:22:22.742365 n-d-844739-1 devstack@n-api.service[119037]: machine: x86_64 Jun 05 08:22:22.742365 n-d-844739-1 devstack@n-api.service[119037]: clock source: unix Jun 05 08:22:22.742365 n-d-844739-1 devstack@n-api.service[119037]: pcre jit disabled Jun 05 08:22:22.742365 n-d-844739-1 devstack@n-api.service[119037]: detected number of CPU cores: 4 Jun 05 08:22:22.742365 n-d-844739-1 devstack@n-api.service[119037]: current working directory: / Jun 05 08:22:22.742365 n-d-844739-1 devstack@n-api.service[119037]: detected binary path: /usr/bin/uwsgi-core Jun 05 08:22:22.742365 n-d-844739-1 devstack@n-api.service[119037]: your processes number limit is 47680 Jun 05 08:22:22.742365 n-d-844739-1 devstack@n-api.service[119037]: your memory page size is 4096 bytes Jun 05 08:22:22.742365 n-d-844739-1 devstack@n-api.service[119037]: detected max file descriptor number: 2048 Jun 05 08:22:22.742365 n-d-844739-1 devstack@n-api.service[119037]: lock engine: pthread robust mutexes Jun 05 08:22:22.743464 n-d-844739-1 devstack@n-api.service[119037]: thunder lock: enabled Jun 05 08:22:22.743464 n-d-844739-1 devstack@n-api.service[119037]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 05 08:22:22.743464 n-d-844739-1 devstack@n-api.service[119037]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 05 08:22:22.788364 n-d-844739-1 devstack@n-api.service[119037]: Python main interpreter initialized at 0x557e23fd69c0 Jun 05 08:22:22.788364 n-d-844739-1 devstack@n-api.service[119037]: python threads support enabled Jun 05 08:22:22.788364 n-d-844739-1 devstack@n-api.service[119037]: your server socket listen backlog is limited to 100 connections Jun 05 08:22:22.788364 n-d-844739-1 devstack@n-api.service[119037]: your mercy for graceful operations on workers is 90 seconds Jun 05 08:22:22.788799 n-d-844739-1 devstack@n-api.service[119037]: mapped 403077 bytes (393 KB) for 2 cores Jun 05 08:22:22.788799 n-d-844739-1 devstack@n-api.service[119037]: *** Operational MODE: preforking *** Jun 05 08:22:22.789043 n-d-844739-1 devstack@n-api.service[119037]: *** uWSGI is running in multiple interpreter mode *** Jun 05 08:22:22.789043 n-d-844739-1 devstack@n-api.service[119037]: spawned uWSGI master process (pid: 119037) Jun 05 08:22:22.789251 n-d-844739-1 systemd[1]: Started Devstack devstack@n-api.service. Jun 05 08:22:22.789865 n-d-844739-1 devstack@n-api.service[119037]: spawned uWSGI worker 1 (pid: 119049, cores: 1) Jun 05 08:22:22.790377 n-d-844739-1 devstack@n-api.service[119037]: spawned uWSGI worker 2 (pid: 119050, cores: 1) Jun 05 08:22:22.790654 n-d-844739-1 devstack@n-api.service[119037]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 05 08:22:24.080231 n-d-844739-1 devstack@n-api.service[119049]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 05 08:22:24.123196 n-d-844739-1 devstack@n-api.service[119050]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 05 08:22:24.971083 n-d-844739-1 devstack@n-api.service[119049]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 05 08:22:24.971083 n-d-844739-1 devstack@n-api.service[119049]: from cryptography.utils import int_from_bytes Jun 05 08:22:24.971435 n-d-844739-1 devstack@n-api.service[119049]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 05 08:22:24.971435 n-d-844739-1 devstack@n-api.service[119049]: from cryptography.utils import int_from_bytes Jun 05 08:22:24.999226 n-d-844739-1 devstack@n-api.service[119050]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 05 08:22:24.999226 n-d-844739-1 devstack@n-api.service[119050]: from cryptography.utils import int_from_bytes Jun 05 08:22:24.999557 n-d-844739-1 devstack@n-api.service[119050]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 05 08:22:24.999557 n-d-844739-1 devstack@n-api.service[119050]: from cryptography.utils import int_from_bytes Jun 05 08:22:27.448642 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 05 08:22:27.449220 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 05 08:22:27.449506 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 05 08:22:27.449824 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 05 08:22:27.450084 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 05 08:22:27.450481 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.450816 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.451146 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.451464 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.451808 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.452164 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.452504 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.452837 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.453178 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.453447 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.453771 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.454108 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-844739-1 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.454449 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.454764 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.455083 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.455413 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.455730 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.456128 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.456402 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.456911 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.458315 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.458315 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.458315 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.458315 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.458637 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.458925 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.459249 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.459571 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.459892 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.460248 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.460662 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-844739-1 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.460989 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.461310 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.461630 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.462056 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.463256 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.463474 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.463780 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.464130 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.464447 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.464790 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.465119 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.465449 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.465782 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.466095 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.466411 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.466732 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.467061 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.467391 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.467691 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.467950 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.468292 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.468626 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.468953 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.469288 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.469550 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.469808 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.470137 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.470468 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.470786 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.471103 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.471417 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.471736 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.472079 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.472407 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.472709 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.473030 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.473361 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.473686 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.474021 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.474338 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.474669 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.475089 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.475355 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.475668 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.476020 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.476376 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.476695 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.477026 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.477358 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.477675 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.477991 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.478578 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.479158 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.479420 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.479746 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.480011 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.480352 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.480672 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.481005 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.481326 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.481644 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.481959 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.482273 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.482588 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.482901 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.483226 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.483543 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.483859 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.484199 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.484518 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.484834 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.485150 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.485481 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.485815 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.486134 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.486441 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.486748 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.487069 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.487402 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.487720 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.488049 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.488313 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 05 08:22:27.488814 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.488966 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 05 08:22:27.489127 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.489127 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.489407 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 05 08:22:27.489567 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.489724 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 05 08:22:27.489866 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.490022 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 05 08:22:27.490164 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.490310 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.490456 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.490604 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.490752 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.490899 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.491050 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.491210 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.491358 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.491515 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.491684 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.491826 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.491971 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.492156 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.492318 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.492459 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.492604 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.492751 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.492898 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.493058 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.493210 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.493350 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.493495 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.493655 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-844739-1 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.493803 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.494500 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.494500 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.494798 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.494948 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.495096 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.495260 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.495428 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.495608 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.495758 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.495926 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.496088 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.496235 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.496391 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.496540 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.496682 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.496820 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.496970 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.497170 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.498043 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.498254 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.498405 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.498553 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.498696 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.498848 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.499541 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.499652 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.499741 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.499828 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.499904 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.499987 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.499987 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.500158 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.500239 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.500320 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.500400 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.500496 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.500590 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.500681 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.500765 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.500856 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-844739-1 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.500950 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.501042 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.501197 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.501371 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.501525 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.501684 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.501838 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.502016 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.502167 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.502338 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.502486 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.502655 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.502804 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.502984 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.503140 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.503318 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.503477 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.503617 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.503756 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.503956 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.504150 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.504293 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.504444 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.504627 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.504783 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.504957 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.505112 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.505251 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.505413 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.505562 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.505713 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.505858 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.505997 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.506181 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.506358 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.507400 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.508400 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.508561 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.508715 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.508868 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.509029 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.509178 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.509817 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.510451 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.510614 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.510768 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.510916 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.511065 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.511216 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.511363 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.511363 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.511640 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.511793 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.511932 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.512107 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.512262 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.512413 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.512559 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.512698 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.512845 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.512991 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.513137 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.513285 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.513426 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.513564 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.513719 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.513869 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.514016 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.514168 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.514314 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.514453 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.514598 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.514806 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.514992 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.515193 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.515339 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.515457 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.515573 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.515692 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.515849 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.516004 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.516285 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.516431 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.516570 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.516747 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.517219 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.517408 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.517590 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.518596 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.518760 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.518760 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.519062 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.519220 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.519367 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.519515 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.519662 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.519830 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.520024 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.520161 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.520514 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.520673 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.520822 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.520970 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.521122 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.521274 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.521274 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.521539 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.521686 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.521839 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.521986 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.522140 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.522285 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.522431 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.522571 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.522719 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.522858 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.523006 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.523145 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.523325 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.523545 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.523702 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.523860 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.524010 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.524210 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.524352 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.524501 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.524642 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.524789 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.526129 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.526295 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.526441 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.526590 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.526741 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.526895 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.527044 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.527192 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.527341 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.527482 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.527638 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.527780 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.528772 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.528956 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.529108 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.529249 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.529420 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.530333 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.530497 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.530643 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.530790 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.530939 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.531089 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.531238 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.531377 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.531516 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.531677 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.531828 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.531976 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.532151 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.532151 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.532442 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.532594 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.532736 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.532882 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.533029 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.533183 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.533331 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.533470 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.533619 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.533767 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.533907 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.534060 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.534201 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.534340 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.534486 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.534486 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.534750 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.534750 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.535036 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.535036 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.535308 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.535457 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.535604 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.535752 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.535893 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.536078 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.536238 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.536380 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.536529 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.536668 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.536807 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.536947 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.537092 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.537254 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.537407 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.537554 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.537701 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.537846 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.538003 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.538926 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.539093 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.539243 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.539390 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.539537 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.539684 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.539824 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.539987 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.540154 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.540305 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.540445 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.541155 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.541316 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.541478 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.541628 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 05 08:22:27.541769 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.541915 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.542063 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.542214 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.542373 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.543107 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.543269 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.543410 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.543616 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.543771 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.543921 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.544090 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.544250 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.544399 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.544547 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.544695 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.544843 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.544995 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.545152 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.545418 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.545589 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.545733 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.545872 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.546010 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.546267 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.546436 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.546594 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.546741 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.546888 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.547029 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.547187 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.547327 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.547580 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.547741 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.547884 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.548023 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.548248 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.549262 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.549557 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.549791 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.549964 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.550115 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.550264 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.550417 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.550568 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.550709 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.550847 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.550987 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.552003 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.552185 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.552351 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.552502 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.552645 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.552800 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.552942 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.553120 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.553777 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.553944 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.554088 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.554244 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.554386 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.554526 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.554665 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.554806 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.554955 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.555104 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.555252 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.555398 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.555550 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.555699 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.555855 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.555997 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.556282 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.557030 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.557184 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.557339 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.557491 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.557640 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.557781 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.557922 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.558062 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.558221 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.558375 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.559203 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.559563 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.559720 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.559863 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.560014 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.560189 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.560338 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.560486 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.560633 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.560773 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.560933 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.561076 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.561222 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.561370 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.561522 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.561682 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.561914 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.562075 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.562218 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.562372 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.562526 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.562899 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.563057 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.563221 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.563369 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.563510 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.563650 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.563800 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.564138 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.564313 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.564489 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.564645 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.564804 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.564944 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.565068 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.565155 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.565246 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.565336 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.565419 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.565515 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.565609 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.565693 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.565774 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.565856 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.565936 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.566035 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.566130 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.566213 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.566301 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.566385 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.566474 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.566570 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.566654 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.566735 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.566815 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.566906 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.567004 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.567096 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.567188 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.567272 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.567354 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.567434 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.567523 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.567619 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.567710 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.567793 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.567881 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.567881 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.568055 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.568153 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.568238 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.568329 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.568412 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.568502 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.568592 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.568710 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.568988 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.569319 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.569428 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.569707 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.569802 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.569893 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.569977 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.570058 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.570147 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.570246 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.570344 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.570429 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.570521 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.570633 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.570719 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.570815 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.570899 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.570988 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.571089 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.571182 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.571265 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.571346 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.571435 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.571525 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.571617 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.571700 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.572324 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.572502 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.572987 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.573084 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.573187 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.573279 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.573483 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.573578 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.573661 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.573742 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.573834 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.573918 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.574008 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.574098 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.574181 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.574276 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.574361 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.574454 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.574547 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.574639 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.574723 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.574813 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.574903 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.574992 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.575087 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.575171 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.575263 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.575421 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.575515 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.575600 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.575678 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.575760 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.575849 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.575945 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.576080 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.576167 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.576249 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.576343 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.576437 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.576529 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.576620 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.576704 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.576801 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.576890 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.576988 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.577072 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.577161 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.577257 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.577257 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.577434 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.577529 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.577612 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.577700 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.577783 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.577783 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.577946 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.577946 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.578118 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.578118 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.578266 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.578354 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.578450 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.578534 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.578614 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.578695 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.578781 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.578872 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.579875 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.579973 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.580081 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.580179 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.580265 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.580347 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.580444 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.580536 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.580628 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.580718 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.580802 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.580897 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.580991 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.581084 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.581180 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.581272 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.581356 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.581446 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.581546 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.581637 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.581727 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.581811 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.581899 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.581992 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.582082 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.582167 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.582247 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.582335 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.582436 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.582537 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.582625 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.582715 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.582799 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.582892 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.582988 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.583073 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.583171 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.583243 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.583312 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.583380 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.583465 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.583564 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.583635 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.583715 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.583795 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.583876 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.583975 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.584172 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.584266 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.584354 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.584443 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.584533 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.584634 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.584726 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.584818 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.584909 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.585004 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.585097 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.585180 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.585262 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.585349 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.585432 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.585592 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.585701 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.585909 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.586008 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.586220 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.586313 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.586531 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.586637 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.586847 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.586946 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.587178 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.587277 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.588149 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.588264 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.588568 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.588687 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.588895 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.589140 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.589267 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.589473 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.589569 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.589797 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.590136 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.590461 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.590611 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.590780 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.590999 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.591083 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.591330 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.591412 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.591716 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.591801 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.592060 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.592161 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.592381 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.592464 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.592706 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.592790 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.593033 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.593121 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.593351 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.593442 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.593679 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.593775 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.593994 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.594076 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.594310 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.594406 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.594634 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.594724 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.594953 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.595043 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.595271 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.595396 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.595588 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.595679 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.595907 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.596003 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.596251 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.596435 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.596571 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.596657 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.596903 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.597050 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.597222 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.597410 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.597612 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.597768 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.597918 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.598066 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.598272 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.598375 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.598597 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.598755 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.598907 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.599056 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.599399 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.599490 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.599572 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.600375 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.600483 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.600483 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.600682 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.600788 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.600876 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.600965 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.601086 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.601164 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.601249 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.601329 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.601406 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.601632 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.601730 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.601900 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.601994 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.602217 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.602399 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.602555 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.602655 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.602874 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.602968 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.603279 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.603813 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.603921 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.604015 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.604147 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.604234 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.604316 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.604407 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.604498 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.604670 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.604922 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.605014 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.605244 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.605350 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.605564 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.605674 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.605879 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.605971 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.606192 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.606297 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.606509 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.606607 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.606822 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.606913 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.607143 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.607243 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.607454 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.607545 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.607787 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.607885 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.608127 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.608238 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.608442 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.608534 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.608755 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.608848 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.609072 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.609165 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.609423 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.609527 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.609735 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.609822 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.610068 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.610169 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.610382 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.610497 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.610695 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.610795 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.611009 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.611101 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.611343 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.611434 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.611661 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.611800 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.611976 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.612111 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.612315 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.612434 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.612627 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.612740 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.612945 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.613058 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.613261 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.613463 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.613565 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.613784 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.613908 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.614103 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.614208 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.614435 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.614545 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.614773 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.614884 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.615080 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.615188 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.615398 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.615510 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.615709 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.615819 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.616025 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.616202 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.616361 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.616465 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.616673 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.616774 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.616983 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.617077 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.617301 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.617400 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.617616 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.617707 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.617923 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.618015 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.618240 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.618343 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.618549 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.618678 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.618976 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.619078 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.619299 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.619614 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.619803 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.619927 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.620274 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.620488 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.620603 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.620892 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.621011 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.621226 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.621364 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.621544 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.621731 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.621846 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.622163 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.622341 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.622514 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.622787 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.622903 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.623098 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.623414 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.623515 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.623727 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.623848 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.624071 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.624387 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.624543 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.625021 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.625458 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.625580 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.625797 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.626117 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.626222 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.626437 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.626603 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.626780 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.626938 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.627111 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.627310 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.627416 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.627686 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.628003 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.628340 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.628675 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.629000 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.629092 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.629315 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.629407 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.629675 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.629875 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.629992 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.630241 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.630360 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.630612 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.630737 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.630918 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.631011 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.631231 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.631338 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.631551 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.631644 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.631878 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.631991 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.632251 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.632365 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.632576 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.632659 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.632900 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.632982 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.633451 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.633568 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.633568 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.633701 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.633866 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.633959 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.634206 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.634815 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.635022 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.635333 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.635443 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.635664 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.635772 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.635985 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.636111 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.636330 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.636424 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.636662 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.636765 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.636995 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.637089 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.637331 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.637431 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.637642 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.637742 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.637958 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.638052 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.638276 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.638383 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.638595 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.638690 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.638911 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.639004 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.639224 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.639325 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.639539 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.639648 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.639885 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.639982 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.640200 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.640307 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.640506 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.640613 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.640821 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.640924 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.641130 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.641232 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.641447 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.641541 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.641763 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.641869 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.642075 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.642171 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.642394 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.642486 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.642710 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.642810 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.643022 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.643115 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.643336 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.643429 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.643648 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.643749 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.643964 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.644090 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.644366 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.644482 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.644707 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.644813 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.645046 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.645155 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.645375 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.645467 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.645712 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.645813 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.646027 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.646119 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.646360 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.646470 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.646665 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.646768 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.646985 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.647086 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.647296 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.647389 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.647619 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.647737 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.647947 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.648078 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.648307 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.648414 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.648633 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.648737 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.648949 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.649048 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.649265 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.649358 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.649582 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.650604 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.650720 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.650902 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.651004 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.651163 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.651319 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.651488 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.651698 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.651806 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.651967 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.652248 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.652401 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.652478 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.652618 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.652781 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.653047 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.653155 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.653371 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.653472 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.653684 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.653778 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.654046 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.654147 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.654382 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.654472 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.654715 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.654820 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.655310 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.655412 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.655641 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.655735 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.655963 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.656081 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.656303 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.656397 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.656625 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.656725 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.656942 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.657041 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.657274 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.657376 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.657606 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.657700 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.657924 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.658030 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.658247 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.658347 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.658560 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.658660 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.658887 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.659034 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.659209 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.659380 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.659534 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.659619 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.659859 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.660214 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.660531 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.660632 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.660856 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.661065 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.661182 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.661519 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.661867 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.662125 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.662237 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.662946 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.663048 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.663124 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.663202 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.663274 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.663350 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.663441 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.663646 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.663729 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.663969 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.664076 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.664313 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.664405 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.664634 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.664736 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.664969 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.665051 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.665400 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.665530 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.665638 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.666266 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.666266 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.666468 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.666542 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.666698 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.666773 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.666843 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.666986 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.667085 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.667293 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.667421 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.667568 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.667669 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.667904 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.668006 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.668258 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.668363 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.668578 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.668787 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.668936 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.669078 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.669235 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.669385 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.669556 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.669748 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.669891 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.670116 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.670276 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.670445 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.670583 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.670771 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.670862 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.671176 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.671341 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.671847 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.671998 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.672160 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.672261 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.672347 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.672421 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.672498 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.672590 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.672719 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.672826 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.673068 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.673167 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.673404 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.673521 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.673681 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.673799 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.673999 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.674094 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.674322 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.674413 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.674634 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.674742 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.674945 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.675040 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.675263 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.675366 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.675574 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.675676 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.675896 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.676011 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.676267 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.676372 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.676529 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.676646 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.676842 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.676956 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.677150 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.677245 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.677462 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.677562 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.677782 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.677882 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.678095 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.678188 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.678439 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.678546 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.678892 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.678990 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.679070 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.679167 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.679302 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.679421 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.679623 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.679733 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.679942 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.680084 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.680513 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.680606 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.680802 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.680965 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.681668 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.681979 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.682606 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.682692 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.682773 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.682773 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.682918 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.682990 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.683074 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.683275 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.683366 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.683674 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.683769 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.683909 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.683992 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.684261 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.684345 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.684633 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.684753 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.685123 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.685571 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.685928 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.686264 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.686870 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.686967 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.687063 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.687148 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.687238 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.687404 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.687553 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.687754 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.687868 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.688125 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.688239 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.688471 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.688561 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.688816 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.688913 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.689138 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.689399 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.689493 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.689748 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.689843 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.690068 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.690159 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.690388 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.690480 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.690708 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.690810 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.691026 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.691121 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.691343 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.691438 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.691660 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.691751 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.691977 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.692098 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.692332 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.692435 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.692658 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.692778 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.692996 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.693097 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.693328 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.693429 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.693659 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.693827 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.693977 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.694122 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.694298 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.694462 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.694603 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.694743 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.694911 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.695012 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.695234 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.695328 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.695562 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.695705 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.695893 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.696023 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.696277 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.696423 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.696575 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.696699 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.697555 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.698143 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.698143 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.698374 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.698484 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.698595 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.698755 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.698960 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.699207 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.699207 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.699418 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.700121 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.700231 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.700334 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.700421 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.700502 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.700575 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.700654 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.700740 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.700814 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.700884 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.700954 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.701032 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.701255 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.701354 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.701580 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.701662 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.701969 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.702064 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.702253 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.702365 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.702577 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.702792 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.702889 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.703079 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.703428 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.703755 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.703975 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.704336 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.704675 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.704999 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.705318 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.705636 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.705964 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.706267 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.706633 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.707118 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.707222 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.707479 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.707563 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.707815 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.707900 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.708172 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.708381 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.708507 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.708712 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.708838 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.709035 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.709162 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.709360 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.709502 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.709686 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.709841 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.710011 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.710171 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.710317 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.710481 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.710628 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.710806 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.710943 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.711242 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.711377 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.711561 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.711702 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.711880 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.712017 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.712226 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.712976 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.713081 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.713155 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.713226 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.713307 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.713736 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] nova_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.713823 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.713968 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] nova_sys_admin.group = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.714170 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.714280 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] nova_sys_admin.helper_command = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.714381 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.714473 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] nova_sys_admin.logger_name = oslo_privsep.daemon {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.714558 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.714736 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] nova_sys_admin.thread_pool_size = 4 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.714835 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.715069 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] nova_sys_admin.user = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.715177 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.715402 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.715495 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.715732 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.715843 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.716073 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.716183 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.716397 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.716515 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.716715 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.716817 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.717037 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.717131 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.717352 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.717490 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.717689 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.717781 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.718006 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.718098 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.718324 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.718417 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.718640 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.718733 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.718964 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.719057 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.719278 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.719370 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.719594 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.719686 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.719912 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.720005 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.720266 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.720372 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.720588 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.720687 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.720901 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.720999 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.721219 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.721319 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.721534 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.721634 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.721880 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.721979 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.722194 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.722285 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.722513 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.722618 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.722835 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.722934 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.723158 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.723259 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.723501 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.723623 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.723815 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.723917 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.724156 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.724259 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.724721 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.724819 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.724819 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.724971 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.725097 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.725190 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.725415 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.725510 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.725745 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.725881 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.726084 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.726182 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.726421 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.726639 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.726806 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.726987 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.727089 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.727320 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.727422 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.727667 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.727768 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.728551 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.728679 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.728778 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.728865 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.728948 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.729031 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.729113 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.729205 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.729321 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.729423 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.729642 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.729742 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.729951 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 05 08:22:27.730049 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.730273 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.730592 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.730913 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.731232 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.731551 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.731869 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.732209 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.732531 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.732848 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.733164 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.733485 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.733804 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.734155 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.734536 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.734802 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.735696 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.735696 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.735907 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.736089 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.736559 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.736713 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.737039 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.737381 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.737704 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.738020 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.738478 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.740529 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.740899 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.741254 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.741595 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.741952 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.742304 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.742640 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.743012 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.743346 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.745845 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.745845 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.745845 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.745845 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.746586 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.746902 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.747302 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.747740 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.748285 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.748822 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.749224 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.749619 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.752066 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.752066 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.752066 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.752066 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.752066 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.752066 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.752066 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.757202 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.757202 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.757202 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.757202 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.757202 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.757202 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.757202 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.763020 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.768072 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.768072 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.768072 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.768072 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.768072 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] nova_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.768072 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] nova_sys_admin.group = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.768072 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] nova_sys_admin.helper_command = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.768072 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] nova_sys_admin.logger_name = oslo_privsep.daemon {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.768732 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] nova_sys_admin.thread_pool_size = 4 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.768732 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] nova_sys_admin.user = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.768732 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.769247 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.769999 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.770589 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.771087 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.771566 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.772347 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.772593 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.772959 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.773327 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.773698 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.774308 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.774686 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.775103 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.776335 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.776736 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.777180 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.777654 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.778028 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.778334 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.778782 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.779122 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.780724 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.781025 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.781689 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.782042 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.782373 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.782698 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.783029 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.783395 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.783723 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.784069 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.784401 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.784744 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.785080 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.785406 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.785744 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.786084 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.786444 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.786766 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.787138 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.787467 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.787792 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.788137 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.788457 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 05 08:22:27.788709 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 05 08:22:27.792461 n-d-844739-1 devstack@n-api.service[119049]: INFO dbcounter [None req-e8327cba-edec-47a7-83f8-92b67e9c6a16 None None] Registered counter for database nova_api Jun 05 08:22:27.813678 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_db.sqlalchemy.engines [None req-e8327cba-edec-47a7-83f8-92b67e9c6a16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119049) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 05 08:22:27.820686 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writer thread running {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 05 08:22:27.855810 n-d-844739-1 devstack@n-api.service[119050]: INFO dbcounter [None req-774a635c-6c84-43d8-94dc-aa30a79a7f2d None None] Registered counter for database nova_api Jun 05 08:22:27.876646 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_db.sqlalchemy.engines [None req-774a635c-6c84-43d8-94dc-aa30a79a7f2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119050) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 05 08:22:27.879126 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.context [None req-e8327cba-edec-47a7-83f8-92b67e9c6a16 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ceb8701a-c729-4596-86e5-c56dbc5a8933(cell1) {{(pid=119049) load_cells /opt/stack/nova/nova/context.py:464}} Jun 05 08:22:27.883340 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e8327cba-edec-47a7-83f8-92b67e9c6a16 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:22:27.885600 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e8327cba-edec-47a7-83f8-92b67e9c6a16 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:22:27.885921 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writer thread running {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 05 08:22:27.886413 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e8327cba-edec-47a7-83f8-92b67e9c6a16 None None] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:22:27.888431 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e8327cba-edec-47a7-83f8-92b67e9c6a16 None None] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:22:27.890501 n-d-844739-1 devstack@n-api.service[119049]: INFO dbcounter [None req-e8327cba-edec-47a7-83f8-92b67e9c6a16 None None] Registered counter for database nova_cell0 Jun 05 08:22:27.894631 n-d-844739-1 devstack@n-api.service[119049]: INFO dbcounter [None req-e8327cba-edec-47a7-83f8-92b67e9c6a16 None None] Registered counter for database nova_cell1 Jun 05 08:22:27.902327 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_db.sqlalchemy.engines [None req-e8327cba-edec-47a7-83f8-92b67e9c6a16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119049) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 05 08:22:27.905897 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_db.sqlalchemy.engines [None req-e8327cba-edec-47a7-83f8-92b67e9c6a16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119049) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 05 08:22:27.909339 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writer thread running {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 05 08:22:27.946622 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.context [None req-774a635c-6c84-43d8-94dc-aa30a79a7f2d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ceb8701a-c729-4596-86e5-c56dbc5a8933(cell1) {{(pid=119050) load_cells /opt/stack/nova/nova/context.py:464}} Jun 05 08:22:27.952159 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-774a635c-6c84-43d8-94dc-aa30a79a7f2d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:22:27.953699 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-774a635c-6c84-43d8-94dc-aa30a79a7f2d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:22:27.954491 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-774a635c-6c84-43d8-94dc-aa30a79a7f2d None None] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:22:27.956478 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-774a635c-6c84-43d8-94dc-aa30a79a7f2d None None] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:22:27.958494 n-d-844739-1 devstack@n-api.service[119050]: INFO dbcounter [None req-774a635c-6c84-43d8-94dc-aa30a79a7f2d None None] Registered counter for database nova_cell0 Jun 05 08:22:27.963155 n-d-844739-1 devstack@n-api.service[119050]: INFO dbcounter [None req-774a635c-6c84-43d8-94dc-aa30a79a7f2d None None] Registered counter for database nova_cell1 Jun 05 08:22:27.970250 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_db.sqlalchemy.engines [None req-774a635c-6c84-43d8-94dc-aa30a79a7f2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119050) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 05 08:22:27.972541 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_db.sqlalchemy.engines [None req-774a635c-6c84-43d8-94dc-aa30a79a7f2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119050) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 05 08:22:27.977597 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writer thread running {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 05 08:22:28.053922 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writer thread running {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 05 08:22:28.064608 n-d-844739-1 devstack@n-api.service[119049]: INFO dbcounter [None req-e8327cba-edec-47a7-83f8-92b67e9c6a16 None None] Registered counter for database nova_cell0 Jun 05 08:22:28.071618 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_db.sqlalchemy.engines [None req-e8327cba-edec-47a7-83f8-92b67e9c6a16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119049) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 05 08:22:28.076669 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writer thread running {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 05 08:22:28.126177 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writer thread running {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 05 08:22:28.136386 n-d-844739-1 devstack@n-api.service[119050]: INFO dbcounter [None req-774a635c-6c84-43d8-94dc-aa30a79a7f2d None None] Registered counter for database nova_cell0 Jun 05 08:22:28.143356 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_db.sqlalchemy.engines [None req-774a635c-6c84-43d8-94dc-aa30a79a7f2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119050) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 05 08:22:28.147727 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writer thread running {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 05 08:22:28.519800 n-d-844739-1 devstack@n-api.service[119049]: WARNING keystonemiddleware.auth_token [None req-e8327cba-edec-47a7-83f8-92b67e9c6a16 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 05 08:22:28.528759 n-d-844739-1 devstack@n-api.service[119049]: WARNING keystonemiddleware.auth_token [None req-e8327cba-edec-47a7-83f8-92b67e9c6a16 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 05 08:22:28.593277 n-d-844739-1 devstack@n-api.service[119050]: WARNING keystonemiddleware.auth_token [None req-774a635c-6c84-43d8-94dc-aa30a79a7f2d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 05 08:22:28.600733 n-d-844739-1 devstack@n-api.service[119050]: WARNING keystonemiddleware.auth_token [None req-774a635c-6c84-43d8-94dc-aa30a79a7f2d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 05 08:22:28.754544 n-d-844739-1 devstack@n-api.service[119049]: WARNING keystonemiddleware.auth_token [None req-e8327cba-edec-47a7-83f8-92b67e9c6a16 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 05 08:22:28.761161 n-d-844739-1 devstack@n-api.service[119049]: WARNING keystonemiddleware.auth_token [None req-e8327cba-edec-47a7-83f8-92b67e9c6a16 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 05 08:22:28.766352 n-d-844739-1 devstack@n-api.service[119049]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557e23fd69c0 pid: 119049 (default app) Jun 05 08:22:28.827066 n-d-844739-1 devstack@n-api.service[119050]: WARNING keystonemiddleware.auth_token [None req-774a635c-6c84-43d8-94dc-aa30a79a7f2d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 05 08:22:28.833123 n-d-844739-1 devstack@n-api.service[119050]: WARNING keystonemiddleware.auth_token [None req-774a635c-6c84-43d8-94dc-aa30a79a7f2d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 05 08:22:28.839276 n-d-844739-1 devstack@n-api.service[119050]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557e23fd69c0 pid: 119050 (default app) Jun 05 08:23:14.288617 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=3 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:23:14.290710 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=3 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:23:14.291881 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=3 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:23:14.293318 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=3 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:23:15.575276 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=3 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:23:15.584789 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=3 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:23:15.585845 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=3 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:23:15.587325 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=3 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:23:15.957736 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4fafc8b1-1eb8-4c39-aa05-4a6bfc59e982 tempest-AggregatesAdminTestV241-539222272 tempest-AggregatesAdminTestV241-539222272-project-admin] Calling method '.version_select at 0x7f24421b2700>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:15.961497 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:15.961497 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:23:15.967764 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4fafc8b1-1eb8-4c39-aa05-4a6bfc59e982 tempest-AggregatesAdminTestV241-539222272 tempest-AggregatesAdminTestV241-539222272-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ceb8701a-c729-4596-86e5-c56dbc5a8933(cell1) {{(pid=119049) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jun 05 08:23:15.968890 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4fafc8b1-1eb8-4c39-aa05-4a6bfc59e982 tempest-AggregatesAdminTestV241-539222272 tempest-AggregatesAdminTestV241-539222272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:15.969723 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4fafc8b1-1eb8-4c39-aa05-4a6bfc59e982 tempest-AggregatesAdminTestV241-539222272 tempest-AggregatesAdminTestV241-539222272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:15.999060 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4fafc8b1-1eb8-4c39-aa05-4a6bfc59e982 tempest-AggregatesAdminTestV241-539222272 tempest-AggregatesAdminTestV241-539222272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:15.999663 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4fafc8b1-1eb8-4c39-aa05-4a6bfc59e982 tempest-AggregatesAdminTestV241-539222272 tempest-AggregatesAdminTestV241-539222272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:16.014637 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4fafc8b1-1eb8-4c39-aa05-4a6bfc59e982 tempest-AggregatesAdminTestV241-539222272 tempest-AggregatesAdminTestV241-539222272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:16.015383 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4fafc8b1-1eb8-4c39-aa05-4a6bfc59e982 tempest-AggregatesAdminTestV241-539222272 tempest-AggregatesAdminTestV241-539222272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:16.022235 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4fafc8b1-1eb8-4c39-aa05-4a6bfc59e982 tempest-AggregatesAdminTestV241-539222272 tempest-AggregatesAdminTestV241-539222272-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.749568 Jun 05 08:23:16.023609 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1/1] 10.222.0.33 () {60 vars in 1207 bytes} [Sun Jun 5 08:23:14 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:23:16.527188 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6f1bbaa6-1cdf-48fb-8be8-9b6c6421173e tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1105599268", "ram": 512, "vcpus": 1, "disk": 10, "id": 1649659385, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:16.566402 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:16.566402 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:23:16.669494 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6f1bbaa6-1cdf-48fb-8be8-9b6c6421173e tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.642772 Jun 05 08:23:16.672824 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 2/2] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:23:16 2022] POST /compute/v2.1/flavors => generated 416 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:16.687002 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-37675ed8-26f9-4af1-8938-c25702cdfbe3 tempest-AggregatesAdminTestV241-539222272 tempest-AggregatesAdminTestV241-539222272-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-254257420"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:16.690772 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:16.690772 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:23:16.695370 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.aggregate [None req-37675ed8-26f9-4af1-8938-c25702cdfbe3 tempest-AggregatesAdminTestV241-539222272 tempest-AggregatesAdminTestV241-539222272-project-admin] Generated uuid a9f47f6b-90e2-4a95-a43a-60c7f3359bed for aggregate {{(pid=119049) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 05 08:23:16.845819 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-37675ed8-26f9-4af1-8938-c25702cdfbe3 tempest-AggregatesAdminTestV241-539222272 tempest-AggregatesAdminTestV241-539222272-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.171753 Jun 05 08:23:16.846458 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 3/3] 10.222.0.33 () {62 vars in 1204 bytes} [Sun Jun 5 08:23:16 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:23:17.004703 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d68f4e76-f1f1-4701-8f6b-68b17bfc4aa2 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Calling method '.version_select at 0x7f24421ad790>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:17.008138 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:17.008138 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:17.014998 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d68f4e76-f1f1-4701-8f6b-68b17bfc4aa2 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ceb8701a-c729-4596-86e5-c56dbc5a8933(cell1) {{(pid=119050) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jun 05 08:23:17.016175 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d68f4e76-f1f1-4701-8f6b-68b17bfc4aa2 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:17.016877 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d68f4e76-f1f1-4701-8f6b-68b17bfc4aa2 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:17.050242 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-00d7e127-5ccf-488f-9a6e-ff3d80e0f8aa tempest-AZAdminV2TestJSON-1132188316 tempest-AZAdminV2TestJSON-1132188316-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:17.052120 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-00d7e127-5ccf-488f-9a6e-ff3d80e0f8aa tempest-AZAdminV2TestJSON-1132188316 tempest-AZAdminV2TestJSON-1132188316-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:17.052770 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-00d7e127-5ccf-488f-9a6e-ff3d80e0f8aa tempest-AZAdminV2TestJSON-1132188316 tempest-AZAdminV2TestJSON-1132188316-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:17.053837 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-00d7e127-5ccf-488f-9a6e-ff3d80e0f8aa tempest-AZAdminV2TestJSON-1132188316 tempest-AZAdminV2TestJSON-1132188316-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:17.054669 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-00d7e127-5ccf-488f-9a6e-ff3d80e0f8aa tempest-AZAdminV2TestJSON-1132188316 tempest-AZAdminV2TestJSON-1132188316-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:17.104308 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d68f4e76-f1f1-4701-8f6b-68b17bfc4aa2 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:17.104960 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d68f4e76-f1f1-4701-8f6b-68b17bfc4aa2 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:17.135158 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d68f4e76-f1f1-4701-8f6b-68b17bfc4aa2 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:17.138362 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d68f4e76-f1f1-4701-8f6b-68b17bfc4aa2 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:17.151122 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d68f4e76-f1f1-4701-8f6b-68b17bfc4aa2 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.592265 Jun 05 08:23:17.155098 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-00d7e127-5ccf-488f-9a6e-ff3d80e0f8aa tempest-AZAdminV2TestJSON-1132188316 tempest-AZAdminV2TestJSON-1132188316-project-admin] 10.222.0.33 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.307169 Jun 05 08:23:17.156351 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1/4] 10.222.0.33 () {58 vars in 1166 bytes} [Sun Jun 5 08:23:15 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:17.169218 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 4/5] 10.222.0.33 () {58 vars in 1163 bytes} [Sun Jun 5 08:23:16 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:23:17.243167 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0f7035aa-b48f-4d26-93f1-f79b6acde8b5 tempest-FlavorsAccessTestJSON-1555492831 tempest-FlavorsAccessTestJSON-1555492831-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-833476340", "id": 723335268, "os-flavor-access:is_public": "False"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:17.245176 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:17.245176 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:23:17.277020 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0f7035aa-b48f-4d26-93f1-f79b6acde8b5 tempest-FlavorsAccessTestJSON-1555492831 tempest-FlavorsAccessTestJSON-1555492831-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.106036 Jun 05 08:23:17.285865 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 5/6] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:23:17 2022] POST /compute/v2.1/flavors => generated 427 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:17.371264 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1e53a3fd-fba9-4214-b8a8-672ed18624de tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-336997173", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:17.390249 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0a881bf7-ff0b-4c8f-a611-371ff245bfc2 tempest-AZAdminNegativeTestJSON-2088263056 tempest-AZAdminNegativeTestJSON-2088263056-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:17.391016 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:17.391016 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:17.391868 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0a881bf7-ff0b-4c8f-a611-371ff245bfc2 tempest-AZAdminNegativeTestJSON-2088263056 tempest-AZAdminNegativeTestJSON-2088263056-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '2c5ae590fd344a4897657d9962c9f0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a78ab1adbd1d47efb7b0e1945c76118c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:17.395418 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0a881bf7-ff0b-4c8f-a611-371ff245bfc2 tempest-AZAdminNegativeTestJSON-2088263056 tempest-AZAdminNegativeTestJSON-2088263056-project] Request method failure captured: Jun 05 08:23:17.395418 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jun 05 08:23:17.395418 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:23:17.395418 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:23:17.395418 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:23:17.395418 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:23:17.395418 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:23:17.395418 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:23:17.395418 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:23:17.395418 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:23:17.395418 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGfxKE35NIgkXX60OiooqRwYKNTN2zRX8C-tHgQnqp86JCr0em1sn4tH6x6rqdm85GhjZVKeDjgOKwLR5NU10D-NWsvHmmwPQCahzHwJe5HKzWKucBrkA21qbSHjLCvJ-WFSreyOlNmXjCzZoaHrx0IKIHmL-LSoz1ObiQqS7tNo7U0 Jun 05 08:23:17.395418 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:23:17.395418 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:23:17.395418 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:23:17.395418 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:23:17.395418 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:23:17.395418 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:23:17.395418 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: a78ab1adbd1d47efb7b0e1945c76118c Jun 05 08:23:17.395418 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-AZAdminNegativeTestJSON-2088263056 Jun 05 08:23:17.395418 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:23:17.395418 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:23:17.396463 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a78ab1adbd1d47efb7b0e1945c76118c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a78ab1adbd1d47efb7b0e1945c76118c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a78ab1adbd1d47efb7b0e1945c76118c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a78ab1adbd1d47efb7b0e1945c76118c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:23:17.396463 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-AZAdminNegativeTestJSON-2088263056 Jun 05 08:23:17.396463 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: a78ab1adbd1d47efb7b0e1945c76118c Jun 05 08:23:17.396463 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-2088263056 Jun 05 08:23:17.396463 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-AZAdminNegativeTestJSON-2088263056-project Jun 05 08:23:17.396463 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:23:17.396463 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:23:17.396463 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 2c5ae590fd344a4897657d9962c9f0c7 Jun 05 08:23:17.396463 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-AZAdminNegativeTestJSON-2088263056-project Jun 05 08:23:17.396463 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:23:17.396463 n-d-844739-1 devstack@n-api.service[119050]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jun 05 08:23:17.396463 n-d-844739-1 devstack@n-api.service[119050]: action_args: {} Jun 05 08:23:17.397067 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:23:17.397067 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:17.397067 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:17.397067 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:17.397067 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:23:17.397067 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:23:17.397067 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:23:17.397067 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:23:17.397067 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jun 05 08:23:17.397067 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jun 05 08:23:17.397067 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:23:17.397067 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:23:17.397067 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:23:17.397067 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:23:17.397067 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:23:17.397067 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:23:17.397067 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:23:17.397067 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:23:17.397067 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:23:17.398061 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:23:17.398061 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:23:17.398061 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:23:17.398061 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:23:17.398061 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:23:17.398061 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jun 05 08:23:17.398061 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:17.398061 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:17.398061 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:17.398061 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:17.398061 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:17.398061 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:17.398061 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:23:17.398061 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:23:17.398061 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jun 05 08:23:17.398061 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:17.398061 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0a881bf7-ff0b-4c8f-a611-371ff245bfc2 tempest-AZAdminNegativeTestJSON-2088263056 tempest-AZAdminNegativeTestJSON-2088263056-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:23:17.398855 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0a881bf7-ff0b-4c8f-a611-371ff245bfc2 tempest-AZAdminNegativeTestJSON-2088263056 tempest-AZAdminNegativeTestJSON-2088263056-project] 10.222.0.33 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.238928 Jun 05 08:23:17.404881 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 2/7] 10.222.0.33 () {58 vars in 1184 bytes} [Sun Jun 5 08:23:17 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 247 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:23:17.611953 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-038de7e2-c956-417e-8092-ea470f13d637 tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:17.672805 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-038de7e2-c956-417e-8092-ea470f13d637 tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760-project] HTTP exception thrown: Flavor 1649659385 has no extra specs with key hw:cpu_thread_policy. Jun 05 08:23:17.674464 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-038de7e2-c956-417e-8092-ea470f13d637 tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760-project] Request method failure captured: Jun 05 08:23:17.674464 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/flavors/1649659385/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jun 05 08:23:17.674464 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:23:17.674464 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:23:17.674464 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:23:17.674464 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:23:17.674464 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:23:17.674464 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:23:17.674464 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:23:17.674464 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:23:17.674464 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGfw1jFYTHk7PU1R2U18VilBRO992jv5Y8NEdIPeqlWJaaOrdJYxpKHmQCKb3zq52flvT3KW1H_TGFhpzzCktIkZovkJD_D5wiMOyDw78hhxYLQarDsBjy6lrGl0HZii_nTXnz8UnHInvpFT2sqF3pxKfj0acFxDyHviAIBs4urWbyI Jun 05 08:23:17.674464 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:23:17.674464 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:23:17.674464 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:23:17.674464 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:23:17.674464 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:23:17.674464 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:23:17.674464 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: ae1e291c303d44fe98a2eff4cde9b8da Jun 05 08:23:17.674464 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 Jun 05 08:23:17.674464 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:23:17.674464 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:23:17.675457 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ae1e291c303d44fe98a2eff4cde9b8da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ae1e291c303d44fe98a2eff4cde9b8da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ae1e291c303d44fe98a2eff4cde9b8da", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ae1e291c303d44fe98a2eff4cde9b8da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:23:17.675457 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 Jun 05 08:23:17.675457 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: ae1e291c303d44fe98a2eff4cde9b8da Jun 05 08:23:17.675457 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 Jun 05 08:23:17.675457 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760-project Jun 05 08:23:17.675457 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:23:17.675457 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:23:17.675457 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 5b787a11e98f47919c30bbef45aec85c Jun 05 08:23:17.675457 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760-project Jun 05 08:23:17.675457 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:23:17.675457 n-d-844739-1 devstack@n-api.service[119050]: exception: Flavor 1649659385 has no extra specs with key hw:cpu_thread_policy. Jun 05 08:23:17.675979 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'flavor_id': '1649659385', 'id': 'hw:cpu_thread_policy'} Jun 05 08:23:17.675979 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:23:17.675979 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:17.675979 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jun 05 08:23:17.675979 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jun 05 08:23:17.675979 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jun 05 08:23:17.675979 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:17.675979 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:17.675979 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:17.675979 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:17.675979 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:17.675979 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:17.675979 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:23:17.675979 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:23:17.675979 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:23:17.675979 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:23:17.675979 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jun 05 08:23:17.675979 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 05 08:23:17.675979 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1649659385 has no extra specs with key hw:cpu_thread_policy. Jun 05 08:23:17.675979 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:17.675979 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:17.675979 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:17.676959 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:17.676959 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:17.676959 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:17.676959 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:23:17.676959 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:23:17.676959 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1649659385 has no extra specs with key hw:cpu_thread_policy. Jun 05 08:23:17.676959 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:17.676959 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-038de7e2-c956-417e-8092-ea470f13d637 tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760-project] Returning 404 to user: Flavor 1649659385 has no extra specs with key hw:cpu_thread_policy. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:23:17.676959 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-038de7e2-c956-417e-8092-ea470f13d637 tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760-project] 10.222.0.33 "GET /compute/v2.1/flavors/1649659385/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.270004 Jun 05 08:23:17.688223 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 3/8] 10.222.0.33 () {58 vars in 1265 bytes} [Sun Jun 5 08:23:17 2022] GET /compute/v2.1/flavors/1649659385/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 279 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:23:17.699468 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cd9e01d6-b834-4ff1-98a2-b40bf2d20b27 tempest-AggregatesAdminTestV241-539222272 tempest-AggregatesAdminTestV241-539222272-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1692066336"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:17.860713 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:17.860713 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:18.029132 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-cd9e01d6-b834-4ff1-98a2-b40bf2d20b27 tempest-AggregatesAdminTestV241-539222272 tempest-AggregatesAdminTestV241-539222272-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.337796 Jun 05 08:23:18.032208 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 4/9] 10.222.0.33 () {62 vars in 1209 bytes} [Sun Jun 5 08:23:17 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:23:18.041381 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-73c60120-392d-44b4-9a39-e9c3b9043428 tempest-AZAdminV2TestJSON-1132188316 tempest-AZAdminV2TestJSON-1132188316-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:18.047530 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:18.047530 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:18.051438 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-73c60120-392d-44b4-9a39-e9c3b9043428 tempest-AZAdminV2TestJSON-1132188316 tempest-AZAdminV2TestJSON-1132188316-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:18.055419 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-73c60120-392d-44b4-9a39-e9c3b9043428 tempest-AZAdminV2TestJSON-1132188316 tempest-AZAdminV2TestJSON-1132188316-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:18.060296 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-73c60120-392d-44b4-9a39-e9c3b9043428 tempest-AZAdminV2TestJSON-1132188316 tempest-AZAdminV2TestJSON-1132188316-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:18.062055 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-73c60120-392d-44b4-9a39-e9c3b9043428 tempest-AZAdminV2TestJSON-1132188316 tempest-AZAdminV2TestJSON-1132188316-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:18.117580 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-73c60120-392d-44b4-9a39-e9c3b9043428 tempest-AZAdminV2TestJSON-1132188316 tempest-AZAdminV2TestJSON-1132188316-project-admin] 10.222.0.33 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.083261 Jun 05 08:23:18.118681 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 5/10] 10.222.0.33 () {58 vars in 1184 bytes} [Sun Jun 5 08:23:18 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:18.123321 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b9d2df0b-154b-4ca4-8590-2ec7dec4d91a tempest-FlavorsAccessTestJSON-1555492831 tempest-FlavorsAccessTestJSON-1555492831-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5040793c21ee45eda3847ae5af1efab0"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:18.124821 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:18.124821 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:18.245693 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-1e53a3fd-fba9-4214-b8a8-672ed18624de tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] validate_networks() for None {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:23:18.617573 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b9d2df0b-154b-4ca4-8590-2ec7dec4d91a tempest-FlavorsAccessTestJSON-1555492831 tempest-FlavorsAccessTestJSON-1555492831-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/723335268/action" status: 200 len: 96 microversion: 2.1 time: 0.497446 Jun 05 08:23:18.618765 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 6/11] 10.222.0.33 () {60 vars in 1196 bytes} [Sun Jun 5 08:23:18 2022] POST /compute/v2.1/flavors/723335268/action => generated 96 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:23:18.624185 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d64e25f8-eb5c-4f65-af21-a61c807b998e tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:18.626007 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:18.626007 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:18.627124 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d64e25f8-eb5c-4f65-af21-a61c807b998e tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '5b787a11e98f47919c30bbef45aec85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e291c303d44fe98a2eff4cde9b8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:18.629372 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d64e25f8-eb5c-4f65-af21-a61c807b998e tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760-project] Request method failure captured: Jun 05 08:23:18.629372 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/flavors/1649659385/os-extra_specs HTTP/1.1 Jun 05 08:23:18.629372 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:23:18.629372 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:23:18.629372 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:23:18.629372 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 66 Jun 05 08:23:18.629372 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:23:18.629372 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:23:18.629372 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:23:18.629372 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:23:18.629372 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGfw1jFYTHk7PU1R2U18VilBRO992jv5Y8NEdIPeqlWJaaOrdJYxpKHmQCKb3zq52flvT3KW1H_TGFhpzzCktIkZovkJD_D5wiMOyDw78hhxYLQarDsBjy6lrGl0HZii_nTXnz8UnHInvpFT2sqF3pxKfj0acFxDyHviAIBs4urWbyI Jun 05 08:23:18.629372 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:23:18.629372 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:23:18.629372 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:23:18.629372 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:23:18.629372 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:23:18.629372 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:23:18.629372 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: ae1e291c303d44fe98a2eff4cde9b8da Jun 05 08:23:18.629372 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 Jun 05 08:23:18.629372 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:23:18.629372 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:23:18.630511 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ae1e291c303d44fe98a2eff4cde9b8da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ae1e291c303d44fe98a2eff4cde9b8da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ae1e291c303d44fe98a2eff4cde9b8da", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ae1e291c303d44fe98a2eff4cde9b8da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:23:18.630511 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 Jun 05 08:23:18.630511 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: ae1e291c303d44fe98a2eff4cde9b8da Jun 05 08:23:18.630511 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 Jun 05 08:23:18.630511 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760-project Jun 05 08:23:18.630511 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:23:18.630511 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:23:18.630511 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 5b787a11e98f47919c30bbef45aec85c Jun 05 08:23:18.630511 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760-project Jun 05 08:23:18.630511 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:23:18.630511 n-d-844739-1 devstack@n-api.service[119050]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jun 05 08:23:18.630511 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:23:18.631054 n-d-844739-1 devstack@n-api.service[119050]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jun 05 08:23:18.631054 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'flavor_id': '1649659385', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jun 05 08:23:18.631054 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:23:18.631054 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:18.631054 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:18.631054 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:18.631054 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:23:18.631054 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:23:18.631054 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:23:18.631054 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:23:18.631054 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:23:18.631054 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:23:18.631054 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jun 05 08:23:18.631054 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jun 05 08:23:18.631054 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:23:18.631054 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:23:18.631054 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:23:18.631054 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:23:18.631054 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:23:18.631887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:23:18.631887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:23:18.631887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:23:18.631887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:23:18.631887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:23:18.631887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:23:18.631887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:23:18.631887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:23:18.631887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:23:18.631887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jun 05 08:23:18.631887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:18.631887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:18.631887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:18.631887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:18.631887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:18.631887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:18.631887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:23:18.631887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:23:18.631887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jun 05 08:23:18.631887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:18.633371 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d64e25f8-eb5c-4f65-af21-a61c807b998e tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:23:18.633371 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d64e25f8-eb5c-4f65-af21-a61c807b998e tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760-project] 10.222.0.33 "POST /compute/v2.1/flavors/1649659385/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.011009 Jun 05 08:23:18.636799 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 7/12] 10.222.0.33 () {60 vars in 1223 bytes} [Sun Jun 5 08:23:18 2022] POST /compute/v2.1/flavors/1649659385/os-extra_specs => generated 124 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:23:18.642553 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c30222cd-231e-43a3-8722-707e5d251114 tempest-AggregatesAdminTestV241-539222272 tempest-AggregatesAdminTestV241-539222272-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:18.643472 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:18.643472 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:18.653489 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c30222cd-231e-43a3-8722-707e5d251114 tempest-AggregatesAdminTestV241-539222272 tempest-AggregatesAdminTestV241-539222272-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.015312 Jun 05 08:23:18.654984 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 8/13] 10.222.0.33 () {60 vars in 1189 bytes} [Sun Jun 5 08:23:18 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:23:19.005221 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-018b8074-564a-419a-8211-c6a89431c5e4 tempest-FlavorsAccessTestJSON-1164421732 tempest-FlavorsAccessTestJSON-1164421732-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:19.030647 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-1e53a3fd-fba9-4214-b8a8-672ed18624de tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:23:19.031088 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-1e53a3fd-fba9-4214-b8a8-672ed18624de tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:23:19.031550 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-1e53a3fd-fba9-4214-b8a8-672ed18624de tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:23:19.031970 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-1e53a3fd-fba9-4214-b8a8-672ed18624de tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:23:19.032439 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-1e53a3fd-fba9-4214-b8a8-672ed18624de tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:23:19.072686 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1e53a3fd-fba9-4214-b8a8-672ed18624de tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:19.073144 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1e53a3fd-fba9-4214-b8a8-672ed18624de tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:19.073976 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1e53a3fd-fba9-4214-b8a8-672ed18624de tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:19.074427 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1e53a3fd-fba9-4214-b8a8-672ed18624de tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:19.074643 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-018b8074-564a-419a-8211-c6a89431c5e4 tempest-FlavorsAccessTestJSON-1164421732 tempest-FlavorsAccessTestJSON-1164421732-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.418272 Jun 05 08:23:19.077310 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 9/14] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:23:18 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:19.086903 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-610f867b-cc9c-405c-9459-0238eb806413 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:19.088216 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:19.088216 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:19.162255 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-1e53a3fd-fba9-4214-b8a8-672ed18624de tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Getting quotas for project 1ff420b4eb2442d3b779708d6fe78c1e. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:23:19.169007 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-610f867b-cc9c-405c-9459-0238eb806413 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1649659385/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.090569 Jun 05 08:23:19.174164 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 10/15] 10.222.0.33 () {60 vars in 1223 bytes} [Sun Jun 5 08:23:19 2022] POST /compute/v2.1/flavors/1649659385/os-extra_specs => generated 66 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:23:19.178589 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-1e53a3fd-fba9-4214-b8a8-672ed18624de tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Getting quotas for user 937d94e450c7457483bc6f6a03332644 and project 1ff420b4eb2442d3b779708d6fe78c1e. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:23:19.179557 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cd66d1d2-2372-4449-a17d-4781e2ff2c11 tempest-AggregatesAdminTestV241-539222272 tempest-AggregatesAdminTestV241-539222272-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-844739-1"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:19.182089 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:19.182089 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:19.192621 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cd66d1d2-2372-4449-a17d-4781e2ff2c11 tempest-AggregatesAdminTestV241-539222272 tempest-AggregatesAdminTestV241-539222272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:19.193530 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cd66d1d2-2372-4449-a17d-4781e2ff2c11 tempest-AggregatesAdminTestV241-539222272 tempest-AggregatesAdminTestV241-539222272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:19.220949 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1e53a3fd-fba9-4214-b8a8-672ed18624de tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:23:19.242321 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1e53a3fd-fba9-4214-b8a8-672ed18624de tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:23:19.350589 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1e53a3fd-fba9-4214-b8a8-672ed18624de tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.063018 Jun 05 08:23:19.357506 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 6/16] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:23:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:23:19.369480 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-10cae2a6-962a-426c-b3d6-fea9f6bc9b96 tempest-FlavorsAccessTestJSON-1555492831 tempest-FlavorsAccessTestJSON-1555492831-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5040793c21ee45eda3847ae5af1efab0"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:19.374030 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:19.374030 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:23:19.894268 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-10cae2a6-962a-426c-b3d6-fea9f6bc9b96 tempest-FlavorsAccessTestJSON-1555492831 tempest-FlavorsAccessTestJSON-1555492831-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/723335268/action" status: 200 len: 21 microversion: 2.1 time: 0.534521 Jun 05 08:23:19.895419 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 7/17] 10.222.0.33 () {60 vars in 1196 bytes} [Sun Jun 5 08:23:19 2022] POST /compute/v2.1/flavors/723335268/action => generated 21 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:23:19.904352 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5234aa2b-8086-4c92-aa38-59da9cd90faa tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:19.905591 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:19.905591 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:23:19.906751 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5234aa2b-8086-4c92-aa38-59da9cd90faa tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '5b787a11e98f47919c30bbef45aec85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e291c303d44fe98a2eff4cde9b8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:19.910192 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5234aa2b-8086-4c92-aa38-59da9cd90faa tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760-project] Request method failure captured: Jun 05 08:23:19.910192 n-d-844739-1 devstack@n-api.service[119049]: request: DELETE /compute/v2.1/flavors/1649659385/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 05 08:23:19.910192 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:23:19.910192 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:23:19.910192 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:23:19.910192 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:23:19.910192 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:23:19.910192 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:23:19.910192 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:23:19.910192 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:23:19.910192 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGfw1jFYTHk7PU1R2U18VilBRO992jv5Y8NEdIPeqlWJaaOrdJYxpKHmQCKb3zq52flvT3KW1H_TGFhpzzCktIkZovkJD_D5wiMOyDw78hhxYLQarDsBjy6lrGl0HZii_nTXnz8UnHInvpFT2sqF3pxKfj0acFxDyHviAIBs4urWbyI Jun 05 08:23:19.910192 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:23:19.910192 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:23:19.910192 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:23:19.910192 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:23:19.910192 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:23:19.910192 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:23:19.910192 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: ae1e291c303d44fe98a2eff4cde9b8da Jun 05 08:23:19.910192 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 Jun 05 08:23:19.910192 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:23:19.910192 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:23:19.911876 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ae1e291c303d44fe98a2eff4cde9b8da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ae1e291c303d44fe98a2eff4cde9b8da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ae1e291c303d44fe98a2eff4cde9b8da", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ae1e291c303d44fe98a2eff4cde9b8da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:23:19.911876 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 Jun 05 08:23:19.911876 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: ae1e291c303d44fe98a2eff4cde9b8da Jun 05 08:23:19.911876 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 Jun 05 08:23:19.911876 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760-project Jun 05 08:23:19.911876 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:23:19.911876 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:23:19.911876 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 5b787a11e98f47919c30bbef45aec85c Jun 05 08:23:19.911876 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760-project Jun 05 08:23:19.911876 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:23:19.911876 n-d-844739-1 devstack@n-api.service[119049]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jun 05 08:23:19.912823 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'flavor_id': '1649659385', 'id': 'hw:numa_nodes'} Jun 05 08:23:19.912823 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:23:19.912823 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:19.912823 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:19.912823 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:19.912823 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:23:19.912823 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:23:19.912823 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:23:19.912823 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:23:19.912823 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jun 05 08:23:19.912823 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jun 05 08:23:19.912823 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:23:19.912823 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:23:19.912823 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:23:19.912823 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:23:19.912823 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:23:19.912823 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:23:19.912823 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:23:19.912823 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:23:19.912823 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:23:19.914425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:23:19.914425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:23:19.914425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:23:19.914425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:23:19.914425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:23:19.914425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jun 05 08:23:19.914425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:19.914425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:19.914425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:19.914425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:19.914425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:19.914425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:19.914425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:23:19.914425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:23:19.914425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jun 05 08:23:19.914425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:19.917165 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5234aa2b-8086-4c92-aa38-59da9cd90faa tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:23:19.918304 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5234aa2b-8086-4c92-aa38-59da9cd90faa tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760-project] 10.222.0.33 "DELETE /compute/v2.1/flavors/1649659385/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.021507 Jun 05 08:23:19.923632 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 8/18] 10.222.0.33 () {58 vars in 1247 bytes} [Sun Jun 5 08:23:19 2022] DELETE /compute/v2.1/flavors/1649659385/os-extra_specs/hw:numa_nodes => generated 124 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:23:19.929293 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3b9b9025-c313-416e-bdbe-5d86d821ca79 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:19.930244 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3b9b9025-c313-416e-bdbe-5d86d821ca79 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:20.045009 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3b9b9025-c313-416e-bdbe-5d86d821ca79 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:20.069161 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3b9b9025-c313-416e-bdbe-5d86d821ca79 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 200 len: 1219 microversion: 2.1 time: 0.144095 Jun 05 08:23:20.077486 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 9/19] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:19 2022] GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 1219 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:20.084196 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2a975cbf-cf41-4f52-afa6-3bf1d5c3a222 tempest-FlavorsAccessTestJSON-1164421732 tempest-FlavorsAccessTestJSON-1164421732-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:20.123045 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2a975cbf-cf41-4f52-afa6-3bf1d5c3a222 tempest-FlavorsAccessTestJSON-1164421732 tempest-FlavorsAccessTestJSON-1164421732-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.044263 Jun 05 08:23:20.124514 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 10/20] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:23:20 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:20.130588 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8cc554d3-eded-4398-992a-af081c62e246 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:20.133069 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:20.133069 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:23:20.191918 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8cc554d3-eded-4398-992a-af081c62e246 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1649659385/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.065920 Jun 05 08:23:20.193000 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 11/21] 10.222.0.33 () {60 vars in 1223 bytes} [Sun Jun 5 08:23:20 2022] POST /compute/v2.1/flavors/1649659385/os-extra_specs => generated 66 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:23:20.203487 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5dd14fe8-e5f0-459e-a8d9-96d8c8b55e55 tempest-FlavorsAccessTestJSON-1555492831 tempest-FlavorsAccessTestJSON-1555492831-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:20.207797 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:20.207797 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:23:20.284998 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5dd14fe8-e5f0-459e-a8d9-96d8c8b55e55 tempest-FlavorsAccessTestJSON-1555492831 tempest-FlavorsAccessTestJSON-1555492831-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/723335268" status: 202 len: 0 microversion: 2.1 time: 0.088876 Jun 05 08:23:20.289674 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-cd66d1d2-2372-4449-a17d-4781e2ff2c11 tempest-AggregatesAdminTestV241-539222272 tempest-AggregatesAdminTestV241-539222272-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.41 time: 1.114110 Jun 05 08:23:20.290856 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 11/22] 10.222.0.33 () {62 vars in 1231 bytes} [Sun Jun 5 08:23:19 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:23:20.296280 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 12/23] 10.222.0.33 () {58 vars in 1157 bytes} [Sun Jun 5 08:23:20 2022] DELETE /compute/v2.1/flavors/723335268 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:23:20.300117 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9900775e-66a3-4816-8f70-e5a1451e70b1 tempest-FlavorsAccessTestJSON-1555492831 tempest-FlavorsAccessTestJSON-1555492831-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:20.303213 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-563c6f22-eb5d-4278-a3f8-12999101f54c tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:20.306928 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:20.306928 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:23:20.307928 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-563c6f22-eb5d-4278-a3f8-12999101f54c tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '5b787a11e98f47919c30bbef45aec85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1e291c303d44fe98a2eff4cde9b8da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:20.314304 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-563c6f22-eb5d-4278-a3f8-12999101f54c tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760-project] Request method failure captured: Jun 05 08:23:20.314304 n-d-844739-1 devstack@n-api.service[119049]: request: PUT /compute/v2.1/flavors/1649659385/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 05 08:23:20.314304 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:23:20.314304 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:23:20.314304 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:23:20.314304 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 22 Jun 05 08:23:20.314304 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:23:20.314304 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:23:20.314304 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:23:20.314304 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:23:20.314304 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGfw1jFYTHk7PU1R2U18VilBRO992jv5Y8NEdIPeqlWJaaOrdJYxpKHmQCKb3zq52flvT3KW1H_TGFhpzzCktIkZovkJD_D5wiMOyDw78hhxYLQarDsBjy6lrGl0HZii_nTXnz8UnHInvpFT2sqF3pxKfj0acFxDyHviAIBs4urWbyI Jun 05 08:23:20.314304 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:23:20.314304 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:23:20.314304 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:23:20.314304 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:23:20.314304 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:23:20.314304 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:23:20.314304 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: ae1e291c303d44fe98a2eff4cde9b8da Jun 05 08:23:20.314304 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 Jun 05 08:23:20.314304 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:23:20.314304 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:23:20.315365 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ae1e291c303d44fe98a2eff4cde9b8da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ae1e291c303d44fe98a2eff4cde9b8da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ae1e291c303d44fe98a2eff4cde9b8da", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ae1e291c303d44fe98a2eff4cde9b8da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:23:20.315365 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 Jun 05 08:23:20.315365 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: ae1e291c303d44fe98a2eff4cde9b8da Jun 05 08:23:20.315365 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 Jun 05 08:23:20.315365 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760-project Jun 05 08:23:20.315365 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:23:20.315365 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:23:20.315365 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 5b787a11e98f47919c30bbef45aec85c Jun 05 08:23:20.315365 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760-project Jun 05 08:23:20.315365 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:23:20.315365 n-d-844739-1 devstack@n-api.service[119049]: {"hw:numa_nodes": "1"} Jun 05 08:23:20.315365 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:23:20.315365 n-d-844739-1 devstack@n-api.service[119049]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jun 05 08:23:20.315972 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'flavor_id': '1649659385', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jun 05 08:23:20.315972 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:23:20.315972 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:20.315972 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:20.315972 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:20.315972 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:23:20.315972 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:23:20.315972 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:23:20.315972 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:23:20.315972 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:23:20.315972 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:23:20.315972 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jun 05 08:23:20.315972 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jun 05 08:23:20.315972 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:23:20.315972 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:23:20.315972 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:23:20.315972 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:23:20.315972 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:23:20.315972 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:23:20.316911 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:23:20.316911 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:23:20.316911 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:23:20.316911 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:23:20.316911 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:23:20.316911 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:23:20.316911 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:23:20.316911 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:23:20.316911 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jun 05 08:23:20.316911 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:20.316911 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:20.316911 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:20.316911 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:20.316911 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:20.316911 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:20.316911 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:23:20.316911 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:23:20.316911 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jun 05 08:23:20.316911 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:20.317783 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-563c6f22-eb5d-4278-a3f8-12999101f54c tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:23:20.317783 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-563c6f22-eb5d-4278-a3f8-12999101f54c tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760 tempest-FlavorsExtraSpecsNegativeTestJSON-1089855760-project] 10.222.0.33 "PUT /compute/v2.1/flavors/1649659385/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.022822 Jun 05 08:23:20.319404 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 13/24] 10.222.0.33 () {60 vars in 1264 bytes} [Sun Jun 5 08:23:20 2022] PUT /compute/v2.1/flavors/1649659385/os-extra_specs/hw:numa_nodes => generated 124 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:23:20.338377 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3f408aee-b837-492d-9e88-1592173c2d25 tempest-AggregatesAdminTestV241-539222272 tempest-AggregatesAdminTestV241-539222272-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-844739-1"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:20.340154 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:20.340154 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:23:20.356749 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9900775e-66a3-4816-8f70-e5a1451e70b1 tempest-FlavorsAccessTestJSON-1555492831 tempest-FlavorsAccessTestJSON-1555492831-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.062872 Jun 05 08:23:20.357737 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 12/25] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:23:20 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:20.362175 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3f408aee-b837-492d-9e88-1592173c2d25 tempest-AggregatesAdminTestV241-539222272 tempest-AggregatesAdminTestV241-539222272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:20.364237 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3f408aee-b837-492d-9e88-1592173c2d25 tempest-AggregatesAdminTestV241-539222272 tempest-AggregatesAdminTestV241-539222272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:20.366078 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-191d5e18-acd9-40ce-bfd5-b8f0c067201d tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:20.370933 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:20.370933 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:20.394683 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-191d5e18-acd9-40ce-bfd5-b8f0c067201d tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620-project-admin] HTTP exception thrown: Flavor 1649659385 has no extra specs with key hw:cpu_thread_policy. Jun 05 08:23:20.396663 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-191d5e18-acd9-40ce-bfd5-b8f0c067201d tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620-project-admin] Request method failure captured: Jun 05 08:23:20.396663 n-d-844739-1 devstack@n-api.service[119050]: request: DELETE /compute/v2.1/flavors/1649659385/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jun 05 08:23:20.396663 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:23:20.396663 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:23:20.396663 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:23:20.396663 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:23:20.396663 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:23:20.396663 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:23:20.396663 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:23:20.396663 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:23:20.396663 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGfzgsW84POfN7275eMQzDFI3XoCoSLd7A2fTM-CrMWRRQplJcp44TCUqXVJBlgoHxYdCB-bw8iHVVlK4P4wRSu8FF9sKKri5z5sEKcU-gpYhA_Ocu1NFRCp1ivLghViRUb-xwSo3sFIgbgW2mLAbKbXHKtKbr9E9TB7K5lDGJMngBw Jun 05 08:23:20.396663 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:23:20.396663 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:23:20.396663 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:23:20.396663 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:23:20.396663 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:23:20.396663 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:23:20.396663 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 79fcd8f5d9ed4f46bb6ffa4b35c99b2c Jun 05 08:23:20.396663 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 Jun 05 08:23:20.396663 n-d-844739-1 devstack@n-api.service[119050]: X-Role: admin,reader,member Jun 05 08:23:20.396663 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: admin,reader,member Jun 05 08:23:20.398027 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/79fcd8f5d9ed4f46bb6ffa4b35c99b2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/79fcd8f5d9ed4f46bb6ffa4b35c99b2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_79fcd8f5d9ed4f46bb6ffa4b35c99b2c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/79fcd8f5d9ed4f46bb6ffa4b35c99b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:23:20.398027 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 Jun 05 08:23:20.398027 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 79fcd8f5d9ed4f46bb6ffa4b35c99b2c Jun 05 08:23:20.398027 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 Jun 05 08:23:20.398027 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620-project-admin Jun 05 08:23:20.398027 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:23:20.398027 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:23:20.398027 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: f4e572297e7e445c9876f33a41f65f98 Jun 05 08:23:20.398027 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620-project-admin Jun 05 08:23:20.398027 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:23:20.398027 n-d-844739-1 devstack@n-api.service[119050]: exception: Flavor 1649659385 has no extra specs with key hw:cpu_thread_policy. Jun 05 08:23:20.398681 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'flavor_id': '1649659385', 'id': 'hw:cpu_thread_policy'} Jun 05 08:23:20.398681 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:23:20.398681 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:20.398681 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jun 05 08:23:20.398681 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jun 05 08:23:20.398681 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jun 05 08:23:20.398681 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:20.398681 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:20.398681 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:20.398681 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:20.398681 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:20.398681 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:20.398681 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:23:20.398681 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:23:20.398681 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:23:20.398681 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:23:20.398681 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jun 05 08:23:20.398681 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 05 08:23:20.398681 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1649659385 has no extra specs with key hw:cpu_thread_policy. Jun 05 08:23:20.398681 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:20.398681 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:20.398681 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:20.399904 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:20.399904 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:20.399904 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:20.399904 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:23:20.399904 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:23:20.399904 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1649659385 has no extra specs with key hw:cpu_thread_policy. Jun 05 08:23:20.399904 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:20.400842 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-191d5e18-acd9-40ce-bfd5-b8f0c067201d tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620-project-admin] Returning 404 to user: Flavor 1649659385 has no extra specs with key hw:cpu_thread_policy. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:23:20.401811 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-191d5e18-acd9-40ce-bfd5-b8f0c067201d tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1649659385/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.043400 Jun 05 08:23:20.407324 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 13/26] 10.222.0.33 () {58 vars in 1268 bytes} [Sun Jun 5 08:23:20 2022] DELETE /compute/v2.1/flavors/1649659385/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:23:20.412326 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cc986adf-9cd3-48b8-9845-da126358057c tempest-FlavorsAccessTestJSON-1555492831 tempest-FlavorsAccessTestJSON-1555492831-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-2002154112", "id": 644842593, "os-flavor-access:is_public": "False"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:20.435650 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:20.435650 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:20.463503 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-cc986adf-9cd3-48b8-9845-da126358057c tempest-FlavorsAccessTestJSON-1555492831 tempest-FlavorsAccessTestJSON-1555492831-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.054965 Jun 05 08:23:20.464565 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 14/27] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:23:20 2022] POST /compute/v2.1/flavors => generated 428 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:20.486409 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e15a1ce8-fcdf-4f19-8d55-76f7d3bf4f35 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:20.495513 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:20.495513 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:20.496975 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-e15a1ce8-fcdf-4f19-8d55-76f7d3bf4f35 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620-project-admin] HTTP exception thrown: Request body and URI mismatch Jun 05 08:23:20.498789 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e15a1ce8-fcdf-4f19-8d55-76f7d3bf4f35 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620-project-admin] Request method failure captured: Jun 05 08:23:20.498789 n-d-844739-1 devstack@n-api.service[119050]: request: PUT /compute/v2.1/flavors/1649659385/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 05 08:23:20.498789 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:23:20.498789 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:23:20.498789 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:23:20.498789 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 27 Jun 05 08:23:20.498789 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:23:20.498789 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:23:20.498789 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:23:20.498789 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:23:20.498789 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGfzgsW84POfN7275eMQzDFI3XoCoSLd7A2fTM-CrMWRRQplJcp44TCUqXVJBlgoHxYdCB-bw8iHVVlK4P4wRSu8FF9sKKri5z5sEKcU-gpYhA_Ocu1NFRCp1ivLghViRUb-xwSo3sFIgbgW2mLAbKbXHKtKbr9E9TB7K5lDGJMngBw Jun 05 08:23:20.498789 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:23:20.498789 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:23:20.498789 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:23:20.498789 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:23:20.498789 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:23:20.498789 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:23:20.498789 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 79fcd8f5d9ed4f46bb6ffa4b35c99b2c Jun 05 08:23:20.498789 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 Jun 05 08:23:20.498789 n-d-844739-1 devstack@n-api.service[119050]: X-Role: admin,reader,member Jun 05 08:23:20.498789 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: admin,reader,member Jun 05 08:23:20.499876 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/79fcd8f5d9ed4f46bb6ffa4b35c99b2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/79fcd8f5d9ed4f46bb6ffa4b35c99b2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_79fcd8f5d9ed4f46bb6ffa4b35c99b2c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/79fcd8f5d9ed4f46bb6ffa4b35c99b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:23:20.499876 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 Jun 05 08:23:20.499876 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 79fcd8f5d9ed4f46bb6ffa4b35c99b2c Jun 05 08:23:20.499876 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 Jun 05 08:23:20.499876 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620-project-admin Jun 05 08:23:20.499876 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:23:20.499876 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:23:20.499876 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: f4e572297e7e445c9876f33a41f65f98 Jun 05 08:23:20.499876 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620-project-admin Jun 05 08:23:20.499876 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:23:20.499876 n-d-844739-1 devstack@n-api.service[119050]: {"hw:cpu_policy": "shared"} Jun 05 08:23:20.499876 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:23:20.499876 n-d-844739-1 devstack@n-api.service[119050]: exception: Request body and URI mismatch Jun 05 08:23:20.500682 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'flavor_id': '1649659385', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jun 05 08:23:20.500682 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:23:20.500682 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:20.500682 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:20.500682 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:20.500682 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:23:20.500682 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:23:20.500682 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:23:20.500682 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:23:20.500682 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:23:20.500682 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:23:20.500682 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jun 05 08:23:20.500682 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jun 05 08:23:20.500682 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jun 05 08:23:20.500682 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:20.500682 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:20.500682 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:20.500682 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:20.500682 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:20.500682 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:20.501708 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:23:20.501708 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:23:20.501708 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jun 05 08:23:20.501708 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:20.501708 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e15a1ce8-fcdf-4f19-8d55-76f7d3bf4f35 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:23:20.501708 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e15a1ce8-fcdf-4f19-8d55-76f7d3bf4f35 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/1649659385/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.034518 Jun 05 08:23:20.506701 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 15/28] 10.222.0.33 () {60 vars in 1264 bytes} [Sun Jun 5 08:23:20 2022] PUT /compute/v2.1/flavors/1649659385/os-extra_specs/hw:numa_nodes => generated 73 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 05 08:23:20.514296 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-91785c3f-c1ae-42d4-ab6d-1e2b38e098d9 tempest-FlavorsAccessTestJSON-1555492831 tempest-FlavorsAccessTestJSON-1555492831-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:20.521203 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:20.521203 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:20.548355 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-91785c3f-c1ae-42d4-ab6d-1e2b38e098d9 tempest-FlavorsAccessTestJSON-1555492831 tempest-FlavorsAccessTestJSON-1555492831-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/644842593/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.037196 Jun 05 08:23:20.549392 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 16/29] 10.222.0.33 () {58 vars in 1205 bytes} [Sun Jun 5 08:23:20 2022] GET /compute/v2.1/flavors/644842593/os-flavor-access => generated 21 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:23:20.558070 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d0fd3bf0-457a-49b5-9980-8dba481ab05f tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:20.575946 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d0fd3bf0-457a-49b5-9980-8dba481ab05f tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620-project-admin] Request method failure captured: Jun 05 08:23:20.575946 n-d-844739-1 devstack@n-api.service[119050]: request: PUT /compute/v2.1/flavors/1649659385/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 05 08:23:20.575946 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:23:20.575946 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:23:20.575946 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:23:20.575946 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 49 Jun 05 08:23:20.575946 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:23:20.575946 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:23:20.575946 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:23:20.575946 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:23:20.575946 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGfzgsW84POfN7275eMQzDFI3XoCoSLd7A2fTM-CrMWRRQplJcp44TCUqXVJBlgoHxYdCB-bw8iHVVlK4P4wRSu8FF9sKKri5z5sEKcU-gpYhA_Ocu1NFRCp1ivLghViRUb-xwSo3sFIgbgW2mLAbKbXHKtKbr9E9TB7K5lDGJMngBw Jun 05 08:23:20.575946 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:23:20.575946 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:23:20.575946 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:23:20.575946 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:23:20.575946 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:23:20.575946 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:23:20.575946 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 79fcd8f5d9ed4f46bb6ffa4b35c99b2c Jun 05 08:23:20.575946 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 Jun 05 08:23:20.575946 n-d-844739-1 devstack@n-api.service[119050]: X-Role: admin,reader,member Jun 05 08:23:20.575946 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: admin,reader,member Jun 05 08:23:20.577279 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/79fcd8f5d9ed4f46bb6ffa4b35c99b2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/79fcd8f5d9ed4f46bb6ffa4b35c99b2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_79fcd8f5d9ed4f46bb6ffa4b35c99b2c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/79fcd8f5d9ed4f46bb6ffa4b35c99b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:23:20.577279 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 Jun 05 08:23:20.577279 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 79fcd8f5d9ed4f46bb6ffa4b35c99b2c Jun 05 08:23:20.577279 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 Jun 05 08:23:20.577279 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620-project-admin Jun 05 08:23:20.577279 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:23:20.577279 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:23:20.577279 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: f4e572297e7e445c9876f33a41f65f98 Jun 05 08:23:20.577279 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620-project-admin Jun 05 08:23:20.577279 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:23:20.577279 n-d-844739-1 devstack@n-api.service[119050]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jun 05 08:23:20.577279 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:23:20.578008 n-d-844739-1 devstack@n-api.service[119050]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 05 08:23:20.578008 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'flavor_id': '1649659385', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jun 05 08:23:20.578008 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:23:20.578008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:20.578008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 05 08:23:20.578008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 05 08:23:20.578008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 05 08:23:20.578008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise error Jun 05 08:23:20.578008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 05 08:23:20.578008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:20.578008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jun 05 08:23:20.578008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 05 08:23:20.578008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jun 05 08:23:20.578008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jun 05 08:23:20.578008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 05 08:23:20.578008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi 'type': ['string', Jun 05 08:23:20.578008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi 'number']}}, Jun 05 08:23:20.578008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 05 08:23:20.578008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:20.578008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi On instance: Jun 05 08:23:20.578008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jun 05 08:23:20.578008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:20.579312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:20.579312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:20.579312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:20.579312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:20.579312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:20.579312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:23:20.579312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:23:20.579312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:23:20.579312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:23:20.579312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 05 08:23:20.579312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 05 08:23:20.579312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 05 08:23:20.579312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 05 08:23:20.579312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 05 08:23:20.579312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 05 08:23:20.579312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 05 08:23:20.579312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:20.579312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:20.579312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:20.579312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:20.580630 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:20.580630 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:20.580630 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 05 08:23:20.580630 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 05 08:23:20.580630 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 05 08:23:20.580630 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:20.582281 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d0fd3bf0-457a-49b5-9980-8dba481ab05f tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:23:20.583296 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d0fd3bf0-457a-49b5-9980-8dba481ab05f tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/1649659385/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.032510 Jun 05 08:23:20.586695 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 17/30] 10.222.0.33 () {60 vars in 1264 bytes} [Sun Jun 5 08:23:20 2022] PUT /compute/v2.1/flavors/1649659385/os-extra_specs/hw:numa_nodes => generated 117 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 05 08:23:20.591424 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-62b4ea92-8640-4d1a-bd54-a0e98c02b505 tempest-FlavorsAccessTestJSON-1555492831 tempest-FlavorsAccessTestJSON-1555492831-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:20.597276 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:20.597276 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:20.666591 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-62b4ea92-8640-4d1a-bd54-a0e98c02b505 tempest-FlavorsAccessTestJSON-1555492831 tempest-FlavorsAccessTestJSON-1555492831-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/644842593" status: 202 len: 0 microversion: 2.1 time: 0.078615 Jun 05 08:23:20.667674 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 18/31] 10.222.0.33 () {58 vars in 1157 bytes} [Sun Jun 5 08:23:20 2022] DELETE /compute/v2.1/flavors/644842593 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:23:20.672775 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7b65b1b1-8670-420b-9985-7e29f04b8de6 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:20.751014 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7b65b1b1-8670-420b-9985-7e29f04b8de6 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1649659385" status: 202 len: 0 microversion: 2.1 time: 0.078709 Jun 05 08:23:20.756159 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 19/32] 10.222.0.33 () {58 vars in 1160 bytes} [Sun Jun 5 08:23:20 2022] DELETE /compute/v2.1/flavors/1649659385 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:23:20.771090 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0a16f689-d9ca-4b9d-be11-88a4691bad01 tempest-FlavorsAccessTestJSON-1555492831 tempest-FlavorsAccessTestJSON-1555492831-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:20.821551 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0a16f689-d9ca-4b9d-be11-88a4691bad01 tempest-FlavorsAccessTestJSON-1555492831 tempest-FlavorsAccessTestJSON-1555492831-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061924 Jun 05 08:23:20.822451 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 20/33] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:23:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:20.844960 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9b9c1238-1084-4c2f-9074-44402d9ad40e tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:20.874297 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9b9c1238-1084-4c2f-9074-44402d9ad40e tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620 tempest-FlavorsExtraSpecsNegativeTestJSON-1904374620-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038905 Jun 05 08:23:20.884766 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 21/34] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:23:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:21.090229 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-dca23ab4-7803-4cfe-9c0f-08cd3079ea02 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:21.090229 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-dca23ab4-7803-4cfe-9c0f-08cd3079ea02 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:21.557033 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3f408aee-b837-492d-9e88-1592173c2d25 tempest-AggregatesAdminTestV241-539222272 tempest-AggregatesAdminTestV241-539222272-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 1.235795 Jun 05 08:23:21.563470 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 14/35] 10.222.0.33 () {62 vars in 1231 bytes} [Sun Jun 5 08:23:20 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:23:21.579616 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1e701bd3-abf1-42a5-8834-7f5d386fd52e tempest-AggregatesAdminTestV241-539222272 tempest-AggregatesAdminTestV241-539222272-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:21.580485 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:21.580485 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:23:21.615075 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1e701bd3-abf1-42a5-8834-7f5d386fd52e tempest-AggregatesAdminTestV241-539222272 tempest-AggregatesAdminTestV241-539222272-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.049195 Jun 05 08:23:21.622458 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 15/36] 10.222.0.33 () {60 vars in 1192 bytes} [Sun Jun 5 08:23:21 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:21.657697 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8bbeecab-8ca5-4bd1-bfaa-71677e438efc tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-217471753", "name": "tempest-test_aggregate-1967912349"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:21.692587 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:21.692587 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:23:21.693752 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.aggregate [None req-8bbeecab-8ca5-4bd1-bfaa-71677e438efc tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Generated uuid da78da56-6317-4c4b-ab0e-4be5e51b5ed2 for aggregate {{(pid=119049) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 05 08:23:21.738017 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8bbeecab-8ca5-4bd1-bfaa-71677e438efc tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.110074 Jun 05 08:23:21.738665 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 16/37] 10.222.0.33 () {60 vars in 1164 bytes} [Sun Jun 5 08:23:21 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:21.760375 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-edc0cb40-16d9-4b4b-9d00-d81aa1a08cb5 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:21.763752 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:21.763752 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:23:21.778325 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-edc0cb40-16d9-4b4b-9d00-d81aa1a08cb5 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 301 microversion: 2.1 time: 0.025452 Jun 05 08:23:21.784811 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 17/38] 10.222.0.33 () {58 vars in 1142 bytes} [Sun Jun 5 08:23:21 2022] GET /compute/v2.1/os-aggregates => generated 301 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:21.791034 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0ba0a124-d928-44f3-be88-b40bb21cfe48 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-844739-1"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:21.792324 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:21.792324 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:23:21.802024 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0ba0a124-d928-44f3-be88-b40bb21cfe48 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:21.802732 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0ba0a124-d928-44f3-be88-b40bb21cfe48 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:21.952648 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=9,nova_api:DELETE=7,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:23:21.980569 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0ba0a124-d928-44f3-be88-b40bb21cfe48 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 313 microversion: 2.1 time: 0.192313 Jun 05 08:23:21.982563 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 18/39] 10.222.0.33 () {60 vars in 1190 bytes} [Sun Jun 5 08:23:21 2022] POST /compute/v2.1/os-aggregates/2/action => generated 313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:22.722257 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-dca23ab4-7803-4cfe-9c0f-08cd3079ea02 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:22.743764 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-dca23ab4-7803-4cfe-9c0f-08cd3079ea02 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 200 len: 1219 microversion: 2.1 time: 1.661068 Jun 05 08:23:22.753343 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 22/40] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:21 2022] GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 1219 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:22.832250 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-25c740b6-4311-46a5-81f5-f84145081497 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1806873566", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "availability_zone": "tempest-test_az-217471753"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:22.859277 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-25c740b6-4311-46a5-81f5-f84145081497 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:22.859852 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-25c740b6-4311-46a5-81f5-f84145081497 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:22.860553 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-25c740b6-4311-46a5-81f5-f84145081497 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:22.860992 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-25c740b6-4311-46a5-81f5-f84145081497 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:23.015304 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-25c740b6-4311-46a5-81f5-f84145081497 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] validate_networks() for None {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:23:23.684413 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-25c740b6-4311-46a5-81f5-f84145081497 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:23:23.685083 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-25c740b6-4311-46a5-81f5-f84145081497 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:23:23.685704 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-25c740b6-4311-46a5-81f5-f84145081497 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:23:23.686257 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-25c740b6-4311-46a5-81f5-f84145081497 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:23:23.716816 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-25c740b6-4311-46a5-81f5-f84145081497 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:23:23.727618 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-25c740b6-4311-46a5-81f5-f84145081497 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:23.729475 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-25c740b6-4311-46a5-81f5-f84145081497 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:23.731822 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-25c740b6-4311-46a5-81f5-f84145081497 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:23.733553 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-25c740b6-4311-46a5-81f5-f84145081497 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:23.761933 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d4b7e561-1062-4b3c-9053-894fad9e0711 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:23.762702 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d4b7e561-1062-4b3c-9053-894fad9e0711 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:23.783891 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d4b7e561-1062-4b3c-9053-894fad9e0711 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:23.786458 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d4b7e561-1062-4b3c-9053-894fad9e0711 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:23.787322 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d4b7e561-1062-4b3c-9053-894fad9e0711 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:23.791066 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d4b7e561-1062-4b3c-9053-894fad9e0711 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:23.796312 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-25c740b6-4311-46a5-81f5-f84145081497 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Getting quotas for project f9587ff19dfc4eefb5129656cbdf4a97. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:23:23.801825 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-25c740b6-4311-46a5-81f5-f84145081497 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Getting quotas for user fd3429347e644bdca51b2b3b976a7bea and project f9587ff19dfc4eefb5129656cbdf4a97. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:23:23.834741 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-25c740b6-4311-46a5-81f5-f84145081497 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:23:23.839048 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-25c740b6-4311-46a5-81f5-f84145081497 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] [instance: 63dc26bf-e378-436f-a328-a88919547afc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:23:23.984463 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-25c740b6-4311-46a5-81f5-f84145081497 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.394456 Jun 05 08:23:23.999189 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 19/41] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:23:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1411 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 05 08:23:24.014579 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fdff2813-bf61-42d8-80d2-e52382dfc015 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:24.027475 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-fdff2813-bf61-42d8-80d2-e52382dfc015 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] [instance: 63dc26bf-e378-436f-a328-a88919547afc] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:24.447075 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-fdff2813-bf61-42d8-80d2-e52382dfc015 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3429347e644bdca51b2b3b976a7bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9587ff19dfc4eefb5129656cbdf4a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:24.463179 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fdff2813-bf61-42d8-80d2-e52382dfc015 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] 10.222.0.33 "GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc" status: 200 len: 1242 microversion: 2.1 time: 0.462500 Jun 05 08:23:24.465020 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 20/42] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:23 2022] GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc => generated 1242 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:24.693137 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d4b7e561-1062-4b3c-9053-894fad9e0711 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:24.713937 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d4b7e561-1062-4b3c-9053-894fad9e0711 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 200 len: 1277 microversion: 2.1 time: 0.957068 Jun 05 08:23:24.721183 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 23/43] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:23 2022] GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 1277 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:25.481433 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-12df913e-b835-49cc-a7e2-977898ecfb9a tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:25.482191 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-12df913e-b835-49cc-a7e2-977898ecfb9a tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] [instance: 63dc26bf-e378-436f-a328-a88919547afc] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:25.615409 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-12df913e-b835-49cc-a7e2-977898ecfb9a tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3429347e644bdca51b2b3b976a7bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9587ff19dfc4eefb5129656cbdf4a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:25.624620 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-12df913e-b835-49cc-a7e2-977898ecfb9a tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] 10.222.0.33 "GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc" status: 200 len: 1242 microversion: 2.1 time: 0.147281 Jun 05 08:23:25.628768 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 21/44] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:25 2022] GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc => generated 1242 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:25.732006 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d2dc4d6f-3ef0-496d-aa3a-00f7935eb6d7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:25.732697 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d2dc4d6f-3ef0-496d-aa3a-00f7935eb6d7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:25.753917 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d2dc4d6f-3ef0-496d-aa3a-00f7935eb6d7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:25.754538 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d2dc4d6f-3ef0-496d-aa3a-00f7935eb6d7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:25.755417 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d2dc4d6f-3ef0-496d-aa3a-00f7935eb6d7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:25.755876 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d2dc4d6f-3ef0-496d-aa3a-00f7935eb6d7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:26.656228 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c8269d29-068b-47e6-a68b-a88ab98d59a4 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:26.657076 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c8269d29-068b-47e6-a68b-a88ab98d59a4 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] [instance: 63dc26bf-e378-436f-a328-a88919547afc] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:26.670035 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c8269d29-068b-47e6-a68b-a88ab98d59a4 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:26.672532 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c8269d29-068b-47e6-a68b-a88ab98d59a4 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:26.680069 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c8269d29-068b-47e6-a68b-a88ab98d59a4 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:26.682613 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c8269d29-068b-47e6-a68b-a88ab98d59a4 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:27.254022 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d2dc4d6f-3ef0-496d-aa3a-00f7935eb6d7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:27.270998 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d2dc4d6f-3ef0-496d-aa3a-00f7935eb6d7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 200 len: 1319 microversion: 2.1 time: 1.542777 Jun 05 08:23:27.274059 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 24/45] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:25 2022] GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 1319 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:27.828375 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c8269d29-068b-47e6-a68b-a88ab98d59a4 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3429347e644bdca51b2b3b976a7bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9587ff19dfc4eefb5129656cbdf4a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:27.870190 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c8269d29-068b-47e6-a68b-a88ab98d59a4 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] 10.222.0.33 "GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc" status: 200 len: 1298 microversion: 2.1 time: 1.223247 Jun 05 08:23:27.884744 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 22/46] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:26 2022] GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc => generated 1298 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:28.297408 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5b87a6aa-3772-4f03-bf2b-521d6fd4c370 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:28.298711 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5b87a6aa-3772-4f03-bf2b-521d6fd4c370 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:28.316291 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:23:28.323695 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5b87a6aa-3772-4f03-bf2b-521d6fd4c370 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:28.325765 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5b87a6aa-3772-4f03-bf2b-521d6fd4c370 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:28.331835 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5b87a6aa-3772-4f03-bf2b-521d6fd4c370 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:28.345452 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5b87a6aa-3772-4f03-bf2b-521d6fd4c370 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:28.890480 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0354cb5d-7aef-43c8-a4f5-1bc1dc763bc1 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:28.891965 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0354cb5d-7aef-43c8-a4f5-1bc1dc763bc1 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] [instance: 63dc26bf-e378-436f-a328-a88919547afc] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:28.904919 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0354cb5d-7aef-43c8-a4f5-1bc1dc763bc1 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:28.906148 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0354cb5d-7aef-43c8-a4f5-1bc1dc763bc1 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:28.907345 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0354cb5d-7aef-43c8-a4f5-1bc1dc763bc1 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:28.909533 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0354cb5d-7aef-43c8-a4f5-1bc1dc763bc1 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:29.068108 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0354cb5d-7aef-43c8-a4f5-1bc1dc763bc1 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3429347e644bdca51b2b3b976a7bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9587ff19dfc4eefb5129656cbdf4a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:29.083998 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0354cb5d-7aef-43c8-a4f5-1bc1dc763bc1 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] 10.222.0.33 "GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc" status: 200 len: 1296 microversion: 2.1 time: 0.196496 Jun 05 08:23:29.086141 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 23/47] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:28 2022] GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc => generated 1296 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:23:29.108598 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5b87a6aa-3772-4f03-bf2b-521d6fd4c370 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:29.125602 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5b87a6aa-3772-4f03-bf2b-521d6fd4c370 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 200 len: 1319 microversion: 2.1 time: 0.833439 Jun 05 08:23:29.126196 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 25/48] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:28 2022] GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 1319 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:30.103086 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-dbd09bf1-51f5-4ab9-9525-9f894c8204a8 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:30.103848 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-dbd09bf1-51f5-4ab9-9525-9f894c8204a8 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] [instance: 63dc26bf-e378-436f-a328-a88919547afc] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:30.125737 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dbd09bf1-51f5-4ab9-9525-9f894c8204a8 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:30.128700 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dbd09bf1-51f5-4ab9-9525-9f894c8204a8 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:30.133737 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dbd09bf1-51f5-4ab9-9525-9f894c8204a8 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:30.135773 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dbd09bf1-51f5-4ab9-9525-9f894c8204a8 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:30.508080 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-dbd09bf1-51f5-4ab9-9525-9f894c8204a8 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3429347e644bdca51b2b3b976a7bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9587ff19dfc4eefb5129656cbdf4a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:30.520364 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-dbd09bf1-51f5-4ab9-9525-9f894c8204a8 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] 10.222.0.33 "GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc" status: 200 len: 1296 microversion: 2.1 time: 0.421746 Jun 05 08:23:30.523976 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 26/49] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:30 2022] GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc => generated 1296 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:30.540146 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f08f0e45-c4f5-42bb-8ba5-e1d210d27c80 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:30.541325 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f08f0e45-c4f5-42bb-8ba5-e1d210d27c80 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:30.570374 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f08f0e45-c4f5-42bb-8ba5-e1d210d27c80 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:30.573476 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f08f0e45-c4f5-42bb-8ba5-e1d210d27c80 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:30.574388 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f08f0e45-c4f5-42bb-8ba5-e1d210d27c80 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:30.574847 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f08f0e45-c4f5-42bb-8ba5-e1d210d27c80 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:30.947601 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2573bbef-8df2-499b-a37b-8ea37887e506 tempest-FlavorsV255TestJSON-917070584 tempest-FlavorsV255TestJSON-917070584-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-458418757", "id": 81070926, "os-flavor-access:is_public": "True"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:30.950812 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:30.950812 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:23:31.015703 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2573bbef-8df2-499b-a37b-8ea37887e506 tempest-FlavorsV255TestJSON-917070584 tempest-FlavorsV255TestJSON-917070584-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 442 microversion: 2.55 time: 1.209939 Jun 05 08:23:31.018075 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 24/50] 10.222.0.33 () {62 vars in 1187 bytes} [Sun Jun 5 08:23:29 2022] POST /compute/v2.1/flavors => generated 442 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:23:31.560726 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9f5566f7-c600-480c-b332-1fa5b8aa984e tempest-FlavorsV255TestJSON-626162297 tempest-FlavorsV255TestJSON-626162297-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:31.596144 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9f5566f7-c600-480c-b332-1fa5b8aa984e tempest-FlavorsV255TestJSON-626162297 tempest-FlavorsV255TestJSON-626162297-project] 10.222.0.33 "GET /compute/v2.1/flavors/81070926" status: 200 len: 442 microversion: 2.55 time: 0.561900 Jun 05 08:23:31.608965 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 25/51] 10.222.0.33 () {60 vars in 1192 bytes} [Sun Jun 5 08:23:31 2022] GET /compute/v2.1/flavors/81070926 => generated 442 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:23:31.644053 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8ad5f271-5df8-4755-8896-646f9ab39617 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:31.672211 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8ad5f271-5df8-4755-8896-646f9ab39617 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] [instance: 63dc26bf-e378-436f-a328-a88919547afc] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:31.701114 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8ad5f271-5df8-4755-8896-646f9ab39617 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:31.702360 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8ad5f271-5df8-4755-8896-646f9ab39617 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:31.705051 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8ad5f271-5df8-4755-8896-646f9ab39617 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:31.706664 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8ad5f271-5df8-4755-8896-646f9ab39617 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:31.851142 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f08f0e45-c4f5-42bb-8ba5-e1d210d27c80 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:31.868844 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f08f0e45-c4f5-42bb-8ba5-e1d210d27c80 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 200 len: 1319 microversion: 2.1 time: 1.343422 Jun 05 08:23:31.872192 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 27/52] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:30 2022] GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 1319 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:31.887129 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6eca0442-015d-4e8a-941a-2d112e084d15 tempest-FlavorsV255TestJSON-917070584 tempest-FlavorsV255TestJSON-917070584-project-admin] Action: 'update', calling method: .version_select at 0x7f24425941f0>, body: {"flavor": {"description": "new"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:31.927154 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:31.927154 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:32.058878 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6eca0442-015d-4e8a-941a-2d112e084d15 tempest-FlavorsV255TestJSON-917070584 tempest-FlavorsV255TestJSON-917070584-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/81070926" status: 200 len: 443 microversion: 2.55 time: 0.183220 Jun 05 08:23:32.062545 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 28/53] 10.222.0.33 () {62 vars in 1212 bytes} [Sun Jun 5 08:23:31 2022] PUT /compute/v2.1/flavors/81070926 => generated 443 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:23:32.079925 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1a8e3833-18e7-4408-a119-9521ee4ba9d4 tempest-FlavorsV255TestJSON-626162297 tempest-FlavorsV255TestJSON-626162297-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:32.091296 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=6 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:23:32.165060 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1a8e3833-18e7-4408-a119-9521ee4ba9d4 tempest-FlavorsV255TestJSON-626162297 tempest-FlavorsV255TestJSON-626162297-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5718 microversion: 2.55 time: 0.085544 Jun 05 08:23:32.165830 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 29/54] 10.222.0.33 () {60 vars in 1186 bytes} [Sun Jun 5 08:23:32 2022] GET /compute/v2.1/flavors/detail => generated 5718 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:23:32.183250 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c7bdaffa-cd4c-422c-b77f-2908a8e4766f tempest-FlavorsV255TestJSON-626162297 tempest-FlavorsV255TestJSON-626162297-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:32.246831 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c7bdaffa-cd4c-422c-b77f-2908a8e4766f tempest-FlavorsV255TestJSON-626162297 tempest-FlavorsV255TestJSON-626162297-project] 10.222.0.33 "GET /compute/v2.1/flavors" status: 200 len: 3150 microversion: 2.55 time: 0.069002 Jun 05 08:23:32.250282 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 30/55] 10.222.0.33 () {60 vars in 1165 bytes} [Sun Jun 5 08:23:32 2022] GET /compute/v2.1/flavors => generated 3150 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:23:32.266624 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3b04fb35-485e-4684-972a-ebdc9797b4e3 tempest-FlavorsV255TestJSON-917070584 tempest-FlavorsV255TestJSON-917070584-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:32.273886 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:32.273886 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:32.342779 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3b04fb35-485e-4684-972a-ebdc9797b4e3 tempest-FlavorsV255TestJSON-917070584 tempest-FlavorsV255TestJSON-917070584-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/81070926" status: 202 len: 0 microversion: 2.55 time: 0.080953 Jun 05 08:23:32.345401 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 31/56] 10.222.0.33 () {60 vars in 1195 bytes} [Sun Jun 5 08:23:32 2022] DELETE /compute/v2.1/flavors/81070926 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:23:32.354909 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ce3db8ff-26b4-468c-8351-a56c8b1ba3c1 tempest-FlavorsV255TestJSON-917070584 tempest-FlavorsV255TestJSON-917070584-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:32.411352 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ce3db8ff-26b4-468c-8351-a56c8b1ba3c1 tempest-FlavorsV255TestJSON-917070584 tempest-FlavorsV255TestJSON-917070584-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.061406 Jun 05 08:23:32.431100 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 32/57] 10.222.0.33 () {60 vars in 1186 bytes} [Sun Jun 5 08:23:32 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:23:32.777845 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8ad5f271-5df8-4755-8896-646f9ab39617 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3429347e644bdca51b2b3b976a7bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9587ff19dfc4eefb5129656cbdf4a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:32.825682 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8ad5f271-5df8-4755-8896-646f9ab39617 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] 10.222.0.33 "GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc" status: 200 len: 1296 microversion: 2.1 time: 1.202624 Jun 05 08:23:32.829017 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 26/58] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:31 2022] GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc => generated 1296 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:32.888199 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2e2a63dc-77cd-4fd8-9f1b-ea3967a5e0ee tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:32.888955 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2e2a63dc-77cd-4fd8-9f1b-ea3967a5e0ee tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:32.892005 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:23:32.896545 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2e2a63dc-77cd-4fd8-9f1b-ea3967a5e0ee tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:32.908956 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2e2a63dc-77cd-4fd8-9f1b-ea3967a5e0ee tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:32.917379 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2e2a63dc-77cd-4fd8-9f1b-ea3967a5e0ee tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:32.919587 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2e2a63dc-77cd-4fd8-9f1b-ea3967a5e0ee tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:33.848065 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-71868cec-20b2-4bd6-9624-0163283cc65d tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:33.849432 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-71868cec-20b2-4bd6-9624-0163283cc65d tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] [instance: 63dc26bf-e378-436f-a328-a88919547afc] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:33.861728 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=8 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:23:33.868392 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-71868cec-20b2-4bd6-9624-0163283cc65d tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:33.868857 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-71868cec-20b2-4bd6-9624-0163283cc65d tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:33.870578 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-71868cec-20b2-4bd6-9624-0163283cc65d tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:33.872431 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-71868cec-20b2-4bd6-9624-0163283cc65d tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:33.966128 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2e2a63dc-77cd-4fd8-9f1b-ea3967a5e0ee tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:33.987064 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2e2a63dc-77cd-4fd8-9f1b-ea3967a5e0ee tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 200 len: 1319 microversion: 2.1 time: 1.094482 Jun 05 08:23:33.989193 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 33/59] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:32 2022] GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 1319 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:34.081254 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-71868cec-20b2-4bd6-9624-0163283cc65d tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3429347e644bdca51b2b3b976a7bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9587ff19dfc4eefb5129656cbdf4a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:34.089987 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-71868cec-20b2-4bd6-9624-0163283cc65d tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] 10.222.0.33 "GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc" status: 200 len: 1296 microversion: 2.1 time: 0.246573 Jun 05 08:23:34.090539 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 27/60] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:33 2022] GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc => generated 1296 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:35.005753 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-96bf855a-aa97-4fd7-ba45-8f79596442cd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:35.008385 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-96bf855a-aa97-4fd7-ba45-8f79596442cd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:35.031090 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-96bf855a-aa97-4fd7-ba45-8f79596442cd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:35.032726 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-96bf855a-aa97-4fd7-ba45-8f79596442cd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:35.034714 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-96bf855a-aa97-4fd7-ba45-8f79596442cd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:35.036940 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-96bf855a-aa97-4fd7-ba45-8f79596442cd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:35.108379 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5155a3f4-e6c3-477b-b5de-37b5132db866 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:35.109584 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5155a3f4-e6c3-477b-b5de-37b5132db866 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] [instance: 63dc26bf-e378-436f-a328-a88919547afc] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:35.129383 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5155a3f4-e6c3-477b-b5de-37b5132db866 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:35.133455 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5155a3f4-e6c3-477b-b5de-37b5132db866 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:35.134652 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5155a3f4-e6c3-477b-b5de-37b5132db866 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:35.136499 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5155a3f4-e6c3-477b-b5de-37b5132db866 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:35.620877 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=18 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:23:36.835608 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5155a3f4-e6c3-477b-b5de-37b5132db866 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3429347e644bdca51b2b3b976a7bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9587ff19dfc4eefb5129656cbdf4a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:36.847012 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5155a3f4-e6c3-477b-b5de-37b5132db866 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] 10.222.0.33 "GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc" status: 200 len: 1338 microversion: 2.1 time: 1.743710 Jun 05 08:23:36.857611 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 28/61] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:35 2022] GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc => generated 1338 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:23:36.994413 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-96bf855a-aa97-4fd7-ba45-8f79596442cd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:37.002061 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-96bf855a-aa97-4fd7-ba45-8f79596442cd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 200 len: 1319 microversion: 2.1 time: 2.001048 Jun 05 08:23:37.002651 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 34/62] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:34 2022] GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 1319 bytes in 2002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:37.567076 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-46cafee7-fedb-49ca-aa88-9accd8efafc9 req-e47bf17e-142e-418f-83b0-1635c951a72e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cddf461-3546-4475-91c7-419b46a255af", "tag": "82f48857-e164-413d-8768-4601593a3494"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:37.599327 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-46cafee7-fedb-49ca-aa88-9accd8efafc9 req-e47bf17e-142e-418f-83b0-1635c951a72e service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:37.606123 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-46cafee7-fedb-49ca-aa88-9accd8efafc9 req-e47bf17e-142e-418f-83b0-1635c951a72e service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:37.657936 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-46cafee7-fedb-49ca-aa88-9accd8efafc9 req-e47bf17e-142e-418f-83b0-1635c951a72e service nova] Creating event network-changed:82f48857-e164-413d-8768-4601593a3494 for instance 8cddf461-3546-4475-91c7-419b46a255af on n-h1-844739-1 Jun 05 08:23:37.659022 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-46cafee7-fedb-49ca-aa88-9accd8efafc9 req-e47bf17e-142e-418f-83b0-1635c951a72e service nova] Acquired lock "compute-rpcapi-router" {{(pid=119049) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 05 08:23:37.661404 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cde45b34-32f0-4760-8636-8bce0e932793 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:37.663351 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cde45b34-32f0-4760-8636-8bce0e932793 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:37.665606 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cde45b34-32f0-4760-8636-8bce0e932793 None None] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:37.666452 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cde45b34-32f0-4760-8636-8bce0e932793 None None] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:37.693313 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.compute.rpcapi [None req-cde45b34-32f0-4760-8636-8bce0e932793 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 05 08:23:37.697993 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cde45b34-32f0-4760-8636-8bce0e932793 None None] Releasing lock "compute-rpcapi-router" {{(pid=119049) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 05 08:23:37.745117 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-cde45b34-32f0-4760-8636-8bce0e932793 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.885947 Jun 05 08:23:37.750241 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 29/63] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:37.822830 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fac742ec-1548-46b6-b39b-cebdf759680c tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Calling method '.version_select at 0x7f244067f550>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:37.823663 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:37.823663 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:37.824960 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fac742ec-1548-46b6-b39b-cebdf759680c tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:37.825604 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fac742ec-1548-46b6-b39b-cebdf759680c tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:37.876615 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fac742ec-1548-46b6-b39b-cebdf759680c tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:37.886745 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fac742ec-1548-46b6-b39b-cebdf759680c tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:37.954587 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fac742ec-1548-46b6-b39b-cebdf759680c tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:37.958295 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fac742ec-1548-46b6-b39b-cebdf759680c tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:37.987015 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fac742ec-1548-46b6-b39b-cebdf759680c tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.968780 Jun 05 08:23:37.993856 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 35/64] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:23:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:38.571601 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-cd6b3f34-0fc7-4e84-8e62-35f41f6e7799 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:38.573959 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:38.573959 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:23:38.587091 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cd6b3f34-0fc7-4e84-8e62-35f41f6e7799 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:38.587799 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cd6b3f34-0fc7-4e84-8e62-35f41f6e7799 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:38.589736 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cd6b3f34-0fc7-4e84-8e62-35f41f6e7799 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:38.591675 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cd6b3f34-0fc7-4e84-8e62-35f41f6e7799 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:38.611042 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-99bf03dd-49a1-4ea3-b9a4-0a4520ad41b6 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:38.623388 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-99bf03dd-49a1-4ea3-b9a4-0a4520ad41b6 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.628396 Jun 05 08:23:38.635289 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 36/65] 10.222.0.33 () {58 vars in 1136 bytes} [Sun Jun 5 08:23:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:38.716690 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-cd6b3f34-0fc7-4e84-8e62-35f41f6e7799 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 401 microversion: 2.1 time: 0.960561 Jun 05 08:23:38.718197 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 30/66] 10.222.0.33 () {58 vars in 1175 bytes} [Sun Jun 5 08:23:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 401 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:38.748142 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c8f19145-4bc4-4530-bf77-1c6f65f2bba4 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:38.750404 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c8f19145-4bc4-4530-bf77-1c6f65f2bba4 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] [instance: 63dc26bf-e378-436f-a328-a88919547afc] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:38.765871 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c8f19145-4bc4-4530-bf77-1c6f65f2bba4 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:38.766753 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c8f19145-4bc4-4530-bf77-1c6f65f2bba4 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:38.768553 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c8f19145-4bc4-4530-bf77-1c6f65f2bba4 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:38.769989 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c8f19145-4bc4-4530-bf77-1c6f65f2bba4 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:38.946611 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7662035f-4fd5-444c-a3de-8e8159346153 tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-746436956", "id": 990582833, "os-flavor-access:is_public": "False"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:38.948796 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:38.948796 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:38.971925 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7662035f-4fd5-444c-a3de-8e8159346153 tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.335243 Jun 05 08:23:38.977265 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 37/67] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:23:38 2022] POST /compute/v2.1/flavors => generated 435 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:38.991746 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-81e63603-567d-430a-b935-c7e7088d5623 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Calling method '.version_select at 0x7f2440569ca0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:38.993462 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:38.993462 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:38.995036 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-81e63603-567d-430a-b935-c7e7088d5623 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:38.995513 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-81e63603-567d-430a-b935-c7e7088d5623 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:39.038683 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-81e63603-567d-430a-b935-c7e7088d5623 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:39.039519 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-81e63603-567d-430a-b935-c7e7088d5623 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:39.085413 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-81e63603-567d-430a-b935-c7e7088d5623 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:39.091329 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-81e63603-567d-430a-b935-c7e7088d5623 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:39.106424 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-81e63603-567d-430a-b935-c7e7088d5623 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.123523 Jun 05 08:23:39.112480 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 38/68] 10.222.0.33 () {58 vars in 1166 bytes} [Sun Jun 5 08:23:38 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:39.126203 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7338963f-7cc0-4d2e-bd49-4aeb4303a089 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:39.129030 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7338963f-7cc0-4d2e-bd49-4aeb4303a089 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:39.143432 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7338963f-7cc0-4d2e-bd49-4aeb4303a089 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:39.146875 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7338963f-7cc0-4d2e-bd49-4aeb4303a089 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:39.149463 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7338963f-7cc0-4d2e-bd49-4aeb4303a089 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:39.151074 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7338963f-7cc0-4d2e-bd49-4aeb4303a089 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:39.625363 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7338963f-7cc0-4d2e-bd49-4aeb4303a089 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:39.641117 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7338963f-7cc0-4d2e-bd49-4aeb4303a089 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 200 len: 1319 microversion: 2.1 time: 0.524545 Jun 05 08:23:39.656341 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 39/69] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:39 2022] GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 1319 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:39.696749 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c8f19145-4bc4-4530-bf77-1c6f65f2bba4 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3429347e644bdca51b2b3b976a7bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9587ff19dfc4eefb5129656cbdf4a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:39.727618 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c8f19145-4bc4-4530-bf77-1c6f65f2bba4 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] 10.222.0.33 "GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc" status: 200 len: 1338 microversion: 2.1 time: 1.001469 Jun 05 08:23:39.737666 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 31/70] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:38 2022] GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc => generated 1338 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:39.778828 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-32570980-e03c-4337-82a1-7629c093934c tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "add8e40157be4934a1b74e0d9056e2fb"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:39.789861 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:39.789861 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:23:40.354945 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a3781928-fc3e-425f-990e-46988be99d1d tempest-ServersWithSpecificFlavorTestJSON-377976084 tempest-ServersWithSpecificFlavorTestJSON-377976084-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1460406576", "id": 1541174189, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:40.356547 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:40.356547 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:40.404148 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a3781928-fc3e-425f-990e-46988be99d1d tempest-ServersWithSpecificFlavorTestJSON-377976084 tempest-ServersWithSpecificFlavorTestJSON-377976084-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.745885 Jun 05 08:23:40.417244 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 40/71] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:23:39 2022] POST /compute/v2.1/flavors => generated 425 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:40.431243 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-163d46b5-67d2-4648-be2a-462223318e84 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Calling method '.version_select at 0x7f24406020d0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:40.432579 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:40.432579 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:40.434452 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-163d46b5-67d2-4648-be2a-462223318e84 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:40.436122 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-163d46b5-67d2-4648-be2a-462223318e84 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:40.464685 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-163d46b5-67d2-4648-be2a-462223318e84 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:40.466659 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-163d46b5-67d2-4648-be2a-462223318e84 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:40.483090 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-163d46b5-67d2-4648-be2a-462223318e84 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:40.484326 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-163d46b5-67d2-4648-be2a-462223318e84 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:40.496979 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-163d46b5-67d2-4648-be2a-462223318e84 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.075919 Jun 05 08:23:40.503585 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 41/72] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:23:40 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:40.511034 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c76b14ef-90bf-40bd-ade0-fc3e72563baa tempest-ServersWithSpecificFlavorTestJSON-377976084 tempest-ServersWithSpecificFlavorTestJSON-377976084-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:40.524123 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c76b14ef-90bf-40bd-ade0-fc3e72563baa tempest-ServersWithSpecificFlavorTestJSON-377976084 tempest-ServersWithSpecificFlavorTestJSON-377976084-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.018559 Jun 05 08:23:40.532897 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 42/73] 10.222.0.33 () {58 vars in 1181 bytes} [Sun Jun 5 08:23:40 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:23:40.542326 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-712efa02-4311-4c9b-a24a-1e28f57509ac tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Calling method '.version_select at 0x7f24405f8a60>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:40.543464 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:40.543464 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:40.545500 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-712efa02-4311-4c9b-a24a-1e28f57509ac tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:40.546314 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-712efa02-4311-4c9b-a24a-1e28f57509ac tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:40.570365 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-712efa02-4311-4c9b-a24a-1e28f57509ac tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:40.571206 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-712efa02-4311-4c9b-a24a-1e28f57509ac tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:40.581939 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-712efa02-4311-4c9b-a24a-1e28f57509ac tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.047528 Jun 05 08:23:40.595525 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 43/74] 10.222.0.33 () {58 vars in 1151 bytes} [Sun Jun 5 08:23:40 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:40.605972 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0c563df1-bad0-47b1-b37e-d3f14b12c342 tempest-ServersWithSpecificFlavorTestJSON-377976084 tempest-ServersWithSpecificFlavorTestJSON-377976084-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-609760923", "id": 1638903052, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:40.609842 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:40.609842 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:40.627150 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-32570980-e03c-4337-82a1-7629c093934c tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/990582833/action" status: 200 len: 96 microversion: 2.1 time: 0.884232 Jun 05 08:23:40.630673 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 32/75] 10.222.0.33 () {60 vars in 1196 bytes} [Sun Jun 5 08:23:39 2022] POST /compute/v2.1/flavors/990582833/action => generated 96 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:23:40.635574 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f385535b-6e56-4c18-aef0-cfacec7fd08e tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Calling method '.version_select at 0x7f24404eba60>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:40.637142 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:40.637142 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:23:40.640681 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f385535b-6e56-4c18-aef0-cfacec7fd08e tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:40.641762 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f385535b-6e56-4c18-aef0-cfacec7fd08e tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:40.695988 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0c563df1-bad0-47b1-b37e-d3f14b12c342 tempest-ServersWithSpecificFlavorTestJSON-377976084 tempest-ServersWithSpecificFlavorTestJSON-377976084-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.093080 Jun 05 08:23:40.699805 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f385535b-6e56-4c18-aef0-cfacec7fd08e tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.067796 Jun 05 08:23:40.703807 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 33/76] 10.222.0.33 () {58 vars in 1178 bytes} [Sun Jun 5 08:23:40 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:40.714954 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 44/77] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:23:40 2022] POST /compute/v2.1/flavors => generated 424 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:40.721250 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-530132e7-eb2c-4ed3-b0dd-dfe6f3be8579 tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "add8e40157be4934a1b74e0d9056e2fb"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:40.743994 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1c1c091e-3497-4fd0-8582-58c90d66caf5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:40.745274 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1c1c091e-3497-4fd0-8582-58c90d66caf5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:40.775741 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1c1c091e-3497-4fd0-8582-58c90d66caf5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:40.778014 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1c1c091e-3497-4fd0-8582-58c90d66caf5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:40.782082 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1c1c091e-3497-4fd0-8582-58c90d66caf5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:40.785530 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1c1c091e-3497-4fd0-8582-58c90d66caf5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:41.399204 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1c1c091e-3497-4fd0-8582-58c90d66caf5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:41.429023 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1c1c091e-3497-4fd0-8582-58c90d66caf5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 200 len: 1319 microversion: 2.1 time: 0.703469 Jun 05 08:23:41.430977 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 45/78] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:40 2022] GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 1319 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:41.446385 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-603feee8-0f3f-4f29-9948-0a4255b28bd7 tempest-ServersWithSpecificFlavorTestJSON-377976084 tempest-ServersWithSpecificFlavorTestJSON-377976084-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:41.462979 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-530132e7-eb2c-4ed3-b0dd-dfe6f3be8579 tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] HTTP exception thrown: Flavor access already exists for flavor 19 and project add8e40157be4934a1b74e0d9056e2fb combination. Jun 05 08:23:41.478593 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-603feee8-0f3f-4f29-9948-0a4255b28bd7 tempest-ServersWithSpecificFlavorTestJSON-377976084 tempest-ServersWithSpecificFlavorTestJSON-377976084-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.046211 Jun 05 08:23:41.488256 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 46/79] 10.222.0.33 () {58 vars in 1181 bytes} [Sun Jun 5 08:23:41 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:23:41.496925 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-40b2cb37-de3c-4fae-9daa-f2b1afffdc61 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Calling method '.version_select at 0x7f2440569e50>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:41.498405 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:41.498405 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:41.499959 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-40b2cb37-de3c-4fae-9daa-f2b1afffdc61 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:41.502604 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-40b2cb37-de3c-4fae-9daa-f2b1afffdc61 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:41.506587 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-530132e7-eb2c-4ed3-b0dd-dfe6f3be8579 tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] Request method failure captured: Jun 05 08:23:41.506587 n-d-844739-1 devstack@n-api.service[119049]: request: POST /compute/v2.1/flavors/990582833/action HTTP/1.1 Jun 05 08:23:41.506587 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:23:41.506587 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:23:41.506587 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:23:41.506587 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 67 Jun 05 08:23:41.506587 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:23:41.506587 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:23:41.506587 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:23:41.506587 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:23:41.506587 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGgG84fvWaFjMLnrJexNpazYuMIOApOMXotDDPLfqesAabNuWfG5n6-t9NkpMT-GuS4s8SW8tnTvq1GiNc7xxTZfjOLaeju4dbuF-BTbVxp1CGBdJhWD25l898md2rBXWN12LX-LtpLj4xihYSFdBBPiLU9HtPeuzrnfToiE6Qc-TCs Jun 05 08:23:41.506587 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:23:41.506587 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:23:41.506587 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:23:41.506587 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:23:41.506587 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:23:41.506587 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:23:41.506587 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 6daced84669640f69996d261a74847c4 Jun 05 08:23:41.506587 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-178812022 Jun 05 08:23:41.506587 n-d-844739-1 devstack@n-api.service[119049]: X-Role: admin,reader,member Jun 05 08:23:41.506587 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: admin,reader,member Jun 05 08:23:41.507747 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6daced84669640f69996d261a74847c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6daced84669640f69996d261a74847c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6daced84669640f69996d261a74847c4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6daced84669640f69996d261a74847c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:23:41.507747 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-178812022 Jun 05 08:23:41.507747 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 6daced84669640f69996d261a74847c4 Jun 05 08:23:41.507747 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-178812022 Jun 05 08:23:41.507747 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin Jun 05 08:23:41.507747 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:23:41.507747 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:23:41.507747 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: daf5cc65d9e9487ba56fbe23a66ef515 Jun 05 08:23:41.507747 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin Jun 05 08:23:41.507747 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:23:41.507747 n-d-844739-1 devstack@n-api.service[119049]: {"addTenantAccess": {"tenant": "add8e40157be4934a1b74e0d9056e2fb"}} Jun 05 08:23:41.507747 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:23:41.508596 n-d-844739-1 devstack@n-api.service[119049]: exception: Flavor access already exists for flavor 19 and project add8e40157be4934a1b74e0d9056e2fb combination. Jun 05 08:23:41.508596 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '990582833', 'body': {'addTenantAccess': {'tenant': 'add8e40157be4934a1b74e0d9056e2fb'}}} Jun 05 08:23:41.508596 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:23:41.508596 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:41.508596 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 05 08:23:41.508596 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 05 08:23:41.508596 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 05 08:23:41.508596 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 05 08:23:41.508596 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 05 08:23:41.508596 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 05 08:23:41.508596 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 05 08:23:41.508596 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 05 08:23:41.508596 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 05 08:23:41.508596 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 05 08:23:41.508596 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 05 08:23:41.508596 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result.read() Jun 05 08:23:41.508596 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 05 08:23:41.508596 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 05 08:23:41.509531 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 05 08:23:41.509531 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 05 08:23:41.509531 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 05 08:23:41.509531 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 05 08:23:41.509531 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 05 08:23:41.509531 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 05 08:23:41.509531 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '19-add8e40157be4934a1b74e0d9056e2fb' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jun 05 08:23:41.509531 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:41.509531 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jun 05 08:23:41.509531 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:41.509531 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:41.509531 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jun 05 08:23:41.509531 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi project.save(context.session) Jun 05 08:23:41.509531 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jun 05 08:23:41.509531 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi session.flush() Jun 05 08:23:41.509531 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 05 08:23:41.509531 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self._flush(objects) Jun 05 08:23:41.509531 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 05 08:23:41.509531 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jun 05 08:23:41.510465 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 05 08:23:41.510465 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi compat.raise_( Jun 05 08:23:41.510465 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 05 08:23:41.510465 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception Jun 05 08:23:41.510465 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 05 08:23:41.510465 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi flush_context.execute() Jun 05 08:23:41.510465 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 05 08:23:41.510465 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi rec.execute(self) Jun 05 08:23:41.510465 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 05 08:23:41.510465 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jun 05 08:23:41.510465 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 05 08:23:41.510465 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jun 05 08:23:41.510465 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 05 08:23:41.510465 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jun 05 08:23:41.510465 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 05 08:23:41.510465 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jun 05 08:23:41.510465 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 05 08:23:41.510465 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jun 05 08:23:41.511343 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 05 08:23:41.511343 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jun 05 08:23:41.511343 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 05 08:23:41.511343 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jun 05 08:23:41.511343 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 05 08:23:41.511343 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 05 08:23:41.511343 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 05 08:23:41.511343 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception Jun 05 08:23:41.511343 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 05 08:23:41.511343 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 05 08:23:41.511343 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 05 08:23:41.511343 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 05 08:23:41.511343 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 05 08:23:41.511343 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 05 08:23:41.511343 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 05 08:23:41.511343 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 05 08:23:41.511343 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 05 08:23:41.511343 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 05 08:23:41.512364 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 05 08:23:41.512364 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result.read() Jun 05 08:23:41.512364 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 05 08:23:41.512364 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 05 08:23:41.512364 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 05 08:23:41.512364 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 05 08:23:41.512364 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 05 08:23:41.512364 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 05 08:23:41.512364 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 05 08:23:41.512364 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 05 08:23:41.512364 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '19-add8e40157be4934a1b74e0d9056e2fb' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jun 05 08:23:41.512364 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jun 05 08:23:41.512364 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 6, 5, 8, 23, 41, 456024), 'updated_at': None, 'flavor_id': 19, 'project_id': 'add8e40157be4934a1b74e0d9056e2fb'}] Jun 05 08:23:41.512364 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 05 08:23:41.512364 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:41.512364 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:41.512364 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:41.513218 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:41.513218 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jun 05 08:23:41.513218 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jun 05 08:23:41.513218 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 05 08:23:41.513218 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 05 08:23:41.513218 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jun 05 08:23:41.513218 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jun 05 08:23:41.513218 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jun 05 08:23:41.513218 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jun 05 08:23:41.513218 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jun 05 08:23:41.513218 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jun 05 08:23:41.513218 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 05 08:23:41.513218 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 05 08:23:41.513218 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jun 05 08:23:41.513218 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jun 05 08:23:41.513218 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 19 and project add8e40157be4934a1b74e0d9056e2fb combination. Jun 05 08:23:41.513218 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:41.513218 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:41.513218 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:41.516904 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:41.516904 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:41.516904 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:41.516904 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:23:41.516904 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:23:41.516904 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:23:41.516904 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:23:41.516904 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:23:41.516904 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:23:41.516904 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jun 05 08:23:41.516904 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jun 05 08:23:41.516904 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 19 and project add8e40157be4934a1b74e0d9056e2fb combination. Jun 05 08:23:41.516904 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:41.516904 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:41.516904 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:41.516904 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:41.516904 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:41.516904 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:41.516904 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:23:41.516904 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:23:41.523350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 19 and project add8e40157be4934a1b74e0d9056e2fb combination. Jun 05 08:23:41.523350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:41.523350 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-530132e7-eb2c-4ed3-b0dd-dfe6f3be8579 tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] Returning 409 to user: Flavor access already exists for flavor 19 and project add8e40157be4934a1b74e0d9056e2fb combination. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:23:41.523350 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-530132e7-eb2c-4ed3-b0dd-dfe6f3be8579 tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/990582833/action" status: 409 len: 152 microversion: 2.1 time: 0.797178 Jun 05 08:23:41.523350 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 34/80] 10.222.0.33 () {60 vars in 1196 bytes} [Sun Jun 5 08:23:40 2022] POST /compute/v2.1/flavors/990582833/action => generated 152 bytes in 809 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:23:41.550660 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a0a79905-669e-496a-90c3-6f6047749309 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:41.551315 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a0a79905-669e-496a-90c3-6f6047749309 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] [instance: 63dc26bf-e378-436f-a328-a88919547afc] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:41.568063 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a0a79905-669e-496a-90c3-6f6047749309 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:41.571263 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a0a79905-669e-496a-90c3-6f6047749309 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:41.574757 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a0a79905-669e-496a-90c3-6f6047749309 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:41.575543 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a0a79905-669e-496a-90c3-6f6047749309 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:41.609372 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-40b2cb37-de3c-4fae-9daa-f2b1afffdc61 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:41.611892 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-40b2cb37-de3c-4fae-9daa-f2b1afffdc61 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:41.666806 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-40b2cb37-de3c-4fae-9daa-f2b1afffdc61 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:41.674241 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-40b2cb37-de3c-4fae-9daa-f2b1afffdc61 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:41.716420 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-40b2cb37-de3c-4fae-9daa-f2b1afffdc61 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.226578 Jun 05 08:23:41.724490 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 47/81] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:23:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:41.743049 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e943a000-87a9-405e-a9c9-d25b810576e1 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Action: 'create', calling method: .version_select at 0x7f24405b7790>, body: {"keypair": {"name": "tempest-keypair-1041185333", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSUhLBZyb9oekcG2hqi/dreCQeuhvoG+vNJwkPvBDjCfzkUaOYGoInc8gXJOj3EKhlpWRz6qZ9GeIefQ4kuxd8YjQpE8UOmQktzvIn1i5IKb8rte396wRdRm1i0+e56HQ=="}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:41.870251 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-e943a000-87a9-405e-a9c9-d25b810576e1 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Getting quotas for project 0348d3b9a38d437c8e82a24be537c848. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:23:41.891733 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-e943a000-87a9-405e-a9c9-d25b810576e1 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Getting quotas for user da4cc519c13c4b88bfff58f418bcdb4f and project 0348d3b9a38d437c8e82a24be537c848. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:23:42.011001 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e943a000-87a9-405e-a9c9-d25b810576e1 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.284945 Jun 05 08:23:42.017499 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 48/82] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:23:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:42.034692 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2f14f135-cd22-4207-9323-dec3f0507f21 tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "add8e40157be4934a1b74e0d9056e2fb"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:42.042806 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:42.042806 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:42.633964 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a0a79905-669e-496a-90c3-6f6047749309 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3429347e644bdca51b2b3b976a7bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9587ff19dfc4eefb5129656cbdf4a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:42.646539 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a0a79905-669e-496a-90c3-6f6047749309 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] 10.222.0.33 "GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc" status: 200 len: 1338 microversion: 2.1 time: 1.125880 Jun 05 08:23:42.663722 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 35/83] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:41 2022] GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc => generated 1338 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:42.677068 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-cf2e590e-ee3d-4512-bfb2-aa1598b56734 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Calling method '.version_select at 0x7f244057f160>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:42.683406 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:42.683406 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:23:42.697778 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cf2e590e-ee3d-4512-bfb2-aa1598b56734 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:42.698241 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cf2e590e-ee3d-4512-bfb2-aa1598b56734 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:42.740766 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2f14f135-cd22-4207-9323-dec3f0507f21 tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/990582833/action" status: 200 len: 21 microversion: 2.1 time: 0.721466 Jun 05 08:23:42.745872 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 49/84] 10.222.0.33 () {60 vars in 1196 bytes} [Sun Jun 5 08:23:42 2022] POST /compute/v2.1/flavors/990582833/action => generated 21 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:23:42.762765 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cf2e590e-ee3d-4512-bfb2-aa1598b56734 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:42.763231 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cf2e590e-ee3d-4512-bfb2-aa1598b56734 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:42.782476 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e3cce273-ecba-40b5-b321-6d459774a013 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:42.788567 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e3cce273-ecba-40b5-b321-6d459774a013 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:42.799176 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e3cce273-ecba-40b5-b321-6d459774a013 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:42.800010 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e3cce273-ecba-40b5-b321-6d459774a013 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:42.800612 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-cf2e590e-ee3d-4512-bfb2-aa1598b56734 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.122234 Jun 05 08:23:42.801608 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 36/85] 10.222.0.33 () {58 vars in 1151 bytes} [Sun Jun 5 08:23:42 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:42.801986 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e3cce273-ecba-40b5-b321-6d459774a013 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:42.802678 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e3cce273-ecba-40b5-b321-6d459774a013 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:42.831797 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-9932b4de-d499-45c5-b874-3609b032df5b req-f9300f96-2914-45a2-93e3-4e16adb2ffdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63dc26bf-e378-436f-a328-a88919547afc", "tag": "5ba0a894-464e-424e-a5f1-bfb7549d1603"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:42.857281 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-9932b4de-d499-45c5-b874-3609b032df5b req-f9300f96-2914-45a2-93e3-4e16adb2ffdf service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:42.860839 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-9932b4de-d499-45c5-b874-3609b032df5b req-f9300f96-2914-45a2-93e3-4e16adb2ffdf service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:42.915471 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-9932b4de-d499-45c5-b874-3609b032df5b req-f9300f96-2914-45a2-93e3-4e16adb2ffdf service nova] Creating event network-changed:5ba0a894-464e-424e-a5f1-bfb7549d1603 for instance 63dc26bf-e378-436f-a328-a88919547afc on n-h2-844739-1 Jun 05 08:23:42.939647 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-9932b4de-d499-45c5-b874-3609b032df5b req-f9300f96-2914-45a2-93e3-4e16adb2ffdf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136448 Jun 05 08:23:42.943489 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 37/86] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:43.070568 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-12d86769-322e-49b2-8fe4-db42d36b0723 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Calling method '.version_select at 0x7f244050e1f0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:43.072519 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:43.072519 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:23:43.074200 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-12d86769-322e-49b2-8fe4-db42d36b0723 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:43.078242 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-12d86769-322e-49b2-8fe4-db42d36b0723 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:43.079390 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-12d86769-322e-49b2-8fe4-db42d36b0723 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:43.080841 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-12d86769-322e-49b2-8fe4-db42d36b0723 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:43.179970 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-12d86769-322e-49b2-8fe4-db42d36b0723 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 0.233638 Jun 05 08:23:43.182611 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 38/87] 10.222.0.33 () {58 vars in 1127 bytes} [Sun Jun 5 08:23:42 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:43.196267 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c6ef61f8-db5c-4ea6-ab54-04f6d74e234b tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:43.201326 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:43.201326 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:23:43.261069 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c6ef61f8-db5c-4ea6-ab54-04f6d74e234b tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/990582833" status: 202 len: 0 microversion: 2.1 time: 0.073803 Jun 05 08:23:43.268888 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e3cce273-ecba-40b5-b321-6d459774a013 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:43.269915 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 39/88] 10.222.0.33 () {58 vars in 1157 bytes} [Sun Jun 5 08:23:43 2022] DELETE /compute/v2.1/flavors/990582833 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:23:43.273613 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=100 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:23:43.286634 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-93b1d4c2-85ad-4a36-9215-769e4d6abed8 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Calling method '.version_select at 0x7f244053a550>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:43.287838 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e3cce273-ecba-40b5-b321-6d459774a013 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 200 len: 1319 microversion: 2.1 time: 0.538806 Jun 05 08:23:43.295580 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:43.295580 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:23:43.301505 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-93b1d4c2-85ad-4a36-9215-769e4d6abed8 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:43.303027 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-93b1d4c2-85ad-4a36-9215-769e4d6abed8 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:43.310328 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 50/89] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:42 2022] GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 1319 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:43.329585 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-04a3655a-a3fd-4cba-b2c9-8943050de0e2 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Calling method '.version_select at 0x7f24407148b0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:43.339858 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:43.339858 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:43.349425 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-04a3655a-a3fd-4cba-b2c9-8943050de0e2 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:43.350959 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-93b1d4c2-85ad-4a36-9215-769e4d6abed8 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:43.351429 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-93b1d4c2-85ad-4a36-9215-769e4d6abed8 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:43.352418 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-04a3655a-a3fd-4cba-b2c9-8943050de0e2 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:43.355804 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-04a3655a-a3fd-4cba-b2c9-8943050de0e2 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:43.356578 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-04a3655a-a3fd-4cba-b2c9-8943050de0e2 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:43.390073 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-93b1d4c2-85ad-4a36-9215-769e4d6abed8 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.110626 Jun 05 08:23:43.392240 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 40/90] 10.222.0.33 () {58 vars in 1151 bytes} [Sun Jun 5 08:23:43 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:43.423092 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f61f447a-d886-41aa-b2de-170eda3f9f09 tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:43.461746 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-04a3655a-a3fd-4cba-b2c9-8943050de0e2 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 397 microversion: 2.1 time: 0.147666 Jun 05 08:23:43.464761 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 51/91] 10.222.0.33 () {58 vars in 1138 bytes} [Sun Jun 5 08:23:43 2022] GET /compute/v2.1/os-hosts?zone= => generated 397 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:43.469862 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c2a3c8e4-1741-43b0-b7c3-285f74dfb035 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Calling method '.version_select at 0x7f24404c4d30>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:43.475134 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:43.475134 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:43.479093 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c2a3c8e4-1741-43b0-b7c3-285f74dfb035 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:43.482396 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c2a3c8e4-1741-43b0-b7c3-285f74dfb035 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:43.511871 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c2a3c8e4-1741-43b0-b7c3-285f74dfb035 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:43.512354 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c2a3c8e4-1741-43b0-b7c3-285f74dfb035 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:43.529230 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f61f447a-d886-41aa-b2de-170eda3f9f09 tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.111250 Jun 05 08:23:43.534015 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 41/92] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:23:43 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:43.549590 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c2a3c8e4-1741-43b0-b7c3-285f74dfb035 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:43.549894 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c2a3c8e4-1741-43b0-b7c3-285f74dfb035 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:43.571154 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c2a3c8e4-1741-43b0-b7c3-285f74dfb035 tempest-HypervisorAdminTestJSON-368728145 tempest-HypervisorAdminTestJSON-368728145-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=119050) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 05 08:23:43.572548 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cb36ac2d-7301-4e60-93f1-a1a4569fe24f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:43.573018 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cb36ac2d-7301-4e60-93f1-a1a4569fe24f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:43.573822 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cb36ac2d-7301-4e60-93f1-a1a4569fe24f None None] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:43.574325 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cb36ac2d-7301-4e60-93f1-a1a4569fe24f None None] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:43.610258 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.compute.rpcapi [None req-cb36ac2d-7301-4e60-93f1-a1a4569fe24f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 05 08:23:43.611150 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cb36ac2d-7301-4e60-93f1-a1a4569fe24f None None] Releasing lock "compute-rpcapi-router" {{(pid=119050) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 05 08:23:43.716869 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-cb36ac2d-7301-4e60-93f1-a1a4569fe24f None None] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.250573 Jun 05 08:23:43.725693 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 52/93] 10.222.0.33 () {58 vars in 1172 bytes} [Sun Jun 5 08:23:43 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:43.748690 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-10a1862d-2914-4540-91ae-df9f087a2161 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Calling method '.version_select at 0x7f24404d7e50>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:43.750956 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:43.750956 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:43.765665 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10a1862d-2914-4540-91ae-df9f087a2161 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:43.766704 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10a1862d-2914-4540-91ae-df9f087a2161 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:43.767831 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10a1862d-2914-4540-91ae-df9f087a2161 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:43.768599 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10a1862d-2914-4540-91ae-df9f087a2161 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:43.833354 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-10a1862d-2914-4540-91ae-df9f087a2161 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.105519 Jun 05 08:23:43.834066 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 53/94] 10.222.0.33 () {58 vars in 1144 bytes} [Sun Jun 5 08:23:43 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:23:43.841078 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9de07069-2cec-412d-8192-396eaaf5449d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-981624033", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "d6fc5636-9c8b-4238-8a2c-cf51a213fbbf"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:43.863807 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f63337f8-2766-4cea-976b-ae9e109f67d6 tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1834295030", "id": 1877074577, "os-flavor-access:is_public": "True"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:43.867640 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:43.867640 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:43.910977 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f63337f8-2766-4cea-976b-ae9e109f67d6 tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.061528 Jun 05 08:23:43.918053 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 54/95] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:23:43 2022] POST /compute/v2.1/flavors => generated 438 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:43.926428 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b6b937d1-2124-4fa6-89f1-fe88c503413b tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:43.933271 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b6b937d1-2124-4fa6-89f1-fe88c503413b tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] [instance: 63dc26bf-e378-436f-a328-a88919547afc] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:43.962949 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b6b937d1-2124-4fa6-89f1-fe88c503413b tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:43.963898 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b6b937d1-2124-4fa6-89f1-fe88c503413b tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:43.965432 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b6b937d1-2124-4fa6-89f1-fe88c503413b tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:43.966037 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b6b937d1-2124-4fa6-89f1-fe88c503413b tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:44.463088 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b6b937d1-2124-4fa6-89f1-fe88c503413b tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3429347e644bdca51b2b3b976a7bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9587ff19dfc4eefb5129656cbdf4a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:44.478931 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b6b937d1-2124-4fa6-89f1-fe88c503413b tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] 10.222.0.33 "GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc" status: 200 len: 1338 microversion: 2.1 time: 0.557800 Jun 05 08:23:44.482211 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 55/96] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:43 2022] GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc => generated 1338 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:44.499387 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f6b3494a-85d3-4d18-8ca0-1bbb06038e5c tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:44.502749 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:44.502749 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:44.557013 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-f6b3494a-85d3-4d18-8ca0-1bbb06038e5c tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] HTTP exception thrown: Access list not available for public flavors. Jun 05 08:23:44.562841 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f6b3494a-85d3-4d18-8ca0-1bbb06038e5c tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] Request method failure captured: Jun 05 08:23:44.562841 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/flavors/1877074577/os-flavor-access HTTP/1.1 Jun 05 08:23:44.562841 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:23:44.562841 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:23:44.562841 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:23:44.562841 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:23:44.562841 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:23:44.562841 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:23:44.562841 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:23:44.562841 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:23:44.562841 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGgG84fvWaFjMLnrJexNpazYuMIOApOMXotDDPLfqesAabNuWfG5n6-t9NkpMT-GuS4s8SW8tnTvq1GiNc7xxTZfjOLaeju4dbuF-BTbVxp1CGBdJhWD25l898md2rBXWN12LX-LtpLj4xihYSFdBBPiLU9HtPeuzrnfToiE6Qc-TCs Jun 05 08:23:44.562841 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:23:44.562841 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:23:44.562841 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:23:44.562841 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:23:44.562841 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:23:44.562841 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:23:44.562841 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 6daced84669640f69996d261a74847c4 Jun 05 08:23:44.562841 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-178812022 Jun 05 08:23:44.562841 n-d-844739-1 devstack@n-api.service[119050]: X-Role: admin,reader,member Jun 05 08:23:44.562841 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: admin,reader,member Jun 05 08:23:44.564226 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6daced84669640f69996d261a74847c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6daced84669640f69996d261a74847c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6daced84669640f69996d261a74847c4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6daced84669640f69996d261a74847c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:23:44.564226 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-178812022 Jun 05 08:23:44.564226 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 6daced84669640f69996d261a74847c4 Jun 05 08:23:44.564226 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-178812022 Jun 05 08:23:44.564226 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin Jun 05 08:23:44.564226 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:23:44.564226 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:23:44.564226 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: daf5cc65d9e9487ba56fbe23a66ef515 Jun 05 08:23:44.564226 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin Jun 05 08:23:44.564226 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:23:44.564226 n-d-844739-1 devstack@n-api.service[119050]: exception: Access list not available for public flavors. Jun 05 08:23:44.564226 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'flavor_id': '1877074577'} Jun 05 08:23:44.565145 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:23:44.565145 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:44.565145 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:44.565145 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:44.565145 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:23:44.565145 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:23:44.565145 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:23:44.565145 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:23:44.565145 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jun 05 08:23:44.565145 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 05 08:23:44.565145 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jun 05 08:23:44.565145 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:44.565145 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:44.565145 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:44.565145 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:44.565145 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:44.565145 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:44.565145 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:23:44.565145 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:23:44.565145 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jun 05 08:23:44.565145 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:44.566534 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f6b3494a-85d3-4d18-8ca0-1bbb06038e5c tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:23:44.567171 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f6b3494a-85d3-4d18-8ca0-1bbb06038e5c tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/1877074577/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.082380 Jun 05 08:23:44.574397 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 56/97] 10.222.0.33 () {58 vars in 1208 bytes} [Sun Jun 5 08:23:44 2022] GET /compute/v2.1/flavors/1877074577/os-flavor-access => generated 91 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:23:44.590575 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-55c533f3-0678-49c0-b0d7-a472d806af09 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:44.595857 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-55c533f3-0678-49c0-b0d7-a472d806af09 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:44.614692 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-55c533f3-0678-49c0-b0d7-a472d806af09 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:44.618287 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-55c533f3-0678-49c0-b0d7-a472d806af09 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:44.619476 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-55c533f3-0678-49c0-b0d7-a472d806af09 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:44.620126 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-55c533f3-0678-49c0-b0d7-a472d806af09 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:44.926328 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-9de07069-2cec-412d-8192-396eaaf5449d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] validate_networks() for [('d6fc5636-9c8b-4238-8a2c-cf51a213fbbf', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:23:45.561033 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-55c533f3-0678-49c0-b0d7-a472d806af09 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:45.570244 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-55c533f3-0678-49c0-b0d7-a472d806af09 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 200 len: 1319 microversion: 2.1 time: 0.994530 Jun 05 08:23:45.576814 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 57/98] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:44 2022] GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 1319 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:45.581624 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-449055fa-b7f5-4f6c-8da7-90b92bc7734e tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:45.584845 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:45.584845 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:45.597520 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=5,nova_api:INSERT=5 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:23:45.614834 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-449055fa-b7f5-4f6c-8da7-90b92bc7734e tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1877074577" status: 202 len: 0 microversion: 2.1 time: 0.035927 Jun 05 08:23:45.618735 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 58/99] 10.222.0.33 () {58 vars in 1160 bytes} [Sun Jun 5 08:23:45 2022] DELETE /compute/v2.1/flavors/1877074577 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:23:45.636841 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0b6c8a08-10c3-42fd-a3c9-e6e4024c0ea0 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:45.638945 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0b6c8a08-10c3-42fd-a3c9-e6e4024c0ea0 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] [instance: 63dc26bf-e378-436f-a328-a88919547afc] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:45.662666 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0b6c8a08-10c3-42fd-a3c9-e6e4024c0ea0 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:45.663154 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0b6c8a08-10c3-42fd-a3c9-e6e4024c0ea0 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:45.663979 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0b6c8a08-10c3-42fd-a3c9-e6e4024c0ea0 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:45.667592 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0b6c8a08-10c3-42fd-a3c9-e6e4024c0ea0 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:46.037503 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0b6c8a08-10c3-42fd-a3c9-e6e4024c0ea0 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3429347e644bdca51b2b3b976a7bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9587ff19dfc4eefb5129656cbdf4a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:46.049918 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0b6c8a08-10c3-42fd-a3c9-e6e4024c0ea0 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] 10.222.0.33 "GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc" status: 200 len: 1338 microversion: 2.1 time: 0.429364 Jun 05 08:23:46.052076 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 59/100] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:45 2022] GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc => generated 1338 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:46.063799 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-dfc6b963-6b45-4323-bd9a-eeaf02b7610b tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:46.098846 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-dfc6b963-6b45-4323-bd9a-eeaf02b7610b tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.045109 Jun 05 08:23:46.099987 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 60/101] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:23:46 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:46.122260 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-052ee51b-4ea4-4c85-8811-07bc8a34262a tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-853181531", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "1638903052", "adminPass": "***", "networks": [{"uuid": "c20801c1-6ea9-471f-94e8-06f626292b48"}], "security_groups": [{"name": "tempest-securitygroup--2089244299"}], "key_name": "tempest-keypair-1041185333", "user_data": "}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:46.341665 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-052ee51b-4ea4-4c85-8811-07bc8a34262a tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] validate_networks() for [('c20801c1-6ea9-471f-94e8-06f626292b48', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:23:46.368950 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-9de07069-2cec-412d-8192-396eaaf5449d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:23:46.369525 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-9de07069-2cec-412d-8192-396eaaf5449d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:23:46.369829 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-9de07069-2cec-412d-8192-396eaaf5449d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:23:46.370425 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-9de07069-2cec-412d-8192-396eaaf5449d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:23:46.370831 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-9de07069-2cec-412d-8192-396eaaf5449d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:23:46.379738 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9de07069-2cec-412d-8192-396eaaf5449d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:46.380217 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9de07069-2cec-412d-8192-396eaaf5449d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:46.381029 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9de07069-2cec-412d-8192-396eaaf5449d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:46.381620 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9de07069-2cec-412d-8192-396eaaf5449d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:46.389288 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=85 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:23:46.402575 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-9de07069-2cec-412d-8192-396eaaf5449d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Getting quotas for project 4d03f2fd71b942c58157558bc37213b2. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:23:46.407027 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-9de07069-2cec-412d-8192-396eaaf5449d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Getting quotas for user 63a93651985b4efaa4b0b2fde0f91010 and project 4d03f2fd71b942c58157558bc37213b2. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:23:46.421368 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9de07069-2cec-412d-8192-396eaaf5449d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:23:46.424008 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9de07069-2cec-412d-8192-396eaaf5449d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:23:46.454371 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=9,nova_api:DELETE=3 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:23:46.485205 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9de07069-2cec-412d-8192-396eaaf5449d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.949834 Jun 05 08:23:46.486062 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 42/102] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:23:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:23:46.491214 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0771b21d-8873-4560-9c8b-8a2b9e937339 tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-757615568", "id": 667249510, "os-flavor-access:is_public": "False"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:46.492961 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:46.492961 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:23:46.516876 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0771b21d-8873-4560-9c8b-8a2b9e937339 tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.029799 Jun 05 08:23:46.524126 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 43/103] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:23:46 2022] POST /compute/v2.1/flavors => generated 435 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:46.530014 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a9631f53-8d14-44b7-a456-9834d9e79672 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:46.530834 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a9631f53-8d14-44b7-a456-9834d9e79672 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:46.618597 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a9631f53-8d14-44b7-a456-9834d9e79672 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:46.627315 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a9631f53-8d14-44b7-a456-9834d9e79672 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1210 microversion: 2.1 time: 0.101920 Jun 05 08:23:46.628705 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 44/104] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:46 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:47.039857 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-92021f12-0e31-448f-a6d2-ade1d27966a1 tempest-FlavorsAccessNegativeTestJSON-788143202 tempest-FlavorsAccessNegativeTestJSON-788143202-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "add8e40157be4934a1b74e0d9056e2fb"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:47.041607 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:47.041607 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:23:47.043422 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-92021f12-0e31-448f-a6d2-ade1d27966a1 tempest-FlavorsAccessNegativeTestJSON-788143202 tempest-FlavorsAccessNegativeTestJSON-788143202-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'dff8568ad848420693e916d80a047b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add8e40157be4934a1b74e0d9056e2fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:47.045101 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-92021f12-0e31-448f-a6d2-ade1d27966a1 tempest-FlavorsAccessNegativeTestJSON-788143202 tempest-FlavorsAccessNegativeTestJSON-788143202-project] Request method failure captured: Jun 05 08:23:47.045101 n-d-844739-1 devstack@n-api.service[119049]: request: POST /compute/v2.1/flavors/667249510/action HTTP/1.1 Jun 05 08:23:47.045101 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:23:47.045101 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:23:47.045101 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:23:47.045101 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 67 Jun 05 08:23:47.045101 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:23:47.045101 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:23:47.045101 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:23:47.045101 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:23:47.045101 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGgCjRyQKuVEmBxhmlsKBQGCxvJcLfzb-cWwU8suK2DDACUgfCfvnbpdU9IDKtgOuPo0eny1r45yMLSC5yiYrt76gigPERI8zizjS2hxzpEBtTPrbJ8hgRbm3TMPxnIpmhc30WdCYwM6JZK1i8KSdxYuHtMnHpoRq7237irsjlgktNQ Jun 05 08:23:47.045101 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:23:47.045101 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:23:47.045101 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:23:47.045101 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:23:47.045101 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:23:47.045101 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:23:47.045101 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: add8e40157be4934a1b74e0d9056e2fb Jun 05 08:23:47.045101 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-788143202 Jun 05 08:23:47.045101 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:23:47.045101 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:23:47.046283 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/add8e40157be4934a1b74e0d9056e2fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/add8e40157be4934a1b74e0d9056e2fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_add8e40157be4934a1b74e0d9056e2fb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/add8e40157be4934a1b74e0d9056e2fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:23:47.046283 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-788143202 Jun 05 08:23:47.046283 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: add8e40157be4934a1b74e0d9056e2fb Jun 05 08:23:47.046283 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-788143202 Jun 05 08:23:47.046283 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-FlavorsAccessNegativeTestJSON-788143202-project Jun 05 08:23:47.046283 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:23:47.046283 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:23:47.046283 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: dff8568ad848420693e916d80a047b47 Jun 05 08:23:47.046283 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-788143202-project Jun 05 08:23:47.046283 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:23:47.046283 n-d-844739-1 devstack@n-api.service[119049]: {"addTenantAccess": {"tenant": "add8e40157be4934a1b74e0d9056e2fb"}} Jun 05 08:23:47.046283 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:23:47.046951 n-d-844739-1 devstack@n-api.service[119049]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jun 05 08:23:47.046951 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '667249510', 'body': {'addTenantAccess': {'tenant': 'add8e40157be4934a1b74e0d9056e2fb'}}} Jun 05 08:23:47.046951 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:23:47.046951 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:47.046951 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:47.046951 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:47.046951 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:23:47.046951 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:23:47.046951 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:23:47.046951 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:23:47.046951 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:23:47.046951 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:23:47.046951 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jun 05 08:23:47.046951 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jun 05 08:23:47.046951 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:23:47.046951 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:23:47.046951 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:23:47.046951 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:23:47.046951 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:23:47.048425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:23:47.048425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:23:47.048425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:23:47.048425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:23:47.048425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:23:47.048425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:23:47.048425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:23:47.048425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:23:47.048425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:23:47.048425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jun 05 08:23:47.048425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:47.048425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:47.048425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:47.048425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:47.048425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:47.048425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:47.048425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:23:47.048425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:23:47.048425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jun 05 08:23:47.048425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:47.051135 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-92021f12-0e31-448f-a6d2-ade1d27966a1 tempest-FlavorsAccessNegativeTestJSON-788143202 tempest-FlavorsAccessNegativeTestJSON-788143202-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:23:47.052427 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-92021f12-0e31-448f-a6d2-ade1d27966a1 tempest-FlavorsAccessNegativeTestJSON-788143202 tempest-FlavorsAccessNegativeTestJSON-788143202-project] 10.222.0.33 "POST /compute/v2.1/flavors/667249510/action" status: 403 len: 130 microversion: 2.1 time: 0.421620 Jun 05 08:23:47.053987 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 45/105] 10.222.0.33 () {60 vars in 1196 bytes} [Sun Jun 5 08:23:46 2022] POST /compute/v2.1/flavors/667249510/action => generated 130 bytes in 424 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:23:47.059191 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-23f0d5f0-debf-4ee3-96ec-37bbca8ded1e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:47.060835 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-23f0d5f0-debf-4ee3-96ec-37bbca8ded1e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:47.070251 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-23f0d5f0-debf-4ee3-96ec-37bbca8ded1e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:47.070708 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-23f0d5f0-debf-4ee3-96ec-37bbca8ded1e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:47.071535 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-23f0d5f0-debf-4ee3-96ec-37bbca8ded1e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:47.072159 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-23f0d5f0-debf-4ee3-96ec-37bbca8ded1e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:47.293517 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-23f0d5f0-debf-4ee3-96ec-37bbca8ded1e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:47.310671 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-052ee51b-4ea4-4c85-8811-07bc8a34262a tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:23:47.311194 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-052ee51b-4ea4-4c85-8811-07bc8a34262a tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:23:47.311953 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-052ee51b-4ea4-4c85-8811-07bc8a34262a tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:23:47.312402 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-052ee51b-4ea4-4c85-8811-07bc8a34262a tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:23:47.312849 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-052ee51b-4ea4-4c85-8811-07bc8a34262a tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:23:47.317508 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-23f0d5f0-debf-4ee3-96ec-37bbca8ded1e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 200 len: 1319 microversion: 2.1 time: 0.262335 Jun 05 08:23:47.318101 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 46/106] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:47 2022] GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:47.323163 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ca7091c3-27cf-487c-a8e4-b7821478e778 tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:47.323926 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:47.323926 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:23:47.324143 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-052ee51b-4ea4-4c85-8811-07bc8a34262a tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:47.324446 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-052ee51b-4ea4-4c85-8811-07bc8a34262a tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:47.325248 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-052ee51b-4ea4-4c85-8811-07bc8a34262a tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:47.325716 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-052ee51b-4ea4-4c85-8811-07bc8a34262a tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:47.349723 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ca7091c3-27cf-487c-a8e4-b7821478e778 tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/667249510" status: 202 len: 0 microversion: 2.1 time: 0.029710 Jun 05 08:23:47.350972 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 47/107] 10.222.0.33 () {58 vars in 1157 bytes} [Sun Jun 5 08:23:47 2022] DELETE /compute/v2.1/flavors/667249510 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:23:47.356503 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3d801b91-1920-4fc3-9dad-f4d625766719 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:47.356680 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-052ee51b-4ea4-4c85-8811-07bc8a34262a tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Getting quotas for project 0348d3b9a38d437c8e82a24be537c848. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:23:47.357742 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3d801b91-1920-4fc3-9dad-f4d625766719 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] [instance: 63dc26bf-e378-436f-a328-a88919547afc] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:47.361209 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-052ee51b-4ea4-4c85-8811-07bc8a34262a tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Getting quotas for user da4cc519c13c4b88bfff58f418bcdb4f and project 0348d3b9a38d437c8e82a24be537c848. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:23:47.364680 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3d801b91-1920-4fc3-9dad-f4d625766719 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:47.366160 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3d801b91-1920-4fc3-9dad-f4d625766719 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:47.367421 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3d801b91-1920-4fc3-9dad-f4d625766719 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:47.368098 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3d801b91-1920-4fc3-9dad-f4d625766719 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:47.376310 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-052ee51b-4ea4-4c85-8811-07bc8a34262a tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:23:47.379392 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-052ee51b-4ea4-4c85-8811-07bc8a34262a tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: e4c09fb3-f67f-4b07-a992-2e70683932bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:23:47.453025 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-052ee51b-4ea4-4c85-8811-07bc8a34262a tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.351834 Jun 05 08:23:47.456478 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 61/108] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:23:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 1356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:23:47.468008 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-47c7a506-99d3-4065-8a43-9657df74f965 tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:47.535010 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-47c7a506-99d3-4065-8a43-9657df74f965 tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.077073 Jun 05 08:23:47.537470 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 62/109] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:23:47 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:47.546898 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3d613752-a3b2-4c27-a5e4-1a4f21a76dc0 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:47.547692 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3d613752-a3b2-4c27-a5e4-1a4f21a76dc0 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: e4c09fb3-f67f-4b07-a992-2e70683932bd] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:47.621011 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3d613752-a3b2-4c27-a5e4-1a4f21a76dc0 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:47.624909 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3d801b91-1920-4fc3-9dad-f4d625766719 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3429347e644bdca51b2b3b976a7bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9587ff19dfc4eefb5129656cbdf4a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:47.630185 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3d613752-a3b2-4c27-a5e4-1a4f21a76dc0 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd" status: 200 len: 1264 microversion: 2.1 time: 0.091244 Jun 05 08:23:47.630820 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 63/110] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:47 2022] GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd => generated 1264 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:47.636863 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-bc1a239b-dec5-475d-ae5c-6d1830a24dbf tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1656483069", "id": 1400323487, "os-flavor-access:is_public": "False"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:47.645100 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3d801b91-1920-4fc3-9dad-f4d625766719 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] 10.222.0.33 "GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc" status: 200 len: 1338 microversion: 2.1 time: 0.292824 Jun 05 08:23:47.646500 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:47.646500 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:47.653758 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 48/111] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:47 2022] GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc => generated 1338 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:47.666991 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-705f011c-f519-43ca-8d03-8d5af5fcefb7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:47.667646 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-705f011c-f519-43ca-8d03-8d5af5fcefb7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:47.672495 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-bc1a239b-dec5-475d-ae5c-6d1830a24dbf tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.040413 Jun 05 08:23:47.679705 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 64/112] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:23:47 2022] POST /compute/v2.1/flavors => generated 439 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:47.683332 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-705f011c-f519-43ca-8d03-8d5af5fcefb7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:47.683981 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-705f011c-f519-43ca-8d03-8d5af5fcefb7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:47.684792 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-705f011c-f519-43ca-8d03-8d5af5fcefb7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:47.685116 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-21d22869-f71e-4f2e-b7f0-2178d012982f tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "add8e40157be4934a1b74e0d9056e2fb"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:47.685249 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-705f011c-f519-43ca-8d03-8d5af5fcefb7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:47.686524 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:47.686524 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:47.767163 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-705f011c-f519-43ca-8d03-8d5af5fcefb7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:47.778459 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-705f011c-f519-43ca-8d03-8d5af5fcefb7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1262 microversion: 2.1 time: 0.122393 Jun 05 08:23:47.780213 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 49/113] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:47 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1262 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:48.054035 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-21d22869-f71e-4f2e-b7f0-2178d012982f tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1400323487/action" status: 200 len: 97 microversion: 2.1 time: 0.372863 Jun 05 08:23:48.055098 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 65/114] 10.222.0.33 () {60 vars in 1199 bytes} [Sun Jun 5 08:23:47 2022] POST /compute/v2.1/flavors/1400323487/action => generated 97 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 05 08:23:48.064549 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9ceead99-964b-4e73-8106-9ffb0be0a137 tempest-FlavorsAccessNegativeTestJSON-788143202 tempest-FlavorsAccessNegativeTestJSON-788143202-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "add8e40157be4934a1b74e0d9056e2fb"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:48.066063 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:48.066063 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:23:48.067346 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9ceead99-964b-4e73-8106-9ffb0be0a137 tempest-FlavorsAccessNegativeTestJSON-788143202 tempest-FlavorsAccessNegativeTestJSON-788143202-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'dff8568ad848420693e916d80a047b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add8e40157be4934a1b74e0d9056e2fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:48.069159 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9ceead99-964b-4e73-8106-9ffb0be0a137 tempest-FlavorsAccessNegativeTestJSON-788143202 tempest-FlavorsAccessNegativeTestJSON-788143202-project] Request method failure captured: Jun 05 08:23:48.069159 n-d-844739-1 devstack@n-api.service[119049]: request: POST /compute/v2.1/flavors/1400323487/action HTTP/1.1 Jun 05 08:23:48.069159 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:23:48.069159 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:23:48.069159 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:23:48.069159 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 70 Jun 05 08:23:48.069159 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:23:48.069159 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:23:48.069159 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:23:48.069159 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:23:48.069159 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGgCjRyQKuVEmBxhmlsKBQGCxvJcLfzb-cWwU8suK2DDACUgfCfvnbpdU9IDKtgOuPo0eny1r45yMLSC5yiYrt76gigPERI8zizjS2hxzpEBtTPrbJ8hgRbm3TMPxnIpmhc30WdCYwM6JZK1i8KSdxYuHtMnHpoRq7237irsjlgktNQ Jun 05 08:23:48.069159 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:23:48.069159 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:23:48.069159 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:23:48.069159 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:23:48.069159 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:23:48.069159 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:23:48.069159 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: add8e40157be4934a1b74e0d9056e2fb Jun 05 08:23:48.069159 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-788143202 Jun 05 08:23:48.069159 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:23:48.069159 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:23:48.070509 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/add8e40157be4934a1b74e0d9056e2fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/add8e40157be4934a1b74e0d9056e2fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_add8e40157be4934a1b74e0d9056e2fb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/add8e40157be4934a1b74e0d9056e2fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:23:48.070509 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-788143202 Jun 05 08:23:48.070509 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: add8e40157be4934a1b74e0d9056e2fb Jun 05 08:23:48.070509 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-788143202 Jun 05 08:23:48.070509 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-FlavorsAccessNegativeTestJSON-788143202-project Jun 05 08:23:48.070509 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:23:48.070509 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:23:48.070509 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: dff8568ad848420693e916d80a047b47 Jun 05 08:23:48.070509 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-788143202-project Jun 05 08:23:48.070509 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:23:48.070509 n-d-844739-1 devstack@n-api.service[119049]: {"removeTenantAccess": {"tenant": "add8e40157be4934a1b74e0d9056e2fb"}} Jun 05 08:23:48.070509 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:23:48.071479 n-d-844739-1 devstack@n-api.service[119049]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jun 05 08:23:48.071479 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '1400323487', 'body': {'removeTenantAccess': {'tenant': 'add8e40157be4934a1b74e0d9056e2fb'}}} Jun 05 08:23:48.071479 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:23:48.071479 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:48.071479 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:48.071479 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:48.071479 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:23:48.071479 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:23:48.071479 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:23:48.071479 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:23:48.071479 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:23:48.071479 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:23:48.071479 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jun 05 08:23:48.071479 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi context.can( Jun 05 08:23:48.071479 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:23:48.071479 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:23:48.071479 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:23:48.071479 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:23:48.071479 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:23:48.071479 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:23:48.072757 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:23:48.072757 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:23:48.072757 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:23:48.072757 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:23:48.072757 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:23:48.072757 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:23:48.072757 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:23:48.072757 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:23:48.072757 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jun 05 08:23:48.072757 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:48.072757 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:48.072757 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:48.072757 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:48.072757 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:48.072757 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:48.072757 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:23:48.072757 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:23:48.072757 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jun 05 08:23:48.072757 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:48.073914 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9ceead99-964b-4e73-8106-9ffb0be0a137 tempest-FlavorsAccessNegativeTestJSON-788143202 tempest-FlavorsAccessNegativeTestJSON-788143202-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:23:48.073914 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9ceead99-964b-4e73-8106-9ffb0be0a137 tempest-FlavorsAccessNegativeTestJSON-788143202 tempest-FlavorsAccessNegativeTestJSON-788143202-project] 10.222.0.33 "POST /compute/v2.1/flavors/1400323487/action" status: 403 len: 133 microversion: 2.1 time: 0.013117 Jun 05 08:23:48.074354 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 50/115] 10.222.0.33 () {60 vars in 1199 bytes} [Sun Jun 5 08:23:48 2022] POST /compute/v2.1/flavors/1400323487/action => generated 133 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:23:48.082239 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cb1182b7-5da0-4913-8625-221775166be3 tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "add8e40157be4934a1b74e0d9056e2fb"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:48.083500 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:48.083500 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:48.294160 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-cb1182b7-5da0-4913-8625-221775166be3 tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1400323487/action" status: 200 len: 21 microversion: 2.1 time: 0.215504 Jun 05 08:23:48.295210 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 66/116] 10.222.0.33 () {60 vars in 1199 bytes} [Sun Jun 5 08:23:48 2022] POST /compute/v2.1/flavors/1400323487/action => generated 21 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 05 08:23:48.304798 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6d46bde3-cf10-4ca2-bc8a-3989748055c0 tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:48.306759 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:48.306759 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:23:48.327907 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6d46bde3-cf10-4ca2-bc8a-3989748055c0 tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1400323487" status: 202 len: 0 microversion: 2.1 time: 0.027741 Jun 05 08:23:48.328798 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 51/117] 10.222.0.33 () {58 vars in 1160 bytes} [Sun Jun 5 08:23:48 2022] DELETE /compute/v2.1/flavors/1400323487 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:23:48.337909 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-af5044fd-e1de-4ab3-b0e8-06f6f4f00eb1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:48.343356 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-af5044fd-e1de-4ab3-b0e8-06f6f4f00eb1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:48.351963 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-af5044fd-e1de-4ab3-b0e8-06f6f4f00eb1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:48.352515 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-af5044fd-e1de-4ab3-b0e8-06f6f4f00eb1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:48.353300 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-af5044fd-e1de-4ab3-b0e8-06f6f4f00eb1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:48.353877 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-af5044fd-e1de-4ab3-b0e8-06f6f4f00eb1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:48.354219 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-080c4f53-4edb-4557-913a-cf98407a3090 tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:48.379319 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-080c4f53-4edb-4557-913a-cf98407a3090 tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.033844 Jun 05 08:23:48.380110 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 52/118] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:23:48 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:48.397358 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6960d7c7-feef-4dc2-b355-5358961f993a tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-821693389", "id": 1657138899, "os-flavor-access:is_public": "False"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:48.399312 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:48.399312 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:23:48.421724 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6960d7c7-feef-4dc2-b355-5358961f993a tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.028535 Jun 05 08:23:48.423171 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 53/119] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:23:48 2022] POST /compute/v2.1/flavors => generated 438 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:48.434142 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9a3c0f99-f5c9-443a-8f48-557dc985a83e tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "f3e7756e80c74f4bae2829bc44c49c04"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:48.538215 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-af5044fd-e1de-4ab3-b0e8-06f6f4f00eb1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:48.547467 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-af5044fd-e1de-4ab3-b0e8-06f6f4f00eb1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 200 len: 1319 microversion: 2.1 time: 0.214416 Jun 05 08:23:48.550257 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 67/120] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:48 2022] GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:48.647480 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-59be1971-7bda-4f2d-be1f-8524da34ee96 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:48.648509 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-59be1971-7bda-4f2d-be1f-8524da34ee96 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: e4c09fb3-f67f-4b07-a992-2e70683932bd] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:48.655247 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-59be1971-7bda-4f2d-be1f-8524da34ee96 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:48.655787 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-59be1971-7bda-4f2d-be1f-8524da34ee96 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:48.656696 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-59be1971-7bda-4f2d-be1f-8524da34ee96 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:48.657217 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-59be1971-7bda-4f2d-be1f-8524da34ee96 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:48.728322 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-9a3c0f99-f5c9-443a-8f48-557dc985a83e tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] HTTP exception thrown: Flavor access not found for 25 / f3e7756e80c74f4bae2829bc44c49c04 combination. Jun 05 08:23:48.729265 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-59be1971-7bda-4f2d-be1f-8524da34ee96 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:48.730828 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9a3c0f99-f5c9-443a-8f48-557dc985a83e tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] Request method failure captured: Jun 05 08:23:48.730828 n-d-844739-1 devstack@n-api.service[119049]: request: POST /compute/v2.1/flavors/1657138899/action HTTP/1.1 Jun 05 08:23:48.730828 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:23:48.730828 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:23:48.730828 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:23:48.730828 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 70 Jun 05 08:23:48.730828 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:23:48.730828 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:23:48.730828 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:23:48.730828 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:23:48.730828 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGgG84fvWaFjMLnrJexNpazYuMIOApOMXotDDPLfqesAabNuWfG5n6-t9NkpMT-GuS4s8SW8tnTvq1GiNc7xxTZfjOLaeju4dbuF-BTbVxp1CGBdJhWD25l898md2rBXWN12LX-LtpLj4xihYSFdBBPiLU9HtPeuzrnfToiE6Qc-TCs Jun 05 08:23:48.730828 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:23:48.730828 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:23:48.730828 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:23:48.730828 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:23:48.730828 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:23:48.730828 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:23:48.730828 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 6daced84669640f69996d261a74847c4 Jun 05 08:23:48.730828 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-178812022 Jun 05 08:23:48.730828 n-d-844739-1 devstack@n-api.service[119049]: X-Role: admin,reader,member Jun 05 08:23:48.730828 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: admin,reader,member Jun 05 08:23:48.732313 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6daced84669640f69996d261a74847c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6daced84669640f69996d261a74847c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6daced84669640f69996d261a74847c4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6daced84669640f69996d261a74847c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:23:48.732313 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-178812022 Jun 05 08:23:48.732313 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 6daced84669640f69996d261a74847c4 Jun 05 08:23:48.732313 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-178812022 Jun 05 08:23:48.732313 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin Jun 05 08:23:48.732313 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:23:48.732313 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:23:48.732313 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: daf5cc65d9e9487ba56fbe23a66ef515 Jun 05 08:23:48.732313 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin Jun 05 08:23:48.732313 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:23:48.732313 n-d-844739-1 devstack@n-api.service[119049]: {"removeTenantAccess": {"tenant": "f3e7756e80c74f4bae2829bc44c49c04"}} Jun 05 08:23:48.732313 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:23:48.733103 n-d-844739-1 devstack@n-api.service[119049]: exception: Flavor access not found for 25 / f3e7756e80c74f4bae2829bc44c49c04 combination. Jun 05 08:23:48.733103 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '1657138899', 'body': {'removeTenantAccess': {'tenant': 'f3e7756e80c74f4bae2829bc44c49c04'}}} Jun 05 08:23:48.733103 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:23:48.733103 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:48.733103 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jun 05 08:23:48.733103 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jun 05 08:23:48.733103 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 05 08:23:48.733103 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 05 08:23:48.733103 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jun 05 08:23:48.733103 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jun 05 08:23:48.733103 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jun 05 08:23:48.733103 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jun 05 08:23:48.733103 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jun 05 08:23:48.733103 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jun 05 08:23:48.733103 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 05 08:23:48.733103 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 05 08:23:48.733103 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jun 05 08:23:48.733103 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jun 05 08:23:48.734371 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 25 / f3e7756e80c74f4bae2829bc44c49c04 combination. Jun 05 08:23:48.734371 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:48.734371 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:48.734371 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:48.734371 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:48.734371 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:48.734371 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:48.734371 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:23:48.734371 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:23:48.734371 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:23:48.734371 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:23:48.734371 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:23:48.734371 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:23:48.734371 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jun 05 08:23:48.734371 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:23:48.734371 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 25 / f3e7756e80c74f4bae2829bc44c49c04 combination. Jun 05 08:23:48.734371 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:48.734371 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:48.734371 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:48.734371 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:48.735642 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:48.735642 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:48.735642 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:23:48.735642 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:23:48.735642 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 25 / f3e7756e80c74f4bae2829bc44c49c04 combination. Jun 05 08:23:48.735642 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:48.736794 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9a3c0f99-f5c9-443a-8f48-557dc985a83e tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] Returning 404 to user: Flavor access not found for 25 / f3e7756e80c74f4bae2829bc44c49c04 combination. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:23:48.737741 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9a3c0f99-f5c9-443a-8f48-557dc985a83e tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1657138899/action" status: 404 len: 124 microversion: 2.1 time: 0.308287 Jun 05 08:23:48.737871 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-59be1971-7bda-4f2d-be1f-8524da34ee96 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd" status: 200 len: 1268 microversion: 2.1 time: 0.094863 Jun 05 08:23:48.738327 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 54/122] 10.222.0.33 () {60 vars in 1199 bytes} [Sun Jun 5 08:23:48 2022] POST /compute/v2.1/flavors/1657138899/action => generated 124 bytes in 309 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:23:48.738445 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 68/122] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:48 2022] GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd => generated 1268 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:48.743615 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9f0965ee-3b28-4062-9e3e-17b39d976b33 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:48.744540 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9f0965ee-3b28-4062-9e3e-17b39d976b33 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] [instance: 63dc26bf-e378-436f-a328-a88919547afc] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:48.750764 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9f0965ee-3b28-4062-9e3e-17b39d976b33 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:48.750905 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-36d77774-51b2-44e8-a33b-f55d86dc5afc tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:48.751222 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9f0965ee-3b28-4062-9e3e-17b39d976b33 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:48.752074 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9f0965ee-3b28-4062-9e3e-17b39d976b33 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:48.752524 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9f0965ee-3b28-4062-9e3e-17b39d976b33 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:48.772600 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-36d77774-51b2-44e8-a33b-f55d86dc5afc tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1657138899" status: 202 len: 0 microversion: 2.1 time: 0.027451 Jun 05 08:23:48.773653 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 55/123] 10.222.0.33 () {58 vars in 1160 bytes} [Sun Jun 5 08:23:48 2022] DELETE /compute/v2.1/flavors/1657138899 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:23:48.910146 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-9f0965ee-3b28-4062-9e3e-17b39d976b33 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3429347e644bdca51b2b3b976a7bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9587ff19dfc4eefb5129656cbdf4a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:48.919379 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9f0965ee-3b28-4062-9e3e-17b39d976b33 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] 10.222.0.33 "GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc" status: 200 len: 1338 microversion: 2.1 time: 0.179608 Jun 05 08:23:48.922124 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 69/124] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:48 2022] GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc => generated 1338 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:48.927222 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-482c20a1-f0f8-429f-8eaf-ad900d51017c tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:48.933407 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1e80b855-f9fb-4059-9889-a93456329201 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-664365756", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:48.949585 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-482c20a1-f0f8-429f-8eaf-ad900d51017c tempest-FlavorsAccessNegativeTestJSON-178812022 tempest-FlavorsAccessNegativeTestJSON-178812022-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.025914 Jun 05 08:23:48.955098 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 70/125] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:23:48 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:48.956441 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-70f6af7d-ce40-4a5c-bdb9-5a49ab45e4e2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:48.957221 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-70f6af7d-ce40-4a5c-bdb9-5a49ab45e4e2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:48.971459 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-70f6af7d-ce40-4a5c-bdb9-5a49ab45e4e2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:48.972270 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-70f6af7d-ce40-4a5c-bdb9-5a49ab45e4e2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:48.973572 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-70f6af7d-ce40-4a5c-bdb9-5a49ab45e4e2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:48.974190 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-70f6af7d-ce40-4a5c-bdb9-5a49ab45e4e2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:49.007330 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-1e80b855-f9fb-4059-9889-a93456329201 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] validate_networks() for None {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:23:49.048075 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-70f6af7d-ce40-4a5c-bdb9-5a49ab45e4e2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:49.061267 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-70f6af7d-ce40-4a5c-bdb9-5a49ab45e4e2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1280 microversion: 2.1 time: 0.109694 Jun 05 08:23:49.062277 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 71/126] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:48 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1280 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:49.247825 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-1e80b855-f9fb-4059-9889-a93456329201 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:23:49.248301 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-1e80b855-f9fb-4059-9889-a93456329201 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:23:49.248780 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-1e80b855-f9fb-4059-9889-a93456329201 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:23:49.249189 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-1e80b855-f9fb-4059-9889-a93456329201 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:23:49.249602 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-1e80b855-f9fb-4059-9889-a93456329201 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:23:49.258794 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1e80b855-f9fb-4059-9889-a93456329201 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:49.259245 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1e80b855-f9fb-4059-9889-a93456329201 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:49.260139 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1e80b855-f9fb-4059-9889-a93456329201 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:49.260710 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1e80b855-f9fb-4059-9889-a93456329201 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:49.278385 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-1e80b855-f9fb-4059-9889-a93456329201 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Getting quotas for project 68bdb8ea7b9848e598fadcaa8e92a86e. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:23:49.282428 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-1e80b855-f9fb-4059-9889-a93456329201 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Getting quotas for user ec38465e5e8e4925ba6c71a6b1e3246d and project 68bdb8ea7b9848e598fadcaa8e92a86e. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:23:49.293845 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1e80b855-f9fb-4059-9889-a93456329201 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:23:49.295969 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1e80b855-f9fb-4059-9889-a93456329201 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 121df5fc-10cc-4f27-bbe8-878791f857a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:23:49.342631 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1e80b855-f9fb-4059-9889-a93456329201 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567308 Jun 05 08:23:49.343464 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 56/127] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:23:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:23:49.354703 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2ce001e9-02c6-4325-a842-98f141d8eccb tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:49.355317 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2ce001e9-02c6-4325-a842-98f141d8eccb tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 121df5fc-10cc-4f27-bbe8-878791f857a2] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:49.422604 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2ce001e9-02c6-4325-a842-98f141d8eccb tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:49.430774 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2ce001e9-02c6-4325-a842-98f141d8eccb tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2" status: 200 len: 1218 microversion: 2.1 time: 0.081089 Jun 05 08:23:49.437769 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 72/128] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:49 2022] GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:49.566555 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7ce7dfba-f762-496e-9883-6af3f417cd73 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:49.567128 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7ce7dfba-f762-496e-9883-6af3f417cd73 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:49.576311 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7ce7dfba-f762-496e-9883-6af3f417cd73 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:49.578123 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7ce7dfba-f762-496e-9883-6af3f417cd73 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:49.579067 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7ce7dfba-f762-496e-9883-6af3f417cd73 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:49.579760 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7ce7dfba-f762-496e-9883-6af3f417cd73 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:49.730303 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7ce7dfba-f762-496e-9883-6af3f417cd73 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:49.738870 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7ce7dfba-f762-496e-9883-6af3f417cd73 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 200 len: 1319 microversion: 2.1 time: 0.176402 Jun 05 08:23:49.740073 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 57/129] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:49 2022] GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:49.757117 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5b4a73f1-cad6-41bf-bd91-c2510fc49fba tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:49.758167 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5b4a73f1-cad6-41bf-bd91-c2510fc49fba tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: e4c09fb3-f67f-4b07-a992-2e70683932bd] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:49.766088 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5b4a73f1-cad6-41bf-bd91-c2510fc49fba tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:49.766832 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5b4a73f1-cad6-41bf-bd91-c2510fc49fba tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:49.767677 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5b4a73f1-cad6-41bf-bd91-c2510fc49fba tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:49.768217 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5b4a73f1-cad6-41bf-bd91-c2510fc49fba tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:49.837881 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5b4a73f1-cad6-41bf-bd91-c2510fc49fba tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:49.846948 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5b4a73f1-cad6-41bf-bd91-c2510fc49fba tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd" status: 200 len: 1268 microversion: 2.1 time: 0.095866 Jun 05 08:23:49.847922 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 73/130] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:49 2022] GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd => generated 1268 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:49.936768 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ea6894fe-6b0d-4b00-9697-674b77fd8758 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:49.937687 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ea6894fe-6b0d-4b00-9697-674b77fd8758 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] [instance: 63dc26bf-e378-436f-a328-a88919547afc] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:49.944568 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ea6894fe-6b0d-4b00-9697-674b77fd8758 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:49.945331 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ea6894fe-6b0d-4b00-9697-674b77fd8758 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:49.946212 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ea6894fe-6b0d-4b00-9697-674b77fd8758 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:49.946880 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ea6894fe-6b0d-4b00-9697-674b77fd8758 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:50.081571 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3fb9dc2d-4305-43f6-be1e-20d97a9b4a4f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:50.082573 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3fb9dc2d-4305-43f6-be1e-20d97a9b4a4f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:50.090147 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3fb9dc2d-4305-43f6-be1e-20d97a9b4a4f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:50.090790 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3fb9dc2d-4305-43f6-be1e-20d97a9b4a4f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:50.091785 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3fb9dc2d-4305-43f6-be1e-20d97a9b4a4f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:50.092412 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3fb9dc2d-4305-43f6-be1e-20d97a9b4a4f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:50.110452 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ea6894fe-6b0d-4b00-9697-674b77fd8758 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3429347e644bdca51b2b3b976a7bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9587ff19dfc4eefb5129656cbdf4a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:50.121514 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ea6894fe-6b0d-4b00-9697-674b77fd8758 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] 10.222.0.33 "GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc" status: 200 len: 1338 microversion: 2.1 time: 0.188418 Jun 05 08:23:50.132654 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 58/131] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:49 2022] GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc => generated 1338 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:50.165590 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3fb9dc2d-4305-43f6-be1e-20d97a9b4a4f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:50.173626 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3fb9dc2d-4305-43f6-be1e-20d97a9b4a4f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1280 microversion: 2.1 time: 0.097336 Jun 05 08:23:50.174206 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 74/132] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:50 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1280 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:50.450648 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b13adf00-f1e3-4380-a338-364ef56160e4 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:50.451776 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b13adf00-f1e3-4380-a338-364ef56160e4 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 121df5fc-10cc-4f27-bbe8-878791f857a2] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:50.462489 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b13adf00-f1e3-4380-a338-364ef56160e4 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:50.466052 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b13adf00-f1e3-4380-a338-364ef56160e4 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:50.467447 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b13adf00-f1e3-4380-a338-364ef56160e4 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:50.468161 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b13adf00-f1e3-4380-a338-364ef56160e4 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:50.745129 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b13adf00-f1e3-4380-a338-364ef56160e4 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:50.758393 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b13adf00-f1e3-4380-a338-364ef56160e4 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2" status: 200 len: 1299 microversion: 2.1 time: 0.310732 Jun 05 08:23:50.769198 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 59/133] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:50 2022] GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2 => generated 1299 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:50.777334 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bbb80bd1-c30f-4bd1-a69f-9a7cd3570463 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:50.777893 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-bbb80bd1-c30f-4bd1-a69f-9a7cd3570463 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:50.786522 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bbb80bd1-c30f-4bd1-a69f-9a7cd3570463 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:50.788241 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bbb80bd1-c30f-4bd1-a69f-9a7cd3570463 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:50.789577 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bbb80bd1-c30f-4bd1-a69f-9a7cd3570463 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:50.791460 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bbb80bd1-c30f-4bd1-a69f-9a7cd3570463 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:50.938194 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-6cb0e567-32f1-44ef-9b01-c0e8b71a3aae req-fc44e5a2-9831-44d8-974d-a65d5d7be1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63dc26bf-e378-436f-a328-a88919547afc", "name": "network-vif-plugged", "status": "completed", "tag": "5ba0a894-464e-424e-a5f1-bfb7549d1603"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:50.950644 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-6cb0e567-32f1-44ef-9b01-c0e8b71a3aae req-fc44e5a2-9831-44d8-974d-a65d5d7be1e9 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:50.951438 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-6cb0e567-32f1-44ef-9b01-c0e8b71a3aae req-fc44e5a2-9831-44d8-974d-a65d5d7be1e9 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:50.972360 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-6cb0e567-32f1-44ef-9b01-c0e8b71a3aae req-fc44e5a2-9831-44d8-974d-a65d5d7be1e9 service nova] Creating event network-vif-plugged:5ba0a894-464e-424e-a5f1-bfb7549d1603 for instance 63dc26bf-e378-436f-a328-a88919547afc on n-h2-844739-1 Jun 05 08:23:50.978211 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-6cb0e567-32f1-44ef-9b01-c0e8b71a3aae req-fc44e5a2-9831-44d8-974d-a65d5d7be1e9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.250660 Jun 05 08:23:50.981806 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 75/134] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:50.986972 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6166ea7b-6308-4876-9179-d5ab32811cd7 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:50.987687 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6166ea7b-6308-4876-9179-d5ab32811cd7 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: e4c09fb3-f67f-4b07-a992-2e70683932bd] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:50.995771 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6166ea7b-6308-4876-9179-d5ab32811cd7 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:50.996508 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6166ea7b-6308-4876-9179-d5ab32811cd7 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:50.997806 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6166ea7b-6308-4876-9179-d5ab32811cd7 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:50.998478 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6166ea7b-6308-4876-9179-d5ab32811cd7 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:51.156657 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6166ea7b-6308-4876-9179-d5ab32811cd7 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:51.178890 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6166ea7b-6308-4876-9179-d5ab32811cd7 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd" status: 200 len: 1316 microversion: 2.1 time: 0.195771 Jun 05 08:23:51.179755 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 76/135] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:50 2022] GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd => generated 1316 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:51.192205 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4f1533a3-365f-4f4f-9db2-18f67ed46607 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:51.194168 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4f1533a3-365f-4f4f-9db2-18f67ed46607 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] [instance: 63dc26bf-e378-436f-a328-a88919547afc] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:51.206558 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4f1533a3-365f-4f4f-9db2-18f67ed46607 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:51.208654 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4f1533a3-365f-4f4f-9db2-18f67ed46607 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:51.210870 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4f1533a3-365f-4f4f-9db2-18f67ed46607 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:51.211858 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4f1533a3-365f-4f4f-9db2-18f67ed46607 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:51.341514 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-bbb80bd1-c30f-4bd1-a69f-9a7cd3570463 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:51.364911 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bbb80bd1-c30f-4bd1-a69f-9a7cd3570463 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 200 len: 1319 microversion: 2.1 time: 0.591355 Jun 05 08:23:51.367636 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 60/136] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:50 2022] GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 1319 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:51.401575 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2df7016e-4efb-44f3-bd4b-846c9c880c41 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:51.402497 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2df7016e-4efb-44f3-bd4b-846c9c880c41 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:51.423731 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2df7016e-4efb-44f3-bd4b-846c9c880c41 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:51.424388 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2df7016e-4efb-44f3-bd4b-846c9c880c41 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:51.425658 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2df7016e-4efb-44f3-bd4b-846c9c880c41 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:51.429058 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2df7016e-4efb-44f3-bd4b-846c9c880c41 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:51.716111 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2df7016e-4efb-44f3-bd4b-846c9c880c41 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:51.725616 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2df7016e-4efb-44f3-bd4b-846c9c880c41 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1268 microversion: 2.1 time: 0.328333 Jun 05 08:23:51.726325 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 61/137] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:51 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1268 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:51.776829 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b3591f5a-7b69-4e9b-8aa0-bfe7fb78f32b tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:51.778403 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b3591f5a-7b69-4e9b-8aa0-bfe7fb78f32b tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 121df5fc-10cc-4f27-bbe8-878791f857a2] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:51.785012 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b3591f5a-7b69-4e9b-8aa0-bfe7fb78f32b tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:51.785731 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b3591f5a-7b69-4e9b-8aa0-bfe7fb78f32b tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:51.786587 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b3591f5a-7b69-4e9b-8aa0-bfe7fb78f32b tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:51.787911 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b3591f5a-7b69-4e9b-8aa0-bfe7fb78f32b tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:51.856433 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4f1533a3-365f-4f4f-9db2-18f67ed46607 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3429347e644bdca51b2b3b976a7bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9587ff19dfc4eefb5129656cbdf4a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:51.865187 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4f1533a3-365f-4f4f-9db2-18f67ed46607 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] 10.222.0.33 "GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc" status: 200 len: 1338 microversion: 2.1 time: 0.684152 Jun 05 08:23:51.865780 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 77/138] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:51 2022] GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc => generated 1338 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:51.892828 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b3591f5a-7b69-4e9b-8aa0-bfe7fb78f32b tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:51.901655 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b3591f5a-7b69-4e9b-8aa0-bfe7fb78f32b tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2" status: 200 len: 1297 microversion: 2.1 time: 0.130693 Jun 05 08:23:51.902268 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 62/139] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:51 2022] GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2 => generated 1297 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:23:52.205853 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c2bdc939-a722-4ff8-af16-47d9d83838b2 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:52.207915 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c2bdc939-a722-4ff8-af16-47d9d83838b2 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: e4c09fb3-f67f-4b07-a992-2e70683932bd] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:52.224869 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c2bdc939-a722-4ff8-af16-47d9d83838b2 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:52.225809 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c2bdc939-a722-4ff8-af16-47d9d83838b2 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:52.228742 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c2bdc939-a722-4ff8-af16-47d9d83838b2 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:52.230753 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c2bdc939-a722-4ff8-af16-47d9d83838b2 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:52.386563 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8fc757c2-9e18-4b9a-b41e-71add0f816eb tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:52.388547 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8fc757c2-9e18-4b9a-b41e-71add0f816eb tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:52.402765 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8fc757c2-9e18-4b9a-b41e-71add0f816eb tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:52.402954 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8fc757c2-9e18-4b9a-b41e-71add0f816eb tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:52.403762 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8fc757c2-9e18-4b9a-b41e-71add0f816eb tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:52.404249 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8fc757c2-9e18-4b9a-b41e-71add0f816eb tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:52.627784 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c2bdc939-a722-4ff8-af16-47d9d83838b2 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:52.639228 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c2bdc939-a722-4ff8-af16-47d9d83838b2 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd" status: 200 len: 1390 microversion: 2.1 time: 0.439412 Jun 05 08:23:52.640297 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 78/140] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:52 2022] GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd => generated 1390 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:52.743595 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b979e066-31c3-4a83-9aab-fa8cb98ab46c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:52.744243 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b979e066-31c3-4a83-9aab-fa8cb98ab46c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:52.753199 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b979e066-31c3-4a83-9aab-fa8cb98ab46c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:52.757858 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b979e066-31c3-4a83-9aab-fa8cb98ab46c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:52.758891 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b979e066-31c3-4a83-9aab-fa8cb98ab46c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:52.759497 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b979e066-31c3-4a83-9aab-fa8cb98ab46c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:52.894753 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8fc757c2-9e18-4b9a-b41e-71add0f816eb tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:52.906001 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8fc757c2-9e18-4b9a-b41e-71add0f816eb tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 200 len: 1319 microversion: 2.1 time: 0.525434 Jun 05 08:23:52.920507 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 63/141] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:52 2022] GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 1319 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:52.927250 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7f9004c2-bc06-4752-a8d0-759205823ae4 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:52.929033 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7f9004c2-bc06-4752-a8d0-759205823ae4 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] [instance: 63dc26bf-e378-436f-a328-a88919547afc] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:52.937396 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7f9004c2-bc06-4752-a8d0-759205823ae4 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:52.938124 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7f9004c2-bc06-4752-a8d0-759205823ae4 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:52.939362 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7f9004c2-bc06-4752-a8d0-759205823ae4 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:52.940143 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7f9004c2-bc06-4752-a8d0-759205823ae4 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:53.325885 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b979e066-31c3-4a83-9aab-fa8cb98ab46c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:53.339606 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b979e066-31c3-4a83-9aab-fa8cb98ab46c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1310 microversion: 2.1 time: 0.599686 Jun 05 08:23:53.342290 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 79/142] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:52 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1310 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:23:53.351021 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e8a8f5ff-b05b-4b45-9b2f-7532bee792d7 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:53.356643 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e8a8f5ff-b05b-4b45-9b2f-7532bee792d7 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 121df5fc-10cc-4f27-bbe8-878791f857a2] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:53.380335 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e8a8f5ff-b05b-4b45-9b2f-7532bee792d7 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:53.382353 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e8a8f5ff-b05b-4b45-9b2f-7532bee792d7 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:53.383537 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e8a8f5ff-b05b-4b45-9b2f-7532bee792d7 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:53.384240 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e8a8f5ff-b05b-4b45-9b2f-7532bee792d7 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:53.438002 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7f9004c2-bc06-4752-a8d0-759205823ae4 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3429347e644bdca51b2b3b976a7bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9587ff19dfc4eefb5129656cbdf4a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:53.446411 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7f9004c2-bc06-4752-a8d0-759205823ae4 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] 10.222.0.33 "GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc" status: 200 len: 1338 microversion: 2.1 time: 0.524094 Jun 05 08:23:53.447557 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 64/143] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:52 2022] GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc => generated 1338 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:53.658450 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ebc5c402-f519-4e4c-bf8c-c917c349c2d0 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:53.660395 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ebc5c402-f519-4e4c-bf8c-c917c349c2d0 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: e4c09fb3-f67f-4b07-a992-2e70683932bd] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:53.676498 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ebc5c402-f519-4e4c-bf8c-c917c349c2d0 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:53.677223 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ebc5c402-f519-4e4c-bf8c-c917c349c2d0 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:53.678645 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ebc5c402-f519-4e4c-bf8c-c917c349c2d0 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:53.679078 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ebc5c402-f519-4e4c-bf8c-c917c349c2d0 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:54.189481 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e8a8f5ff-b05b-4b45-9b2f-7532bee792d7 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:54.208668 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=100 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:23:54.225571 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e8a8f5ff-b05b-4b45-9b2f-7532bee792d7 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2" status: 200 len: 1339 microversion: 2.1 time: 0.878025 Jun 05 08:23:54.226713 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 80/144] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:53 2022] GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2 => generated 1339 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:54.240537 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d62f7b02-b1da-4346-86db-941c77169171 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:54.241978 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d62f7b02-b1da-4346-86db-941c77169171 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:54.252884 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d62f7b02-b1da-4346-86db-941c77169171 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:54.253592 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d62f7b02-b1da-4346-86db-941c77169171 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:54.254565 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d62f7b02-b1da-4346-86db-941c77169171 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:54.255149 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d62f7b02-b1da-4346-86db-941c77169171 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:54.416000 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ebc5c402-f519-4e4c-bf8c-c917c349c2d0 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:54.423809 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ebc5c402-f519-4e4c-bf8c-c917c349c2d0 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd" status: 200 len: 1390 microversion: 2.1 time: 0.770927 Jun 05 08:23:54.426495 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 65/145] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:53 2022] GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd => generated 1390 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:23:54.675978 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d62f7b02-b1da-4346-86db-941c77169171 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:54.677100 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-0548ab97-5ead-4000-a455-fbd6496138c7 req-1fd702cb-7b0e-4f74-891b-f29f3b8a6caa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4c09fb3-f67f-4b07-a992-2e70683932bd", "tag": "0d4a6d59-7631-4ce9-ba50-a33984101036"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:54.686151 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d62f7b02-b1da-4346-86db-941c77169171 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 200 len: 1319 microversion: 2.1 time: 0.457806 Jun 05 08:23:54.694351 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-0548ab97-5ead-4000-a455-fbd6496138c7 req-1fd702cb-7b0e-4f74-891b-f29f3b8a6caa service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:54.695075 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-0548ab97-5ead-4000-a455-fbd6496138c7 req-1fd702cb-7b0e-4f74-891b-f29f3b8a6caa service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:54.702733 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 81/146] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:54 2022] GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 1319 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:54.719918 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-0548ab97-5ead-4000-a455-fbd6496138c7 req-1fd702cb-7b0e-4f74-891b-f29f3b8a6caa service nova] Creating event network-changed:0d4a6d59-7631-4ce9-ba50-a33984101036 for instance e4c09fb3-f67f-4b07-a992-2e70683932bd on n-h1-844739-1 Jun 05 08:23:54.727571 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-0548ab97-5ead-4000-a455-fbd6496138c7 req-1fd702cb-7b0e-4f74-891b-f29f3b8a6caa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.299839 Jun 05 08:23:54.728738 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 66/147] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:54.734790 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-50a14627-eb34-4f1c-aec2-94a1876e84f7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:54.736135 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-50a14627-eb34-4f1c-aec2-94a1876e84f7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:54.745949 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-50a14627-eb34-4f1c-aec2-94a1876e84f7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:54.746740 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-50a14627-eb34-4f1c-aec2-94a1876e84f7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:54.747757 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-50a14627-eb34-4f1c-aec2-94a1876e84f7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:54.748346 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-50a14627-eb34-4f1c-aec2-94a1876e84f7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:54.808879 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-229eec38-5c43-496a-ac3d-054a1490cfdb tempest-HypervisorAdminV253TestBase-810573901 tempest-HypervisorAdminV253TestBase-810573901-project-admin] Calling method '.version_select at 0x7f2440491b80>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:54.811122 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:54.811122 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:54.812360 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-229eec38-5c43-496a-ac3d-054a1490cfdb tempest-HypervisorAdminV253TestBase-810573901 tempest-HypervisorAdminV253TestBase-810573901-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:54.812814 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-229eec38-5c43-496a-ac3d-054a1490cfdb tempest-HypervisorAdminV253TestBase-810573901 tempest-HypervisorAdminV253TestBase-810573901-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:54.838596 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-229eec38-5c43-496a-ac3d-054a1490cfdb tempest-HypervisorAdminV253TestBase-810573901 tempest-HypervisorAdminV253TestBase-810573901-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:54.839062 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-229eec38-5c43-496a-ac3d-054a1490cfdb tempest-HypervisorAdminV253TestBase-810573901 tempest-HypervisorAdminV253TestBase-810573901-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:54.879351 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-229eec38-5c43-496a-ac3d-054a1490cfdb tempest-HypervisorAdminV253TestBase-810573901 tempest-HypervisorAdminV253TestBase-810573901-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:54.880135 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-229eec38-5c43-496a-ac3d-054a1490cfdb tempest-HypervisorAdminV253TestBase-810573901 tempest-HypervisorAdminV253TestBase-810573901-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:54.896374 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-229eec38-5c43-496a-ac3d-054a1490cfdb tempest-HypervisorAdminV253TestBase-810573901 tempest-HypervisorAdminV253TestBase-810573901-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:54.897234 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-229eec38-5c43-496a-ac3d-054a1490cfdb tempest-HypervisorAdminV253TestBase-810573901 tempest-HypervisorAdminV253TestBase-810573901-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:54.924826 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-229eec38-5c43-496a-ac3d-054a1490cfdb tempest-HypervisorAdminV253TestBase-810573901 tempest-HypervisorAdminV253TestBase-810573901-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:54.925449 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-229eec38-5c43-496a-ac3d-054a1490cfdb tempest-HypervisorAdminV253TestBase-810573901 tempest-HypervisorAdminV253TestBase-810573901-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:54.933512 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-229eec38-5c43-496a-ac3d-054a1490cfdb tempest-HypervisorAdminV253TestBase-810573901 tempest-HypervisorAdminV253TestBase-810573901-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1994 microversion: 2.53 time: 0.229429 Jun 05 08:23:54.934274 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 82/148] 10.222.0.33 () {60 vars in 1242 bytes} [Sun Jun 5 08:23:54 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1994 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:23:54.939709 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c0fab13d-0731-4d05-bad7-398ba40e19d0 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:54.940447 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c0fab13d-0731-4d05-bad7-398ba40e19d0 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] [instance: 63dc26bf-e378-436f-a328-a88919547afc] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:54.952715 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c0fab13d-0731-4d05-bad7-398ba40e19d0 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:54.953175 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c0fab13d-0731-4d05-bad7-398ba40e19d0 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:54.953981 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c0fab13d-0731-4d05-bad7-398ba40e19d0 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:54.955247 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c0fab13d-0731-4d05-bad7-398ba40e19d0 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:55.342421 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-50a14627-eb34-4f1c-aec2-94a1876e84f7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:55.354109 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-50a14627-eb34-4f1c-aec2-94a1876e84f7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1310 microversion: 2.1 time: 0.623883 Jun 05 08:23:55.366069 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 67/149] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:54 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1310 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:55.371862 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-a2cdbc4d-b7c2-45e4-be2b-22f17ad88a6d req-457fb5f9-7389-42ca-b1f0-b9afe62c953a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cddf461-3546-4475-91c7-419b46a255af", "name": "network-vif-plugged", "status": "completed", "tag": "82f48857-e164-413d-8768-4601593a3494"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:55.385237 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-a2cdbc4d-b7c2-45e4-be2b-22f17ad88a6d req-457fb5f9-7389-42ca-b1f0-b9afe62c953a service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:55.386338 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-a2cdbc4d-b7c2-45e4-be2b-22f17ad88a6d req-457fb5f9-7389-42ca-b1f0-b9afe62c953a service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:55.393130 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c0fab13d-0731-4d05-bad7-398ba40e19d0 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3429347e644bdca51b2b3b976a7bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9587ff19dfc4eefb5129656cbdf4a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:55.409076 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-a2cdbc4d-b7c2-45e4-be2b-22f17ad88a6d req-457fb5f9-7389-42ca-b1f0-b9afe62c953a service nova] Creating event network-vif-plugged:82f48857-e164-413d-8768-4601593a3494 for instance 8cddf461-3546-4475-91c7-419b46a255af on n-h1-844739-1 Jun 05 08:23:55.411656 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c0fab13d-0731-4d05-bad7-398ba40e19d0 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] 10.222.0.33 "GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc" status: 200 len: 1486 microversion: 2.1 time: 0.475472 Jun 05 08:23:55.423666 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-a2cdbc4d-b7c2-45e4-be2b-22f17ad88a6d req-457fb5f9-7389-42ca-b1f0-b9afe62c953a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048358 Jun 05 08:23:55.424333 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 83/150] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:54 2022] GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc => generated 1486 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:55.424426 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 68/151] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:55.424426 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3942565f-67cc-42f1-a4ca-6d7bcd3dd7d4 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:55.424426 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3942565f-67cc-42f1-a4ca-6d7bcd3dd7d4 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 121df5fc-10cc-4f27-bbe8-878791f857a2] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:55.426795 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7f2f8721-76ae-4243-83a9-656c5f13cd8a tempest-HypervisorAdminV253TestBase-810573901 tempest-HypervisorAdminV253TestBase-810573901-project-admin] Calling method '.version_select at 0x7f2440412c10>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:55.429817 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:55.429817 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:23:55.431794 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7f2f8721-76ae-4243-83a9-656c5f13cd8a tempest-HypervisorAdminV253TestBase-810573901 tempest-HypervisorAdminV253TestBase-810573901-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:55.432257 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7f2f8721-76ae-4243-83a9-656c5f13cd8a tempest-HypervisorAdminV253TestBase-810573901 tempest-HypervisorAdminV253TestBase-810573901-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:55.438696 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3942565f-67cc-42f1-a4ca-6d7bcd3dd7d4 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:55.439158 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3942565f-67cc-42f1-a4ca-6d7bcd3dd7d4 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:55.440582 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3942565f-67cc-42f1-a4ca-6d7bcd3dd7d4 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:55.440582 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3942565f-67cc-42f1-a4ca-6d7bcd3dd7d4 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:55.447203 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7f2f8721-76ae-4243-83a9-656c5f13cd8a tempest-HypervisorAdminV253TestBase-810573901 tempest-HypervisorAdminV253TestBase-810573901-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:55.447741 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7f2f8721-76ae-4243-83a9-656c5f13cd8a tempest-HypervisorAdminV253TestBase-810573901 tempest-HypervisorAdminV253TestBase-810573901-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:55.472640 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7f2f8721-76ae-4243-83a9-656c5f13cd8a tempest-HypervisorAdminV253TestBase-810573901 tempest-HypervisorAdminV253TestBase-810573901-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:55.473094 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7f2f8721-76ae-4243-83a9-656c5f13cd8a tempest-HypervisorAdminV253TestBase-810573901 tempest-HypervisorAdminV253TestBase-810573901-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:55.487647 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7f2f8721-76ae-4243-83a9-656c5f13cd8a tempest-HypervisorAdminV253TestBase-810573901 tempest-HypervisorAdminV253TestBase-810573901-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:55.488467 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7f2f8721-76ae-4243-83a9-656c5f13cd8a tempest-HypervisorAdminV253TestBase-810573901 tempest-HypervisorAdminV253TestBase-810573901-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:55.523397 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7f2f8721-76ae-4243-83a9-656c5f13cd8a tempest-HypervisorAdminV253TestBase-810573901 tempest-HypervisorAdminV253TestBase-810573901-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:55.523898 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7f2f8721-76ae-4243-83a9-656c5f13cd8a tempest-HypervisorAdminV253TestBase-810573901 tempest-HypervisorAdminV253TestBase-810573901-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:55.534965 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7f2f8721-76ae-4243-83a9-656c5f13cd8a tempest-HypervisorAdminV253TestBase-810573901 tempest-HypervisorAdminV253TestBase-810573901-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 686 microversion: 2.53 time: 0.114714 Jun 05 08:23:55.535970 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 84/152] 10.222.0.33 () {60 vars in 1221 bytes} [Sun Jun 5 08:23:55 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 686 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:23:55.547880 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-2ecc1754-4496-41ef-abcd-1301708a2ff7 req-bea480c2-54d2-4161-bd62-88617804235a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "969237ff-17eb-4838-9c3d-68dcbc1f94ca", "tag": "b5f2e58e-0349-480d-8927-484d2f39dee5"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:55.553099 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:DELETE=3,nova_api:SELECT=92,nova_api:INSERT=5 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:23:55.557373 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-2ecc1754-4496-41ef-abcd-1301708a2ff7 req-bea480c2-54d2-4161-bd62-88617804235a service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:55.558447 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-2ecc1754-4496-41ef-abcd-1301708a2ff7 req-bea480c2-54d2-4161-bd62-88617804235a service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:55.574364 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-2ecc1754-4496-41ef-abcd-1301708a2ff7 req-bea480c2-54d2-4161-bd62-88617804235a service nova] Creating event network-changed:b5f2e58e-0349-480d-8927-484d2f39dee5 for instance 969237ff-17eb-4838-9c3d-68dcbc1f94ca on n-h1-844739-1 Jun 05 08:23:55.580925 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-2ecc1754-4496-41ef-abcd-1301708a2ff7 req-bea480c2-54d2-4161-bd62-88617804235a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042457 Jun 05 08:23:55.581937 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 85/153] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:23:55.590229 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-688441e0-d1c0-4ac9-9efb-1d351fc38935 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:55.591701 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-688441e0-d1c0-4ac9-9efb-1d351fc38935 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] [instance: 63dc26bf-e378-436f-a328-a88919547afc] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:55.601077 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-688441e0-d1c0-4ac9-9efb-1d351fc38935 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:55.601457 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-688441e0-d1c0-4ac9-9efb-1d351fc38935 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:55.602821 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-688441e0-d1c0-4ac9-9efb-1d351fc38935 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:55.603692 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-688441e0-d1c0-4ac9-9efb-1d351fc38935 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:55.610938 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3942565f-67cc-42f1-a4ca-6d7bcd3dd7d4 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:55.618985 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3942565f-67cc-42f1-a4ca-6d7bcd3dd7d4 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2" status: 200 len: 1339 microversion: 2.1 time: 0.200207 Jun 05 08:23:55.619599 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 69/154] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:55 2022] GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2 => generated 1339 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:55.628186 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b8c5c2b9-d464-4238-bc39-72644c6f8a88 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:55.628186 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b8c5c2b9-d464-4238-bc39-72644c6f8a88 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: e4c09fb3-f67f-4b07-a992-2e70683932bd] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:55.631050 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b8c5c2b9-d464-4238-bc39-72644c6f8a88 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:55.631704 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b8c5c2b9-d464-4238-bc39-72644c6f8a88 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:55.632516 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b8c5c2b9-d464-4238-bc39-72644c6f8a88 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:55.633325 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b8c5c2b9-d464-4238-bc39-72644c6f8a88 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:55.868754 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b8c5c2b9-d464-4238-bc39-72644c6f8a88 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:55.878707 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b8c5c2b9-d464-4238-bc39-72644c6f8a88 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd" status: 200 len: 1390 microversion: 2.1 time: 0.257978 Jun 05 08:23:55.879319 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 70/155] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:55 2022] GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd => generated 1390 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:55.884389 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-518bbeb3-a26c-4312-8855-f995a344c03c tempest-HypervisorAdminV253TestBase-810573901 tempest-HypervisorAdminV253TestBase-810573901-project-admin] Calling method '.version_select at 0x7f2440265f70>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:55.885657 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:23:55.885657 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:23:55.886841 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-518bbeb3-a26c-4312-8855-f995a344c03c tempest-HypervisorAdminV253TestBase-810573901 tempest-HypervisorAdminV253TestBase-810573901-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:55.887291 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-518bbeb3-a26c-4312-8855-f995a344c03c tempest-HypervisorAdminV253TestBase-810573901 tempest-HypervisorAdminV253TestBase-810573901-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:55.907530 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-518bbeb3-a26c-4312-8855-f995a344c03c tempest-HypervisorAdminV253TestBase-810573901 tempest-HypervisorAdminV253TestBase-810573901-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:55.907979 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-518bbeb3-a26c-4312-8855-f995a344c03c tempest-HypervisorAdminV253TestBase-810573901 tempest-HypervisorAdminV253TestBase-810573901-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:55.911165 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=100 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:23:55.915393 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-518bbeb3-a26c-4312-8855-f995a344c03c tempest-HypervisorAdminV253TestBase-810573901 tempest-HypervisorAdminV253TestBase-810573901-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/02979639-b6ff-4615-a01e-29c6e09ce421" status: 200 len: 792 microversion: 2.53 time: 0.035125 Jun 05 08:23:55.924594 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 71/156] 10.222.0.33 () {60 vars in 1297 bytes} [Sun Jun 5 08:23:55 2022] GET /compute/v2.1/os-hypervisors/02979639-b6ff-4615-a01e-29c6e09ce421 => generated 792 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:23:55.924594 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c8baacdf-6222-4075-b065-410c37623676 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:55.924594 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c8baacdf-6222-4075-b065-410c37623676 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:55.926996 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c8baacdf-6222-4075-b065-410c37623676 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:55.927478 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c8baacdf-6222-4075-b065-410c37623676 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:55.928274 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c8baacdf-6222-4075-b065-410c37623676 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:55.928822 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c8baacdf-6222-4075-b065-410c37623676 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:56.036982 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-688441e0-d1c0-4ac9-9efb-1d351fc38935 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc" status: 200 len: 1637 microversion: 2.1 time: 0.453326 Jun 05 08:23:56.038420 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 86/157] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:55 2022] GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc => generated 1637 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:56.054662 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3c0063e1-8390-4728-b997-46e31274f4ec tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:56.055223 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3c0063e1-8390-4728-b997-46e31274f4ec tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] [instance: 63dc26bf-e378-436f-a328-a88919547afc] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:56.061569 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3c0063e1-8390-4728-b997-46e31274f4ec tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:56.062026 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3c0063e1-8390-4728-b997-46e31274f4ec tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:56.062803 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3c0063e1-8390-4728-b997-46e31274f4ec tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:56.063581 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3c0063e1-8390-4728-b997-46e31274f4ec tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:56.092551 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3c0063e1-8390-4728-b997-46e31274f4ec tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] [instance: 63dc26bf-e378-436f-a328-a88919547afc] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:23:56.094517 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c8baacdf-6222-4075-b065-410c37623676 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:56.103139 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c8baacdf-6222-4075-b065-410c37623676 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 200 len: 1319 microversion: 2.1 time: 0.186119 Jun 05 08:23:56.103830 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 72/158] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:55 2022] GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:56.220262 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3c0063e1-8390-4728-b997-46e31274f4ec tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] 10.222.0.33 "DELETE /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc" status: 204 len: 0 microversion: 2.1 time: 0.169277 Jun 05 08:23:56.220891 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 87/159] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:23:56 2022] DELETE /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:23:56.229218 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ece6b00a-c639-4b8f-96d9-8252a0f53144 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:56.229893 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ece6b00a-c639-4b8f-96d9-8252a0f53144 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] [instance: 63dc26bf-e378-436f-a328-a88919547afc] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:56.235760 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ece6b00a-c639-4b8f-96d9-8252a0f53144 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:56.236253 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ece6b00a-c639-4b8f-96d9-8252a0f53144 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:56.237022 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ece6b00a-c639-4b8f-96d9-8252a0f53144 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:56.237465 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ece6b00a-c639-4b8f-96d9-8252a0f53144 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:56.373579 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f8d6639b-4d38-4655-83f2-3a6d83038774 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:56.374612 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f8d6639b-4d38-4655-83f2-3a6d83038774 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:56.384484 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ece6b00a-c639-4b8f-96d9-8252a0f53144 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3429347e644bdca51b2b3b976a7bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9587ff19dfc4eefb5129656cbdf4a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:56.385737 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f8d6639b-4d38-4655-83f2-3a6d83038774 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:56.386230 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f8d6639b-4d38-4655-83f2-3a6d83038774 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:56.387208 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f8d6639b-4d38-4655-83f2-3a6d83038774 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:56.387830 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f8d6639b-4d38-4655-83f2-3a6d83038774 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:56.394556 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ece6b00a-c639-4b8f-96d9-8252a0f53144 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] 10.222.0.33 "GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc" status: 200 len: 1492 microversion: 2.1 time: 0.168981 Jun 05 08:23:56.395613 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 73/160] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:56 2022] GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc => generated 1492 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:56.530911 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f8d6639b-4d38-4655-83f2-3a6d83038774 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:56.541194 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f8d6639b-4d38-4655-83f2-3a6d83038774 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1310 microversion: 2.1 time: 0.172643 Jun 05 08:23:56.541952 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 88/161] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:56 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1310 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:56.635099 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ede5dd11-e1a3-4f02-851b-870f50fd9534 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:56.635734 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ede5dd11-e1a3-4f02-851b-870f50fd9534 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 121df5fc-10cc-4f27-bbe8-878791f857a2] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:56.641960 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ede5dd11-e1a3-4f02-851b-870f50fd9534 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:56.642421 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ede5dd11-e1a3-4f02-851b-870f50fd9534 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:56.643192 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ede5dd11-e1a3-4f02-851b-870f50fd9534 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:56.643634 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ede5dd11-e1a3-4f02-851b-870f50fd9534 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:56.834508 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ede5dd11-e1a3-4f02-851b-870f50fd9534 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:56.842376 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ede5dd11-e1a3-4f02-851b-870f50fd9534 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2" status: 200 len: 1339 microversion: 2.1 time: 0.211229 Jun 05 08:23:56.842949 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 74/162] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:56 2022] GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2 => generated 1339 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:56.897165 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1e50b1e3-5710-4fc8-9d2b-8069e19cc9e4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:56.897780 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1e50b1e3-5710-4fc8-9d2b-8069e19cc9e4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: e4c09fb3-f67f-4b07-a992-2e70683932bd] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:56.903611 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1e50b1e3-5710-4fc8-9d2b-8069e19cc9e4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:56.904087 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1e50b1e3-5710-4fc8-9d2b-8069e19cc9e4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:56.905113 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1e50b1e3-5710-4fc8-9d2b-8069e19cc9e4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:56.905547 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1e50b1e3-5710-4fc8-9d2b-8069e19cc9e4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:57.112303 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1e50b1e3-5710-4fc8-9d2b-8069e19cc9e4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:57.122927 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c6fdb47b-ca1f-4e1c-8577-705322e5d6e1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:57.126728 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c6fdb47b-ca1f-4e1c-8577-705322e5d6e1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:57.132580 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1e50b1e3-5710-4fc8-9d2b-8069e19cc9e4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd" status: 200 len: 1390 microversion: 2.1 time: 0.240328 Jun 05 08:23:57.137972 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c6fdb47b-ca1f-4e1c-8577-705322e5d6e1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:57.139187 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 89/163] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:56 2022] GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd => generated 1390 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:57.139718 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c6fdb47b-ca1f-4e1c-8577-705322e5d6e1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:57.140617 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c6fdb47b-ca1f-4e1c-8577-705322e5d6e1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:57.141129 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c6fdb47b-ca1f-4e1c-8577-705322e5d6e1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:57.351006 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c6fdb47b-ca1f-4e1c-8577-705322e5d6e1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:57.358616 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c6fdb47b-ca1f-4e1c-8577-705322e5d6e1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 200 len: 1319 microversion: 2.1 time: 0.241426 Jun 05 08:23:57.359422 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 75/164] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:57 2022] GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:23:57.412662 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3c7d9536-d517-44dd-8815-e4a77ccbd676 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:57.413442 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3c7d9536-d517-44dd-8815-e4a77ccbd676 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] [instance: 63dc26bf-e378-436f-a328-a88919547afc] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:57.415449 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=8 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:23:57.421672 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3c7d9536-d517-44dd-8815-e4a77ccbd676 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:57.422142 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3c7d9536-d517-44dd-8815-e4a77ccbd676 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:57.422924 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3c7d9536-d517-44dd-8815-e4a77ccbd676 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:57.423508 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3c7d9536-d517-44dd-8815-e4a77ccbd676 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:57.559864 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-02344fbf-df1b-4d80-affe-d5ca55f7c8fb tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:57.560745 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-02344fbf-df1b-4d80-affe-d5ca55f7c8fb tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:57.561192 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3c7d9536-d517-44dd-8815-e4a77ccbd676 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3429347e644bdca51b2b3b976a7bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9587ff19dfc4eefb5129656cbdf4a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:57.567353 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5,nova_api:DELETE=10 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:23:57.569615 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-02344fbf-df1b-4d80-affe-d5ca55f7c8fb tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:57.570037 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3c7d9536-d517-44dd-8815-e4a77ccbd676 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] 10.222.0.33 "GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc" status: 200 len: 1492 microversion: 2.1 time: 0.161916 Jun 05 08:23:57.570685 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-02344fbf-df1b-4d80-affe-d5ca55f7c8fb tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:57.570923 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 90/165] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:57 2022] GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc => generated 1492 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:57.572270 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-02344fbf-df1b-4d80-affe-d5ca55f7c8fb tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:57.572734 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-02344fbf-df1b-4d80-affe-d5ca55f7c8fb tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:57.598679 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-4185778f-ee2e-4399-8e5e-edc85de53fba req-705accf0-3cf3-486c-b70c-87daf642cee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "121df5fc-10cc-4f27-bbe8-878791f857a2", "tag": "c049258a-e044-42be-8df2-e43356b5756c"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:57.607408 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-4185778f-ee2e-4399-8e5e-edc85de53fba req-705accf0-3cf3-486c-b70c-87daf642cee2 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:57.608075 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-4185778f-ee2e-4399-8e5e-edc85de53fba req-705accf0-3cf3-486c-b70c-87daf642cee2 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:57.620659 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-4185778f-ee2e-4399-8e5e-edc85de53fba req-705accf0-3cf3-486c-b70c-87daf642cee2 service nova] Creating event network-changed:c049258a-e044-42be-8df2-e43356b5756c for instance 121df5fc-10cc-4f27-bbe8-878791f857a2 on n-h2-844739-1 Jun 05 08:23:57.628120 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-4185778f-ee2e-4399-8e5e-edc85de53fba req-705accf0-3cf3-486c-b70c-87daf642cee2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032994 Jun 05 08:23:57.628818 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 91/166] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:23:57.728700 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-02344fbf-df1b-4d80-affe-d5ca55f7c8fb tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:57.736064 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-02344fbf-df1b-4d80-affe-d5ca55f7c8fb tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1310 microversion: 2.1 time: 0.181883 Jun 05 08:23:57.736639 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 76/167] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:57 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1310 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:23:57.860523 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2930dca6-2c30-4237-bf40-d43d0e43fa8f tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:57.861232 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2930dca6-2c30-4237-bf40-d43d0e43fa8f tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 121df5fc-10cc-4f27-bbe8-878791f857a2] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:57.869722 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2930dca6-2c30-4237-bf40-d43d0e43fa8f tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:57.870162 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2930dca6-2c30-4237-bf40-d43d0e43fa8f tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:57.870939 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2930dca6-2c30-4237-bf40-d43d0e43fa8f tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:57.871387 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2930dca6-2c30-4237-bf40-d43d0e43fa8f tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:58.108488 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2930dca6-2c30-4237-bf40-d43d0e43fa8f tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:58.123642 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2930dca6-2c30-4237-bf40-d43d0e43fa8f tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2" status: 200 len: 1339 microversion: 2.1 time: 0.266374 Jun 05 08:23:58.124374 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 92/168] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:57 2022] GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2 => generated 1339 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:23:58.157251 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-071b5051-942f-4c90-8db8-d642aec4f64c tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:58.157872 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-071b5051-942f-4c90-8db8-d642aec4f64c tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: e4c09fb3-f67f-4b07-a992-2e70683932bd] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:58.164739 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-071b5051-942f-4c90-8db8-d642aec4f64c tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:58.165205 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-071b5051-942f-4c90-8db8-d642aec4f64c tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:58.165967 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-071b5051-942f-4c90-8db8-d642aec4f64c tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:58.166403 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-071b5051-942f-4c90-8db8-d642aec4f64c tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:58.379642 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-dec6dee1-f85b-48a8-9244-4ef8bbc89c50 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:58.380905 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-dec6dee1-f85b-48a8-9244-4ef8bbc89c50 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:58.388655 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dec6dee1-f85b-48a8-9244-4ef8bbc89c50 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:58.389919 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dec6dee1-f85b-48a8-9244-4ef8bbc89c50 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:58.391087 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dec6dee1-f85b-48a8-9244-4ef8bbc89c50 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:58.391411 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-071b5051-942f-4c90-8db8-d642aec4f64c tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:58.391841 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dec6dee1-f85b-48a8-9244-4ef8bbc89c50 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:58.400879 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-071b5051-942f-4c90-8db8-d642aec4f64c tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd" status: 200 len: 1390 microversion: 2.1 time: 0.248120 Jun 05 08:23:58.401489 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 77/169] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:58 2022] GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd => generated 1390 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:58.607162 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2ae9c3f4-140b-42b0-a985-ffc4ff7e66d0 tempest-ImagesMetadataNegativeTestJSON-1638610133 tempest-ImagesMetadataNegativeTestJSON-1638610133-project] Calling method '.version_select at 0x7f244050e790>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:58.647702 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-2ae9c3f4-140b-42b0-a985-ffc4ff7e66d0 tempest-ImagesMetadataNegativeTestJSON-1638610133 tempest-ImagesMetadataNegativeTestJSON-1638610133-project] HTTP exception thrown: Image not found. Jun 05 08:23:58.660785 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2ae9c3f4-140b-42b0-a985-ffc4ff7e66d0 tempest-ImagesMetadataNegativeTestJSON-1638610133 tempest-ImagesMetadataNegativeTestJSON-1638610133-project] Request method failure captured: Jun 05 08:23:58.660785 n-d-844739-1 devstack@n-api.service[119049]: request: DELETE /compute/v2.1/images/b265dd03-bb76-4e26-937a-902d09cf98c5/metadata/os_distro HTTP/1.1 Jun 05 08:23:58.660785 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:23:58.660785 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:23:58.660785 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:23:58.660785 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:23:58.660785 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:23:58.660785 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:23:58.660785 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:23:58.660785 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:23:58.660785 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGgeNif8jVFs_FHdNrn1311RNmnuV-JT0JFbf8s-TJaTRMKNwNlIhcd5s6b2Er0zkKsYjEQJngpgQXcNwgtXJz86Ucp7HV0zTzBTQIGvPWOuMBAWE5yImxh2ps8o3IU16k0qLEECcE3JdNse6Dzesv0vYteC9XOeE7PMxQcb2rMeptg Jun 05 08:23:58.660785 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:23:58.660785 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:23:58.660785 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:23:58.660785 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:23:58.660785 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:23:58.660785 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:23:58.660785 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 705c8e778f8649daab01995ec806f64e Jun 05 08:23:58.660785 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1638610133 Jun 05 08:23:58.660785 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:23:58.660785 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:23:58.662689 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/705c8e778f8649daab01995ec806f64e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/705c8e778f8649daab01995ec806f64e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_705c8e778f8649daab01995ec806f64e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/705c8e778f8649daab01995ec806f64e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:23:58.662689 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1638610133 Jun 05 08:23:58.662689 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 705c8e778f8649daab01995ec806f64e Jun 05 08:23:58.662689 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1638610133 Jun 05 08:23:58.662689 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ImagesMetadataNegativeTestJSON-1638610133-project Jun 05 08:23:58.662689 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:23:58.662689 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:23:58.662689 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 40aca8b474d148cc8bc8513e1bd10d2d Jun 05 08:23:58.662689 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1638610133-project Jun 05 08:23:58.662689 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:23:58.662689 n-d-844739-1 devstack@n-api.service[119049]: exception: Image not found. Jun 05 08:23:58.662689 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'image_id': 'b265dd03-bb76-4e26-937a-902d09cf98c5', 'id': 'os_distro'} Jun 05 08:23:58.662689 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:23:58.663606 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:58.663606 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 05 08:23:58.663606 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 05 08:23:58.663606 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 05 08:23:58.663606 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 05 08:23:58.663606 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 05 08:23:58.663606 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 05 08:23:58.663606 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 05 08:23:58.663606 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 05 08:23:58.663606 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 05 08:23:58.663606 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 05 08:23:58.663606 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 05 08:23:58.663606 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 05 08:23:58.663606 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 05 08:23:58.663606 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 05 08:23:58.663606 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 05 08:23:58.663606 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 05 08:23:58.663606 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b265dd03-bb76-4e26-937a-902d09cf98c5 Jun 05 08:23:58.665671 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:58.665671 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:58.665671 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:58.665671 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:58.665671 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 05 08:23:58.665671 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 05 08:23:58.665671 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 05 08:23:58.665671 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 05 08:23:58.665671 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 05 08:23:58.665671 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 05 08:23:58.665671 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 05 08:23:58.665671 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 05 08:23:58.665671 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 05 08:23:58.665671 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 05 08:23:58.665671 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 05 08:23:58.665671 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 05 08:23:58.665671 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 05 08:23:58.665671 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 05 08:23:58.665671 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 05 08:23:58.665671 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 05 08:23:58.667516 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 05 08:23:58.667516 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 05 08:23:58.667516 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 05 08:23:58.667516 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 05 08:23:58.667516 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 05 08:23:58.667516 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 05 08:23:58.667516 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 05 08:23:58.667516 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 05 08:23:58.667516 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b265dd03-bb76-4e26-937a-902d09cf98c5 could not be found. Jun 05 08:23:58.667516 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:58.667516 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:58.667516 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:58.667516 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:58.667516 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:58.667516 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:58.667516 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:23:58.667516 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:23:58.667516 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:23:58.667516 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:23:58.668740 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:23:58.668740 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:23:58.668740 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jun 05 08:23:58.668740 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 05 08:23:58.668740 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 05 08:23:58.668740 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 05 08:23:58.668740 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 05 08:23:58.668740 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:58.668740 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:58.668740 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:58.668740 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:58.668740 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:58.668740 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:58.668740 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:23:58.668740 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:23:58.668740 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 05 08:23:58.668740 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:58.671328 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2ae9c3f4-140b-42b0-a985-ffc4ff7e66d0 tempest-ImagesMetadataNegativeTestJSON-1638610133 tempest-ImagesMetadataNegativeTestJSON-1638610133-project] Returning 404 to user: Image not found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:23:58.673472 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2ae9c3f4-140b-42b0-a985-ffc4ff7e66d0 tempest-ImagesMetadataNegativeTestJSON-1638610133 tempest-ImagesMetadataNegativeTestJSON-1638610133-project] 10.222.0.33 "DELETE /compute/v2.1/images/b265dd03-bb76-4e26-937a-902d09cf98c5/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.269686 Jun 05 08:23:58.674840 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 78/170] 10.222.0.33 () {58 vars in 1292 bytes} [Sun Jun 5 08:23:58 2022] DELETE /compute/v2.1/images/b265dd03-bb76-4e26-937a-902d09cf98c5/metadata/os_distro => generated 62 bytes in 272 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:23:58.689792 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5d2debe4-32bb-4aa6-bde7-bbe493a4224b tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:58.691272 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5d2debe4-32bb-4aa6-bde7-bbe493a4224b tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] [instance: 63dc26bf-e378-436f-a328-a88919547afc] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:58.710912 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5d2debe4-32bb-4aa6-bde7-bbe493a4224b tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:58.712528 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5d2debe4-32bb-4aa6-bde7-bbe493a4224b tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:58.713652 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5d2debe4-32bb-4aa6-bde7-bbe493a4224b tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:58.714242 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5d2debe4-32bb-4aa6-bde7-bbe493a4224b tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:59.000384 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-dec6dee1-f85b-48a8-9244-4ef8bbc89c50 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:59.009583 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-dec6dee1-f85b-48a8-9244-4ef8bbc89c50 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 200 len: 1319 microversion: 2.1 time: 0.636081 Jun 05 08:23:59.010340 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 93/171] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:58 2022] GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 1319 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:59.015069 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8303a6ed-5549-4577-a702-46e646a3ab19 tempest-ImagesMetadataNegativeTestJSON-1638610133 tempest-ImagesMetadataNegativeTestJSON-1638610133-project] Calling method '.version_select at 0x7f2440284700>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:59.040307 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-8303a6ed-5549-4577-a702-46e646a3ab19 tempest-ImagesMetadataNegativeTestJSON-1638610133 tempest-ImagesMetadataNegativeTestJSON-1638610133-project] HTTP exception thrown: Image not found. Jun 05 08:23:59.041608 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5d2debe4-32bb-4aa6-bde7-bbe493a4224b tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3429347e644bdca51b2b3b976a7bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9587ff19dfc4eefb5129656cbdf4a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:59.044377 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8303a6ed-5549-4577-a702-46e646a3ab19 tempest-ImagesMetadataNegativeTestJSON-1638610133 tempest-ImagesMetadataNegativeTestJSON-1638610133-project] Request method failure captured: Jun 05 08:23:59.044377 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/images/48dd0848-5cd8-440d-b00c-443bb03e5e19/metadata/os_version HTTP/1.1 Jun 05 08:23:59.044377 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:23:59.044377 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:23:59.044377 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:23:59.044377 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:23:59.044377 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:23:59.044377 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:23:59.044377 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:23:59.044377 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:23:59.044377 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGgeNif8jVFs_FHdNrn1311RNmnuV-JT0JFbf8s-TJaTRMKNwNlIhcd5s6b2Er0zkKsYjEQJngpgQXcNwgtXJz86Ucp7HV0zTzBTQIGvPWOuMBAWE5yImxh2ps8o3IU16k0qLEECcE3JdNse6Dzesv0vYteC9XOeE7PMxQcb2rMeptg Jun 05 08:23:59.044377 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:23:59.044377 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:23:59.044377 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:23:59.044377 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:23:59.044377 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:23:59.044377 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:23:59.044377 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 705c8e778f8649daab01995ec806f64e Jun 05 08:23:59.044377 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1638610133 Jun 05 08:23:59.044377 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:23:59.044377 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:23:59.045491 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/705c8e778f8649daab01995ec806f64e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/705c8e778f8649daab01995ec806f64e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_705c8e778f8649daab01995ec806f64e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/705c8e778f8649daab01995ec806f64e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:23:59.045491 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1638610133 Jun 05 08:23:59.045491 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 705c8e778f8649daab01995ec806f64e Jun 05 08:23:59.045491 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1638610133 Jun 05 08:23:59.045491 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ImagesMetadataNegativeTestJSON-1638610133-project Jun 05 08:23:59.045491 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:23:59.045491 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:23:59.045491 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 40aca8b474d148cc8bc8513e1bd10d2d Jun 05 08:23:59.045491 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1638610133-project Jun 05 08:23:59.045491 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:23:59.045491 n-d-844739-1 devstack@n-api.service[119050]: exception: Image not found. Jun 05 08:23:59.045491 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'image_id': '48dd0848-5cd8-440d-b00c-443bb03e5e19', 'id': 'os_version'} Jun 05 08:23:59.045491 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:23:59.046244 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:59.046244 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 05 08:23:59.046244 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 05 08:23:59.046244 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 05 08:23:59.046244 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 05 08:23:59.046244 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 05 08:23:59.046244 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 05 08:23:59.046244 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 05 08:23:59.046244 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 05 08:23:59.046244 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 05 08:23:59.046244 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 05 08:23:59.046244 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 05 08:23:59.046244 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 05 08:23:59.046244 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 05 08:23:59.046244 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 05 08:23:59.046244 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 05 08:23:59.046244 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 05 08:23:59.046244 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 48dd0848-5cd8-440d-b00c-443bb03e5e19 Jun 05 08:23:59.047141 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.047141 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:59.047141 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.047141 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:59.047141 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 05 08:23:59.047141 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 05 08:23:59.047141 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 05 08:23:59.047141 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 05 08:23:59.047141 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 05 08:23:59.047141 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 05 08:23:59.047141 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 05 08:23:59.047141 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 05 08:23:59.047141 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 05 08:23:59.047141 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 05 08:23:59.047141 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 05 08:23:59.047141 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 05 08:23:59.047141 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 05 08:23:59.047141 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 05 08:23:59.047141 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 05 08:23:59.047141 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 05 08:23:59.048155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 05 08:23:59.048155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 05 08:23:59.048155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 05 08:23:59.048155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 05 08:23:59.048155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 05 08:23:59.048155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 05 08:23:59.048155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 05 08:23:59.048155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 05 08:23:59.048155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 48dd0848-5cd8-440d-b00c-443bb03e5e19 could not be found. Jun 05 08:23:59.048155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.048155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:59.048155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.048155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:59.048155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:59.048155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:59.048155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:23:59.048155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:23:59.048155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:23:59.048155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:23:59.049097 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:23:59.049097 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:23:59.049097 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jun 05 08:23:59.049097 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jun 05 08:23:59.049097 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 05 08:23:59.049097 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 05 08:23:59.049097 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 05 08:23:59.049097 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.049097 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:59.049097 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.049097 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:59.049097 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:59.049097 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:59.049097 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:23:59.049097 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:23:59.049097 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 05 08:23:59.049097 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.049097 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8303a6ed-5549-4577-a702-46e646a3ab19 tempest-ImagesMetadataNegativeTestJSON-1638610133 tempest-ImagesMetadataNegativeTestJSON-1638610133-project] Returning 404 to user: Image not found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:23:59.050002 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8303a6ed-5549-4577-a702-46e646a3ab19 tempest-ImagesMetadataNegativeTestJSON-1638610133 tempest-ImagesMetadataNegativeTestJSON-1638610133-project] 10.222.0.33 "GET /compute/v2.1/images/48dd0848-5cd8-440d-b00c-443bb03e5e19/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.034249 Jun 05 08:23:59.050002 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 94/172] 10.222.0.33 () {58 vars in 1292 bytes} [Sun Jun 5 08:23:59 2022] GET /compute/v2.1/images/48dd0848-5cd8-440d-b00c-443bb03e5e19/metadata/os_version => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:23:59.053201 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3a837029-3434-4057-b112-685f0c58ba7a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:59.053970 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3a837029-3434-4057-b112-685f0c58ba7a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:59.056794 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5d2debe4-32bb-4aa6-bde7-bbe493a4224b tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] 10.222.0.33 "GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc" status: 200 len: 1492 microversion: 2.1 time: 0.380734 Jun 05 08:23:59.057388 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 79/173] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:58 2022] GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc => generated 1492 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:59.061888 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0b4bb0a7-ee2d-4268-bd49-81770cb903c8 tempest-ImagesMetadataNegativeTestJSON-1638610133 tempest-ImagesMetadataNegativeTestJSON-1638610133-project] Calling method '.version_select at 0x7f2440274b80>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:59.081679 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3a837029-3434-4057-b112-685f0c58ba7a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:59.082148 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3a837029-3434-4057-b112-685f0c58ba7a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:59.082945 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3a837029-3434-4057-b112-685f0c58ba7a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:59.088923 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-0b4bb0a7-ee2d-4268-bd49-81770cb903c8 tempest-ImagesMetadataNegativeTestJSON-1638610133 tempest-ImagesMetadataNegativeTestJSON-1638610133-project] HTTP exception thrown: Image not found. Jun 05 08:23:59.090622 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3a837029-3434-4057-b112-685f0c58ba7a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:59.090964 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0b4bb0a7-ee2d-4268-bd49-81770cb903c8 tempest-ImagesMetadataNegativeTestJSON-1638610133 tempest-ImagesMetadataNegativeTestJSON-1638610133-project] Request method failure captured: Jun 05 08:23:59.090964 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/images/adc5dbbe-ac42-448d-ae90-945523bc4905/metadata HTTP/1.1 Jun 05 08:23:59.090964 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:23:59.090964 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:23:59.090964 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:23:59.090964 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:23:59.090964 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:23:59.090964 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:23:59.090964 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:23:59.090964 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:23:59.090964 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGgeNif8jVFs_FHdNrn1311RNmnuV-JT0JFbf8s-TJaTRMKNwNlIhcd5s6b2Er0zkKsYjEQJngpgQXcNwgtXJz86Ucp7HV0zTzBTQIGvPWOuMBAWE5yImxh2ps8o3IU16k0qLEECcE3JdNse6Dzesv0vYteC9XOeE7PMxQcb2rMeptg Jun 05 08:23:59.090964 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:23:59.090964 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:23:59.090964 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:23:59.090964 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:23:59.090964 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:23:59.090964 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:23:59.090964 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 705c8e778f8649daab01995ec806f64e Jun 05 08:23:59.090964 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1638610133 Jun 05 08:23:59.090964 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:23:59.090964 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:23:59.092062 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/705c8e778f8649daab01995ec806f64e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/705c8e778f8649daab01995ec806f64e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_705c8e778f8649daab01995ec806f64e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/705c8e778f8649daab01995ec806f64e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:23:59.092062 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1638610133 Jun 05 08:23:59.092062 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 705c8e778f8649daab01995ec806f64e Jun 05 08:23:59.092062 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1638610133 Jun 05 08:23:59.092062 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ImagesMetadataNegativeTestJSON-1638610133-project Jun 05 08:23:59.092062 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:23:59.092062 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:23:59.092062 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 40aca8b474d148cc8bc8513e1bd10d2d Jun 05 08:23:59.092062 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1638610133-project Jun 05 08:23:59.092062 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:23:59.092062 n-d-844739-1 devstack@n-api.service[119049]: exception: Image not found. Jun 05 08:23:59.092062 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'image_id': 'adc5dbbe-ac42-448d-ae90-945523bc4905'} Jun 05 08:23:59.092062 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:23:59.092747 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:59.092747 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 05 08:23:59.092747 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 05 08:23:59.092747 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 05 08:23:59.092747 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 05 08:23:59.092747 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 05 08:23:59.092747 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 05 08:23:59.092747 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 05 08:23:59.092747 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 05 08:23:59.092747 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 05 08:23:59.092747 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 05 08:23:59.092747 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 05 08:23:59.092747 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 05 08:23:59.092747 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 05 08:23:59.092747 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 05 08:23:59.092747 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 05 08:23:59.092747 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 05 08:23:59.092747 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID adc5dbbe-ac42-448d-ae90-945523bc4905 Jun 05 08:23:59.093695 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.093695 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:59.093695 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.093695 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:59.093695 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 05 08:23:59.093695 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 05 08:23:59.093695 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 05 08:23:59.093695 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 05 08:23:59.093695 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 05 08:23:59.093695 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 05 08:23:59.093695 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 05 08:23:59.093695 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 05 08:23:59.093695 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 05 08:23:59.093695 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 05 08:23:59.093695 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 05 08:23:59.093695 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 05 08:23:59.093695 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 05 08:23:59.093695 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 05 08:23:59.093695 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 05 08:23:59.093695 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 05 08:23:59.096287 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 05 08:23:59.096287 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 05 08:23:59.096287 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 05 08:23:59.096287 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 05 08:23:59.096287 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 05 08:23:59.096287 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 05 08:23:59.096287 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 05 08:23:59.096287 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 05 08:23:59.096287 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image adc5dbbe-ac42-448d-ae90-945523bc4905 could not be found. Jun 05 08:23:59.096287 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.096287 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:59.096287 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.096287 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:59.096287 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:59.096287 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:59.096287 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:23:59.096287 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:23:59.096287 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:23:59.096287 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:23:59.099425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:23:59.099425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:23:59.099425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jun 05 08:23:59.099425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jun 05 08:23:59.099425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 05 08:23:59.099425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 05 08:23:59.099425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 05 08:23:59.099425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.099425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:59.099425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.099425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:59.099425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:59.099425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:59.099425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:23:59.099425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:23:59.099425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 05 08:23:59.099425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.099425 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0b4bb0a7-ee2d-4268-bd49-81770cb903c8 tempest-ImagesMetadataNegativeTestJSON-1638610133 tempest-ImagesMetadataNegativeTestJSON-1638610133-project] Returning 404 to user: Image not found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:23:59.101335 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0b4bb0a7-ee2d-4268-bd49-81770cb903c8 tempest-ImagesMetadataNegativeTestJSON-1638610133 tempest-ImagesMetadataNegativeTestJSON-1638610133-project] 10.222.0.33 "GET /compute/v2.1/images/adc5dbbe-ac42-448d-ae90-945523bc4905/metadata" status: 404 len: 62 microversion: 2.1 time: 0.034042 Jun 05 08:23:59.101335 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 80/174] 10.222.0.33 () {58 vars in 1259 bytes} [Sun Jun 5 08:23:59 2022] GET /compute/v2.1/images/adc5dbbe-ac42-448d-ae90-945523bc4905/metadata => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:23:59.102782 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-83cb9d62-67b2-4e94-b156-9930a0aa0699 tempest-ImagesMetadataNegativeTestJSON-1638610133 tempest-ImagesMetadataNegativeTestJSON-1638610133-project] Action: 'update_all', calling method: .version_select at 0x7f24401eab80>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:59.137230 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-83cb9d62-67b2-4e94-b156-9930a0aa0699 tempest-ImagesMetadataNegativeTestJSON-1638610133 tempest-ImagesMetadataNegativeTestJSON-1638610133-project] HTTP exception thrown: Image not found. Jun 05 08:23:59.140164 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-83cb9d62-67b2-4e94-b156-9930a0aa0699 tempest-ImagesMetadataNegativeTestJSON-1638610133 tempest-ImagesMetadataNegativeTestJSON-1638610133-project] Request method failure captured: Jun 05 08:23:59.140164 n-d-844739-1 devstack@n-api.service[119049]: request: PUT /compute/v2.1/images/5c48c303-9c84-4098-9ccd-6b5af13c432a/metadata HTTP/1.1 Jun 05 08:23:59.140164 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:23:59.140164 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:23:59.140164 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:23:59.140164 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 57 Jun 05 08:23:59.140164 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:23:59.140164 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:23:59.140164 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:23:59.140164 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:23:59.140164 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGgeNif8jVFs_FHdNrn1311RNmnuV-JT0JFbf8s-TJaTRMKNwNlIhcd5s6b2Er0zkKsYjEQJngpgQXcNwgtXJz86Ucp7HV0zTzBTQIGvPWOuMBAWE5yImxh2ps8o3IU16k0qLEECcE3JdNse6Dzesv0vYteC9XOeE7PMxQcb2rMeptg Jun 05 08:23:59.140164 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:23:59.140164 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:23:59.140164 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:23:59.140164 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:23:59.140164 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:23:59.140164 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:23:59.140164 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 705c8e778f8649daab01995ec806f64e Jun 05 08:23:59.140164 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1638610133 Jun 05 08:23:59.140164 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:23:59.140164 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:23:59.141329 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/705c8e778f8649daab01995ec806f64e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/705c8e778f8649daab01995ec806f64e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_705c8e778f8649daab01995ec806f64e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/705c8e778f8649daab01995ec806f64e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:23:59.141329 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1638610133 Jun 05 08:23:59.141329 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 705c8e778f8649daab01995ec806f64e Jun 05 08:23:59.141329 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1638610133 Jun 05 08:23:59.141329 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ImagesMetadataNegativeTestJSON-1638610133-project Jun 05 08:23:59.141329 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:23:59.141329 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:23:59.141329 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 40aca8b474d148cc8bc8513e1bd10d2d Jun 05 08:23:59.141329 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1638610133-project Jun 05 08:23:59.141329 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:23:59.141329 n-d-844739-1 devstack@n-api.service[119049]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jun 05 08:23:59.141329 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:23:59.141329 n-d-844739-1 devstack@n-api.service[119049]: exception: Image not found. Jun 05 08:23:59.141329 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'image_id': '5c48c303-9c84-4098-9ccd-6b5af13c432a', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jun 05 08:23:59.142129 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:23:59.142129 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:59.142129 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 05 08:23:59.142129 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 05 08:23:59.142129 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 05 08:23:59.142129 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 05 08:23:59.142129 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 05 08:23:59.142129 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 05 08:23:59.142129 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 05 08:23:59.142129 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 05 08:23:59.142129 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 05 08:23:59.142129 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 05 08:23:59.142129 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 05 08:23:59.142129 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 05 08:23:59.142129 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 05 08:23:59.142129 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 05 08:23:59.142129 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 05 08:23:59.142129 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 05 08:23:59.147806 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5c48c303-9c84-4098-9ccd-6b5af13c432a Jun 05 08:23:59.147806 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.147806 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:59.147806 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.147806 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:59.147806 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 05 08:23:59.147806 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 05 08:23:59.147806 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 05 08:23:59.147806 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 05 08:23:59.147806 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 05 08:23:59.147806 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 05 08:23:59.147806 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 05 08:23:59.147806 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 05 08:23:59.147806 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 05 08:23:59.147806 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 05 08:23:59.147806 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 05 08:23:59.147806 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 05 08:23:59.147806 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 05 08:23:59.147806 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 05 08:23:59.150213 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 05 08:23:59.150213 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 05 08:23:59.150213 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 05 08:23:59.150213 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 05 08:23:59.150213 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 05 08:23:59.150213 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 05 08:23:59.150213 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 05 08:23:59.150213 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 05 08:23:59.150213 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 05 08:23:59.150213 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 05 08:23:59.150213 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5c48c303-9c84-4098-9ccd-6b5af13c432a could not be found. Jun 05 08:23:59.150213 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.150213 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:59.150213 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.150213 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:59.150213 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:59.150213 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:59.150213 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:23:59.150213 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:23:59.152476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:23:59.152476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:23:59.152476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:23:59.152476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:23:59.152476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:23:59.152476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:23:59.152476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jun 05 08:23:59.152476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 05 08:23:59.152476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 05 08:23:59.152476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 05 08:23:59.152476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 05 08:23:59.152476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.152476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:59.152476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.152476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:59.152476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:59.152476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:59.152476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:23:59.152476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:23:59.152476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 05 08:23:59.152476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.155379 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-83cb9d62-67b2-4e94-b156-9930a0aa0699 tempest-ImagesMetadataNegativeTestJSON-1638610133 tempest-ImagesMetadataNegativeTestJSON-1638610133-project] Returning 404 to user: Image not found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:23:59.155379 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-83cb9d62-67b2-4e94-b156-9930a0aa0699 tempest-ImagesMetadataNegativeTestJSON-1638610133 tempest-ImagesMetadataNegativeTestJSON-1638610133-project] 10.222.0.33 "PUT /compute/v2.1/images/5c48c303-9c84-4098-9ccd-6b5af13c432a/metadata" status: 404 len: 62 microversion: 2.1 time: 0.042888 Jun 05 08:23:59.155379 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 81/175] 10.222.0.33 () {60 vars in 1279 bytes} [Sun Jun 5 08:23:59 2022] PUT /compute/v2.1/images/5c48c303-9c84-4098-9ccd-6b5af13c432a/metadata => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:23:59.155772 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:23:59.164382 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7be6b49c-e277-4bfd-9881-bfd283bcc4b0 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:59.165055 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7be6b49c-e277-4bfd-9881-bfd283bcc4b0 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 121df5fc-10cc-4f27-bbe8-878791f857a2] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:59.172922 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7be6b49c-e277-4bfd-9881-bfd283bcc4b0 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:59.173712 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7be6b49c-e277-4bfd-9881-bfd283bcc4b0 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:59.174557 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7be6b49c-e277-4bfd-9881-bfd283bcc4b0 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:59.174996 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7be6b49c-e277-4bfd-9881-bfd283bcc4b0 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:59.269090 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=10 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:23:59.289746 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=14 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:23:59.428009 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=14 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:23:59.434724 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3a837029-3434-4057-b112-685f0c58ba7a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:59.443371 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3a837029-3434-4057-b112-685f0c58ba7a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1310 microversion: 2.1 time: 0.394602 Jun 05 08:23:59.443966 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 95/176] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:59 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1310 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:59.448933 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b4bc870c-32e3-4846-a8c3-3d179c563570 tempest-ImagesMetadataNegativeTestJSON-1638610133 tempest-ImagesMetadataNegativeTestJSON-1638610133-project] Action: 'update', calling method: .version_select at 0x7f2440245c10>, body: {"meta": {"os_distro": "alt"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:59.453788 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7be6b49c-e277-4bfd-9881-bfd283bcc4b0 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:59.466971 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7be6b49c-e277-4bfd-9881-bfd283bcc4b0 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2" status: 200 len: 1339 microversion: 2.1 time: 0.322336 Jun 05 08:23:59.468973 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 82/177] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:59 2022] GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2 => generated 1339 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:59.474996 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7379e183-f574-49d2-b599-d0ffacf34f33 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:23:59.475940 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7379e183-f574-49d2-b599-d0ffacf34f33 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: e4c09fb3-f67f-4b07-a992-2e70683932bd] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:23:59.481300 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-b4bc870c-32e3-4846-a8c3-3d179c563570 tempest-ImagesMetadataNegativeTestJSON-1638610133 tempest-ImagesMetadataNegativeTestJSON-1638610133-project] HTTP exception thrown: Image not found. Jun 05 08:23:59.482516 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7379e183-f574-49d2-b599-d0ffacf34f33 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:59.482982 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7379e183-f574-49d2-b599-d0ffacf34f33 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:59.483370 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b4bc870c-32e3-4846-a8c3-3d179c563570 tempest-ImagesMetadataNegativeTestJSON-1638610133 tempest-ImagesMetadataNegativeTestJSON-1638610133-project] Request method failure captured: Jun 05 08:23:59.483370 n-d-844739-1 devstack@n-api.service[119050]: request: PUT /compute/v2.1/images/c5f96baa-3b51-4e41-b702-c2f019a11f89/metadata/os_distro HTTP/1.1 Jun 05 08:23:59.483370 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:23:59.483370 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:23:59.483370 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:23:59.483370 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 30 Jun 05 08:23:59.483370 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:23:59.483370 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:23:59.483370 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:23:59.483370 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:23:59.483370 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGgeNif8jVFs_FHdNrn1311RNmnuV-JT0JFbf8s-TJaTRMKNwNlIhcd5s6b2Er0zkKsYjEQJngpgQXcNwgtXJz86Ucp7HV0zTzBTQIGvPWOuMBAWE5yImxh2ps8o3IU16k0qLEECcE3JdNse6Dzesv0vYteC9XOeE7PMxQcb2rMeptg Jun 05 08:23:59.483370 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:23:59.483370 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:23:59.483370 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:23:59.483370 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:23:59.483370 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:23:59.483370 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:23:59.483370 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 705c8e778f8649daab01995ec806f64e Jun 05 08:23:59.483370 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1638610133 Jun 05 08:23:59.483370 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:23:59.483370 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:23:59.484520 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/705c8e778f8649daab01995ec806f64e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/705c8e778f8649daab01995ec806f64e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_705c8e778f8649daab01995ec806f64e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/705c8e778f8649daab01995ec806f64e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:23:59.484520 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1638610133 Jun 05 08:23:59.484520 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 705c8e778f8649daab01995ec806f64e Jun 05 08:23:59.484520 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1638610133 Jun 05 08:23:59.484520 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ImagesMetadataNegativeTestJSON-1638610133-project Jun 05 08:23:59.484520 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:23:59.484520 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:23:59.484520 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 40aca8b474d148cc8bc8513e1bd10d2d Jun 05 08:23:59.484520 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1638610133-project Jun 05 08:23:59.484520 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:23:59.484520 n-d-844739-1 devstack@n-api.service[119050]: {"meta": {"os_distro": "alt"}} Jun 05 08:23:59.484520 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:23:59.484520 n-d-844739-1 devstack@n-api.service[119050]: exception: Image not found. Jun 05 08:23:59.484520 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'image_id': 'c5f96baa-3b51-4e41-b702-c2f019a11f89', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jun 05 08:23:59.485246 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:23:59.485246 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:59.485246 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 05 08:23:59.485246 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 05 08:23:59.485246 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 05 08:23:59.485246 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 05 08:23:59.485246 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 05 08:23:59.485246 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 05 08:23:59.485246 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 05 08:23:59.485246 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 05 08:23:59.485246 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 05 08:23:59.485246 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 05 08:23:59.485246 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 05 08:23:59.485246 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 05 08:23:59.485246 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 05 08:23:59.485246 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 05 08:23:59.485246 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 05 08:23:59.485246 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 05 08:23:59.486153 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c5f96baa-3b51-4e41-b702-c2f019a11f89 Jun 05 08:23:59.486153 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.486153 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:59.486153 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.486153 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:59.486153 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 05 08:23:59.486153 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 05 08:23:59.486153 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 05 08:23:59.486153 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 05 08:23:59.486153 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 05 08:23:59.486153 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 05 08:23:59.486153 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 05 08:23:59.486153 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 05 08:23:59.486153 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 05 08:23:59.486153 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 05 08:23:59.486153 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 05 08:23:59.486153 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 05 08:23:59.486153 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 05 08:23:59.486153 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 05 08:23:59.487741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 05 08:23:59.487741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 05 08:23:59.487741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 05 08:23:59.487741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 05 08:23:59.487741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 05 08:23:59.487741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 05 08:23:59.487741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 05 08:23:59.487741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 05 08:23:59.487741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 05 08:23:59.487741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 05 08:23:59.487741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c5f96baa-3b51-4e41-b702-c2f019a11f89 could not be found. Jun 05 08:23:59.487741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.487741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:59.487741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.487741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:59.487741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:59.487741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:59.487741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:23:59.487741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:23:59.488695 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:23:59.488695 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:23:59.488695 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:23:59.488695 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:23:59.488695 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:23:59.488695 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:23:59.488695 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jun 05 08:23:59.488695 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 05 08:23:59.488695 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 05 08:23:59.488695 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 05 08:23:59.488695 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 05 08:23:59.488695 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.488695 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:59.488695 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.488695 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:59.488695 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:59.488695 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:59.488695 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:23:59.488695 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:23:59.488695 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 05 08:23:59.488695 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.490300 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7379e183-f574-49d2-b599-d0ffacf34f33 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:59.490434 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b4bc870c-32e3-4846-a8c3-3d179c563570 tempest-ImagesMetadataNegativeTestJSON-1638610133 tempest-ImagesMetadataNegativeTestJSON-1638610133-project] Returning 404 to user: Image not found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:23:59.490554 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7379e183-f574-49d2-b599-d0ffacf34f33 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:59.490679 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b4bc870c-32e3-4846-a8c3-3d179c563570 tempest-ImagesMetadataNegativeTestJSON-1638610133 tempest-ImagesMetadataNegativeTestJSON-1638610133-project] 10.222.0.33 "PUT /compute/v2.1/images/c5f96baa-3b51-4e41-b702-c2f019a11f89/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.039592 Jun 05 08:23:59.491456 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 96/178] 10.222.0.33 () {60 vars in 1309 bytes} [Sun Jun 5 08:23:59 2022] PUT /compute/v2.1/images/c5f96baa-3b51-4e41-b702-c2f019a11f89/metadata/os_distro => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:23:59.498130 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2dd6a8ba-aaad-428b-a247-e6f339091590 tempest-ImagesMetadataNegativeTestJSON-1638610133 tempest-ImagesMetadataNegativeTestJSON-1638610133-project] Action: 'create', calling method: .version_select at 0x7f244038cee0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:59.540739 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-2dd6a8ba-aaad-428b-a247-e6f339091590 tempest-ImagesMetadataNegativeTestJSON-1638610133 tempest-ImagesMetadataNegativeTestJSON-1638610133-project] HTTP exception thrown: Image not found. Jun 05 08:23:59.542839 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2dd6a8ba-aaad-428b-a247-e6f339091590 tempest-ImagesMetadataNegativeTestJSON-1638610133 tempest-ImagesMetadataNegativeTestJSON-1638610133-project] Request method failure captured: Jun 05 08:23:59.542839 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/images/62dfae67-85c5-4f83-bee1-87a7f91109a8/metadata HTTP/1.1 Jun 05 08:23:59.542839 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:23:59.542839 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:23:59.542839 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:23:59.542839 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 57 Jun 05 08:23:59.542839 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:23:59.542839 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:23:59.542839 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:23:59.542839 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:23:59.542839 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGgeNif8jVFs_FHdNrn1311RNmnuV-JT0JFbf8s-TJaTRMKNwNlIhcd5s6b2Er0zkKsYjEQJngpgQXcNwgtXJz86Ucp7HV0zTzBTQIGvPWOuMBAWE5yImxh2ps8o3IU16k0qLEECcE3JdNse6Dzesv0vYteC9XOeE7PMxQcb2rMeptg Jun 05 08:23:59.542839 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:23:59.542839 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:23:59.542839 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:23:59.542839 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:23:59.542839 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:23:59.542839 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:23:59.542839 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 705c8e778f8649daab01995ec806f64e Jun 05 08:23:59.542839 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1638610133 Jun 05 08:23:59.542839 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:23:59.542839 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:23:59.543973 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/705c8e778f8649daab01995ec806f64e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/705c8e778f8649daab01995ec806f64e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_705c8e778f8649daab01995ec806f64e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/705c8e778f8649daab01995ec806f64e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:23:59.543973 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1638610133 Jun 05 08:23:59.543973 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 705c8e778f8649daab01995ec806f64e Jun 05 08:23:59.543973 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1638610133 Jun 05 08:23:59.543973 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ImagesMetadataNegativeTestJSON-1638610133-project Jun 05 08:23:59.543973 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:23:59.543973 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:23:59.543973 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 40aca8b474d148cc8bc8513e1bd10d2d Jun 05 08:23:59.543973 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1638610133-project Jun 05 08:23:59.543973 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:23:59.543973 n-d-844739-1 devstack@n-api.service[119050]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jun 05 08:23:59.543973 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:23:59.543973 n-d-844739-1 devstack@n-api.service[119050]: exception: Image not found. Jun 05 08:23:59.543973 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'image_id': '62dfae67-85c5-4f83-bee1-87a7f91109a8', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jun 05 08:23:59.544719 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:23:59.544719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:59.544719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 05 08:23:59.544719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 05 08:23:59.544719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 05 08:23:59.544719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 05 08:23:59.544719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 05 08:23:59.544719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 05 08:23:59.544719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 05 08:23:59.544719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 05 08:23:59.544719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 05 08:23:59.544719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 05 08:23:59.544719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 05 08:23:59.544719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 05 08:23:59.544719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 05 08:23:59.544719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 05 08:23:59.544719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 05 08:23:59.544719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 05 08:23:59.545594 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 62dfae67-85c5-4f83-bee1-87a7f91109a8 Jun 05 08:23:59.545594 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.545594 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:59.545594 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.545594 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:59.545594 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 05 08:23:59.545594 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 05 08:23:59.545594 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 05 08:23:59.545594 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 05 08:23:59.545594 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 05 08:23:59.545594 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 05 08:23:59.545594 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 05 08:23:59.545594 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 05 08:23:59.545594 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 05 08:23:59.545594 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 05 08:23:59.545594 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 05 08:23:59.545594 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 05 08:23:59.545594 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 05 08:23:59.545594 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 05 08:23:59.546536 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 05 08:23:59.546536 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 05 08:23:59.546536 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 05 08:23:59.546536 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 05 08:23:59.546536 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 05 08:23:59.546536 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 05 08:23:59.546536 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 05 08:23:59.546536 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 05 08:23:59.546536 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 05 08:23:59.546536 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 05 08:23:59.546536 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 62dfae67-85c5-4f83-bee1-87a7f91109a8 could not be found. Jun 05 08:23:59.546536 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.546536 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:59.546536 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.546536 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:59.546536 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:59.546536 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:59.546536 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:23:59.546536 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:23:59.547442 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:23:59.547442 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:23:59.547442 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:23:59.547442 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:23:59.547442 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:23:59.547442 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:23:59.547442 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jun 05 08:23:59.547442 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 05 08:23:59.547442 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 05 08:23:59.547442 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 05 08:23:59.547442 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 05 08:23:59.547442 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.547442 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:23:59.547442 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.547442 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:23:59.547442 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:23:59.547442 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:23:59.547442 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:23:59.547442 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:23:59.547442 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 05 08:23:59.547442 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:23:59.548481 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2dd6a8ba-aaad-428b-a247-e6f339091590 tempest-ImagesMetadataNegativeTestJSON-1638610133 tempest-ImagesMetadataNegativeTestJSON-1638610133-project] Returning 404 to user: Image not found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:23:59.548481 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2dd6a8ba-aaad-428b-a247-e6f339091590 tempest-ImagesMetadataNegativeTestJSON-1638610133 tempest-ImagesMetadataNegativeTestJSON-1638610133-project] 10.222.0.33 "POST /compute/v2.1/images/62dfae67-85c5-4f83-bee1-87a7f91109a8/metadata" status: 404 len: 62 microversion: 2.1 time: 0.050169 Jun 05 08:23:59.551043 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 97/179] 10.222.0.33 () {60 vars in 1280 bytes} [Sun Jun 5 08:23:59 2022] POST /compute/v2.1/images/62dfae67-85c5-4f83-bee1-87a7f91109a8/metadata => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:23:59.658820 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-d4b9a51a-8fe8-43db-bbcf-32e4d974cd13 req-a51fe2ec-596d-46eb-adc5-7342d1c9f1bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63dc26bf-e378-436f-a328-a88919547afc", "name": "network-vif-deleted", "tag": "5ba0a894-464e-424e-a5f1-bfb7549d1603"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:23:59.669331 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-d4b9a51a-8fe8-43db-bbcf-32e4d974cd13 req-a51fe2ec-596d-46eb-adc5-7342d1c9f1bc service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:23:59.670121 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-d4b9a51a-8fe8-43db-bbcf-32e4d974cd13 req-a51fe2ec-596d-46eb-adc5-7342d1c9f1bc service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:23:59.685849 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7379e183-f574-49d2-b599-d0ffacf34f33 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:23:59.694177 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7379e183-f574-49d2-b599-d0ffacf34f33 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd" status: 200 len: 1390 microversion: 2.1 time: 0.223207 Jun 05 08:23:59.694757 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 83/180] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:23:59 2022] GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd => generated 1390 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:23:59.705105 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-d4b9a51a-8fe8-43db-bbcf-32e4d974cd13 req-a51fe2ec-596d-46eb-adc5-7342d1c9f1bc service nova] Creating event network-vif-deleted:5ba0a894-464e-424e-a5f1-bfb7549d1603 for instance 63dc26bf-e378-436f-a328-a88919547afc on n-h2-844739-1 Jun 05 08:23:59.711726 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-d4b9a51a-8fe8-43db-bbcf-32e4d974cd13 req-a51fe2ec-596d-46eb-adc5-7342d1c9f1bc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057706 Jun 05 08:23:59.714670 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 98/181] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:00.029741 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-97bce194-1c06-42dc-9a68-31a5bbb57496 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:00.030682 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-97bce194-1c06-42dc-9a68-31a5bbb57496 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:00.041213 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-97bce194-1c06-42dc-9a68-31a5bbb57496 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:00.041834 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-97bce194-1c06-42dc-9a68-31a5bbb57496 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:00.042672 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-97bce194-1c06-42dc-9a68-31a5bbb57496 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:00.043228 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-97bce194-1c06-42dc-9a68-31a5bbb57496 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:00.074086 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5c0f39f5-24db-4d07-82bb-75ee635c6e25 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:00.074802 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5c0f39f5-24db-4d07-82bb-75ee635c6e25 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] [instance: 63dc26bf-e378-436f-a328-a88919547afc] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:00.081255 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5c0f39f5-24db-4d07-82bb-75ee635c6e25 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:00.081708 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5c0f39f5-24db-4d07-82bb-75ee635c6e25 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:00.082483 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5c0f39f5-24db-4d07-82bb-75ee635c6e25 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:00.082935 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5c0f39f5-24db-4d07-82bb-75ee635c6e25 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:00.120837 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5c0f39f5-24db-4d07-82bb-75ee635c6e25 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:00.121289 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5c0f39f5-24db-4d07-82bb-75ee635c6e25 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:00.121757 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-5c0f39f5-24db-4d07-82bb-75ee635c6e25 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lazy-loading 'fault' on Instance uuid 63dc26bf-e378-436f-a328-a88919547afc {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:00.178663 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5c0f39f5-24db-4d07-82bb-75ee635c6e25 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3429347e644bdca51b2b3b976a7bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9587ff19dfc4eefb5129656cbdf4a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:00.186779 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5c0f39f5-24db-4d07-82bb-75ee635c6e25 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] 10.222.0.33 "GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc" status: 200 len: 1383 microversion: 2.1 time: 0.116792 Jun 05 08:24:00.187522 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 99/182] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:00 2022] GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc => generated 1383 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:24:00.205509 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-70a3b6af-1a19-4593-95a0-bd0e8dfbf79b tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-844739-1"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:00.206991 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:00.206991 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:00.217442 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-70a3b6af-1a19-4593-95a0-bd0e8dfbf79b tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:00.217644 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-97bce194-1c06-42dc-9a68-31a5bbb57496 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:00.217904 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-70a3b6af-1a19-4593-95a0-bd0e8dfbf79b tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:00.228471 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-97bce194-1c06-42dc-9a68-31a5bbb57496 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 200 len: 1319 microversion: 2.1 time: 0.205335 Jun 05 08:24:00.236208 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 84/183] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:00 2022] GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:24:00.355756 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-70a3b6af-1a19-4593-95a0-bd0e8dfbf79b tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 298 microversion: 2.1 time: 0.154809 Jun 05 08:24:00.356528 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 100/184] 10.222.0.33 () {60 vars in 1190 bytes} [Sun Jun 5 08:24:00 2022] POST /compute/v2.1/os-aggregates/2/action => generated 298 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:00.369300 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e4c4227c-a88f-45d0-b4f2-0c36cc9667db tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:00.370627 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:00.370627 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:00.398460 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e4c4227c-a88f-45d0-b4f2-0c36cc9667db tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.033695 Jun 05 08:24:00.399300 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 85/185] 10.222.0.33 () {58 vars in 1151 bytes} [Sun Jun 5 08:24:00 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jun 05 08:24:00.420613 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-66cf6281-2d7c-407c-a79d-e7c1ee3cd24b tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-892270727"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:00.422287 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:00.422287 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:00.423631 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.aggregate [None req-66cf6281-2d7c-407c-a79d-e7c1ee3cd24b tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Generated uuid ba6604e9-8291-4b04-8a9b-b729a525fa51 for aggregate {{(pid=119050) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 05 08:24:00.457036 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-66cf6281-2d7c-407c-a79d-e7c1ee3cd24b tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.038500 Jun 05 08:24:00.460383 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 101/186] 10.222.0.33 () {60 vars in 1163 bytes} [Sun Jun 5 08:24:00 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:00.462300 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-027af09b-50fa-4892-a1be-b4c392e7231f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:00.462921 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-027af09b-50fa-4892-a1be-b4c392e7231f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:00.470738 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-dcba0480-9d24-4640-82e4-20a3ee1a0c0e tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-844739-1"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:00.470938 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-027af09b-50fa-4892-a1be-b4c392e7231f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:00.471501 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-027af09b-50fa-4892-a1be-b4c392e7231f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:00.472579 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-027af09b-50fa-4892-a1be-b4c392e7231f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:00.473077 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:00.473077 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:00.473413 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-027af09b-50fa-4892-a1be-b4c392e7231f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:00.484728 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dcba0480-9d24-4640-82e4-20a3ee1a0c0e tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:00.485346 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dcba0480-9d24-4640-82e4-20a3ee1a0c0e tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:00.640691 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-027af09b-50fa-4892-a1be-b4c392e7231f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:00.649628 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-027af09b-50fa-4892-a1be-b4c392e7231f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1310 microversion: 2.1 time: 0.191704 Jun 05 08:24:00.650409 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 86/187] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:00 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1310 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:00.669737 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d50f4476-870a-48e8-902b-1d7210e5118a tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:00.672130 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-dcba0480-9d24-4640-82e4-20a3ee1a0c0e tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.205046 Jun 05 08:24:00.672887 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 102/188] 10.222.0.33 () {60 vars in 1190 bytes} [Sun Jun 5 08:24:00 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:24:00.674838 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d50f4476-870a-48e8-902b-1d7210e5118a tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 121df5fc-10cc-4f27-bbe8-878791f857a2] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:00.682801 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c4235622-74b1-4124-b9ec-53f50c68665e tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:00.683630 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:00.683630 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:00.685000 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d50f4476-870a-48e8-902b-1d7210e5118a tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:00.686051 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d50f4476-870a-48e8-902b-1d7210e5118a tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:00.687147 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d50f4476-870a-48e8-902b-1d7210e5118a tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:00.687685 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d50f4476-870a-48e8-902b-1d7210e5118a tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:00.693184 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c4235622-74b1-4124-b9ec-53f50c68665e tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 241 microversion: 2.1 time: 0.013221 Jun 05 08:24:00.694143 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 103/189] 10.222.0.33 () {58 vars in 1148 bytes} [Sun Jun 5 08:24:00 2022] GET /compute/v2.1/os-aggregates/3 => generated 241 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:00.711982 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c1d01355-d166-4a26-924a-fb8661e660d8 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-844739-1"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:00.713360 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:00.713360 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:00.723512 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c1d01355-d166-4a26-924a-fb8661e660d8 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:00.727599 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c1d01355-d166-4a26-924a-fb8661e660d8 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:00.873125 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c1d01355-d166-4a26-924a-fb8661e660d8 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.169184 Jun 05 08:24:00.881244 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 104/190] 10.222.0.33 () {60 vars in 1190 bytes} [Sun Jun 5 08:24:00 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:00.883096 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d50f4476-870a-48e8-902b-1d7210e5118a tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:00.888182 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3b77a240-529f-44b6-aa9e-886bd3f5ef79 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:00.889075 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3b77a240-529f-44b6-aa9e-886bd3f5ef79 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: e4c09fb3-f67f-4b07-a992-2e70683932bd] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:00.896279 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3b77a240-529f-44b6-aa9e-886bd3f5ef79 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:00.897129 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3b77a240-529f-44b6-aa9e-886bd3f5ef79 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:00.898185 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3b77a240-529f-44b6-aa9e-886bd3f5ef79 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:00.898738 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3b77a240-529f-44b6-aa9e-886bd3f5ef79 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:00.899846 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d50f4476-870a-48e8-902b-1d7210e5118a tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2" status: 200 len: 1318 microversion: 2.1 time: 0.246978 Jun 05 08:24:00.903010 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 87/191] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:00 2022] GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:00.909379 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-3bfdb7c5-6cf5-41de-945d-661315951875 req-2108bcf8-40d7-4751-b523-4d3352efec95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "121df5fc-10cc-4f27-bbe8-878791f857a2", "name": "network-vif-plugged", "status": "completed", "tag": "c049258a-e044-42be-8df2-e43356b5756c"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:00.922139 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-3bfdb7c5-6cf5-41de-945d-661315951875 req-2108bcf8-40d7-4751-b523-4d3352efec95 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:00.923015 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-3bfdb7c5-6cf5-41de-945d-661315951875 req-2108bcf8-40d7-4751-b523-4d3352efec95 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:00.941197 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-3bfdb7c5-6cf5-41de-945d-661315951875 req-2108bcf8-40d7-4751-b523-4d3352efec95 service nova] Creating event network-vif-plugged:c049258a-e044-42be-8df2-e43356b5756c for instance 121df5fc-10cc-4f27-bbe8-878791f857a2 on n-h2-844739-1 Jun 05 08:24:00.966999 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-3bfdb7c5-6cf5-41de-945d-661315951875 req-2108bcf8-40d7-4751-b523-4d3352efec95 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064506 Jun 05 08:24:00.967776 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 88/192] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:00.972512 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ed9eccac-d9d9-4ceb-923b-b2ed460c87c5 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:00.973335 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:00.973335 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:01.003739 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ed9eccac-d9d9-4ceb-923b-b2ed460c87c5 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.034203 Jun 05 08:24:01.006125 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 89/193] 10.222.0.33 () {58 vars in 1151 bytes} [Sun Jun 5 08:24:00 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 05 08:24:01.022450 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d40fba2d-e1fc-4402-bd70-8e4c27bff961 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-437365963"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:01.023853 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:01.023853 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:01.024760 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.aggregate [None req-d40fba2d-e1fc-4402-bd70-8e4c27bff961 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Generated uuid c9a03be2-068a-4bc3-bc2f-ab7ee9a2c865 for aggregate {{(pid=119049) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 05 08:24:01.050010 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d40fba2d-e1fc-4402-bd70-8e4c27bff961 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.035851 Jun 05 08:24:01.050542 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 90/194] 10.222.0.33 () {60 vars in 1163 bytes} [Sun Jun 5 08:24:01 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:01.063519 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0afb6bb0-11ed-4af5-a47f-d3f3c81468aa tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-844739-1"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:01.067224 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:01.067224 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:01.076745 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0afb6bb0-11ed-4af5-a47f-d3f3c81468aa tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:01.077381 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0afb6bb0-11ed-4af5-a47f-d3f3c81468aa tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:01.205242 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0afb6bb0-11ed-4af5-a47f-d3f3c81468aa tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.147305 Jun 05 08:24:01.206511 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 91/195] 10.222.0.33 () {60 vars in 1190 bytes} [Sun Jun 5 08:24:01 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:01.216468 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2018fe98-20b4-4efe-90f9-42ef16ab078a tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:01.217177 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:01.217177 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:01.225010 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2018fe98-20b4-4efe-90f9-42ef16ab078a tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.011329 Jun 05 08:24:01.225806 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 92/196] 10.222.0.33 () {58 vars in 1142 bytes} [Sun Jun 5 08:24:01 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:24:01.236018 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3b44a52e-7fc0-41dc-967b-ed0d8abd90c0 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-844739-1"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:01.237295 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:01.237295 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:01.246744 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3b44a52e-7fc0-41dc-967b-ed0d8abd90c0 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:01.247193 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3b44a52e-7fc0-41dc-967b-ed0d8abd90c0 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:01.366138 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3b77a240-529f-44b6-aa9e-886bd3f5ef79 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:01.366656 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3b44a52e-7fc0-41dc-967b-ed0d8abd90c0 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.134150 Jun 05 08:24:01.367361 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 93/197] 10.222.0.33 () {60 vars in 1190 bytes} [Sun Jun 5 08:24:01 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:01.378316 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0111283f-334c-4f5e-9a18-8509be3b3df9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:01.379138 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0111283f-334c-4f5e-9a18-8509be3b3df9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:01.379908 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3b77a240-529f-44b6-aa9e-886bd3f5ef79 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd" status: 200 len: 1390 microversion: 2.1 time: 0.495168 Jun 05 08:24:01.381984 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 105/198] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:00 2022] GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd => generated 1390 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:01.390721 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4fe55d56-8bf8-474a-9b7f-429c1d5443b3 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:01.391762 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:01.391762 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:01.394672 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0111283f-334c-4f5e-9a18-8509be3b3df9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:01.395305 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0111283f-334c-4f5e-9a18-8509be3b3df9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:01.396748 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0111283f-334c-4f5e-9a18-8509be3b3df9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:01.397549 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0111283f-334c-4f5e-9a18-8509be3b3df9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:01.420840 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4fe55d56-8bf8-474a-9b7f-429c1d5443b3 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.033621 Jun 05 08:24:01.421531 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 106/199] 10.222.0.33 () {58 vars in 1151 bytes} [Sun Jun 5 08:24:01 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 05 08:24:01.433845 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8407db1a-9e7a-4400-888e-4dc857d2eb07 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-920735495"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:01.436908 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:01.436908 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:01.437999 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.aggregate [None req-8407db1a-9e7a-4400-888e-4dc857d2eb07 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Generated uuid b7754498-2c0a-49d5-94cd-ae9779610ff2 for aggregate {{(pid=119050) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 05 08:24:01.461189 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8407db1a-9e7a-4400-888e-4dc857d2eb07 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.032101 Jun 05 08:24:01.462351 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 107/200] 10.222.0.33 () {60 vars in 1163 bytes} [Sun Jun 5 08:24:01 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:24:01.478084 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9f8e72c0-99f0-4170-a193-0c181407e45b tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-844739-1"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:01.480492 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:01.480492 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:01.495024 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9f8e72c0-99f0-4170-a193-0c181407e45b tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:01.495878 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9f8e72c0-99f0-4170-a193-0c181407e45b tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:01.596623 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0111283f-334c-4f5e-9a18-8509be3b3df9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:01.605532 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0111283f-334c-4f5e-9a18-8509be3b3df9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 200 len: 1319 microversion: 2.1 time: 0.231246 Jun 05 08:24:01.628229 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 94/201] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:01 2022] GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:01.655003 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9f8e72c0-99f0-4170-a193-0c181407e45b tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 241 microversion: 2.1 time: 0.186527 Jun 05 08:24:01.655607 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 108/202] 10.222.0.33 () {60 vars in 1190 bytes} [Sun Jun 5 08:24:01 2022] POST /compute/v2.1/os-aggregates/5/action => generated 241 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:24:01.666347 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4d565805-321c-485f-815c-57ef42cb278a tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-844739-1"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:01.667686 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:01.667686 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:01.668159 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ee09bab3-969d-4933-97f1-124e88b15d84 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:01.670134 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ee09bab3-969d-4933-97f1-124e88b15d84 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:01.678036 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4d565805-321c-485f-815c-57ef42cb278a tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:01.678764 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4d565805-321c-485f-815c-57ef42cb278a tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:01.682511 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ee09bab3-969d-4933-97f1-124e88b15d84 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:01.683141 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ee09bab3-969d-4933-97f1-124e88b15d84 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:01.684141 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ee09bab3-969d-4933-97f1-124e88b15d84 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:01.684767 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ee09bab3-969d-4933-97f1-124e88b15d84 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:01.818659 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4d565805-321c-485f-815c-57ef42cb278a tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 226 microversion: 2.1 time: 0.155102 Jun 05 08:24:01.819561 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 95/203] 10.222.0.33 () {60 vars in 1190 bytes} [Sun Jun 5 08:24:01 2022] POST /compute/v2.1/os-aggregates/5/action => generated 226 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:01.830064 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c88e48d3-12ae-40bc-bf17-df6c659cb477 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:01.830923 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:01.830923 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:01.842973 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ee09bab3-969d-4933-97f1-124e88b15d84 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:01.852390 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ee09bab3-969d-4933-97f1-124e88b15d84 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1310 microversion: 2.1 time: 0.188318 Jun 05 08:24:01.853724 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 109/204] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:01 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1310 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:24:01.871522 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c88e48d3-12ae-40bc-bf17-df6c659cb477 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.045702 Jun 05 08:24:01.872383 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 96/205] 10.222.0.33 () {58 vars in 1151 bytes} [Sun Jun 5 08:24:01 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jun 05 08:24:01.883036 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-649177b6-a704-4b14-889d-a3094a118041 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-782394756"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:01.884438 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:01.884438 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:01.885750 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.aggregate [None req-649177b6-a704-4b14-889d-a3094a118041 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Generated uuid d0db8463-758e-47ff-9385-ec1751e11740 for aggregate {{(pid=119050) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 05 08:24:01.922684 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-649177b6-a704-4b14-889d-a3094a118041 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.043986 Jun 05 08:24:01.922919 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-86c3c664-fe32-4e20-af4b-5dfd5d5811be tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:01.923498 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-86c3c664-fe32-4e20-af4b-5dfd5d5811be tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 121df5fc-10cc-4f27-bbe8-878791f857a2] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:01.931608 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 110/206] 10.222.0.33 () {60 vars in 1163 bytes} [Sun Jun 5 08:24:01 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:01.932151 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-86c3c664-fe32-4e20-af4b-5dfd5d5811be tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:01.933068 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-86c3c664-fe32-4e20-af4b-5dfd5d5811be tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:01.933843 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-86c3c664-fe32-4e20-af4b-5dfd5d5811be tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:01.934277 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-86c3c664-fe32-4e20-af4b-5dfd5d5811be tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:01.937740 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9aec341a-fc68-4c0f-81e8-ba95ff67dfb8 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-429367805"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:01.939906 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:01.939906 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:01.941577 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.aggregate [None req-9aec341a-fc68-4c0f-81e8-ba95ff67dfb8 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Generated uuid 716a612e-9ffe-4bd6-bf14-283304ee2130 for aggregate {{(pid=119050) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 05 08:24:01.976184 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9aec341a-fc68-4c0f-81e8-ba95ff67dfb8 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.042646 Jun 05 08:24:01.977222 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 111/207] 10.222.0.33 () {60 vars in 1163 bytes} [Sun Jun 5 08:24:01 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:01.982582 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cc7b2cdb-eb2c-46ef-a1c7-3b6697bf2c23 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:01.984010 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:01.984010 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:02.008072 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-cc7b2cdb-eb2c-46ef-a1c7-3b6697bf2c23 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.029569 Jun 05 08:24:02.009061 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 112/208] 10.222.0.33 () {58 vars in 1151 bytes} [Sun Jun 5 08:24:01 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 05 08:24:02.014714 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-072acee9-99b7-4046-b223-7ffd42d757c6 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-844739-1"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:02.015963 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:02.015963 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:02.025817 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-072acee9-99b7-4046-b223-7ffd42d757c6 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:02.026285 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-072acee9-99b7-4046-b223-7ffd42d757c6 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:02.035285 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:DELETE=6,nova_api:INSERT=6 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:02.119721 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-86c3c664-fe32-4e20-af4b-5dfd5d5811be tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:02.128001 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-86c3c664-fe32-4e20-af4b-5dfd5d5811be tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2" status: 200 len: 1318 microversion: 2.1 time: 0.213569 Jun 05 08:24:02.128939 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 97/209] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:01 2022] GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:02.143310 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8a130742-5213-4ff0-87fb-9785da3bf343 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:02.144834 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:02.144834 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:02.147396 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-072acee9-99b7-4046-b223-7ffd42d757c6 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 241 microversion: 2.1 time: 0.136451 Jun 05 08:24:02.148020 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 113/210] 10.222.0.33 () {60 vars in 1190 bytes} [Sun Jun 5 08:24:02 2022] POST /compute/v2.1/os-aggregates/7/action => generated 241 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:02.152633 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-8a130742-5213-4ff0-87fb-9785da3bf343 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Jun 05 08:24:02.157849 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8a130742-5213-4ff0-87fb-9785da3bf343 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Request method failure captured: Jun 05 08:24:02.157849 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Jun 05 08:24:02.157849 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:24:02.157849 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:24:02.157849 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:24:02.157849 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:24:02.157849 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:24:02.157849 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:24:02.157849 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:24:02.157849 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:02.157849 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGfzlQY18sDn8F7PRmqjaSuGUFnBl3K8WdYf3MhoKqYV9odkBn4yGogA81NnzJd5o7WMxW8BLTnSmhZ5blagYnNiKewChAHYxxMoW0L5GeuF4SdQvN1M7nVGoaNQnLFVZjfHGBCcA5fGNEkgX-a0Tw3VDBJd5vjTvZ8v0FIk51XHvR0 Jun 05 08:24:02.157849 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:24:02.157849 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:24:02.157849 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:24:02.157849 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:24:02.157849 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:24:02.157849 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:24:02.157849 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 604eeee0bf7142a49f1657bcca10fc24 Jun 05 08:24:02.157849 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-AggregatesAdminTestJSON-545397584 Jun 05 08:24:02.157849 n-d-844739-1 devstack@n-api.service[119049]: X-Role: admin,reader,member Jun 05 08:24:02.157849 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: admin,reader,member Jun 05 08:24:02.158982 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/604eeee0bf7142a49f1657bcca10fc24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/604eeee0bf7142a49f1657bcca10fc24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_604eeee0bf7142a49f1657bcca10fc24", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/604eeee0bf7142a49f1657bcca10fc24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:02.158982 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-AggregatesAdminTestJSON-545397584 Jun 05 08:24:02.158982 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 604eeee0bf7142a49f1657bcca10fc24 Jun 05 08:24:02.158982 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-545397584 Jun 05 08:24:02.158982 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-AggregatesAdminTestJSON-545397584-project-admin Jun 05 08:24:02.158982 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:24:02.158982 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:24:02.158982 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 923f0f8e33ae4699a38710a85ab1ab5e Jun 05 08:24:02.158982 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-AggregatesAdminTestJSON-545397584-project-admin Jun 05 08:24:02.158982 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:24:02.158982 n-d-844739-1 devstack@n-api.service[119049]: exception: Aggregate 6 could not be found. Jun 05 08:24:02.158982 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '6'} Jun 05 08:24:02.158982 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:02.159692 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:02.159692 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jun 05 08:24:02.159692 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jun 05 08:24:02.159692 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jun 05 08:24:02.159692 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jun 05 08:24:02.159692 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:24:02.159692 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:24:02.159692 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 05 08:24:02.159692 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 05 08:24:02.159692 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 05 08:24:02.159692 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 05 08:24:02.159692 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 05 08:24:02.159692 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 05 08:24:02.159692 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Jun 05 08:24:02.159692 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:02.159692 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:02.159692 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:02.159692 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:02.159692 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:02.160715 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:02.160715 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:02.160715 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:02.160715 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:02.160715 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:02.160715 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jun 05 08:24:02.160715 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:24:02.160715 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Jun 05 08:24:02.160715 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:02.160715 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:02.160715 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:02.160715 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:02.160715 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:02.160715 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:02.160715 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:24:02.160715 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:24:02.160715 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Jun 05 08:24:02.160715 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:02.162768 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-53a2aa86-d96c-4b87-b290-24a6e617fa7e tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-844739-1"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:02.162859 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8a130742-5213-4ff0-87fb-9785da3bf343 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:02.162928 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:02.162928 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:02.163172 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8a130742-5213-4ff0-87fb-9785da3bf343 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.020113 Jun 05 08:24:02.163172 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 98/211] 10.222.0.33 () {58 vars in 1148 bytes} [Sun Jun 5 08:24:02 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:24:02.170156 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-984db565-a0fa-4ad3-b606-9d6df3a23778 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:02.171507 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:02.171507 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:02.172494 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-53a2aa86-d96c-4b87-b290-24a6e617fa7e tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:02.172952 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-53a2aa86-d96c-4b87-b290-24a6e617fa7e tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:02.191195 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-984db565-a0fa-4ad3-b606-9d6df3a23778 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Jun 05 08:24:02.193427 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-984db565-a0fa-4ad3-b606-9d6df3a23778 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Request method failure captured: Jun 05 08:24:02.193427 n-d-844739-1 devstack@n-api.service[119049]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Jun 05 08:24:02.193427 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:24:02.193427 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:24:02.193427 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:24:02.193427 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:24:02.193427 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:24:02.193427 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:24:02.193427 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:24:02.193427 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:02.193427 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGfzlQY18sDn8F7PRmqjaSuGUFnBl3K8WdYf3MhoKqYV9odkBn4yGogA81NnzJd5o7WMxW8BLTnSmhZ5blagYnNiKewChAHYxxMoW0L5GeuF4SdQvN1M7nVGoaNQnLFVZjfHGBCcA5fGNEkgX-a0Tw3VDBJd5vjTvZ8v0FIk51XHvR0 Jun 05 08:24:02.193427 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:24:02.193427 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:24:02.193427 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:24:02.193427 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:24:02.193427 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:24:02.193427 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:24:02.193427 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 604eeee0bf7142a49f1657bcca10fc24 Jun 05 08:24:02.193427 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-AggregatesAdminTestJSON-545397584 Jun 05 08:24:02.193427 n-d-844739-1 devstack@n-api.service[119049]: X-Role: admin,reader,member Jun 05 08:24:02.193427 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: admin,reader,member Jun 05 08:24:02.194809 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/604eeee0bf7142a49f1657bcca10fc24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/604eeee0bf7142a49f1657bcca10fc24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_604eeee0bf7142a49f1657bcca10fc24", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/604eeee0bf7142a49f1657bcca10fc24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:02.194809 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-AggregatesAdminTestJSON-545397584 Jun 05 08:24:02.194809 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 604eeee0bf7142a49f1657bcca10fc24 Jun 05 08:24:02.194809 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-545397584 Jun 05 08:24:02.194809 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-AggregatesAdminTestJSON-545397584-project-admin Jun 05 08:24:02.194809 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:24:02.194809 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:24:02.194809 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 923f0f8e33ae4699a38710a85ab1ab5e Jun 05 08:24:02.194809 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-AggregatesAdminTestJSON-545397584-project-admin Jun 05 08:24:02.194809 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:24:02.194809 n-d-844739-1 devstack@n-api.service[119049]: exception: Aggregate 6 could not be found. Jun 05 08:24:02.194809 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '6'} Jun 05 08:24:02.194809 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:02.195753 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:02.195753 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jun 05 08:24:02.195753 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jun 05 08:24:02.195753 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 05 08:24:02.195753 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 05 08:24:02.195753 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:24:02.195753 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:24:02.195753 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:24:02.195753 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:24:02.195753 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 05 08:24:02.195753 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 05 08:24:02.195753 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jun 05 08:24:02.195753 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jun 05 08:24:02.195753 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:24:02.195753 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:24:02.195753 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 05 08:24:02.195753 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 05 08:24:02.195753 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 05 08:24:02.195753 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 05 08:24:02.197045 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 05 08:24:02.197045 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 05 08:24:02.197045 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Jun 05 08:24:02.197045 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:02.197045 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:02.197045 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:02.197045 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:02.197045 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:02.197045 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:02.197045 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:02.197045 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:02.197045 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:02.197045 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:02.197045 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jun 05 08:24:02.197045 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:24:02.197045 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Jun 05 08:24:02.197045 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:02.197045 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:02.197045 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:02.197045 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:02.197045 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:02.200554 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:02.200554 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:24:02.200554 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:24:02.200554 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Jun 05 08:24:02.200554 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:02.200554 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-984db565-a0fa-4ad3-b606-9d6df3a23778 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:02.200554 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-984db565-a0fa-4ad3-b606-9d6df3a23778 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.029283 Jun 05 08:24:02.200554 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 99/212] 10.222.0.33 () {58 vars in 1151 bytes} [Sun Jun 5 08:24:02 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:24:02.204762 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f965f3ef-39e6-4c14-9c30-04c90985fd65 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1485143043", "name": "tempest-test_aggregate-1982447406"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:02.206388 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:02.206388 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:02.207308 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.aggregate [None req-f965f3ef-39e6-4c14-9c30-04c90985fd65 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Generated uuid 527770c2-0e6b-438e-897e-39f7456c17c7 for aggregate {{(pid=119049) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 05 08:24:02.211312 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-53a2aa86-d96c-4b87-b290-24a6e617fa7e tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] HTTP exception thrown: Aggregate 7 already has host n-h2-844739-1. Jun 05 08:24:02.230976 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-53a2aa86-d96c-4b87-b290-24a6e617fa7e tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Request method failure captured: Jun 05 08:24:02.230976 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/os-aggregates/7/action HTTP/1.1 Jun 05 08:24:02.230976 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:24:02.230976 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:24:02.230976 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:24:02.230976 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 39 Jun 05 08:24:02.230976 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:24:02.230976 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:24:02.230976 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:24:02.230976 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:02.230976 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGgIRZ2w5RYMc-xJAJAW0Au2dlUXKz-nyQAmHbUmmgk7S8GMjTamz5c7cQPYC36qdAn3gD5Y1scW4h_CJuLFHq-YVgLlesWCG79ZEh6998Ouiktqxh8Ungx_1AvcIIZp5TYYkRV595HGTi0WikuwtFk_QhG2D06ZrHaZMk_tsl7sDm8 Jun 05 08:24:02.230976 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:24:02.230976 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:24:02.230976 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:24:02.230976 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:24:02.230976 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:24:02.230976 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:24:02.230976 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: c0c2c53930be48d2a79494d8e5fdf4de Jun 05 08:24:02.230976 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1245114998 Jun 05 08:24:02.230976 n-d-844739-1 devstack@n-api.service[119050]: X-Role: admin,reader,member Jun 05 08:24:02.230976 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: admin,reader,member Jun 05 08:24:02.232467 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c0c2c53930be48d2a79494d8e5fdf4de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0c2c53930be48d2a79494d8e5fdf4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c0c2c53930be48d2a79494d8e5fdf4de", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0c2c53930be48d2a79494d8e5fdf4de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:02.232467 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1245114998 Jun 05 08:24:02.232467 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: c0c2c53930be48d2a79494d8e5fdf4de Jun 05 08:24:02.232467 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1245114998 Jun 05 08:24:02.232467 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin Jun 05 08:24:02.232467 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:24:02.232467 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:24:02.232467 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 2e73595af34542108dfc5bfec02cbe79 Jun 05 08:24:02.232467 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin Jun 05 08:24:02.232467 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:24:02.232467 n-d-844739-1 devstack@n-api.service[119050]: {"add_host": {"host": "n-h2-844739-1"}} Jun 05 08:24:02.232467 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:24:02.232467 n-d-844739-1 devstack@n-api.service[119050]: exception: Aggregate 7 already has host n-h2-844739-1. Jun 05 08:24:02.233334 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '7', 'body': {'add_host': {'host': 'n-h2-844739-1'}}} Jun 05 08:24:02.233334 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:02.233334 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:02.233334 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 05 08:24:02.233334 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 05 08:24:02.233334 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 05 08:24:02.233334 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 05 08:24:02.233334 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 05 08:24:02.233334 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 05 08:24:02.233334 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 05 08:24:02.233334 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 05 08:24:02.233334 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 05 08:24:02.233334 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 05 08:24:02.233334 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 05 08:24:02.233334 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result.read() Jun 05 08:24:02.233334 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 05 08:24:02.233334 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 05 08:24:02.233334 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 05 08:24:02.233334 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 05 08:24:02.234590 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 05 08:24:02.234590 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 05 08:24:02.234590 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 05 08:24:02.234590 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 05 08:24:02.234590 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-844739-1-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jun 05 08:24:02.234590 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:02.234590 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jun 05 08:24:02.234590 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:02.234590 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:02.234590 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jun 05 08:24:02.234590 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jun 05 08:24:02.234590 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jun 05 08:24:02.234590 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi session.flush() Jun 05 08:24:02.234590 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 05 08:24:02.234590 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._flush(objects) Jun 05 08:24:02.234590 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 05 08:24:02.234590 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jun 05 08:24:02.234590 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 05 08:24:02.234590 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi compat.raise_( Jun 05 08:24:02.236731 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 05 08:24:02.236731 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception Jun 05 08:24:02.236731 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 05 08:24:02.236731 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi flush_context.execute() Jun 05 08:24:02.236731 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 05 08:24:02.236731 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi rec.execute(self) Jun 05 08:24:02.236731 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 05 08:24:02.236731 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jun 05 08:24:02.236731 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 05 08:24:02.236731 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jun 05 08:24:02.236731 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 05 08:24:02.236731 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jun 05 08:24:02.236731 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 05 08:24:02.236731 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jun 05 08:24:02.236731 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 05 08:24:02.236731 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jun 05 08:24:02.236731 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 05 08:24:02.236731 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jun 05 08:24:02.237911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 05 08:24:02.237911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jun 05 08:24:02.237911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 05 08:24:02.237911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 05 08:24:02.237911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 05 08:24:02.237911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception Jun 05 08:24:02.237911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 05 08:24:02.237911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 05 08:24:02.237911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 05 08:24:02.237911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 05 08:24:02.237911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 05 08:24:02.237911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 05 08:24:02.237911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 05 08:24:02.237911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 05 08:24:02.237911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 05 08:24:02.237911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 05 08:24:02.237911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 05 08:24:02.237911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result.read() Jun 05 08:24:02.239707 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 05 08:24:02.239707 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 05 08:24:02.239707 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 05 08:24:02.239707 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 05 08:24:02.239707 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 05 08:24:02.239707 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 05 08:24:02.239707 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 05 08:24:02.239707 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 05 08:24:02.239707 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-844739-1-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jun 05 08:24:02.239707 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jun 05 08:24:02.239707 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 6, 5, 8, 24, 2, 199589), 'updated_at': None, 'host': 'n-h2-844739-1', 'aggregate_id': 7}] Jun 05 08:24:02.239707 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 05 08:24:02.239707 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:02.239707 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:02.239707 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:02.239707 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:02.239707 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jun 05 08:24:02.240871 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jun 05 08:24:02.240871 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 05 08:24:02.240871 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 05 08:24:02.240871 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:24:02.240871 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:24:02.240871 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:24:02.240871 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:24:02.240871 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 05 08:24:02.240871 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 05 08:24:02.240871 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jun 05 08:24:02.240871 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jun 05 08:24:02.240871 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 05 08:24:02.240871 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 05 08:24:02.240871 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jun 05 08:24:02.240871 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jun 05 08:24:02.240871 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jun 05 08:24:02.240871 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jun 05 08:24:02.240871 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 7 already has host n-h2-844739-1. Jun 05 08:24:02.240871 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:02.240871 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:02.242031 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:02.242031 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:02.242031 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:02.242031 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:02.242031 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:02.242031 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:02.242031 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:02.242031 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:02.242031 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:24:02.242031 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:24:02.242031 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jun 05 08:24:02.242031 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jun 05 08:24:02.242031 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 7 already has host n-h2-844739-1. Jun 05 08:24:02.242031 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:02.242031 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:02.242031 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:02.242031 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:02.242031 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:02.242031 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:02.242031 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:24:02.242031 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:24:02.244629 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 already has host n-h2-844739-1. Jun 05 08:24:02.244629 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:02.244629 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-53a2aa86-d96c-4b87-b290-24a6e617fa7e tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Returning 409 to user: Aggregate 7 already has host n-h2-844739-1. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:02.244629 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-53a2aa86-d96c-4b87-b290-24a6e617fa7e tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/7/action" status: 409 len: 95 microversion: 2.1 time: 0.078844 Jun 05 08:24:02.244629 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 114/213] 10.222.0.33 () {60 vars in 1190 bytes} [Sun Jun 5 08:24:02 2022] POST /compute/v2.1/os-aggregates/7/action => generated 95 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 377 bytes (2 switches on core 0) Jun 05 08:24:02.245030 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f965f3ef-39e6-4c14-9c30-04c90985fd65 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.042253 Jun 05 08:24:02.249280 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 100/214] 10.222.0.33 () {60 vars in 1164 bytes} [Sun Jun 5 08:24:02 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:02.254478 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8c94f28e-c066-4f79-b036-2339afc78300 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:02.255303 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:02.255303 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:02.260510 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1e8fb8f3-fe99-43a4-bf9b-526b307e1acf tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-844739-1"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:02.277457 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:02.277457 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:02.292989 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1e8fb8f3-fe99-43a4-bf9b-526b307e1acf tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:02.294275 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8c94f28e-c066-4f79-b036-2339afc78300 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.043848 Jun 05 08:24:02.294399 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1e8fb8f3-fe99-43a4-bf9b-526b307e1acf tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:02.298281 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 101/215] 10.222.0.33 () {58 vars in 1151 bytes} [Sun Jun 5 08:24:02 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 05 08:24:02.309845 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8f0e20be-9472-4f92-8b89-03180f59d023 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:02.310657 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:02.310657 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:02.327862 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-8f0e20be-9472-4f92-8b89-03180f59d023 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Jun 05 08:24:02.329849 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8f0e20be-9472-4f92-8b89-03180f59d023 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Request method failure captured: Jun 05 08:24:02.329849 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Jun 05 08:24:02.329849 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:24:02.329849 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:24:02.329849 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:24:02.329849 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:24:02.329849 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:24:02.329849 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:24:02.329849 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:24:02.329849 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:02.329849 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGfzlQY18sDn8F7PRmqjaSuGUFnBl3K8WdYf3MhoKqYV9odkBn4yGogA81NnzJd5o7WMxW8BLTnSmhZ5blagYnNiKewChAHYxxMoW0L5GeuF4SdQvN1M7nVGoaNQnLFVZjfHGBCcA5fGNEkgX-a0Tw3VDBJd5vjTvZ8v0FIk51XHvR0 Jun 05 08:24:02.329849 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:24:02.329849 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:24:02.329849 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:24:02.329849 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:24:02.329849 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:24:02.329849 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:24:02.329849 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 604eeee0bf7142a49f1657bcca10fc24 Jun 05 08:24:02.329849 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-AggregatesAdminTestJSON-545397584 Jun 05 08:24:02.329849 n-d-844739-1 devstack@n-api.service[119049]: X-Role: admin,reader,member Jun 05 08:24:02.329849 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: admin,reader,member Jun 05 08:24:02.331116 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/604eeee0bf7142a49f1657bcca10fc24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/604eeee0bf7142a49f1657bcca10fc24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_604eeee0bf7142a49f1657bcca10fc24", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/604eeee0bf7142a49f1657bcca10fc24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:02.331116 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-AggregatesAdminTestJSON-545397584 Jun 05 08:24:02.331116 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 604eeee0bf7142a49f1657bcca10fc24 Jun 05 08:24:02.331116 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-545397584 Jun 05 08:24:02.331116 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-AggregatesAdminTestJSON-545397584-project-admin Jun 05 08:24:02.331116 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:24:02.331116 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:24:02.331116 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 923f0f8e33ae4699a38710a85ab1ab5e Jun 05 08:24:02.331116 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-AggregatesAdminTestJSON-545397584-project-admin Jun 05 08:24:02.331116 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:24:02.331116 n-d-844739-1 devstack@n-api.service[119049]: exception: Aggregate 8 could not be found. Jun 05 08:24:02.331116 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '8'} Jun 05 08:24:02.331116 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:02.331917 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:02.331917 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jun 05 08:24:02.331917 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jun 05 08:24:02.331917 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jun 05 08:24:02.331917 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jun 05 08:24:02.331917 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:24:02.331917 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:24:02.331917 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 05 08:24:02.331917 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 05 08:24:02.331917 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 05 08:24:02.331917 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 05 08:24:02.331917 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 05 08:24:02.331917 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 05 08:24:02.331917 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Jun 05 08:24:02.331917 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:02.331917 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:02.331917 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:02.331917 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:02.331917 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:02.333887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:02.333887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:02.333887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:02.333887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:02.333887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:02.333887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jun 05 08:24:02.333887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:24:02.333887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Jun 05 08:24:02.333887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:02.333887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:02.333887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:02.333887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:02.333887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:02.333887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:02.333887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:24:02.333887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:24:02.333887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Jun 05 08:24:02.333887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:02.333887 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8f0e20be-9472-4f92-8b89-03180f59d023 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:02.335068 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8f0e20be-9472-4f92-8b89-03180f59d023 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.031863 Jun 05 08:24:02.340990 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 102/216] 10.222.0.33 () {58 vars in 1148 bytes} [Sun Jun 5 08:24:02 2022] GET /compute/v2.1/os-aggregates/8 => generated 77 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:24:02.350925 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-76386150-a7c1-483a-ad86-213e465fedfd tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:02.353038 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:02.353038 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:02.388350 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-76386150-a7c1-483a-ad86-213e465fedfd tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Jun 05 08:24:02.390020 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-76386150-a7c1-483a-ad86-213e465fedfd tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Request method failure captured: Jun 05 08:24:02.390020 n-d-844739-1 devstack@n-api.service[119049]: request: DELETE /compute/v2.1/os-aggregates/8 HTTP/1.1 Jun 05 08:24:02.390020 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:24:02.390020 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:24:02.390020 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:24:02.390020 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:24:02.390020 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:24:02.390020 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:24:02.390020 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:24:02.390020 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:02.390020 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGfzlQY18sDn8F7PRmqjaSuGUFnBl3K8WdYf3MhoKqYV9odkBn4yGogA81NnzJd5o7WMxW8BLTnSmhZ5blagYnNiKewChAHYxxMoW0L5GeuF4SdQvN1M7nVGoaNQnLFVZjfHGBCcA5fGNEkgX-a0Tw3VDBJd5vjTvZ8v0FIk51XHvR0 Jun 05 08:24:02.390020 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:24:02.390020 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:24:02.390020 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:24:02.390020 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:24:02.390020 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:24:02.390020 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:24:02.390020 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 604eeee0bf7142a49f1657bcca10fc24 Jun 05 08:24:02.390020 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-AggregatesAdminTestJSON-545397584 Jun 05 08:24:02.390020 n-d-844739-1 devstack@n-api.service[119049]: X-Role: admin,reader,member Jun 05 08:24:02.390020 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: admin,reader,member Jun 05 08:24:02.391415 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/604eeee0bf7142a49f1657bcca10fc24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/604eeee0bf7142a49f1657bcca10fc24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_604eeee0bf7142a49f1657bcca10fc24", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/604eeee0bf7142a49f1657bcca10fc24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:02.391415 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-AggregatesAdminTestJSON-545397584 Jun 05 08:24:02.391415 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 604eeee0bf7142a49f1657bcca10fc24 Jun 05 08:24:02.391415 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-545397584 Jun 05 08:24:02.391415 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-AggregatesAdminTestJSON-545397584-project-admin Jun 05 08:24:02.391415 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:24:02.391415 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:24:02.391415 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 923f0f8e33ae4699a38710a85ab1ab5e Jun 05 08:24:02.391415 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-AggregatesAdminTestJSON-545397584-project-admin Jun 05 08:24:02.391415 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:24:02.391415 n-d-844739-1 devstack@n-api.service[119049]: exception: Aggregate 8 could not be found. Jun 05 08:24:02.391415 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '8'} Jun 05 08:24:02.391415 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:02.393974 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:02.393974 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jun 05 08:24:02.393974 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jun 05 08:24:02.393974 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 05 08:24:02.393974 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 05 08:24:02.393974 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:24:02.393974 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:24:02.393974 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:24:02.393974 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:24:02.393974 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 05 08:24:02.393974 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 05 08:24:02.393974 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jun 05 08:24:02.393974 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jun 05 08:24:02.393974 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:24:02.393974 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:24:02.393974 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 05 08:24:02.393974 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 05 08:24:02.393974 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 05 08:24:02.393974 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 05 08:24:02.394942 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 05 08:24:02.394942 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 05 08:24:02.394942 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Jun 05 08:24:02.394942 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:02.394942 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:02.394942 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:02.394942 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:02.394942 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:02.394942 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:02.394942 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:02.394942 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:02.394942 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:02.394942 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:02.394942 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jun 05 08:24:02.394942 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:24:02.394942 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Jun 05 08:24:02.394942 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:02.394942 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:02.394942 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:02.394942 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:02.394942 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:02.396639 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:02.396639 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:24:02.396639 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:24:02.396639 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Jun 05 08:24:02.396639 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:02.396639 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-76386150-a7c1-483a-ad86-213e465fedfd tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:02.396639 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-76386150-a7c1-483a-ad86-213e465fedfd tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.049237 Jun 05 08:24:02.399098 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 103/217] 10.222.0.33 () {58 vars in 1151 bytes} [Sun Jun 5 08:24:02 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 77 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:24:02.406192 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-daf4cc19-c05c-4004-a0b7-e7b0eee3e926 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:02.406813 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-daf4cc19-c05c-4004-a0b7-e7b0eee3e926 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: e4c09fb3-f67f-4b07-a992-2e70683932bd] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:02.428967 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-daf4cc19-c05c-4004-a0b7-e7b0eee3e926 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:02.429847 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-daf4cc19-c05c-4004-a0b7-e7b0eee3e926 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:02.430813 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-daf4cc19-c05c-4004-a0b7-e7b0eee3e926 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:02.431287 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-daf4cc19-c05c-4004-a0b7-e7b0eee3e926 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:02.457796 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=100 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:02.464621 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1e8fb8f3-fe99-43a4-bf9b-526b307e1acf tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 226 microversion: 2.1 time: 0.212885 Jun 05 08:24:02.466033 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 115/218] 10.222.0.33 () {60 vars in 1190 bytes} [Sun Jun 5 08:24:02 2022] POST /compute/v2.1/os-aggregates/7/action => generated 226 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:02.472167 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-41d37aa2-9830-4910-b457-9c994f694cdc tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-623172133"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:02.477497 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:02.477497 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:02.480779 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.aggregate [None req-41d37aa2-9830-4910-b457-9c994f694cdc tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Generated uuid db69f4d2-eb93-4afd-87a7-0627246bd164 for aggregate {{(pid=119050) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 05 08:24:02.514596 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-41d37aa2-9830-4910-b457-9c994f694cdc tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.047211 Jun 05 08:24:02.516433 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 116/219] 10.222.0.33 () {60 vars in 1163 bytes} [Sun Jun 5 08:24:02 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:02.521582 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-088aded1-a45f-4eff-ad4e-947c8cd5ce10 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:02.522543 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:02.522543 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:02.555564 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-088aded1-a45f-4eff-ad4e-947c8cd5ce10 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.037833 Jun 05 08:24:02.556438 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 117/220] 10.222.0.33 () {58 vars in 1151 bytes} [Sun Jun 5 08:24:02 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 05 08:24:02.605057 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-daf4cc19-c05c-4004-a0b7-e7b0eee3e926 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:02.612392 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-daf4cc19-c05c-4004-a0b7-e7b0eee3e926 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd" status: 200 len: 1390 microversion: 2.1 time: 0.212030 Jun 05 08:24:02.613128 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 104/221] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:02 2022] GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd => generated 1390 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:02.618327 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1048c040-6384-4f89-9c73-c5db3b61df72 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:02.619100 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:02.619100 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:02.626324 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1048c040-6384-4f89-9c73-c5db3b61df72 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 226 microversion: 2.1 time: 0.012076 Jun 05 08:24:02.626874 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 105/222] 10.222.0.33 () {58 vars in 1148 bytes} [Sun Jun 5 08:24:02 2022] GET /compute/v2.1/os-aggregates/9 => generated 226 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:02.631088 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4d3fbee0-6c13-46ae-94d4-9c78ff72fea9 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1297679198"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:02.632405 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:02.632405 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:02.633281 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.aggregate [None req-4d3fbee0-6c13-46ae-94d4-9c78ff72fea9 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Generated uuid 9bff8892-d862-4316-9fe3-b7072ec81db7 for aggregate {{(pid=119049) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 05 08:24:02.660971 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4d3fbee0-6c13-46ae-94d4-9c78ff72fea9 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.033065 Jun 05 08:24:02.662148 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 106/223] 10.222.0.33 () {60 vars in 1163 bytes} [Sun Jun 5 08:24:02 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:02.667475 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-02100173-f4c8-472c-acfb-bee711f771e2 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:02.668115 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-02100173-f4c8-472c-acfb-bee711f771e2 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:02.671238 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=10,nova_api:INSERT=5 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:02.676437 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-02100173-f4c8-472c-acfb-bee711f771e2 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:02.677560 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-02100173-f4c8-472c-acfb-bee711f771e2 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:02.678459 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-02100173-f4c8-472c-acfb-bee711f771e2 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:02.679064 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-02100173-f4c8-472c-acfb-bee711f771e2 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:02.701239 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e421f359-22d6-4b85-9468-ced75e89a67d tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Action: 'create', calling method: .version_select at 0x7f2433f731f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-602965899", "description": "tempest-description-547311884"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:02.862952 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-02100173-f4c8-472c-acfb-bee711f771e2 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:02.871168 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-02100173-f4c8-472c-acfb-bee711f771e2 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 200 len: 1469 microversion: 2.1 time: 0.207873 Jun 05 08:24:02.871754 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 107/224] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:02 2022] GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 1469 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:02.876174 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-889ed714-8f9c-4a35-a2e9-99b6ac0d13af tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:02.877609 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:02.877609 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:02.898829 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-889ed714-8f9c-4a35-a2e9-99b6ac0d13af tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 264 microversion: 2.1 time: 0.026021 Jun 05 08:24:02.905319 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 108/225] 10.222.0.33 () {60 vars in 1190 bytes} [Sun Jun 5 08:24:02 2022] POST /compute/v2.1/os-aggregates/9/action => generated 264 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:02.910218 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e54edc1b-bb08-4446-8e54-b77aa9cf58b2 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Calling method '.version_select at 0x7f2440265f70>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:02.912262 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:02.912262 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:02.913683 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e54edc1b-bb08-4446-8e54-b77aa9cf58b2 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:02.914142 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e54edc1b-bb08-4446-8e54-b77aa9cf58b2 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:02.915078 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e54edc1b-bb08-4446-8e54-b77aa9cf58b2 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:02.915644 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e54edc1b-bb08-4446-8e54-b77aa9cf58b2 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:02.923237 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e421f359-22d6-4b85-9468-ced75e89a67d tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.365149 Jun 05 08:24:02.931614 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 118/226] 10.222.0.33 () {60 vars in 1179 bytes} [Sun Jun 5 08:24:02 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:02.942324 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e54edc1b-bb08-4446-8e54-b77aa9cf58b2 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.035875 Jun 05 08:24:02.943205 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 109/227] 10.222.0.33 () {58 vars in 1127 bytes} [Sun Jun 5 08:24:02 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:02.947889 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8aea8db2-166b-4c4a-bcce-d625216dc178 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:02.948533 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8aea8db2-166b-4c4a-bcce-d625216dc178 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:02.954423 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8aea8db2-166b-4c4a-bcce-d625216dc178 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:02.954879 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8aea8db2-166b-4c4a-bcce-d625216dc178 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:02.955681 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8aea8db2-166b-4c4a-bcce-d625216dc178 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:02.956143 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8aea8db2-166b-4c4a-bcce-d625216dc178 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:03.048306 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8b44d9be-4d7f-4fbc-8d53-36d5eab416ff tempest-AggregatesAdminNegativeTestJSON-1071987933 tempest-AggregatesAdminNegativeTestJSON-1071987933-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-844739-1"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:03.049596 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:03.049596 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:03.050434 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8b44d9be-4d7f-4fbc-8d53-36d5eab416ff tempest-AggregatesAdminNegativeTestJSON-1071987933 tempest-AggregatesAdminNegativeTestJSON-1071987933-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '5fad2defefb448dcbeae5ec878ea0db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74b51bf5aba419d84454fcfcd110610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:03.052538 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8b44d9be-4d7f-4fbc-8d53-36d5eab416ff tempest-AggregatesAdminNegativeTestJSON-1071987933 tempest-AggregatesAdminNegativeTestJSON-1071987933-project] Request method failure captured: Jun 05 08:24:03.052538 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Jun 05 08:24:03.052538 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:24:03.052538 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:24:03.052538 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:24:03.052538 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 39 Jun 05 08:24:03.052538 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:24:03.052538 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:24:03.052538 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:24:03.052538 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:03.052538 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGgFR7BRz94qVsrpu1OMzvz2l0k3w2zx_iPvpQDeGo06IjKT0SxUxbEJ7uhtVACyiKwc1jM_XbPjbv0RhhgQWj5Q4mr-aSETbgVoeSd_tafYTkUF9w01OFcmHqbg5Z9GfZR7F_-zYx5gGtvQAzIlZOsi4FGoWT5OcHitbEOkn_urLcA Jun 05 08:24:03.052538 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:24:03.052538 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:24:03.052538 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:24:03.052538 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:24:03.052538 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:24:03.052538 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:24:03.052538 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: b74b51bf5aba419d84454fcfcd110610 Jun 05 08:24:03.052538 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1071987933 Jun 05 08:24:03.052538 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:24:03.052538 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:24:03.053934 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b74b51bf5aba419d84454fcfcd110610"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b74b51bf5aba419d84454fcfcd110610"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b74b51bf5aba419d84454fcfcd110610", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b74b51bf5aba419d84454fcfcd110610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:03.053934 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1071987933 Jun 05 08:24:03.053934 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: b74b51bf5aba419d84454fcfcd110610 Jun 05 08:24:03.053934 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1071987933 Jun 05 08:24:03.053934 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-AggregatesAdminNegativeTestJSON-1071987933-project Jun 05 08:24:03.053934 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:24:03.053934 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:24:03.053934 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 5fad2defefb448dcbeae5ec878ea0db3 Jun 05 08:24:03.053934 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1071987933-project Jun 05 08:24:03.053934 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:24:03.053934 n-d-844739-1 devstack@n-api.service[119050]: {"add_host": {"host": "n-h2-844739-1"}} Jun 05 08:24:03.053934 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:24:03.053934 n-d-844739-1 devstack@n-api.service[119050]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jun 05 08:24:03.056004 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '10', 'body': {'add_host': {'host': 'n-h2-844739-1'}}} Jun 05 08:24:03.056004 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:03.056004 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:03.056004 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:03.056004 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:03.056004 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:03.056004 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:03.056004 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:03.056004 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:03.056004 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:24:03.056004 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:24:03.056004 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jun 05 08:24:03.056004 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jun 05 08:24:03.056004 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:24:03.056004 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:24:03.056004 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:24:03.056004 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:24:03.056004 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:24:03.056004 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:24:03.057748 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:24:03.057748 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:24:03.057748 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:24:03.057748 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:24:03.057748 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:24:03.057748 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:24:03.057748 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:24:03.057748 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:24:03.057748 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jun 05 08:24:03.057748 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:03.057748 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:03.057748 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:03.057748 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:03.057748 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:03.057748 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:03.057748 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:24:03.057748 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:24:03.057748 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jun 05 08:24:03.057748 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:03.059036 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8b44d9be-4d7f-4fbc-8d53-36d5eab416ff tempest-AggregatesAdminNegativeTestJSON-1071987933 tempest-AggregatesAdminNegativeTestJSON-1071987933-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:03.059036 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8b44d9be-4d7f-4fbc-8d53-36d5eab416ff tempest-AggregatesAdminNegativeTestJSON-1071987933 tempest-AggregatesAdminNegativeTestJSON-1071987933-project] 10.222.0.33 "POST /compute/v2.1/os-aggregates/10/action" status: 403 len: 118 microversion: 2.1 time: 0.128298 Jun 05 08:24:03.059036 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 119/228] 10.222.0.33 () {60 vars in 1193 bytes} [Sun Jun 5 08:24:02 2022] POST /compute/v2.1/os-aggregates/10/action => generated 118 bytes in 130 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:24:03.109129 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8aea8db2-166b-4c4a-bcce-d625216dc178 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:03.117053 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8aea8db2-166b-4c4a-bcce-d625216dc178 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1310 microversion: 2.1 time: 0.172794 Jun 05 08:24:03.117629 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 110/229] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:02 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1310 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:03.121944 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6506227b-c0ef-47fb-b16c-f478ad731b2d tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:03.122710 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:03.122710 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:03.129284 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6506227b-c0ef-47fb-b16c-f478ad731b2d tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 240 microversion: 2.1 time: 0.010707 Jun 05 08:24:03.129816 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 111/230] 10.222.0.33 () {58 vars in 1148 bytes} [Sun Jun 5 08:24:03 2022] GET /compute/v2.1/os-aggregates/9 => generated 240 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:03.139806 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-47c0475e-831d-41be-b81c-bf9b43fce17a tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Action: 'create', calling method: .version_select at 0x7f244007c5e0>, body: {"security_group_rule": {"parent_group_id": "9158b01c-a0cd-46c6-9eca-a42c4f5e6d93", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:03.188583 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-22657180-725c-4f2c-b357-9bf16707ab47 tempest-DeleteServersAdminTestJSON-27414384 tempest-DeleteServersAdminTestJSON-27414384-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:03.189153 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-22657180-725c-4f2c-b357-9bf16707ab47 tempest-DeleteServersAdminTestJSON-27414384 tempest-DeleteServersAdminTestJSON-27414384-project-admin] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:03.197020 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-22657180-725c-4f2c-b357-9bf16707ab47 tempest-DeleteServersAdminTestJSON-27414384 tempest-DeleteServersAdminTestJSON-27414384-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:03.197666 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-22657180-725c-4f2c-b357-9bf16707ab47 tempest-DeleteServersAdminTestJSON-27414384 tempest-DeleteServersAdminTestJSON-27414384-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:03.198578 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-22657180-725c-4f2c-b357-9bf16707ab47 tempest-DeleteServersAdminTestJSON-27414384 tempest-DeleteServersAdminTestJSON-27414384-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:03.199033 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-22657180-725c-4f2c-b357-9bf16707ab47 tempest-DeleteServersAdminTestJSON-27414384 tempest-DeleteServersAdminTestJSON-27414384-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:03.226352 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-22657180-725c-4f2c-b357-9bf16707ab47 tempest-DeleteServersAdminTestJSON-27414384 tempest-DeleteServersAdminTestJSON-27414384-project-admin] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:24:03.336909 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-47c0475e-831d-41be-b81c-bf9b43fce17a tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.200495 Jun 05 08:24:03.337935 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 112/231] 10.222.0.33 () {60 vars in 1194 bytes} [Sun Jun 5 08:24:03 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:03.344421 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-22657180-725c-4f2c-b357-9bf16707ab47 tempest-DeleteServersAdminTestJSON-27414384 tempest-DeleteServersAdminTestJSON-27414384-project-admin] 10.222.0.33 "DELETE /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 204 len: 0 microversion: 2.1 time: 0.287665 Jun 05 08:24:03.347953 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 120/232] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:24:03 2022] DELETE /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:24:03.350919 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-76aa54bd-1761-4dee-864d-fbb0a9502dbf req-ac04d2c6-374b-4127-b5df-42e689909c6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c09fb3-f67f-4b07-a992-2e70683932bd", "name": "network-vif-plugged", "status": "completed", "tag": "0d4a6d59-7631-4ce9-ba50-a33984101036"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:03.351488 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0fc8635f-98d4-41c4-939a-8bd5d0217d06 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Calling method '.version_select at 0x7f244007c940>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:03.352823 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:03.352823 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:03.353993 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0fc8635f-98d4-41c4-939a-8bd5d0217d06 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:03.354619 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0fc8635f-98d4-41c4-939a-8bd5d0217d06 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:03.355458 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0fc8635f-98d4-41c4-939a-8bd5d0217d06 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:03.355877 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0fc8635f-98d4-41c4-939a-8bd5d0217d06 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:03.359073 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-76aa54bd-1761-4dee-864d-fbb0a9502dbf req-ac04d2c6-374b-4127-b5df-42e689909c6e service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:03.359521 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-76aa54bd-1761-4dee-864d-fbb0a9502dbf req-ac04d2c6-374b-4127-b5df-42e689909c6e service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:03.371690 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-76aa54bd-1761-4dee-864d-fbb0a9502dbf req-ac04d2c6-374b-4127-b5df-42e689909c6e service nova] Creating event network-vif-plugged:0d4a6d59-7631-4ce9-ba50-a33984101036 for instance e4c09fb3-f67f-4b07-a992-2e70683932bd on n-h1-844739-1 Jun 05 08:24:03.376659 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-76aa54bd-1761-4dee-864d-fbb0a9502dbf req-ac04d2c6-374b-4127-b5df-42e689909c6e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029928 Jun 05 08:24:03.377258 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 121/233] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:03.381689 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0fc8635f-98d4-41c4-939a-8bd5d0217d06 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.036484 Jun 05 08:24:03.382322 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 113/234] 10.222.0.33 () {58 vars in 1154 bytes} [Sun Jun 5 08:24:03 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:03.382529 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f9dde04f-1bf2-431e-b859-93997c878538 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:03.383391 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:03.383391 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:03.388071 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5e0dfa88-6975-4109-a9fb-94d66ad80112 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:03.388848 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:03.388848 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:03.404662 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f9dde04f-1bf2-431e-b859-93997c878538 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.025886 Jun 05 08:24:03.405286 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 122/235] 10.222.0.33 () {58 vars in 1154 bytes} [Sun Jun 5 08:24:03 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 05 08:24:03.410325 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9b8922c4-97de-4e66-9f00-4271b8bde82d tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:03.411068 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9b8922c4-97de-4e66-9f00-4271b8bde82d tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 121df5fc-10cc-4f27-bbe8-878791f857a2] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:03.417245 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5e0dfa88-6975-4109-a9fb-94d66ad80112 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.033889 Jun 05 08:24:03.417830 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 114/236] 10.222.0.33 () {58 vars in 1151 bytes} [Sun Jun 5 08:24:03 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 05 08:24:03.421826 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9b8922c4-97de-4e66-9f00-4271b8bde82d tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:03.421826 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9b8922c4-97de-4e66-9f00-4271b8bde82d tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:03.421826 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9b8922c4-97de-4e66-9f00-4271b8bde82d tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:03.421826 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9b8922c4-97de-4e66-9f00-4271b8bde82d tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:03.423463 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1c68039b-f0d7-4684-a29f-797f8bebf7bf tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Action: 'create', calling method: .version_select at 0x7f244007c8b0>, body: {"security_group_rule": {"parent_group_id": "9158b01c-a0cd-46c6-9eca-a42c4f5e6d93", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:03.505856 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-1c68039b-f0d7-4684-a29f-797f8bebf7bf tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] HTTP exception thrown: This rule already exists in group 9158b01c-a0cd-46c6-9eca-a42c4f5e6d93 Jun 05 08:24:03.508242 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1c68039b-f0d7-4684-a29f-797f8bebf7bf tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Request method failure captured: Jun 05 08:24:03.508242 n-d-844739-1 devstack@n-api.service[119049]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 05 08:24:03.508242 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:24:03.508242 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:24:03.508242 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:24:03.508242 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 138 Jun 05 08:24:03.508242 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:24:03.508242 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:24:03.508242 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:24:03.508242 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:03.508242 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGgi_mobQeYIY4rKAF6MX2eJMDlGP5Psyfjisk28tLi8plE4pnuHyHhk0q073DIfg8oFdALDNR5n_olGUg6FlT5Rnfz23Qix4BApGaNx2cHjtveAdgRQqvUcYm5X9bDyj5kgPWR9mgKWJavmqp4MfBjQeRSfn8IltY7XC8hmilpH-YI Jun 05 08:24:03.508242 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:24:03.508242 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:24:03.508242 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:24:03.508242 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:24:03.508242 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:24:03.508242 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:24:03.508242 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: ba602ab823574300b56acf7afebe6c58 Jun 05 08:24:03.508242 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-689221279 Jun 05 08:24:03.508242 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:24:03.508242 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:24:03.509481 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba602ab823574300b56acf7afebe6c58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba602ab823574300b56acf7afebe6c58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba602ab823574300b56acf7afebe6c58", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba602ab823574300b56acf7afebe6c58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:03.509481 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-689221279 Jun 05 08:24:03.509481 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: ba602ab823574300b56acf7afebe6c58 Jun 05 08:24:03.509481 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-689221279 Jun 05 08:24:03.509481 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-689221279-project Jun 05 08:24:03.509481 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:24:03.509481 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:24:03.509481 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 3b829fe307174f20baee36fa542de6ef Jun 05 08:24:03.509481 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-689221279-project Jun 05 08:24:03.509481 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:24:03.509481 n-d-844739-1 devstack@n-api.service[119049]: {"security_group_rule": {"parent_group_id": "9158b01c-a0cd-46c6-9eca-a42c4f5e6d93", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jun 05 08:24:03.509481 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:24:03.510273 n-d-844739-1 devstack@n-api.service[119049]: exception: This rule already exists in group 9158b01c-a0cd-46c6-9eca-a42c4f5e6d93 Jun 05 08:24:03.510273 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'body': {'security_group_rule': {'parent_group_id': '9158b01c-a0cd-46c6-9eca-a42c4f5e6d93', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jun 05 08:24:03.510273 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:03.510273 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:03.510273 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jun 05 08:24:03.510273 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jun 05 08:24:03.510273 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jun 05 08:24:03.510273 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jun 05 08:24:03.510273 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 9158b01c-a0cd-46c6-9eca-a42c4f5e6d93 Jun 05 08:24:03.510273 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:03.510273 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:03.510273 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:03.510273 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:03.510273 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:03.510273 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:03.510273 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:03.510273 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:03.510273 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:24:03.510273 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:24:03.510273 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:03.511583 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:03.511583 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jun 05 08:24:03.511583 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 05 08:24:03.511583 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 9158b01c-a0cd-46c6-9eca-a42c4f5e6d93 Jun 05 08:24:03.511583 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:03.511583 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:03.511583 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:03.511583 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:03.511583 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:03.511583 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:03.511583 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:24:03.511583 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:24:03.511583 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 9158b01c-a0cd-46c6-9eca-a42c4f5e6d93 Jun 05 08:24:03.511583 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:03.511583 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1c68039b-f0d7-4684-a29f-797f8bebf7bf tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Returning 400 to user: This rule already exists in group 9158b01c-a0cd-46c6-9eca-a42c4f5e6d93 {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:03.512619 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1c68039b-f0d7-4684-a29f-797f8bebf7bf tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.090767 Jun 05 08:24:03.512619 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 115/237] 10.222.0.33 () {60 vars in 1194 bytes} [Sun Jun 5 08:24:03 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 05 08:24:03.516754 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6bea69dc-fcc9-478d-8522-5d427f3d018a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:03.517489 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6bea69dc-fcc9-478d-8522-5d427f3d018a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:03.524527 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6bea69dc-fcc9-478d-8522-5d427f3d018a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:03.524978 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6bea69dc-fcc9-478d-8522-5d427f3d018a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:03.525738 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6bea69dc-fcc9-478d-8522-5d427f3d018a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:03.526171 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6bea69dc-fcc9-478d-8522-5d427f3d018a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:03.583171 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-9b8922c4-97de-4e66-9f00-4271b8bde82d tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:03.590863 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9b8922c4-97de-4e66-9f00-4271b8bde82d tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2" status: 200 len: 1468 microversion: 2.1 time: 0.184409 Jun 05 08:24:03.591521 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 123/238] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:03 2022] GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2 => generated 1468 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:03.603661 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c944589c-7433-4099-8302-1661e870af11 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Calling method '.version_select at 0x7f2440231c10>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:03.603661 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:03.603661 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:03.603661 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c944589c-7433-4099-8302-1661e870af11 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:03.603661 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c944589c-7433-4099-8302-1661e870af11 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:03.604088 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c944589c-7433-4099-8302-1661e870af11 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:03.604088 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c944589c-7433-4099-8302-1661e870af11 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:03.624138 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c944589c-7433-4099-8302-1661e870af11 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.031404 Jun 05 08:24:03.624746 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 124/239] 10.222.0.33 () {58 vars in 1127 bytes} [Sun Jun 5 08:24:03 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:03.629334 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-51acce81-58d9-4bba-8ba3-33b3ea61b4e6 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1625243250"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:03.631156 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:03.631156 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:03.632024 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.aggregate [None req-51acce81-58d9-4bba-8ba3-33b3ea61b4e6 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Generated uuid 589c1d26-07ec-4781-b351-c069d3c04832 for aggregate {{(pid=119050) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 05 08:24:03.651652 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-51acce81-58d9-4bba-8ba3-33b3ea61b4e6 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.025607 Jun 05 08:24:03.658952 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 125/240] 10.222.0.33 () {60 vars in 1163 bytes} [Sun Jun 5 08:24:03 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:03.662180 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6cb2dc6e-63ec-4d71-9bd7-3aed08f6bb48 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-571247870", "availability_zone": "tempest-test_az-149552972"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:03.680817 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6bea69dc-fcc9-478d-8522-5d427f3d018a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:03.681559 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:03.681559 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:03.682612 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.aggregate [None req-6cb2dc6e-63ec-4d71-9bd7-3aed08f6bb48 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Generated uuid a873b925-d356-4e6d-ba14-d704ae12259b for aggregate {{(pid=119050) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 05 08:24:03.689806 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6bea69dc-fcc9-478d-8522-5d427f3d018a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 200 len: 1475 microversion: 2.1 time: 0.178265 Jun 05 08:24:03.690401 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 116/241] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:03 2022] GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 1475 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:03.699952 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0c4c95ac-9003-4ba4-b34e-fc6e1ec0cdf1 tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Calling method '.version_select at 0x7f2440050c10>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:03.723310 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6cb2dc6e-63ec-4d71-9bd7-3aed08f6bb48 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.069264 Jun 05 08:24:03.724068 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 126/242] 10.222.0.33 () {60 vars in 1164 bytes} [Sun Jun 5 08:24:03 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:03.841663 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-87855e41-3e9b-4002-9e3f-61d26b38bb75 tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1719689963", "block_migration": true, "disk_over_commit": false}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:03.842996 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-87855e41-3e9b-4002-9e3f-61d26b38bb75 tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] [instance: 121df5fc-10cc-4f27-bbe8-878791f857a2] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:03.849879 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-87855e41-3e9b-4002-9e3f-61d26b38bb75 tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:03.850431 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-87855e41-3e9b-4002-9e3f-61d26b38bb75 tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:03.851098 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-87855e41-3e9b-4002-9e3f-61d26b38bb75 tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:03.851519 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-87855e41-3e9b-4002-9e3f-61d26b38bb75 tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:03.854554 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0c4c95ac-9003-4ba4-b34e-fc6e1ec0cdf1 tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-group-rules/8a463721-20ea-4280-a494-c7c5ae38b751" status: 202 len: 0 microversion: 2.1 time: 0.162927 Jun 05 08:24:03.859238 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 117/243] 10.222.0.33 () {58 vars in 1286 bytes} [Sun Jun 5 08:24:03 2022] DELETE /compute/v2.1/os-security-group-rules/8a463721-20ea-4280-a494-c7c5ae38b751 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:24:03.859915 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bbcc78fb-a61f-4284-8a6b-899c3086d5a4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:03.860558 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-bbcc78fb-a61f-4284-8a6b-899c3086d5a4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: e4c09fb3-f67f-4b07-a992-2e70683932bd] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:03.869500 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bbcc78fb-a61f-4284-8a6b-899c3086d5a4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:03.870074 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bbcc78fb-a61f-4284-8a6b-899c3086d5a4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:03.870894 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bbcc78fb-a61f-4284-8a6b-899c3086d5a4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:03.871328 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bbcc78fb-a61f-4284-8a6b-899c3086d5a4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:03.939928 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-87855e41-3e9b-4002-9e3f-61d26b38bb75 tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Lazy-loading 'flavor' on Instance uuid 121df5fc-10cc-4f27-bbe8-878791f857a2 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:03.986501 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-87855e41-3e9b-4002-9e3f-61d26b38bb75 tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] [instance: 121df5fc-10cc-4f27-bbe8-878791f857a2] Going to try to live migrate instance to tempest-host-1719689963 {{(pid=119050) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 05 08:24:03.993981 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-87855e41-3e9b-4002-9e3f-61d26b38bb75 tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] HTTP exception thrown: Compute host tempest-host-1719689963 could not be found. Jun 05 08:24:03.997829 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-87855e41-3e9b-4002-9e3f-61d26b38bb75 tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Request method failure captured: Jun 05 08:24:03.997829 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2/action HTTP/1.1 Jun 05 08:24:03.997829 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:24:03.997829 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:24:03.997829 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:24:03.997829 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 107 Jun 05 08:24:03.997829 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:24:03.997829 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:24:03.997829 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:24:03.997829 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:03.997829 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGgUAmPGceYxyhYnzI2pmf8IdhrzLHxUfD7C2bhonDjL29g2wzg2W0ukdjBjW63iHFUSTrFv3KRfY4ZQUIUQB3yoO2S6a3YDt0Fg2g1QMj7v2jJym8W9mrzdLDhpKc8kB6NywJ9mK7KP05f6NHoKfR04RO2_tVnVBBhka9ODS4mVJiE Jun 05 08:24:03.997829 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:24:03.997829 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:24:03.997829 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:24:03.997829 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:24:03.997829 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:24:03.997829 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:24:03.997829 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 4d18dde2fee8424c851d3c5bfbf69b82 Jun 05 08:24:03.997829 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-LiveMigrationNegativeTest-44922645 Jun 05 08:24:03.997829 n-d-844739-1 devstack@n-api.service[119050]: X-Role: admin,reader,member Jun 05 08:24:03.997829 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: admin,reader,member Jun 05 08:24:03.999126 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4d18dde2fee8424c851d3c5bfbf69b82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4d18dde2fee8424c851d3c5bfbf69b82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4d18dde2fee8424c851d3c5bfbf69b82", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4d18dde2fee8424c851d3c5bfbf69b82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:03.999126 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-LiveMigrationNegativeTest-44922645 Jun 05 08:24:03.999126 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 4d18dde2fee8424c851d3c5bfbf69b82 Jun 05 08:24:03.999126 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-44922645 Jun 05 08:24:03.999126 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-LiveMigrationNegativeTest-44922645-project-admin Jun 05 08:24:03.999126 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:24:03.999126 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:24:03.999126 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 7f7d6df94b7b4188bd287591f82778b4 Jun 05 08:24:03.999126 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-LiveMigrationNegativeTest-44922645-project-admin Jun 05 08:24:03.999126 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:24:03.999126 n-d-844739-1 devstack@n-api.service[119050]: {"os-migrateLive": {"host": "tempest-host-1719689963", "block_migration": true, "disk_over_commit": false}} Jun 05 08:24:03.999126 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:24:03.999911 n-d-844739-1 devstack@n-api.service[119050]: exception: Compute host tempest-host-1719689963 could not be found. Jun 05 08:24:03.999911 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '121df5fc-10cc-4f27-bbe8-878791f857a2', 'body': {'os-migrateLive': {'host': 'tempest-host-1719689963', 'block_migration': True, 'disk_over_commit': False}}} Jun 05 08:24:03.999911 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:03.999911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:03.999911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jun 05 08:24:03.999911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jun 05 08:24:03.999911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 05 08:24:03.999911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 05 08:24:03.999911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 05 08:24:03.999911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 05 08:24:03.999911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 05 08:24:03.999911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 05 08:24:03.999911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 05 08:24:03.999911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 05 08:24:03.999911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 05 08:24:03.999911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 05 08:24:03.999911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jun 05 08:24:03.999911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 05 08:24:03.999911 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 05 08:24:04.000920 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 05 08:24:04.000920 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 05 08:24:04.000920 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 05 08:24:04.000920 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jun 05 08:24:04.000920 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jun 05 08:24:04.000920 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:24:04.000920 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:24:04.000920 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jun 05 08:24:04.000920 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jun 05 08:24:04.000920 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jun 05 08:24:04.000920 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:04.000920 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jun 05 08:24:04.000920 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jun 05 08:24:04.000920 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jun 05 08:24:04.000920 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jun 05 08:24:04.000920 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jun 05 08:24:04.000920 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jun 05 08:24:04.000920 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1719689963 could not be found. Jun 05 08:24:04.000920 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.002014 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:04.002014 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.002014 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:04.002014 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:04.002014 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:04.002014 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:04.002014 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:04.002014 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:04.002014 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:04.002014 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:24:04.002014 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:24:04.002014 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:24:04.002014 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:24:04.002014 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:24:04.002014 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:24:04.002014 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 05 08:24:04.002014 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jun 05 08:24:04.002014 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 05 08:24:04.002014 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1719689963 could not be found. Jun 05 08:24:04.002014 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.003353 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:04.003353 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.003353 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:04.003353 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:04.003353 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:04.003353 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:24:04.003353 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:24:04.003353 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1719689963 could not be found. Jun 05 08:24:04.003353 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.003353 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-87855e41-3e9b-4002-9e3f-61d26b38bb75 tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Returning 400 to user: Compute host tempest-host-1719689963 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:04.003353 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-87855e41-3e9b-4002-9e3f-61d26b38bb75 tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2/action" status: 400 len: 100 microversion: 2.1 time: 0.269439 Jun 05 08:24:04.003353 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 127/244] 10.222.0.33 () {60 vars in 1278 bytes} [Sun Jun 5 08:24:03 2022] POST /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2/action => generated 100 bytes in 275 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 05 08:24:04.004492 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2db913c2-c6c6-44fe-acba-fd7446a40ab6 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Calling method '.version_select at 0x7f2433edcc10>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:04.005875 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:04.005875 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:04.011463 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-bbcc78fb-a61f-4284-8a6b-899c3086d5a4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:04.012505 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2db913c2-c6c6-44fe-acba-fd7446a40ab6 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:04.012959 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2db913c2-c6c6-44fe-acba-fd7446a40ab6 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:04.019043 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bbcc78fb-a61f-4284-8a6b-899c3086d5a4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd" status: 200 len: 1390 microversion: 2.1 time: 0.162854 Jun 05 08:24:04.019626 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 118/245] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:03 2022] GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:04.024641 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d9e07d86-7ccb-4129-bb34-56598031d729 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1807496540"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:04.025186 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2db913c2-c6c6-44fe-acba-fd7446a40ab6 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:04.025639 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2db913c2-c6c6-44fe-acba-fd7446a40ab6 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:04.026067 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:04.026067 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:04.034593 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d9e07d86-7ccb-4129-bb34-56598031d729 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:04.035134 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d9e07d86-7ccb-4129-bb34-56598031d729 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:04.042940 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d9e07d86-7ccb-4129-bb34-56598031d729 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:04.043257 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2db913c2-c6c6-44fe-acba-fd7446a40ab6 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/n-h2-844739-1" status: 200 len: 598 microversion: 2.1 time: 0.042390 Jun 05 08:24:04.043388 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d9e07d86-7ccb-4129-bb34-56598031d729 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:04.043820 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 128/246] 10.222.0.33 () {58 vars in 1169 bytes} [Sun Jun 5 08:24:03 2022] GET /compute/v2.1/os-hosts/n-h2-844739-1 => generated 598 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:04.048297 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ce5a3b92-cde9-4382-831e-9efa08f2fc42 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-571247870_new", "availability_zone": "tempest-test_az-149552972_new"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:04.050420 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:04.050420 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:04.050960 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-d9e07d86-7ccb-4129-bb34-56598031d729 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1807496540 could not be found. Jun 05 08:24:04.053832 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d9e07d86-7ccb-4129-bb34-56598031d729 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Request method failure captured: Jun 05 08:24:04.053832 n-d-844739-1 devstack@n-api.service[119049]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Jun 05 08:24:04.053832 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:24:04.053832 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:24:04.053832 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:24:04.053832 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 58 Jun 05 08:24:04.053832 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:24:04.053832 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:24:04.053832 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:24:04.053832 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:04.053832 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGgIRZ2w5RYMc-xJAJAW0Au2dlUXKz-nyQAmHbUmmgk7S8GMjTamz5c7cQPYC36qdAn3gD5Y1scW4h_CJuLFHq-YVgLlesWCG79ZEh6998Ouiktqxh8Ungx_1AvcIIZp5TYYkRV595HGTi0WikuwtFk_QhG2D06ZrHaZMk_tsl7sDm8 Jun 05 08:24:04.053832 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:24:04.053832 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:24:04.053832 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:24:04.053832 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:24:04.053832 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:24:04.053832 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:24:04.053832 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: c0c2c53930be48d2a79494d8e5fdf4de Jun 05 08:24:04.053832 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1245114998 Jun 05 08:24:04.053832 n-d-844739-1 devstack@n-api.service[119049]: X-Role: admin,reader,member Jun 05 08:24:04.053832 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: admin,reader,member Jun 05 08:24:04.055238 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c0c2c53930be48d2a79494d8e5fdf4de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0c2c53930be48d2a79494d8e5fdf4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c0c2c53930be48d2a79494d8e5fdf4de", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0c2c53930be48d2a79494d8e5fdf4de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:04.055238 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1245114998 Jun 05 08:24:04.055238 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: c0c2c53930be48d2a79494d8e5fdf4de Jun 05 08:24:04.055238 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1245114998 Jun 05 08:24:04.055238 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin Jun 05 08:24:04.055238 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:24:04.055238 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:24:04.055238 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 2e73595af34542108dfc5bfec02cbe79 Jun 05 08:24:04.055238 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin Jun 05 08:24:04.055238 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:24:04.055238 n-d-844739-1 devstack@n-api.service[119049]: {"add_host": {"host": "tempest-nonexist_host-1807496540"}} Jun 05 08:24:04.055238 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:24:04.055238 n-d-844739-1 devstack@n-api.service[119049]: exception: Compute host tempest-nonexist_host-1807496540 could not be found. Jun 05 08:24:04.056077 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '11', 'body': {'add_host': {'host': 'tempest-nonexist_host-1807496540'}}} Jun 05 08:24:04.056077 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:04.056077 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:04.056077 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jun 05 08:24:04.056077 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jun 05 08:24:04.056077 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:24:04.056077 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:24:04.056077 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 05 08:24:04.056077 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 05 08:24:04.056077 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 05 08:24:04.056077 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 05 08:24:04.056077 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 05 08:24:04.056077 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 05 08:24:04.056077 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1807496540' is not mapped to any cell Jun 05 08:24:04.056077 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.056077 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:04.056077 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.056077 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:04.056077 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jun 05 08:24:04.057048 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jun 05 08:24:04.057048 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 05 08:24:04.057048 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 05 08:24:04.057048 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 05 08:24:04.057048 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.057048 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:04.057048 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.057048 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:04.057048 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jun 05 08:24:04.057048 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jun 05 08:24:04.057048 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 05 08:24:04.057048 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 05 08:24:04.057048 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:24:04.057048 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:24:04.057048 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:24:04.057048 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:24:04.057048 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 05 08:24:04.057048 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 05 08:24:04.057048 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jun 05 08:24:04.057048 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jun 05 08:24:04.058070 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jun 05 08:24:04.058070 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jun 05 08:24:04.058070 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1807496540 could not be found. Jun 05 08:24:04.058070 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.058070 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:04.058070 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.058070 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:04.058070 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:04.058070 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:04.058070 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:04.058070 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:04.058070 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:04.058070 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:04.058070 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:24:04.058070 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:24:04.058070 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jun 05 08:24:04.058070 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:24:04.058070 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1807496540 could not be found. Jun 05 08:24:04.058070 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.058070 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:04.058070 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.059429 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:04.059429 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:04.059429 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:04.059429 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:24:04.059429 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:24:04.059429 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1807496540 could not be found. Jun 05 08:24:04.059429 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.059429 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d9e07d86-7ccb-4129-bb34-56598031d729 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1807496540 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:04.059429 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d9e07d86-7ccb-4129-bb34-56598031d729 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/11/action" status: 404 len: 111 microversion: 2.1 time: 0.034704 Jun 05 08:24:04.059429 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 119/247] 10.222.0.33 () {60 vars in 1193 bytes} [Sun Jun 5 08:24:04 2022] POST /compute/v2.1/os-aggregates/11/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:24:04.061207 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-408cef7d-4024-4f3a-a418-32a25044f44a tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Action: 'create', calling method: .version_select at 0x7f2440265ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-198342440", "description": "tempest-description-1342957554"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:04.084692 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ce5a3b92-cde9-4382-831e-9efa08f2fc42 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:04.085139 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ce5a3b92-cde9-4382-831e-9efa08f2fc42 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:04.118081 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ce5a3b92-cde9-4382-831e-9efa08f2fc42 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 334 microversion: 2.1 time: 0.073193 Jun 05 08:24:04.119010 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 129/248] 10.222.0.33 () {60 vars in 1172 bytes} [Sun Jun 5 08:24:04 2022] PUT /compute/v2.1/os-aggregates/12 => generated 334 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:04.124109 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-13f9c9a2-d3c0-486f-b388-edc41d6a2ef7 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:04.124729 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-13f9c9a2-d3c0-486f-b388-edc41d6a2ef7 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 121df5fc-10cc-4f27-bbe8-878791f857a2] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:04.134524 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-13f9c9a2-d3c0-486f-b388-edc41d6a2ef7 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:04.134977 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-13f9c9a2-d3c0-486f-b388-edc41d6a2ef7 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:04.135746 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-13f9c9a2-d3c0-486f-b388-edc41d6a2ef7 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:04.136216 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-13f9c9a2-d3c0-486f-b388-edc41d6a2ef7 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:04.237134 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-408cef7d-4024-4f3a-a418-32a25044f44a tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.180032 Jun 05 08:24:04.237740 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 120/249] 10.222.0.33 () {60 vars in 1179 bytes} [Sun Jun 5 08:24:04 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:04.242515 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e8f71daf-0942-471b-9928-18ef21fdea99 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Calling method '.version_select at 0x7f24405b19d0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:04.243450 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:04.243450 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:04.249972 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e8f71daf-0942-471b-9928-18ef21fdea99 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:04.250431 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e8f71daf-0942-471b-9928-18ef21fdea99 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:04.264237 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e8f71daf-0942-471b-9928-18ef21fdea99 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:04.264693 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e8f71daf-0942-471b-9928-18ef21fdea99 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:04.297726 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e8f71daf-0942-471b-9928-18ef21fdea99 tempest-HostsAdminTestJSON-684342440 tempest-HostsAdminTestJSON-684342440-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/n-h1-844739-1" status: 200 len: 729 microversion: 2.1 time: 0.058791 Jun 05 08:24:04.298224 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 121/250] 10.222.0.33 () {58 vars in 1169 bytes} [Sun Jun 5 08:24:04 2022] GET /compute/v2.1/os-hosts/n-h1-844739-1 => generated 729 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:04.303232 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c856fcdd-7896-48cd-bc2f-e5b3f7d6ac7f tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:04.304077 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:04.304077 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:04.309517 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-13f9c9a2-d3c0-486f-b388-edc41d6a2ef7 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:04.319089 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-13f9c9a2-d3c0-486f-b388-edc41d6a2ef7 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2" status: 200 len: 1468 microversion: 2.1 time: 0.198656 Jun 05 08:24:04.319998 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 130/251] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:04 2022] GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2 => generated 1468 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:04.325319 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c856fcdd-7896-48cd-bc2f-e5b3f7d6ac7f tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.026054 Jun 05 08:24:04.325899 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 122/252] 10.222.0.33 () {58 vars in 1154 bytes} [Sun Jun 5 08:24:04 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 05 08:24:04.344756 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-02b6daa6-a4fd-4572-979b-cf5dab4c32d2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:04.346271 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-02b6daa6-a4fd-4572-979b-cf5dab4c32d2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:04.354741 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-02b6daa6-a4fd-4572-979b-cf5dab4c32d2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:04.355250 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-02b6daa6-a4fd-4572-979b-cf5dab4c32d2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:04.355982 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-02b6daa6-a4fd-4572-979b-cf5dab4c32d2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:04.356692 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-02b6daa6-a4fd-4572-979b-cf5dab4c32d2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:04.370840 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ae2c8ddf-0681-4c54-8259-f6c7514ca712 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:04.371601 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:04.371601 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:04.385492 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ae2c8ddf-0681-4c54-8259-f6c7514ca712 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 337 microversion: 2.1 time: 0.026345 Jun 05 08:24:04.386300 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 131/253] 10.222.0.33 () {58 vars in 1142 bytes} [Sun Jun 5 08:24:04 2022] GET /compute/v2.1/os-aggregates => generated 337 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:04.390981 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fdab7959-a594-4628-9ea6-913367b1f2a1 tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Action: 'create', calling method: .version_select at 0x7f2433eb4670>, body: {"security_group_rule": {"parent_group_id": "247a35bf-b599-4f42-b346-fc7433572230", "ip_protocol": "tcp", "from_port": 1966737668, "to_port": 22}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:04.486335 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-fdab7959-a594-4628-9ea6-913367b1f2a1 tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] HTTP exception thrown: Invalid port range 1966737668:22. Former value cannot be greater than the later Jun 05 08:24:04.488733 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fdab7959-a594-4628-9ea6-913367b1f2a1 tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Request method failure captured: Jun 05 08:24:04.488733 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 05 08:24:04.488733 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:24:04.488733 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:24:04.488733 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:24:04.488733 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 146 Jun 05 08:24:04.488733 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:24:04.488733 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:24:04.488733 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:24:04.488733 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:04.488733 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGgi_mobQeYIY4rKAF6MX2eJMDlGP5Psyfjisk28tLi8plE4pnuHyHhk0q073DIfg8oFdALDNR5n_olGUg6FlT5Rnfz23Qix4BApGaNx2cHjtveAdgRQqvUcYm5X9bDyj5kgPWR9mgKWJavmqp4MfBjQeRSfn8IltY7XC8hmilpH-YI Jun 05 08:24:04.488733 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:24:04.488733 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:24:04.488733 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:24:04.488733 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:24:04.488733 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:24:04.488733 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:24:04.488733 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: ba602ab823574300b56acf7afebe6c58 Jun 05 08:24:04.488733 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-689221279 Jun 05 08:24:04.488733 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:24:04.488733 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:24:04.490758 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba602ab823574300b56acf7afebe6c58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba602ab823574300b56acf7afebe6c58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba602ab823574300b56acf7afebe6c58", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba602ab823574300b56acf7afebe6c58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:04.490758 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-689221279 Jun 05 08:24:04.490758 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: ba602ab823574300b56acf7afebe6c58 Jun 05 08:24:04.490758 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-689221279 Jun 05 08:24:04.490758 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-689221279-project Jun 05 08:24:04.490758 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:24:04.490758 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:24:04.490758 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 3b829fe307174f20baee36fa542de6ef Jun 05 08:24:04.490758 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-689221279-project Jun 05 08:24:04.490758 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:24:04.490758 n-d-844739-1 devstack@n-api.service[119050]: {"security_group_rule": {"parent_group_id": "247a35bf-b599-4f42-b346-fc7433572230", "ip_protocol": "tcp", "from_port": 1966737668, "to_port": 22}} Jun 05 08:24:04.490758 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:24:04.491633 n-d-844739-1 devstack@n-api.service[119050]: exception: Invalid port range 1966737668:22. Former value cannot be greater than the later Jun 05 08:24:04.491633 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'body': {'security_group_rule': {'parent_group_id': '247a35bf-b599-4f42-b346-fc7433572230', 'ip_protocol': 'tcp', 'from_port': 1966737668, 'to_port': 22}}} Jun 05 08:24:04.491633 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:04.491633 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:04.491633 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 05 08:24:04.491633 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 05 08:24:04.491633 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 05 08:24:04.491633 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 05 08:24:04.491633 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 05 08:24:04.491633 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 05 08:24:04.491633 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jun 05 08:24:04.491633 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jun 05 08:24:04.491633 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1966737668:22. Former value cannot be greater than the later Jun 05 08:24:04.491633 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.491633 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:04.491633 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.491633 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:04.491633 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:04.491633 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:04.492852 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:04.492852 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:04.492852 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:24:04.492852 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:24:04.492852 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:04.492852 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:04.492852 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 05 08:24:04.492852 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 05 08:24:04.492852 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1966737668:22. Former value cannot be greater than the later Jun 05 08:24:04.492852 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.492852 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:04.492852 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.492852 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:04.492852 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:04.492852 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:04.492852 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:24:04.492852 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:24:04.492852 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1966737668:22. Former value cannot be greater than the later Jun 05 08:24:04.492852 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.495452 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fdab7959-a594-4628-9ea6-913367b1f2a1 tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Returning 400 to user: Invalid port range 1966737668:22. Former value cannot be greater than the later {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:04.496505 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fdab7959-a594-4628-9ea6-913367b1f2a1 tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.109127 Jun 05 08:24:04.497601 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 132/254] 10.222.0.33 () {60 vars in 1194 bytes} [Sun Jun 5 08:24:04 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 05 08:24:04.509618 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cd54ae0e-5780-4e1a-9697-309566ffa159 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:04.512935 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cd54ae0e-5780-4e1a-9697-309566ffa159 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Request method failure captured: Jun 05 08:24:04.512935 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 05 08:24:04.512935 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:24:04.512935 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:24:04.512935 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:24:04.512935 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 283 Jun 05 08:24:04.512935 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:24:04.512935 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:24:04.512935 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:24:04.512935 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:04.512935 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGgIRZ2w5RYMc-xJAJAW0Au2dlUXKz-nyQAmHbUmmgk7S8GMjTamz5c7cQPYC36qdAn3gD5Y1scW4h_CJuLFHq-YVgLlesWCG79ZEh6998Ouiktqxh8Ungx_1AvcIIZp5TYYkRV595HGTi0WikuwtFk_QhG2D06ZrHaZMk_tsl7sDm8 Jun 05 08:24:04.512935 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:24:04.512935 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:24:04.512935 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:24:04.512935 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:24:04.512935 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:24:04.512935 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:24:04.512935 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: c0c2c53930be48d2a79494d8e5fdf4de Jun 05 08:24:04.512935 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1245114998 Jun 05 08:24:04.512935 n-d-844739-1 devstack@n-api.service[119050]: X-Role: admin,reader,member Jun 05 08:24:04.512935 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: admin,reader,member Jun 05 08:24:04.514005 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c0c2c53930be48d2a79494d8e5fdf4de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0c2c53930be48d2a79494d8e5fdf4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c0c2c53930be48d2a79494d8e5fdf4de", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0c2c53930be48d2a79494d8e5fdf4de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:04.514005 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1245114998 Jun 05 08:24:04.514005 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: c0c2c53930be48d2a79494d8e5fdf4de Jun 05 08:24:04.514005 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1245114998 Jun 05 08:24:04.514005 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin Jun 05 08:24:04.514005 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:24:04.514005 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:24:04.514005 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 2e73595af34542108dfc5bfec02cbe79 Jun 05 08:24:04.514005 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin Jun 05 08:24:04.514005 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:24:04.514005 n-d-844739-1 devstack@n-api.service[119050]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jun 05 08:24:04.514564 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:24:04.514564 n-d-844739-1 devstack@n-api.service[119050]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 05 08:24:04.514564 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jun 05 08:24:04.514564 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:04.514564 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:04.514564 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 05 08:24:04.514564 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 05 08:24:04.514564 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 05 08:24:04.514564 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise error Jun 05 08:24:04.514564 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 05 08:24:04.514564 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.515158 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jun 05 08:24:04.515158 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 05 08:24:04.515158 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.515158 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jun 05 08:24:04.515158 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 05 08:24:04.515158 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.515158 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:04.515158 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.515158 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:04.515158 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:04.515158 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:04.515158 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:04.515158 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:04.515158 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:04.515158 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:04.515158 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:24:04.515158 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:24:04.515158 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 05 08:24:04.515158 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 05 08:24:04.516148 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 05 08:24:04.516148 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 05 08:24:04.516148 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 05 08:24:04.516148 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 05 08:24:04.516148 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 05 08:24:04.516148 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.516148 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:04.516148 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.516148 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:04.516148 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:04.516148 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:04.516148 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 05 08:24:04.516148 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 05 08:24:04.516845 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 05 08:24:04.516845 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.516845 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cd54ae0e-5780-4e1a-9697-309566ffa159 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:04.516845 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-cd54ae0e-5780-4e1a-9697-309566ffa159 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.014661 Jun 05 08:24:04.517292 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 133/255] 10.222.0.33 () {60 vars in 1164 bytes} [Sun Jun 5 08:24:04 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 05 08:24:04.525936 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5937da75-57f4-4542-adce-8bdf3891c999 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:04.526845 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:04.526845 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:04.554867 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5937da75-57f4-4542-adce-8bdf3891c999 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.032295 Jun 05 08:24:04.555839 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 134/256] 10.222.0.33 () {58 vars in 1154 bytes} [Sun Jun 5 08:24:04 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 05 08:24:04.562921 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a89dc085-7167-4813-9843-641509638cbd tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1513611871", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:04.591569 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-02b6daa6-a4fd-4572-979b-cf5dab4c32d2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:04.601722 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-02b6daa6-a4fd-4572-979b-cf5dab4c32d2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1310 microversion: 2.1 time: 0.274181 Jun 05 08:24:04.602623 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 123/257] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:04 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1310 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:04.613189 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-35527936-1c56-4c71-ac54-86624fc3aa0d tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Action: 'create', calling method: .version_select at 0x7f2440050b80>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-742959279", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:04.615632 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-35527936-1c56-4c71-ac54-86624fc3aa0d tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] HTTP exception thrown: Security group id should be uuid Jun 05 08:24:04.619784 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-35527936-1c56-4c71-ac54-86624fc3aa0d tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Request method failure captured: Jun 05 08:24:04.619784 n-d-844739-1 devstack@n-api.service[119049]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 05 08:24:04.619784 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:24:04.619784 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:24:04.619784 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:24:04.619784 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 130 Jun 05 08:24:04.619784 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:24:04.619784 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:24:04.619784 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:24:04.619784 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:04.619784 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGgi_mobQeYIY4rKAF6MX2eJMDlGP5Psyfjisk28tLi8plE4pnuHyHhk0q073DIfg8oFdALDNR5n_olGUg6FlT5Rnfz23Qix4BApGaNx2cHjtveAdgRQqvUcYm5X9bDyj5kgPWR9mgKWJavmqp4MfBjQeRSfn8IltY7XC8hmilpH-YI Jun 05 08:24:04.619784 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:24:04.619784 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:24:04.619784 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:24:04.619784 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:24:04.619784 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:24:04.619784 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:24:04.619784 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: ba602ab823574300b56acf7afebe6c58 Jun 05 08:24:04.619784 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-689221279 Jun 05 08:24:04.619784 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:24:04.619784 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:24:04.621227 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba602ab823574300b56acf7afebe6c58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba602ab823574300b56acf7afebe6c58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba602ab823574300b56acf7afebe6c58", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba602ab823574300b56acf7afebe6c58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:04.621227 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-689221279 Jun 05 08:24:04.621227 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: ba602ab823574300b56acf7afebe6c58 Jun 05 08:24:04.621227 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-689221279 Jun 05 08:24:04.621227 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-689221279-project Jun 05 08:24:04.621227 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:24:04.621227 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:24:04.621227 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 3b829fe307174f20baee36fa542de6ef Jun 05 08:24:04.621227 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-689221279-project Jun 05 08:24:04.621227 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:24:04.621227 n-d-844739-1 devstack@n-api.service[119049]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-742959279", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jun 05 08:24:04.621227 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:24:04.621227 n-d-844739-1 devstack@n-api.service[119049]: exception: Security group id should be uuid Jun 05 08:24:04.622160 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-742959279', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jun 05 08:24:04.622160 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:04.622160 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:04.622160 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jun 05 08:24:04.622160 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jun 05 08:24:04.622160 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jun 05 08:24:04.622160 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jun 05 08:24:04.622160 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jun 05 08:24:04.622160 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.622160 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:04.622160 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.622160 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:04.622160 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:04.622160 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:04.622160 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:04.622160 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:04.622160 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:24:04.622160 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:24:04.622160 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:04.622160 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:04.623886 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 05 08:24:04.623886 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 05 08:24:04.623886 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jun 05 08:24:04.623886 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.623886 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:04.623886 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.623886 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:04.623886 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:04.623886 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:04.623886 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:24:04.623886 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:24:04.623886 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jun 05 08:24:04.623886 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.623886 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-35527936-1c56-4c71-ac54-86624fc3aa0d tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Returning 400 to user: Security group id should be uuid {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:04.623886 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-35527936-1c56-4c71-ac54-86624fc3aa0d tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.017488 Jun 05 08:24:04.624863 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 124/258] 10.222.0.33 () {60 vars in 1194 bytes} [Sun Jun 5 08:24:04 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 05 08:24:04.630785 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-06726cd9-7500-4a83-a70c-7c4fdab4a7c2 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:04.640004 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-06726cd9-7500-4a83-a70c-7c4fdab4a7c2 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Request method failure captured: Jun 05 08:24:04.640004 n-d-844739-1 devstack@n-api.service[119049]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 05 08:24:04.640004 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:24:04.640004 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:24:04.640004 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:24:04.640004 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 27 Jun 05 08:24:04.640004 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:24:04.640004 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:24:04.640004 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:24:04.640004 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:04.640004 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGgIRZ2w5RYMc-xJAJAW0Au2dlUXKz-nyQAmHbUmmgk7S8GMjTamz5c7cQPYC36qdAn3gD5Y1scW4h_CJuLFHq-YVgLlesWCG79ZEh6998Ouiktqxh8Ungx_1AvcIIZp5TYYkRV595HGTi0WikuwtFk_QhG2D06ZrHaZMk_tsl7sDm8 Jun 05 08:24:04.640004 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:24:04.640004 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:24:04.640004 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:24:04.640004 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:24:04.640004 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:24:04.640004 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:24:04.640004 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: c0c2c53930be48d2a79494d8e5fdf4de Jun 05 08:24:04.640004 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1245114998 Jun 05 08:24:04.640004 n-d-844739-1 devstack@n-api.service[119049]: X-Role: admin,reader,member Jun 05 08:24:04.640004 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: admin,reader,member Jun 05 08:24:04.641486 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c0c2c53930be48d2a79494d8e5fdf4de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0c2c53930be48d2a79494d8e5fdf4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c0c2c53930be48d2a79494d8e5fdf4de", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0c2c53930be48d2a79494d8e5fdf4de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:04.641486 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1245114998 Jun 05 08:24:04.641486 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: c0c2c53930be48d2a79494d8e5fdf4de Jun 05 08:24:04.641486 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1245114998 Jun 05 08:24:04.641486 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin Jun 05 08:24:04.641486 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:24:04.641486 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:24:04.641486 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 2e73595af34542108dfc5bfec02cbe79 Jun 05 08:24:04.641486 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin Jun 05 08:24:04.641486 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:24:04.641486 n-d-844739-1 devstack@n-api.service[119049]: {"aggregate": {"name": ""}} Jun 05 08:24:04.641486 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:24:04.641486 n-d-844739-1 devstack@n-api.service[119049]: exception: Invalid input for field/attribute name. Value: . '' is too short Jun 05 08:24:04.642301 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'body': {'aggregate': {'name': ''}}} Jun 05 08:24:04.642301 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:04.642301 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:04.642301 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 05 08:24:04.642301 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 05 08:24:04.642301 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 05 08:24:04.642301 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise error Jun 05 08:24:04.642301 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 05 08:24:04.642301 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.642301 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jun 05 08:24:04.642301 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 05 08:24:04.642301 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.642301 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jun 05 08:24:04.642301 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi '' Jun 05 08:24:04.642301 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.642301 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:04.642301 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.642301 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:04.642301 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:04.642301 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:04.642301 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:04.642301 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:04.642301 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:04.643807 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:04.643807 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:24:04.643807 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:24:04.643807 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 05 08:24:04.643807 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 05 08:24:04.643807 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 05 08:24:04.643807 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 05 08:24:04.643807 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 05 08:24:04.643807 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 05 08:24:04.643807 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jun 05 08:24:04.643807 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.643807 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:04.643807 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.643807 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:04.643807 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:04.643807 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:04.643807 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 05 08:24:04.643807 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 05 08:24:04.643807 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jun 05 08:24:04.643807 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:04.646688 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-06726cd9-7500-4a83-a70c-7c4fdab4a7c2 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:04.646688 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-06726cd9-7500-4a83-a70c-7c4fdab4a7c2 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.017977 Jun 05 08:24:04.646688 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 125/259] 10.222.0.33 () {60 vars in 1163 bytes} [Sun Jun 5 08:24:04 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 05 08:24:04.647724 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-a89dc085-7167-4813-9843-641509638cbd tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] validate_networks() for None {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:24:04.649385 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c45cad43-f08b-4269-82ab-1a6d9093ac05 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2020805469"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:04.650675 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:04.650675 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:04.651790 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.aggregate [None req-c45cad43-f08b-4269-82ab-1a6d9093ac05 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Generated uuid 38caa9ab-7028-4e4f-a0b4-dd2de12146ba for aggregate {{(pid=119049) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 05 08:24:04.683476 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c45cad43-f08b-4269-82ab-1a6d9093ac05 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.039718 Jun 05 08:24:04.684517 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 126/260] 10.222.0.33 () {60 vars in 1163 bytes} [Sun Jun 5 08:24:04 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:04.690739 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a75a2384-ca38-405f-b7a6-0a991c33b677 tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Action: 'create', calling method: .version_select at 0x7f2440140310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1389286558", "description": "tempest-description-365396465"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:05.021830 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-a89dc085-7167-4813-9843-641509638cbd tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:24:05.022502 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-a89dc085-7167-4813-9843-641509638cbd tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:24:05.024405 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-a89dc085-7167-4813-9843-641509638cbd tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:24:05.025110 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-a89dc085-7167-4813-9843-641509638cbd tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:24:05.025884 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-a89dc085-7167-4813-9843-641509638cbd tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:24:05.039359 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a89dc085-7167-4813-9843-641509638cbd tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:05.040072 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a89dc085-7167-4813-9843-641509638cbd tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:05.042505 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a89dc085-7167-4813-9843-641509638cbd tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:05.043266 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a89dc085-7167-4813-9843-641509638cbd tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:05.051295 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:05.070157 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-a89dc085-7167-4813-9843-641509638cbd tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Getting quotas for project 68bdb8ea7b9848e598fadcaa8e92a86e. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:24:05.083093 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a75a2384-ca38-405f-b7a6-0a991c33b677 tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.396521 Jun 05 08:24:05.085567 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 127/261] 10.222.0.33 () {60 vars in 1179 bytes} [Sun Jun 5 08:24:04 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:05.102952 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b25493e1-35f2-44c0-940d-87c5a95a6352 tempest-AggregatesAdminNegativeTestJSON-1071987933 tempest-AggregatesAdminNegativeTestJSON-1071987933-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1868756560"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:05.106394 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-a89dc085-7167-4813-9843-641509638cbd tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Getting quotas for user ec38465e5e8e4925ba6c71a6b1e3246d and project 68bdb8ea7b9848e598fadcaa8e92a86e. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:24:05.106765 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:05.106765 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:05.108210 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b25493e1-35f2-44c0-940d-87c5a95a6352 tempest-AggregatesAdminNegativeTestJSON-1071987933 tempest-AggregatesAdminNegativeTestJSON-1071987933-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '5fad2defefb448dcbeae5ec878ea0db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74b51bf5aba419d84454fcfcd110610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:05.109247 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6,nova_api:DELETE=7,nova_api:UPDATE=3 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:05.112646 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b25493e1-35f2-44c0-940d-87c5a95a6352 tempest-AggregatesAdminNegativeTestJSON-1071987933 tempest-AggregatesAdminNegativeTestJSON-1071987933-project] Request method failure captured: Jun 05 08:24:05.112646 n-d-844739-1 devstack@n-api.service[119049]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 05 08:24:05.112646 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:24:05.112646 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:24:05.112646 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:24:05.112646 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 60 Jun 05 08:24:05.112646 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:24:05.112646 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:24:05.112646 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:24:05.112646 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:05.112646 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGgFR7BRz94qVsrpu1OMzvz2l0k3w2zx_iPvpQDeGo06IjKT0SxUxbEJ7uhtVACyiKwc1jM_XbPjbv0RhhgQWj5Q4mr-aSETbgVoeSd_tafYTkUF9w01OFcmHqbg5Z9GfZR7F_-zYx5gGtvQAzIlZOsi4FGoWT5OcHitbEOkn_urLcA Jun 05 08:24:05.112646 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:24:05.112646 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:24:05.112646 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:24:05.112646 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:24:05.112646 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:24:05.112646 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:24:05.112646 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: b74b51bf5aba419d84454fcfcd110610 Jun 05 08:24:05.112646 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1071987933 Jun 05 08:24:05.112646 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:24:05.112646 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:24:05.113837 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b74b51bf5aba419d84454fcfcd110610"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b74b51bf5aba419d84454fcfcd110610"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b74b51bf5aba419d84454fcfcd110610", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b74b51bf5aba419d84454fcfcd110610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:05.113837 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1071987933 Jun 05 08:24:05.113837 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: b74b51bf5aba419d84454fcfcd110610 Jun 05 08:24:05.113837 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1071987933 Jun 05 08:24:05.113837 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-AggregatesAdminNegativeTestJSON-1071987933-project Jun 05 08:24:05.113837 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:24:05.113837 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:24:05.113837 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 5fad2defefb448dcbeae5ec878ea0db3 Jun 05 08:24:05.113837 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1071987933-project Jun 05 08:24:05.113837 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:24:05.113837 n-d-844739-1 devstack@n-api.service[119049]: {"aggregate": {"name": "tempest-test_aggregate-1868756560"}} Jun 05 08:24:05.113837 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:24:05.113837 n-d-844739-1 devstack@n-api.service[119049]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jun 05 08:24:05.115157 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1868756560'}}} Jun 05 08:24:05.115157 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:05.115157 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:05.115157 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:05.115157 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:05.115157 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:05.115157 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:05.115157 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:05.115157 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:05.115157 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:24:05.115157 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:24:05.115157 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:24:05.115157 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:24:05.115157 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jun 05 08:24:05.115157 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jun 05 08:24:05.115157 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:24:05.115157 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:24:05.115157 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:24:05.115157 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:24:05.119805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:24:05.119805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:24:05.119805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:24:05.119805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:24:05.119805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:24:05.119805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:24:05.119805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:24:05.119805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:24:05.119805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:24:05.119805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:24:05.119805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jun 05 08:24:05.119805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:05.119805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:05.119805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:05.119805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:05.119805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:05.119805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:05.119805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:24:05.119805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:24:05.119805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jun 05 08:24:05.123208 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:05.126325 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b25493e1-35f2-44c0-940d-87c5a95a6352 tempest-AggregatesAdminNegativeTestJSON-1071987933 tempest-AggregatesAdminNegativeTestJSON-1071987933-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:05.128355 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b25493e1-35f2-44c0-940d-87c5a95a6352 tempest-AggregatesAdminNegativeTestJSON-1071987933 tempest-AggregatesAdminNegativeTestJSON-1071987933-project] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.032021 Jun 05 08:24:05.129871 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 128/262] 10.222.0.33 () {60 vars in 1163 bytes} [Sun Jun 5 08:24:05 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:24:05.144682 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-52d291c5-4fdf-4803-8429-483894678d58 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:05.148641 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:05.148641 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:05.150796 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a89dc085-7167-4813-9843-641509638cbd tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:24:05.153395 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a89dc085-7167-4813-9843-641509638cbd tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 98766f8e-7b27-49e9-8565-4bc9c3e808d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:24:05.157197 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-52d291c5-4fdf-4803-8429-483894678d58 tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.025904 Jun 05 08:24:05.158276 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 129/263] 10.222.0.33 () {58 vars in 1142 bytes} [Sun Jun 5 08:24:05 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:05.163486 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fd178da5-e0e5-4efa-a107-f3e29913e0f9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:05.164553 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-fd178da5-e0e5-4efa-a107-f3e29913e0f9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:05.171475 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fd178da5-e0e5-4efa-a107-f3e29913e0f9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:05.172675 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fd178da5-e0e5-4efa-a107-f3e29913e0f9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:05.173671 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fd178da5-e0e5-4efa-a107-f3e29913e0f9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:05.174297 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fd178da5-e0e5-4efa-a107-f3e29913e0f9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:05.222253 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a89dc085-7167-4813-9843-641509638cbd tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.664995 Jun 05 08:24:05.223062 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 135/264] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:24:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:24:05.241559 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2684b888-92d2-4320-a499-1552e26ed6ac tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:05.241795 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2684b888-92d2-4320-a499-1552e26ed6ac tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: e4c09fb3-f67f-4b07-a992-2e70683932bd] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:05.259659 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2684b888-92d2-4320-a499-1552e26ed6ac tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:05.260516 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2684b888-92d2-4320-a499-1552e26ed6ac tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:05.261649 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2684b888-92d2-4320-a499-1552e26ed6ac tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:05.262099 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2684b888-92d2-4320-a499-1552e26ed6ac tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:05.403240 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-fd178da5-e0e5-4efa-a107-f3e29913e0f9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:05.422135 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fd178da5-e0e5-4efa-a107-f3e29913e0f9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 200 len: 1475 microversion: 2.1 time: 0.262192 Jun 05 08:24:05.432462 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 130/265] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:05 2022] GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 1475 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:05.432462 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0a050a03-f9e1-4e4c-8134-f7c7dc75d489 tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Action: 'create', calling method: .version_select at 0x7f2440050e50>, body: {"security_group_rule": {"parent_group_id": "82643568-94b9-4f77-99eb-bb83cde80ab4", "ip_protocol": "tempest-999-723470620", "from_port": 22, "to_port": 22}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:05.509010 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2684b888-92d2-4320-a499-1552e26ed6ac tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:05.522321 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2684b888-92d2-4320-a499-1552e26ed6ac tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd" status: 200 len: 1390 microversion: 2.1 time: 0.291888 Jun 05 08:24:05.523688 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 136/266] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:05 2022] GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd => generated 1390 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:05.529454 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e5bf2508-b79e-4c70-a9d4-f826525b0207 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-353943890"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:05.531186 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:05.531186 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:05.532172 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.aggregate [None req-e5bf2508-b79e-4c70-a9d4-f826525b0207 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Generated uuid fc81e9c7-2770-43ab-94df-e40114d35d5a for aggregate {{(pid=119050) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 05 08:24:05.541100 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-0a050a03-f9e1-4e4c-8134-f7c7dc75d489 tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] HTTP exception thrown: Invalid IP protocol tempest-999-723470620. Jun 05 08:24:05.545241 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0a050a03-f9e1-4e4c-8134-f7c7dc75d489 tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Request method failure captured: Jun 05 08:24:05.545241 n-d-844739-1 devstack@n-api.service[119049]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 05 08:24:05.545241 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:24:05.545241 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:24:05.545241 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:24:05.545241 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 156 Jun 05 08:24:05.545241 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:24:05.545241 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:24:05.545241 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:24:05.545241 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:05.545241 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGgi_mobQeYIY4rKAF6MX2eJMDlGP5Psyfjisk28tLi8plE4pnuHyHhk0q073DIfg8oFdALDNR5n_olGUg6FlT5Rnfz23Qix4BApGaNx2cHjtveAdgRQqvUcYm5X9bDyj5kgPWR9mgKWJavmqp4MfBjQeRSfn8IltY7XC8hmilpH-YI Jun 05 08:24:05.545241 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:24:05.545241 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:24:05.545241 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:24:05.545241 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:24:05.545241 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:24:05.545241 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:24:05.545241 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: ba602ab823574300b56acf7afebe6c58 Jun 05 08:24:05.545241 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-689221279 Jun 05 08:24:05.545241 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:24:05.545241 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:24:05.547253 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba602ab823574300b56acf7afebe6c58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba602ab823574300b56acf7afebe6c58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba602ab823574300b56acf7afebe6c58", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba602ab823574300b56acf7afebe6c58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:05.547253 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-689221279 Jun 05 08:24:05.547253 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: ba602ab823574300b56acf7afebe6c58 Jun 05 08:24:05.547253 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-689221279 Jun 05 08:24:05.547253 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-689221279-project Jun 05 08:24:05.547253 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:24:05.547253 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:24:05.547253 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 3b829fe307174f20baee36fa542de6ef Jun 05 08:24:05.547253 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-689221279-project Jun 05 08:24:05.547253 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:24:05.547253 n-d-844739-1 devstack@n-api.service[119049]: {"security_group_rule": {"parent_group_id": "82643568-94b9-4f77-99eb-bb83cde80ab4", "ip_protocol": "tempest-999-723470620", "from_port": 22, "to_port": 22}} Jun 05 08:24:05.547253 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:24:05.547253 n-d-844739-1 devstack@n-api.service[119049]: exception: Invalid IP protocol tempest-999-723470620. Jun 05 08:24:05.548437 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'body': {'security_group_rule': {'parent_group_id': '82643568-94b9-4f77-99eb-bb83cde80ab4', 'ip_protocol': 'tempest-999-723470620', 'from_port': 22, 'to_port': 22}}} Jun 05 08:24:05.548437 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:05.548437 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:05.548437 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 05 08:24:05.548437 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 05 08:24:05.548437 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 05 08:24:05.548437 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 05 08:24:05.548437 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 05 08:24:05.548437 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 05 08:24:05.548437 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jun 05 08:24:05.548437 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jun 05 08:24:05.548437 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-723470620. Jun 05 08:24:05.548437 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:05.548437 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:05.548437 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:05.548437 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:05.548437 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:05.548437 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:05.548437 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:05.551020 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:05.551020 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:24:05.551020 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:24:05.551020 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:05.551020 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:05.551020 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 05 08:24:05.551020 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 05 08:24:05.551020 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-723470620. Jun 05 08:24:05.551020 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:05.551020 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:05.551020 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:05.551020 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:05.551020 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:05.551020 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:05.551020 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:24:05.551020 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:24:05.551020 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-723470620. Jun 05 08:24:05.551020 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:05.554942 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0a050a03-f9e1-4e4c-8134-f7c7dc75d489 tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Returning 400 to user: Invalid IP protocol tempest-999-723470620. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:05.556058 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0a050a03-f9e1-4e4c-8134-f7c7dc75d489 tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.129860 Jun 05 08:24:05.564212 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 131/267] 10.222.0.33 () {60 vars in 1194 bytes} [Sun Jun 5 08:24:05 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 05 08:24:05.567483 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e5bf2508-b79e-4c70-a9d4-f826525b0207 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.042177 Jun 05 08:24:05.570199 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ec7cedf1-152a-4ed9-b726-1250612029ef tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:05.571029 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:05.571029 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:05.577028 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 137/268] 10.222.0.33 () {60 vars in 1163 bytes} [Sun Jun 5 08:24:05 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:05.587604 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4babac99-0bfc-4063-b1f4-ea0567e58514 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:05.588550 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4babac99-0bfc-4063-b1f4-ea0567e58514 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 98766f8e-7b27-49e9-8565-4bc9c3e808d8] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:05.621415 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ec7cedf1-152a-4ed9-b726-1250612029ef tempest-AggregatesAdminTestJSON-545397584 tempest-AggregatesAdminTestJSON-545397584-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.059866 Jun 05 08:24:05.622794 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 132/269] 10.222.0.33 () {58 vars in 1154 bytes} [Sun Jun 5 08:24:05 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 05 08:24:05.657647 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7f0438be-db68-4ee7-9326-10e5c8bff525 tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Action: 'create', calling method: .version_select at 0x7f244007c5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1326120630", "description": "tempest-description-1284948544"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:05.740958 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4babac99-0bfc-4063-b1f4-ea0567e58514 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:05.750523 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4babac99-0bfc-4063-b1f4-ea0567e58514 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8" status: 200 len: 1219 microversion: 2.1 time: 0.172835 Jun 05 08:24:05.753211 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 138/270] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:05 2022] GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8 => generated 1219 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:05.767575 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d0ca78c7-2327-4321-aef7-a3addb5abe38 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-353943890"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:05.773242 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:05.773242 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:05.774309 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.aggregate [None req-d0ca78c7-2327-4321-aef7-a3addb5abe38 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Generated uuid 06a42002-52c1-401c-9c9b-72540362f63c for aggregate {{(pid=119050) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 05 08:24:05.797985 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-d0ca78c7-2327-4321-aef7-a3addb5abe38 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-353943890 already exists. Jun 05 08:24:05.802933 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d0ca78c7-2327-4321-aef7-a3addb5abe38 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Request method failure captured: Jun 05 08:24:05.802933 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 05 08:24:05.802933 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:24:05.802933 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:24:05.802933 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:24:05.802933 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 59 Jun 05 08:24:05.802933 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:24:05.802933 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:24:05.802933 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:24:05.802933 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:05.802933 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGgIRZ2w5RYMc-xJAJAW0Au2dlUXKz-nyQAmHbUmmgk7S8GMjTamz5c7cQPYC36qdAn3gD5Y1scW4h_CJuLFHq-YVgLlesWCG79ZEh6998Ouiktqxh8Ungx_1AvcIIZp5TYYkRV595HGTi0WikuwtFk_QhG2D06ZrHaZMk_tsl7sDm8 Jun 05 08:24:05.802933 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:24:05.802933 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:24:05.802933 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:24:05.802933 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:24:05.802933 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:24:05.802933 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:24:05.802933 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: c0c2c53930be48d2a79494d8e5fdf4de Jun 05 08:24:05.802933 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1245114998 Jun 05 08:24:05.802933 n-d-844739-1 devstack@n-api.service[119050]: X-Role: admin,reader,member Jun 05 08:24:05.802933 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: admin,reader,member Jun 05 08:24:05.804368 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c0c2c53930be48d2a79494d8e5fdf4de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0c2c53930be48d2a79494d8e5fdf4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c0c2c53930be48d2a79494d8e5fdf4de", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0c2c53930be48d2a79494d8e5fdf4de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:05.804368 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1245114998 Jun 05 08:24:05.804368 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: c0c2c53930be48d2a79494d8e5fdf4de Jun 05 08:24:05.804368 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1245114998 Jun 05 08:24:05.804368 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin Jun 05 08:24:05.804368 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:24:05.804368 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:24:05.804368 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 2e73595af34542108dfc5bfec02cbe79 Jun 05 08:24:05.804368 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin Jun 05 08:24:05.804368 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:24:05.804368 n-d-844739-1 devstack@n-api.service[119050]: {"aggregate": {"name": "tempest-test_aggregate-353943890"}} Jun 05 08:24:05.804368 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:24:05.804368 n-d-844739-1 devstack@n-api.service[119050]: exception: Aggregate tempest-test_aggregate-353943890 already exists. Jun 05 08:24:05.805126 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-353943890'}}} Jun 05 08:24:05.805126 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:05.805126 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:05.805126 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jun 05 08:24:05.805126 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jun 05 08:24:05.805126 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 05 08:24:05.805126 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 05 08:24:05.805126 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:24:05.805126 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:24:05.805126 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:24:05.805126 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:24:05.805126 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 05 08:24:05.805126 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 05 08:24:05.805126 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jun 05 08:24:05.805126 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi aggregate.create() Jun 05 08:24:05.805126 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 05 08:24:05.805126 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 05 08:24:05.805126 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jun 05 08:24:05.805126 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jun 05 08:24:05.806093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 05 08:24:05.806093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 05 08:24:05.806093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jun 05 08:24:05.806093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jun 05 08:24:05.806093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-353943890 already exists. Jun 05 08:24:05.806093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:05.806093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:05.806093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:05.806093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:05.806093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:05.806093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:05.806093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:05.806093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:05.806093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:05.806093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:05.806093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:24:05.806093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:24:05.806093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:24:05.806093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:24:05.806093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jun 05 08:24:05.807094 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jun 05 08:24:05.807094 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-353943890 already exists. Jun 05 08:24:05.807094 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:05.807094 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:05.807094 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:05.807094 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:05.807094 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:05.807094 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:05.807094 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:24:05.807094 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:24:05.807094 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-353943890 already exists. Jun 05 08:24:05.807094 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:05.807094 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d0ca78c7-2327-4321-aef7-a3addb5abe38 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-353943890 already exists. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:05.807094 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d0ca78c7-2327-4321-aef7-a3addb5abe38 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.049728 Jun 05 08:24:05.811333 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 139/271] 10.222.0.33 () {60 vars in 1163 bytes} [Sun Jun 5 08:24:05 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:24:05.826645 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0d26aa7e-c3de-4028-bef6-797186784304 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:05.827282 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0d26aa7e-c3de-4028-bef6-797186784304 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:05.846254 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0d26aa7e-c3de-4028-bef6-797186784304 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:05.846440 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0d26aa7e-c3de-4028-bef6-797186784304 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:05.847231 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0d26aa7e-c3de-4028-bef6-797186784304 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:05.847673 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0d26aa7e-c3de-4028-bef6-797186784304 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:06.032776 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7f0438be-db68-4ee7-9326-10e5c8bff525 tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.408645 Jun 05 08:24:06.033383 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 133/272] 10.222.0.33 () {60 vars in 1179 bytes} [Sun Jun 5 08:24:05 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:06.038644 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4de198d9-bfb3-467c-9313-b402a787f94b tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:06.039144 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4de198d9-bfb3-467c-9313-b402a787f94b tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] [instance: 63dc26bf-e378-436f-a328-a88919547afc] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:06.060549 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4de198d9-bfb3-467c-9313-b402a787f94b tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:06.061009 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4de198d9-bfb3-467c-9313-b402a787f94b tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:06.061797 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4de198d9-bfb3-467c-9313-b402a787f94b tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:06.062240 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4de198d9-bfb3-467c-9313-b402a787f94b tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:06.094734 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4de198d9-bfb3-467c-9313-b402a787f94b tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] [instance: 63dc26bf-e378-436f-a328-a88919547afc] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:24:06.118755 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0d26aa7e-c3de-4028-bef6-797186784304 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:06.129546 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0d26aa7e-c3de-4028-bef6-797186784304 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1310 microversion: 2.1 time: 0.317026 Jun 05 08:24:06.132832 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 140/273] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:05 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1310 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:06.146048 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-a73b07de-8952-42c4-b64f-884f60222ccc req-18e1f4df-2485-4fe3-a6d4-dce18b5da852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cddf461-3546-4475-91c7-419b46a255af", "name": "network-vif-deleted", "tag": "82f48857-e164-413d-8768-4601593a3494"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:06.166705 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-a73b07de-8952-42c4-b64f-884f60222ccc req-18e1f4df-2485-4fe3-a6d4-dce18b5da852 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:06.167815 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-a73b07de-8952-42c4-b64f-884f60222ccc req-18e1f4df-2485-4fe3-a6d4-dce18b5da852 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:06.180994 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-a73b07de-8952-42c4-b64f-884f60222ccc req-18e1f4df-2485-4fe3-a6d4-dce18b5da852 service nova] Creating event network-vif-deleted:82f48857-e164-413d-8768-4601593a3494 for instance 8cddf461-3546-4475-91c7-419b46a255af on n-h1-844739-1 Jun 05 08:24:06.189864 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-a73b07de-8952-42c4-b64f-884f60222ccc req-18e1f4df-2485-4fe3-a6d4-dce18b5da852 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052794 Jun 05 08:24:06.191298 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 141/274] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:06.201471 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-65f224af-e9a4-4228-91fa-39ed56d722b6 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:06.202653 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:06.202653 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:06.253053 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-65f224af-e9a4-4228-91fa-39ed56d722b6 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.059496 Jun 05 08:24:06.253652 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 142/275] 10.222.0.33 () {58 vars in 1154 bytes} [Sun Jun 5 08:24:06 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 05 08:24:06.265554 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4de198d9-bfb3-467c-9313-b402a787f94b tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] 10.222.0.33 "DELETE /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc" status: 204 len: 0 microversion: 2.1 time: 0.230776 Jun 05 08:24:06.266569 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 134/276] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:24:06 2022] DELETE /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:24:06.269775 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-bd6dff16-5146-4bdd-9852-1d36bb50c7a0 tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Action: 'create', calling method: .version_select at 0x7f2433db4f70>, body: {"security_group_rule": {"parent_group_id": "14bc3b48-e812-4490-b3c3-d56af618b8ea", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:06.284471 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f9fb6faa-a849-425b-aa32-4860110c905e tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2083544213"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:06.287279 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:06.287279 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:06.288534 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.aggregate [None req-f9fb6faa-a849-425b-aa32-4860110c905e tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Generated uuid d2065ba6-ea37-4493-8ff6-b0ba5983b580 for aggregate {{(pid=119049) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 05 08:24:06.313568 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f9fb6faa-a849-425b-aa32-4860110c905e tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.045741 Jun 05 08:24:06.314769 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 135/277] 10.222.0.33 () {60 vars in 1163 bytes} [Sun Jun 5 08:24:06 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:06.319835 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5647e46a-ff45-4181-b67b-fb8047ccf019 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:06.322071 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5647e46a-ff45-4181-b67b-fb8047ccf019 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] [instance: 63dc26bf-e378-436f-a328-a88919547afc] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:06.328671 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5647e46a-ff45-4181-b67b-fb8047ccf019 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:06.329120 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5647e46a-ff45-4181-b67b-fb8047ccf019 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:06.330189 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5647e46a-ff45-4181-b67b-fb8047ccf019 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:06.330892 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5647e46a-ff45-4181-b67b-fb8047ccf019 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:06.352802 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-bd6dff16-5146-4bdd-9852-1d36bb50c7a0 tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jun 05 08:24:06.354435 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-bd6dff16-5146-4bdd-9852-1d36bb50c7a0 tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Request method failure captured: Jun 05 08:24:06.354435 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 05 08:24:06.354435 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:24:06.354435 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:24:06.354435 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:24:06.354435 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 138 Jun 05 08:24:06.354435 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:24:06.354435 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:24:06.354435 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:24:06.354435 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:06.354435 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGgi_mobQeYIY4rKAF6MX2eJMDlGP5Psyfjisk28tLi8plE4pnuHyHhk0q073DIfg8oFdALDNR5n_olGUg6FlT5Rnfz23Qix4BApGaNx2cHjtveAdgRQqvUcYm5X9bDyj5kgPWR9mgKWJavmqp4MfBjQeRSfn8IltY7XC8hmilpH-YI Jun 05 08:24:06.354435 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:24:06.354435 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:24:06.354435 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:24:06.354435 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:24:06.354435 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:24:06.354435 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:24:06.354435 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: ba602ab823574300b56acf7afebe6c58 Jun 05 08:24:06.354435 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-689221279 Jun 05 08:24:06.354435 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:24:06.354435 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:24:06.355557 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba602ab823574300b56acf7afebe6c58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba602ab823574300b56acf7afebe6c58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba602ab823574300b56acf7afebe6c58", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba602ab823574300b56acf7afebe6c58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:06.355557 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-689221279 Jun 05 08:24:06.355557 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: ba602ab823574300b56acf7afebe6c58 Jun 05 08:24:06.355557 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-689221279 Jun 05 08:24:06.355557 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-689221279-project Jun 05 08:24:06.355557 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:24:06.355557 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:24:06.355557 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 3b829fe307174f20baee36fa542de6ef Jun 05 08:24:06.355557 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-689221279-project Jun 05 08:24:06.355557 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:24:06.355557 n-d-844739-1 devstack@n-api.service[119050]: {"security_group_rule": {"parent_group_id": "14bc3b48-e812-4490-b3c3-d56af618b8ea", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jun 05 08:24:06.355557 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:24:06.356245 n-d-844739-1 devstack@n-api.service[119050]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jun 05 08:24:06.356245 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'body': {'security_group_rule': {'parent_group_id': '14bc3b48-e812-4490-b3c3-d56af618b8ea', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jun 05 08:24:06.356245 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:06.356245 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:06.356245 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 05 08:24:06.356245 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 05 08:24:06.356245 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 05 08:24:06.356245 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 05 08:24:06.356245 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 05 08:24:06.356245 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 05 08:24:06.356245 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jun 05 08:24:06.356245 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jun 05 08:24:06.356245 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jun 05 08:24:06.356245 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:06.356245 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:06.356245 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:06.356245 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:06.356245 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:06.356245 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:06.357234 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:06.357234 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:06.357234 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:24:06.357234 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:24:06.357234 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:06.357234 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:06.357234 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 05 08:24:06.357234 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 05 08:24:06.357234 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jun 05 08:24:06.357234 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:06.357234 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:06.357234 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:06.357234 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:06.357234 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:06.357234 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:06.357234 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:24:06.357234 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:24:06.357234 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jun 05 08:24:06.357234 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:06.358494 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-bd6dff16-5146-4bdd-9852-1d36bb50c7a0 tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:06.358494 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-bd6dff16-5146-4bdd-9852-1d36bb50c7a0 tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.100343 Jun 05 08:24:06.362520 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 143/278] 10.222.0.33 () {60 vars in 1194 bytes} [Sun Jun 5 08:24:06 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 05 08:24:06.364655 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5647e46a-ff45-4181-b67b-fb8047ccf019 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:06.365185 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5647e46a-ff45-4181-b67b-fb8047ccf019 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:06.365736 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-5647e46a-ff45-4181-b67b-fb8047ccf019 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lazy-loading 'fault' on Instance uuid 63dc26bf-e378-436f-a328-a88919547afc {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:06.368050 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a7be0bbd-c09e-4e55-850a-78cd66b4817a tempest-AggregatesAdminNegativeTestJSON-1071987933 tempest-AggregatesAdminNegativeTestJSON-1071987933-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:06.368836 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:06.368836 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:06.369673 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a7be0bbd-c09e-4e55-850a-78cd66b4817a tempest-AggregatesAdminNegativeTestJSON-1071987933 tempest-AggregatesAdminNegativeTestJSON-1071987933-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '5fad2defefb448dcbeae5ec878ea0db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74b51bf5aba419d84454fcfcd110610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:06.371770 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a7be0bbd-c09e-4e55-850a-78cd66b4817a tempest-AggregatesAdminNegativeTestJSON-1071987933 tempest-AggregatesAdminNegativeTestJSON-1071987933-project] Request method failure captured: Jun 05 08:24:06.371770 n-d-844739-1 devstack@n-api.service[119050]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Jun 05 08:24:06.371770 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:24:06.371770 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:24:06.371770 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:24:06.371770 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:24:06.371770 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:24:06.371770 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:24:06.371770 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:24:06.371770 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:06.371770 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGgFR7BRz94qVsrpu1OMzvz2l0k3w2zx_iPvpQDeGo06IjKT0SxUxbEJ7uhtVACyiKwc1jM_XbPjbv0RhhgQWj5Q4mr-aSETbgVoeSd_tafYTkUF9w01OFcmHqbg5Z9GfZR7F_-zYx5gGtvQAzIlZOsi4FGoWT5OcHitbEOkn_urLcA Jun 05 08:24:06.371770 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:24:06.371770 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:24:06.371770 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:24:06.371770 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:24:06.371770 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:24:06.371770 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:24:06.371770 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: b74b51bf5aba419d84454fcfcd110610 Jun 05 08:24:06.371770 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1071987933 Jun 05 08:24:06.371770 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:24:06.371770 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:24:06.372959 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b74b51bf5aba419d84454fcfcd110610"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b74b51bf5aba419d84454fcfcd110610"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b74b51bf5aba419d84454fcfcd110610", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b74b51bf5aba419d84454fcfcd110610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:06.372959 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1071987933 Jun 05 08:24:06.372959 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: b74b51bf5aba419d84454fcfcd110610 Jun 05 08:24:06.372959 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1071987933 Jun 05 08:24:06.372959 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-AggregatesAdminNegativeTestJSON-1071987933-project Jun 05 08:24:06.372959 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:24:06.372959 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:24:06.372959 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 5fad2defefb448dcbeae5ec878ea0db3 Jun 05 08:24:06.372959 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1071987933-project Jun 05 08:24:06.372959 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:24:06.372959 n-d-844739-1 devstack@n-api.service[119050]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jun 05 08:24:06.372959 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '15'} Jun 05 08:24:06.373582 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:06.373582 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:06.373582 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:06.373582 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:06.373582 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:06.373582 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:06.373582 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:06.373582 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:06.373582 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jun 05 08:24:06.373582 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jun 05 08:24:06.373582 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:24:06.373582 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:24:06.373582 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:24:06.373582 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:24:06.373582 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:24:06.373582 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:24:06.373582 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:24:06.373582 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:24:06.373582 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:24:06.377619 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:24:06.377619 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:24:06.377619 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:24:06.377619 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:24:06.377619 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:24:06.377619 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jun 05 08:24:06.377619 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:06.377619 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:06.377619 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:06.377619 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:06.377619 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:06.377619 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:06.377619 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:24:06.377619 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:24:06.377619 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jun 05 08:24:06.377619 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:06.377619 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a7be0bbd-c09e-4e55-850a-78cd66b4817a tempest-AggregatesAdminNegativeTestJSON-1071987933 tempest-AggregatesAdminNegativeTestJSON-1071987933-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:06.378711 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a7be0bbd-c09e-4e55-850a-78cd66b4817a tempest-AggregatesAdminNegativeTestJSON-1071987933 tempest-AggregatesAdminNegativeTestJSON-1071987933-project] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.010442 Jun 05 08:24:06.378711 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 144/279] 10.222.0.33 () {58 vars in 1154 bytes} [Sun Jun 5 08:24:06 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:24:06.380491 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1f238d71-3fd9-45b7-96f7-3711601ae97c tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Action: 'create', calling method: .version_select at 0x7f2433db4040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1115256798", "description": "tempest-description-303230243"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:06.451891 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5647e46a-ff45-4181-b67b-fb8047ccf019 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3429347e644bdca51b2b3b976a7bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9587ff19dfc4eefb5129656cbdf4a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:06.461436 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5647e46a-ff45-4181-b67b-fb8047ccf019 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] 10.222.0.33 "GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc" status: 200 len: 1368 microversion: 2.1 time: 0.145653 Jun 05 08:24:06.462807 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 136/280] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:06 2022] GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:06.467779 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-34231fd0-2b3c-4d55-9ab2-1c9cb9fb7bb1 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:06.468888 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:06.468888 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:06.512433 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-34231fd0-2b3c-4d55-9ab2-1c9cb9fb7bb1 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.048315 Jun 05 08:24:06.514116 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 137/281] 10.222.0.33 () {58 vars in 1154 bytes} [Sun Jun 5 08:24:06 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 05 08:24:06.525300 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c3f10558-d3fc-466e-ab79-53bbc4a1b42b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:06.526408 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c3f10558-d3fc-466e-ab79-53bbc4a1b42b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:06.535653 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c3f10558-d3fc-466e-ab79-53bbc4a1b42b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:06.536853 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c3f10558-d3fc-466e-ab79-53bbc4a1b42b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:06.538025 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c3f10558-d3fc-466e-ab79-53bbc4a1b42b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:06.538317 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c3f10558-d3fc-466e-ab79-53bbc4a1b42b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:06.580778 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c3f10558-d3fc-466e-ab79-53bbc4a1b42b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:06.581513 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c3f10558-d3fc-466e-ab79-53bbc4a1b42b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:06.582049 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-c3f10558-d3fc-466e-ab79-53bbc4a1b42b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid 8cddf461-3546-4475-91c7-419b46a255af {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:06.754703 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c3f10558-d3fc-466e-ab79-53bbc4a1b42b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:06.767478 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c3f10558-d3fc-466e-ab79-53bbc4a1b42b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 200 len: 1364 microversion: 2.1 time: 0.246420 Jun 05 08:24:06.784180 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 138/282] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:06 2022] GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 1364 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:06.804249 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-cab92406-ddf4-49c6-8181-97ef507196f9 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:06.805038 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:06.805038 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:06.814893 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1f238d71-3fd9-45b7-96f7-3711601ae97c tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.439046 Jun 05 08:24:06.815514 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 145/283] 10.222.0.33 () {60 vars in 1179 bytes} [Sun Jun 5 08:24:06 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:06.820448 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-48e4fb80-0829-46c9-9b43-e6e3e15a24b7 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:06.821374 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-48e4fb80-0829-46c9-9b43-e6e3e15a24b7 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: e4c09fb3-f67f-4b07-a992-2e70683932bd] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:06.825728 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-cab92406-ddf4-49c6-8181-97ef507196f9 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jun 05 08:24:06.827494 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-cab92406-ddf4-49c6-8181-97ef507196f9 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Request method failure captured: Jun 05 08:24:06.827494 n-d-844739-1 devstack@n-api.service[119049]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jun 05 08:24:06.827494 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:24:06.827494 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:24:06.827494 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:24:06.827494 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:24:06.827494 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:24:06.827494 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:24:06.827494 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:24:06.827494 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:06.827494 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGgIRZ2w5RYMc-xJAJAW0Au2dlUXKz-nyQAmHbUmmgk7S8GMjTamz5c7cQPYC36qdAn3gD5Y1scW4h_CJuLFHq-YVgLlesWCG79ZEh6998Ouiktqxh8Ungx_1AvcIIZp5TYYkRV595HGTi0WikuwtFk_QhG2D06ZrHaZMk_tsl7sDm8 Jun 05 08:24:06.827494 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:24:06.827494 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:24:06.827494 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:24:06.827494 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:24:06.827494 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:24:06.827494 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:24:06.827494 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: c0c2c53930be48d2a79494d8e5fdf4de Jun 05 08:24:06.827494 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1245114998 Jun 05 08:24:06.827494 n-d-844739-1 devstack@n-api.service[119049]: X-Role: admin,reader,member Jun 05 08:24:06.827494 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: admin,reader,member Jun 05 08:24:06.828911 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c0c2c53930be48d2a79494d8e5fdf4de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0c2c53930be48d2a79494d8e5fdf4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c0c2c53930be48d2a79494d8e5fdf4de", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0c2c53930be48d2a79494d8e5fdf4de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:06.828911 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1245114998 Jun 05 08:24:06.828911 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: c0c2c53930be48d2a79494d8e5fdf4de Jun 05 08:24:06.828911 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1245114998 Jun 05 08:24:06.828911 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin Jun 05 08:24:06.828911 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:24:06.828911 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:24:06.828911 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 2e73595af34542108dfc5bfec02cbe79 Jun 05 08:24:06.828911 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin Jun 05 08:24:06.828911 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:24:06.828911 n-d-844739-1 devstack@n-api.service[119049]: exception: Aggregate -1 could not be found. Jun 05 08:24:06.828911 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '-1'} Jun 05 08:24:06.829682 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:06.829682 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:06.829682 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jun 05 08:24:06.829682 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jun 05 08:24:06.829682 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 05 08:24:06.829682 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 05 08:24:06.829682 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:24:06.829682 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:24:06.829682 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:24:06.829682 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:24:06.829682 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 05 08:24:06.829682 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 05 08:24:06.829682 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jun 05 08:24:06.829682 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jun 05 08:24:06.829682 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:24:06.829682 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:24:06.829682 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 05 08:24:06.829682 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 05 08:24:06.829682 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 05 08:24:06.830877 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 05 08:24:06.830877 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 05 08:24:06.830877 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 05 08:24:06.830877 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jun 05 08:24:06.830877 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:06.830877 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:06.830877 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:06.830877 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:06.830877 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:06.830877 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:06.830877 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:06.830877 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:06.830877 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:06.830877 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:06.830877 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jun 05 08:24:06.830877 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:24:06.830877 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jun 05 08:24:06.830877 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:06.830877 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:06.830877 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:06.830877 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:06.832564 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:06.832564 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:06.832564 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:24:06.832564 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:24:06.832564 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jun 05 08:24:06.832564 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:06.832564 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-cab92406-ddf4-49c6-8181-97ef507196f9 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:06.832564 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-cab92406-ddf4-49c6-8181-97ef507196f9 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.043369 Jun 05 08:24:06.832564 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 139/284] 10.222.0.33 () {58 vars in 1154 bytes} [Sun Jun 5 08:24:06 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:24:06.834657 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-c8e3e8f7-76a1-48d1-a5bd-b0a61b5ae1d5 req-e9961a43-1fab-475d-9f58-80407c1142fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "969237ff-17eb-4838-9c3d-68dcbc1f94ca", "name": "network-vif-plugged", "status": "completed", "tag": "b5f2e58e-0349-480d-8927-484d2f39dee5"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:06.857732 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-48e4fb80-0829-46c9-9b43-e6e3e15a24b7 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:06.858282 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-48e4fb80-0829-46c9-9b43-e6e3e15a24b7 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:06.859031 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-c8e3e8f7-76a1-48d1-a5bd-b0a61b5ae1d5 req-e9961a43-1fab-475d-9f58-80407c1142fb service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:06.859347 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-48e4fb80-0829-46c9-9b43-e6e3e15a24b7 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:06.859481 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-c8e3e8f7-76a1-48d1-a5bd-b0a61b5ae1d5 req-e9961a43-1fab-475d-9f58-80407c1142fb service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:06.859770 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-48e4fb80-0829-46c9-9b43-e6e3e15a24b7 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:06.896733 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-c8e3e8f7-76a1-48d1-a5bd-b0a61b5ae1d5 req-e9961a43-1fab-475d-9f58-80407c1142fb service nova] Creating event network-vif-plugged:b5f2e58e-0349-480d-8927-484d2f39dee5 for instance 969237ff-17eb-4838-9c3d-68dcbc1f94ca on n-h1-844739-1 Jun 05 08:24:06.921912 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-c8e3e8f7-76a1-48d1-a5bd-b0a61b5ae1d5 req-e9961a43-1fab-475d-9f58-80407c1142fb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091255 Jun 05 08:24:06.927114 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 140/285] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:06.932718 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4def22ba-ec5a-4db0-b69b-a1d3f81dac77 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:06.933678 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4def22ba-ec5a-4db0-b69b-a1d3f81dac77 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 98766f8e-7b27-49e9-8565-4bc9c3e808d8] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:06.947161 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4def22ba-ec5a-4db0-b69b-a1d3f81dac77 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:06.952370 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4def22ba-ec5a-4db0-b69b-a1d3f81dac77 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:06.953473 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4def22ba-ec5a-4db0-b69b-a1d3f81dac77 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:06.954103 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4def22ba-ec5a-4db0-b69b-a1d3f81dac77 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:07.106716 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4def22ba-ec5a-4db0-b69b-a1d3f81dac77 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:07.117009 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4def22ba-ec5a-4db0-b69b-a1d3f81dac77 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8" status: 200 len: 1289 microversion: 2.1 time: 0.188354 Jun 05 08:24:07.118160 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 141/286] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:06 2022] GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8 => generated 1289 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:07.131133 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bc019c44-581a-4618-9b7a-3dc6bd91eaae tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Action: 'create', calling method: .version_select at 0x7f2440050940>, body: {"security_group_rule": {"parent_group_id": "5128ee40-93a4-431c-a4c2-399823a2def7", "ip_protocol": "tcp", "from_port": 22, "to_port": 1611806129}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:07.259089 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-48e4fb80-0829-46c9-9b43-e6e3e15a24b7 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:07.271514 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-48e4fb80-0829-46c9-9b43-e6e3e15a24b7 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd" status: 200 len: 1588 microversion: 2.1 time: 0.454411 Jun 05 08:24:07.271913 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 146/287] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:06 2022] GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd => generated 1588 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:07.288300 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-bc019c44-581a-4618-9b7a-3dc6bd91eaae tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] HTTP exception thrown: Invalid port range 22:1611806129. Valid TCP ports should be between 1-65535 Jun 05 08:24:07.290551 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bc019c44-581a-4618-9b7a-3dc6bd91eaae tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Request method failure captured: Jun 05 08:24:07.290551 n-d-844739-1 devstack@n-api.service[119049]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 05 08:24:07.290551 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:24:07.290551 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:24:07.290551 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:24:07.290551 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 146 Jun 05 08:24:07.290551 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:24:07.290551 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:24:07.290551 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:24:07.290551 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:07.290551 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGgi_mobQeYIY4rKAF6MX2eJMDlGP5Psyfjisk28tLi8plE4pnuHyHhk0q073DIfg8oFdALDNR5n_olGUg6FlT5Rnfz23Qix4BApGaNx2cHjtveAdgRQqvUcYm5X9bDyj5kgPWR9mgKWJavmqp4MfBjQeRSfn8IltY7XC8hmilpH-YI Jun 05 08:24:07.290551 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:24:07.290551 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:24:07.290551 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:24:07.290551 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:24:07.290551 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:24:07.290551 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:24:07.290551 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: ba602ab823574300b56acf7afebe6c58 Jun 05 08:24:07.290551 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-689221279 Jun 05 08:24:07.290551 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:24:07.290551 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:24:07.291701 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba602ab823574300b56acf7afebe6c58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba602ab823574300b56acf7afebe6c58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba602ab823574300b56acf7afebe6c58", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba602ab823574300b56acf7afebe6c58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:07.291701 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-689221279 Jun 05 08:24:07.291701 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: ba602ab823574300b56acf7afebe6c58 Jun 05 08:24:07.291701 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-689221279 Jun 05 08:24:07.291701 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-689221279-project Jun 05 08:24:07.291701 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:24:07.291701 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:24:07.291701 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 3b829fe307174f20baee36fa542de6ef Jun 05 08:24:07.291701 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-689221279-project Jun 05 08:24:07.291701 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:24:07.291701 n-d-844739-1 devstack@n-api.service[119049]: {"security_group_rule": {"parent_group_id": "5128ee40-93a4-431c-a4c2-399823a2def7", "ip_protocol": "tcp", "from_port": 22, "to_port": 1611806129}} Jun 05 08:24:07.291701 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:24:07.292529 n-d-844739-1 devstack@n-api.service[119049]: exception: Invalid port range 22:1611806129. Valid TCP ports should be between 1-65535 Jun 05 08:24:07.292529 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5128ee40-93a4-431c-a4c2-399823a2def7', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1611806129}}} Jun 05 08:24:07.292529 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:07.292529 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:07.292529 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 05 08:24:07.292529 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 05 08:24:07.292529 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 05 08:24:07.292529 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 05 08:24:07.292529 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 05 08:24:07.292529 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 05 08:24:07.292529 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jun 05 08:24:07.292529 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jun 05 08:24:07.292529 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1611806129. Valid TCP ports should be between 1-65535 Jun 05 08:24:07.292529 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:07.292529 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:07.292529 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:07.292529 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:07.292529 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:07.292529 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:07.294028 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:07.294028 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:07.294028 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:24:07.294028 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:24:07.294028 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:07.294028 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:07.294028 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 05 08:24:07.294028 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 05 08:24:07.294028 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1611806129. Valid TCP ports should be between 1-65535 Jun 05 08:24:07.294028 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:07.294028 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:07.294028 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:07.294028 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:07.294028 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:07.294028 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:07.294028 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:24:07.294028 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:24:07.294028 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1611806129. Valid TCP ports should be between 1-65535 Jun 05 08:24:07.294028 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:07.300675 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bc019c44-581a-4618-9b7a-3dc6bd91eaae tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Returning 400 to user: Invalid port range 22:1611806129. Valid TCP ports should be between 1-65535 {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:07.300675 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bc019c44-581a-4618-9b7a-3dc6bd91eaae tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.174726 Jun 05 08:24:07.300675 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 142/288] 10.222.0.33 () {60 vars in 1194 bytes} [Sun Jun 5 08:24:07 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 176 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 05 08:24:07.301926 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1ce90d1a-b263-4d34-8c29-21a4f7dd7d23 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1372697326"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:07.302335 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e55b9b2c-22c6-4e96-a4ae-ca9e69de233d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-414071924", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:07.305488 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:07.305488 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:07.307150 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.aggregate [None req-1ce90d1a-b263-4d34-8c29-21a4f7dd7d23 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Generated uuid cb0e8d48-a4d9-4a08-b917-d97e44764b87 for aggregate {{(pid=119050) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 05 08:24:07.344730 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1ce90d1a-b263-4d34-8c29-21a4f7dd7d23 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.059248 Jun 05 08:24:07.347740 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 147/289] 10.222.0.33 () {60 vars in 1163 bytes} [Sun Jun 5 08:24:07 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:07.362074 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a0919a7d-71c4-4a2e-b790-2614d31f5c0a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:07.362849 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a0919a7d-71c4-4a2e-b790-2614d31f5c0a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:07.370038 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-e55b9b2c-22c6-4e96-a4ae-ca9e69de233d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] validate_networks() for None {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:24:07.376617 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a0919a7d-71c4-4a2e-b790-2614d31f5c0a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:07.377555 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a0919a7d-71c4-4a2e-b790-2614d31f5c0a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:07.378842 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a0919a7d-71c4-4a2e-b790-2614d31f5c0a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:07.379343 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a0919a7d-71c4-4a2e-b790-2614d31f5c0a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:07.658288 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a0919a7d-71c4-4a2e-b790-2614d31f5c0a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:07.671072 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a0919a7d-71c4-4a2e-b790-2614d31f5c0a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1310 microversion: 2.1 time: 0.315359 Jun 05 08:24:07.672647 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 148/290] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:07 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1310 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:07.677856 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6841b432-782d-4a7a-bc36-6d5db0e2323b tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:07.678423 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6841b432-782d-4a7a-bc36-6d5db0e2323b tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: e4c09fb3-f67f-4b07-a992-2e70683932bd] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:07.713879 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6841b432-782d-4a7a-bc36-6d5db0e2323b tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:07.713879 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6841b432-782d-4a7a-bc36-6d5db0e2323b tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:07.714535 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6841b432-782d-4a7a-bc36-6d5db0e2323b tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:07.714976 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6841b432-782d-4a7a-bc36-6d5db0e2323b tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:07.767199 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-e55b9b2c-22c6-4e96-a4ae-ca9e69de233d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:24:07.767654 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-e55b9b2c-22c6-4e96-a4ae-ca9e69de233d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:24:07.768262 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-e55b9b2c-22c6-4e96-a4ae-ca9e69de233d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:24:07.768839 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-e55b9b2c-22c6-4e96-a4ae-ca9e69de233d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:24:07.769256 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-e55b9b2c-22c6-4e96-a4ae-ca9e69de233d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:24:07.787851 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e55b9b2c-22c6-4e96-a4ae-ca9e69de233d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:07.788443 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e55b9b2c-22c6-4e96-a4ae-ca9e69de233d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:07.792225 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e55b9b2c-22c6-4e96-a4ae-ca9e69de233d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:07.792689 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e55b9b2c-22c6-4e96-a4ae-ca9e69de233d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:07.837955 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-e55b9b2c-22c6-4e96-a4ae-ca9e69de233d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Getting quotas for project 1ff420b4eb2442d3b779708d6fe78c1e. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:24:07.846370 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-e55b9b2c-22c6-4e96-a4ae-ca9e69de233d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Getting quotas for user 937d94e450c7457483bc6f6a03332644 and project 1ff420b4eb2442d3b779708d6fe78c1e. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:24:07.856116 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6841b432-782d-4a7a-bc36-6d5db0e2323b tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.182022 Jun 05 08:24:07.856565 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 149/291] 10.222.0.33 () {58 vars in 1274 bytes} [Sun Jun 5 08:24:07 2022] GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd/os-interface => generated 284 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:07.861225 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-42f81264-4133-4802-b699-443fd01cc26a tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Action: 'create', calling method: .version_select at 0x7f2433f34160>, body: {"security_group_rule": {"parent_group_id": "c15ca1f3-8669-4c97-bbe2-75e86b978260", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:07.887976 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e55b9b2c-22c6-4e96-a4ae-ca9e69de233d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:24:07.891073 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e55b9b2c-22c6-4e96-a4ae-ca9e69de233d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:24:07.900019 n-d-844739-1 devstack@n-api.service[119050]: DEBUG neutronclient.v2_0.client [None req-42f81264-4133-4802-b699-443fd01cc26a tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c15ca1f3-8669-4c97-bbe2-75e86b978260 does not exist", "detail": ""}} {{(pid=119050) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 05 08:24:07.900645 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.security_group_api [None req-42f81264-4133-4802-b699-443fd01cc26a tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Neutron security group c15ca1f3-8669-4c97-bbe2-75e86b978260 not found {{(pid=119050) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 05 08:24:07.901168 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-42f81264-4133-4802-b699-443fd01cc26a tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] HTTP exception thrown: Security group c15ca1f3-8669-4c97-bbe2-75e86b978260 does not exist Jun 05 08:24:07.901168 n-d-844739-1 devstack@n-api.service[119050]: Neutron server returns request_ids: ['req-055c2d69-d8ed-4a1c-bd6f-5d3e427a035b'] Jun 05 08:24:07.916178 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4,nova_api:DELETE=8 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:07.916422 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-42f81264-4133-4802-b699-443fd01cc26a tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Request method failure captured: Jun 05 08:24:07.916422 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 05 08:24:07.916422 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:24:07.916422 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:24:07.916422 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:24:07.916422 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 138 Jun 05 08:24:07.916422 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:24:07.916422 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:24:07.916422 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:24:07.916422 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:07.916422 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGgi_mobQeYIY4rKAF6MX2eJMDlGP5Psyfjisk28tLi8plE4pnuHyHhk0q073DIfg8oFdALDNR5n_olGUg6FlT5Rnfz23Qix4BApGaNx2cHjtveAdgRQqvUcYm5X9bDyj5kgPWR9mgKWJavmqp4MfBjQeRSfn8IltY7XC8hmilpH-YI Jun 05 08:24:07.916422 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:24:07.916422 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:24:07.916422 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:24:07.916422 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:24:07.916422 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:24:07.916422 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:24:07.916422 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: ba602ab823574300b56acf7afebe6c58 Jun 05 08:24:07.916422 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-689221279 Jun 05 08:24:07.916422 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:24:07.916422 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:24:07.917630 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba602ab823574300b56acf7afebe6c58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba602ab823574300b56acf7afebe6c58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba602ab823574300b56acf7afebe6c58", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba602ab823574300b56acf7afebe6c58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:07.917630 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-689221279 Jun 05 08:24:07.917630 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: ba602ab823574300b56acf7afebe6c58 Jun 05 08:24:07.917630 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-689221279 Jun 05 08:24:07.917630 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-689221279-project Jun 05 08:24:07.917630 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:24:07.917630 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:24:07.917630 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 3b829fe307174f20baee36fa542de6ef Jun 05 08:24:07.917630 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-689221279-project Jun 05 08:24:07.917630 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:24:07.917630 n-d-844739-1 devstack@n-api.service[119050]: {"security_group_rule": {"parent_group_id": "c15ca1f3-8669-4c97-bbe2-75e86b978260", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jun 05 08:24:07.917630 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:24:07.918282 n-d-844739-1 devstack@n-api.service[119050]: exception: Security group c15ca1f3-8669-4c97-bbe2-75e86b978260 does not exist Jun 05 08:24:07.918282 n-d-844739-1 devstack@n-api.service[119050]: Neutron server returns request_ids: ['req-055c2d69-d8ed-4a1c-bd6f-5d3e427a035b'] Jun 05 08:24:07.918282 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c15ca1f3-8669-4c97-bbe2-75e86b978260', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jun 05 08:24:07.918282 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:07.918282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:07.918282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 05 08:24:07.918282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 05 08:24:07.918282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:24:07.918282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:24:07.918282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 05 08:24:07.918282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 05 08:24:07.918282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:24:07.918282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:24:07.918282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 05 08:24:07.918282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 05 08:24:07.918282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:24:07.918282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:24:07.918282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 05 08:24:07.918282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 05 08:24:07.919290 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:24:07.919290 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:24:07.919290 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 05 08:24:07.919290 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 05 08:24:07.919290 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:24:07.919290 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:24:07.919290 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 05 08:24:07.919290 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 05 08:24:07.919290 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 05 08:24:07.919290 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 05 08:24:07.919290 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c15ca1f3-8669-4c97-bbe2-75e86b978260 does not exist Jun 05 08:24:07.919290 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-055c2d69-d8ed-4a1c-bd6f-5d3e427a035b'] Jun 05 08:24:07.919290 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:07.919290 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:07.919290 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:07.919290 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:07.919290 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jun 05 08:24:07.919290 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jun 05 08:24:07.919290 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 05 08:24:07.920310 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 05 08:24:07.920310 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c15ca1f3-8669-4c97-bbe2-75e86b978260 does not exist Jun 05 08:24:07.920310 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-055c2d69-d8ed-4a1c-bd6f-5d3e427a035b'] Jun 05 08:24:07.920310 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:07.920310 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:07.920310 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:07.920310 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:07.920310 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:07.920310 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:07.920310 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:07.920310 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:07.920310 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:24:07.920310 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:24:07.920310 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:07.920310 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:07.920310 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jun 05 08:24:07.920310 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 05 08:24:07.920310 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c15ca1f3-8669-4c97-bbe2-75e86b978260 does not exist Jun 05 08:24:07.920310 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-055c2d69-d8ed-4a1c-bd6f-5d3e427a035b'] Jun 05 08:24:07.920310 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:07.922561 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:07.922561 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:07.922561 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:07.922561 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:07.922561 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:07.922561 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:24:07.922561 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:24:07.922561 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c15ca1f3-8669-4c97-bbe2-75e86b978260 does not exist Jun 05 08:24:07.922561 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-055c2d69-d8ed-4a1c-bd6f-5d3e427a035b'] Jun 05 08:24:07.922561 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:07.922561 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-42f81264-4133-4802-b699-443fd01cc26a tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Returning 404 to user: Security group c15ca1f3-8669-4c97-bbe2-75e86b978260 does not exist Jun 05 08:24:07.922561 n-d-844739-1 devstack@n-api.service[119050]: Neutron server returns request_ids: ['req-055c2d69-d8ed-4a1c-bd6f-5d3e427a035b'] {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:07.922561 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-42f81264-4133-4802-b699-443fd01cc26a tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.060853 Jun 05 08:24:07.923835 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 150/292] 10.222.0.33 () {60 vars in 1194 bytes} [Sun Jun 5 08:24:07 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:24:07.937450 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fbdc33ec-db3f-4dca-bb94-8db967cc3c2a tempest-AggregatesAdminNegativeTestJSON-1071987933 tempest-AggregatesAdminNegativeTestJSON-1071987933-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:07.938277 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:07.938277 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:07.940363 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-fbdc33ec-db3f-4dca-bb94-8db967cc3c2a tempest-AggregatesAdminNegativeTestJSON-1071987933 tempest-AggregatesAdminNegativeTestJSON-1071987933-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '5fad2defefb448dcbeae5ec878ea0db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74b51bf5aba419d84454fcfcd110610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:07.946633 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fbdc33ec-db3f-4dca-bb94-8db967cc3c2a tempest-AggregatesAdminNegativeTestJSON-1071987933 tempest-AggregatesAdminNegativeTestJSON-1071987933-project] Request method failure captured: Jun 05 08:24:07.946633 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Jun 05 08:24:07.946633 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:24:07.946633 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:24:07.946633 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:24:07.946633 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:24:07.946633 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:24:07.946633 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:24:07.946633 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:24:07.946633 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:07.946633 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGgFR7BRz94qVsrpu1OMzvz2l0k3w2zx_iPvpQDeGo06IjKT0SxUxbEJ7uhtVACyiKwc1jM_XbPjbv0RhhgQWj5Q4mr-aSETbgVoeSd_tafYTkUF9w01OFcmHqbg5Z9GfZR7F_-zYx5gGtvQAzIlZOsi4FGoWT5OcHitbEOkn_urLcA Jun 05 08:24:07.946633 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:24:07.946633 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:24:07.946633 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:24:07.946633 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:24:07.946633 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:24:07.946633 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:24:07.946633 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: b74b51bf5aba419d84454fcfcd110610 Jun 05 08:24:07.946633 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1071987933 Jun 05 08:24:07.946633 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:24:07.946633 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:24:07.948136 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b74b51bf5aba419d84454fcfcd110610"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b74b51bf5aba419d84454fcfcd110610"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b74b51bf5aba419d84454fcfcd110610", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b74b51bf5aba419d84454fcfcd110610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:07.948136 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1071987933 Jun 05 08:24:07.948136 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: b74b51bf5aba419d84454fcfcd110610 Jun 05 08:24:07.948136 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1071987933 Jun 05 08:24:07.948136 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-AggregatesAdminNegativeTestJSON-1071987933-project Jun 05 08:24:07.948136 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:24:07.948136 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:24:07.948136 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 5fad2defefb448dcbeae5ec878ea0db3 Jun 05 08:24:07.948136 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1071987933-project Jun 05 08:24:07.948136 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:24:07.948136 n-d-844739-1 devstack@n-api.service[119050]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jun 05 08:24:07.948136 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '16'} Jun 05 08:24:07.948951 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:07.948951 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:07.948951 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:07.948951 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:07.948951 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:07.948951 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:07.948951 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:07.948951 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:07.948951 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jun 05 08:24:07.948951 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jun 05 08:24:07.948951 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:24:07.948951 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:24:07.948951 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:24:07.948951 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:24:07.948951 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:24:07.948951 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:24:07.948951 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:24:07.948951 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:24:07.948951 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:24:07.950132 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:24:07.950132 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:24:07.950132 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:24:07.950132 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:24:07.950132 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:24:07.950132 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jun 05 08:24:07.950132 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:07.950132 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:07.950132 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:07.950132 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:07.950132 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:07.950132 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:07.950132 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:24:07.950132 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:24:07.950132 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jun 05 08:24:07.950132 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:07.952433 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fbdc33ec-db3f-4dca-bb94-8db967cc3c2a tempest-AggregatesAdminNegativeTestJSON-1071987933 tempest-AggregatesAdminNegativeTestJSON-1071987933-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:07.953521 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fbdc33ec-db3f-4dca-bb94-8db967cc3c2a tempest-AggregatesAdminNegativeTestJSON-1071987933 tempest-AggregatesAdminNegativeTestJSON-1071987933-project] 10.222.0.33 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.026038 Jun 05 08:24:07.958750 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 151/293] 10.222.0.33 () {58 vars in 1151 bytes} [Sun Jun 5 08:24:07 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:24:07.967259 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1530e2d4-ab95-4719-800c-ad6681ac9818 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:07.968722 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1530e2d4-ab95-4719-800c-ad6681ac9818 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] [instance: 63dc26bf-e378-436f-a328-a88919547afc] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:07.981726 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1530e2d4-ab95-4719-800c-ad6681ac9818 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:07.982443 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1530e2d4-ab95-4719-800c-ad6681ac9818 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:07.983693 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1530e2d4-ab95-4719-800c-ad6681ac9818 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:07.984344 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1530e2d4-ab95-4719-800c-ad6681ac9818 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:08.027053 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1530e2d4-ab95-4719-800c-ad6681ac9818 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:08.027766 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1530e2d4-ab95-4719-800c-ad6681ac9818 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:08.028266 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-1530e2d4-ab95-4719-800c-ad6681ac9818 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Lazy-loading 'fault' on Instance uuid 63dc26bf-e378-436f-a328-a88919547afc {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:08.030455 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e55b9b2c-22c6-4e96-a4ae-ca9e69de233d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.734811 Jun 05 08:24:08.031108 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 143/294] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:24:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:24:08.035632 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d2efa4d8-9afc-4d70-9559-d18568f827ee tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Calling method '.version_select at 0x7f244007a1f0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:08.065806 n-d-844739-1 devstack@n-api.service[119049]: DEBUG neutronclient.v2_0.client [None req-d2efa4d8-9afc-4d70-9559-d18568f827ee tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule b3774155-a5a3-4633-87f6-ccc11ada6014 does not exist", "detail": ""}} {{(pid=119049) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 05 08:24:08.069361 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.security_group_api [None req-d2efa4d8-9afc-4d70-9559-d18568f827ee tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Neutron security group rule b3774155-a5a3-4633-87f6-ccc11ada6014 not found {{(pid=119049) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jun 05 08:24:08.070037 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-d2efa4d8-9afc-4d70-9559-d18568f827ee tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] HTTP exception thrown: Security group rule b3774155-a5a3-4633-87f6-ccc11ada6014 does not exist Jun 05 08:24:08.070037 n-d-844739-1 devstack@n-api.service[119049]: Neutron server returns request_ids: ['req-7654947d-c14f-43d4-932d-ccc59cde0c72'] Jun 05 08:24:08.075878 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d2efa4d8-9afc-4d70-9559-d18568f827ee tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Request method failure captured: Jun 05 08:24:08.075878 n-d-844739-1 devstack@n-api.service[119049]: request: DELETE /compute/v2.1/os-security-group-rules/b3774155-a5a3-4633-87f6-ccc11ada6014 HTTP/1.1 Jun 05 08:24:08.075878 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:24:08.075878 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:24:08.075878 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:24:08.075878 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:24:08.075878 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:24:08.075878 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:24:08.075878 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:24:08.075878 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:08.075878 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGgi_mobQeYIY4rKAF6MX2eJMDlGP5Psyfjisk28tLi8plE4pnuHyHhk0q073DIfg8oFdALDNR5n_olGUg6FlT5Rnfz23Qix4BApGaNx2cHjtveAdgRQqvUcYm5X9bDyj5kgPWR9mgKWJavmqp4MfBjQeRSfn8IltY7XC8hmilpH-YI Jun 05 08:24:08.075878 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:24:08.075878 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:24:08.075878 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:24:08.075878 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:24:08.075878 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:24:08.075878 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:24:08.075878 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: ba602ab823574300b56acf7afebe6c58 Jun 05 08:24:08.075878 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-689221279 Jun 05 08:24:08.075878 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:24:08.075878 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:24:08.077359 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba602ab823574300b56acf7afebe6c58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba602ab823574300b56acf7afebe6c58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba602ab823574300b56acf7afebe6c58", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba602ab823574300b56acf7afebe6c58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:08.077359 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-689221279 Jun 05 08:24:08.077359 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: ba602ab823574300b56acf7afebe6c58 Jun 05 08:24:08.077359 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-689221279 Jun 05 08:24:08.077359 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-689221279-project Jun 05 08:24:08.077359 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:24:08.077359 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:24:08.077359 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 3b829fe307174f20baee36fa542de6ef Jun 05 08:24:08.077359 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-689221279-project Jun 05 08:24:08.077359 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:24:08.077359 n-d-844739-1 devstack@n-api.service[119049]: exception: Security group rule b3774155-a5a3-4633-87f6-ccc11ada6014 does not exist Jun 05 08:24:08.077359 n-d-844739-1 devstack@n-api.service[119049]: Neutron server returns request_ids: ['req-7654947d-c14f-43d4-932d-ccc59cde0c72'] Jun 05 08:24:08.077990 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'b3774155-a5a3-4633-87f6-ccc11ada6014'} Jun 05 08:24:08.077990 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:08.077990 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:08.077990 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jun 05 08:24:08.077990 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jun 05 08:24:08.077990 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:24:08.077990 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:24:08.077990 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jun 05 08:24:08.077990 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jun 05 08:24:08.077990 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:24:08.077990 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:24:08.077990 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 05 08:24:08.077990 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 05 08:24:08.077990 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:24:08.077990 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:24:08.077990 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 05 08:24:08.077990 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 05 08:24:08.077990 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:24:08.077990 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:24:08.078954 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 05 08:24:08.078954 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 05 08:24:08.078954 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:24:08.078954 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:24:08.078954 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 05 08:24:08.078954 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 05 08:24:08.078954 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 05 08:24:08.078954 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 05 08:24:08.078954 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule b3774155-a5a3-4633-87f6-ccc11ada6014 does not exist Jun 05 08:24:08.078954 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7654947d-c14f-43d4-932d-ccc59cde0c72'] Jun 05 08:24:08.078954 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:08.078954 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:08.078954 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:08.078954 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:08.078954 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jun 05 08:24:08.078954 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jun 05 08:24:08.078954 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jun 05 08:24:08.078954 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 05 08:24:08.079900 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule b3774155-a5a3-4633-87f6-ccc11ada6014 does not exist Jun 05 08:24:08.079900 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7654947d-c14f-43d4-932d-ccc59cde0c72'] Jun 05 08:24:08.079900 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:08.079900 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:08.079900 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:08.079900 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:08.079900 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:08.079900 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:08.079900 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:08.079900 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:08.079900 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:24:08.079900 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:24:08.079900 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:08.079900 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:08.079900 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jun 05 08:24:08.079900 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 05 08:24:08.079900 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule b3774155-a5a3-4633-87f6-ccc11ada6014 does not exist Jun 05 08:24:08.079900 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7654947d-c14f-43d4-932d-ccc59cde0c72'] Jun 05 08:24:08.079900 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:08.079900 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:08.080950 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:08.080950 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:08.080950 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:08.080950 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:08.080950 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:24:08.080950 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:24:08.080950 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule b3774155-a5a3-4633-87f6-ccc11ada6014 does not exist Jun 05 08:24:08.080950 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7654947d-c14f-43d4-932d-ccc59cde0c72'] Jun 05 08:24:08.080950 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:08.080950 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d2efa4d8-9afc-4d70-9559-d18568f827ee tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Returning 404 to user: Security group rule b3774155-a5a3-4633-87f6-ccc11ada6014 does not exist Jun 05 08:24:08.080950 n-d-844739-1 devstack@n-api.service[119049]: Neutron server returns request_ids: ['req-7654947d-c14f-43d4-932d-ccc59cde0c72'] {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:08.081526 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d2efa4d8-9afc-4d70-9559-d18568f827ee tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-group-rules/b3774155-a5a3-4633-87f6-ccc11ada6014" status: 404 len: 199 microversion: 2.1 time: 0.049120 Jun 05 08:24:08.088352 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 144/295] 10.222.0.33 () {58 vars in 1286 bytes} [Sun Jun 5 08:24:08 2022] DELETE /compute/v2.1/os-security-group-rules/b3774155-a5a3-4633-87f6-ccc11ada6014 => generated 199 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:24:08.100552 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b5c07a7b-d176-4af7-a7e2-996c61fb689e tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:08.103725 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:08.103725 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:08.152113 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1530e2d4-ab95-4719-800c-ad6681ac9818 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd3429347e644bdca51b2b3b976a7bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9587ff19dfc4eefb5129656cbdf4a97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:08.155429 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b5c07a7b-d176-4af7-a7e2-996c61fb689e tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.068079 Jun 05 08:24:08.160083 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 145/296] 10.222.0.33 () {58 vars in 1154 bytes} [Sun Jun 5 08:24:08 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 05 08:24:08.164529 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1530e2d4-ab95-4719-800c-ad6681ac9818 tempest-AggregatesAdminTestJSON-1472665320 tempest-AggregatesAdminTestJSON-1472665320-project] 10.222.0.33 "GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc" status: 200 len: 1362 microversion: 2.1 time: 0.203931 Jun 05 08:24:08.168030 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-77a99105-f3f8-4964-9de5-839dac28db1d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:08.168876 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-77a99105-f3f8-4964-9de5-839dac28db1d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:08.170061 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 152/297] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:07 2022] GET /compute/v2.1/servers/63dc26bf-e378-436f-a328-a88919547afc => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:08.186640 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0e97a5d9-e169-4af1-8855-ee7c7194d1bb tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Calling method '.version_select at 0x7f2433f08550>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:08.287988 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-77a99105-f3f8-4964-9de5-839dac28db1d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:08.303650 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-77a99105-f3f8-4964-9de5-839dac28db1d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1219 microversion: 2.1 time: 0.142727 Jun 05 08:24:08.305318 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 146/298] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:08 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1219 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:08.319307 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b6011f88-1c51-4194-b105-fd7de6be9273 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:08.319943 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b6011f88-1c51-4194-b105-fd7de6be9273 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 98766f8e-7b27-49e9-8565-4bc9c3e808d8] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:08.344980 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b6011f88-1c51-4194-b105-fd7de6be9273 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:08.345493 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b6011f88-1c51-4194-b105-fd7de6be9273 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:08.346289 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b6011f88-1c51-4194-b105-fd7de6be9273 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:08.346786 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b6011f88-1c51-4194-b105-fd7de6be9273 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:08.693703 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b6011f88-1c51-4194-b105-fd7de6be9273 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:08.699994 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:08.707452 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b6011f88-1c51-4194-b105-fd7de6be9273 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8" status: 200 len: 1319 microversion: 2.1 time: 0.397056 Jun 05 08:24:08.709363 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 147/299] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:08 2022] GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8 => generated 1319 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:08.720706 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0e97a5d9-e169-4af1-8855-ee7c7194d1bb tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/5128ee40-93a4-431c-a4c2-399823a2def7" status: 202 len: 0 microversion: 2.1 time: 0.547029 Jun 05 08:24:08.722190 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 153/300] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:24:08 2022] DELETE /compute/v2.1/os-security-groups/5128ee40-93a4-431c-a4c2-399823a2def7 => generated 0 bytes in 552 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:24:08.728722 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0899b782-e04a-4348-9e27-dd875c4721e4 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:08.731879 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:08.731879 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:08.732963 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b0010415-79f4-4c62-aaa2-86fe4d1374fa tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:08.735985 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b0010415-79f4-4c62-aaa2-86fe4d1374fa tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:08.748354 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-0899b782-e04a-4348-9e27-dd875c4721e4 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jun 05 08:24:08.749938 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0899b782-e04a-4348-9e27-dd875c4721e4 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Request method failure captured: Jun 05 08:24:08.749938 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jun 05 08:24:08.749938 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:24:08.749938 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:24:08.749938 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:24:08.749938 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:24:08.749938 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:24:08.749938 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:24:08.749938 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:24:08.749938 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:08.749938 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGgIRZ2w5RYMc-xJAJAW0Au2dlUXKz-nyQAmHbUmmgk7S8GMjTamz5c7cQPYC36qdAn3gD5Y1scW4h_CJuLFHq-YVgLlesWCG79ZEh6998Ouiktqxh8Ungx_1AvcIIZp5TYYkRV595HGTi0WikuwtFk_QhG2D06ZrHaZMk_tsl7sDm8 Jun 05 08:24:08.749938 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:24:08.749938 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:24:08.749938 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:24:08.749938 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:24:08.749938 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:24:08.749938 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:24:08.749938 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: c0c2c53930be48d2a79494d8e5fdf4de Jun 05 08:24:08.749938 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1245114998 Jun 05 08:24:08.749938 n-d-844739-1 devstack@n-api.service[119049]: X-Role: admin,reader,member Jun 05 08:24:08.749938 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: admin,reader,member Jun 05 08:24:08.751159 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c0c2c53930be48d2a79494d8e5fdf4de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0c2c53930be48d2a79494d8e5fdf4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c0c2c53930be48d2a79494d8e5fdf4de", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0c2c53930be48d2a79494d8e5fdf4de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:08.751159 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1245114998 Jun 05 08:24:08.751159 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: c0c2c53930be48d2a79494d8e5fdf4de Jun 05 08:24:08.751159 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1245114998 Jun 05 08:24:08.751159 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin Jun 05 08:24:08.751159 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:24:08.751159 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:24:08.751159 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 2e73595af34542108dfc5bfec02cbe79 Jun 05 08:24:08.751159 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin Jun 05 08:24:08.751159 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:24:08.751159 n-d-844739-1 devstack@n-api.service[119049]: exception: Aggregate -1 could not be found. Jun 05 08:24:08.751159 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '-1'} Jun 05 08:24:08.751834 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:08.751834 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:08.751834 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jun 05 08:24:08.751834 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jun 05 08:24:08.751834 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jun 05 08:24:08.751834 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jun 05 08:24:08.751834 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:24:08.751834 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:24:08.751834 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 05 08:24:08.751834 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 05 08:24:08.751834 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 05 08:24:08.751834 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 05 08:24:08.751834 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 05 08:24:08.751834 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 05 08:24:08.751834 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jun 05 08:24:08.751834 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:08.751834 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:08.751834 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:08.751834 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:08.751834 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:08.752946 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:08.752946 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:08.752946 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:08.752946 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:08.752946 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:08.752946 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jun 05 08:24:08.752946 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:24:08.752946 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jun 05 08:24:08.752946 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:08.752946 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:08.752946 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:08.752946 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:08.752946 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:08.752946 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:08.752946 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:24:08.752946 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:24:08.752946 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jun 05 08:24:08.752946 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:08.753885 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0899b782-e04a-4348-9e27-dd875c4721e4 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:08.753885 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0899b782-e04a-4348-9e27-dd875c4721e4 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.040787 Jun 05 08:24:08.753885 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 148/301] 10.222.0.33 () {58 vars in 1151 bytes} [Sun Jun 5 08:24:08 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:24:08.754060 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b0010415-79f4-4c62-aaa2-86fe4d1374fa tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:08.757110 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b0010415-79f4-4c62-aaa2-86fe4d1374fa tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:08.760678 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b0010415-79f4-4c62-aaa2-86fe4d1374fa tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:08.764252 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b0010415-79f4-4c62-aaa2-86fe4d1374fa tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:08.772587 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d9b69800-1737-48e6-9dd5-715f185e1637 tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Calling method '.version_select at 0x7f2433ef2430>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:09.022463 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b0010415-79f4-4c62-aaa2-86fe4d1374fa tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:09.031015 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b0010415-79f4-4c62-aaa2-86fe4d1374fa tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1494 microversion: 2.1 time: 0.307761 Jun 05 08:24:09.031599 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 154/302] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:08 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1494 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:09.053943 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b0aa892f-6629-444f-a6fc-d229cbef13e0 tempest-AggregatesAdminNegativeTestJSON-1071987933 tempest-AggregatesAdminNegativeTestJSON-1071987933-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:09.054904 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:09.054904 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:09.056820 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b0aa892f-6629-444f-a6fc-d229cbef13e0 tempest-AggregatesAdminNegativeTestJSON-1071987933 tempest-AggregatesAdminNegativeTestJSON-1071987933-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '5fad2defefb448dcbeae5ec878ea0db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74b51bf5aba419d84454fcfcd110610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:09.058527 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b0aa892f-6629-444f-a6fc-d229cbef13e0 tempest-AggregatesAdminNegativeTestJSON-1071987933 tempest-AggregatesAdminNegativeTestJSON-1071987933-project] Request method failure captured: Jun 05 08:24:09.058527 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jun 05 08:24:09.058527 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:24:09.058527 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:24:09.058527 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:24:09.058527 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:24:09.058527 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:24:09.058527 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:24:09.058527 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:24:09.058527 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:09.058527 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGgFR7BRz94qVsrpu1OMzvz2l0k3w2zx_iPvpQDeGo06IjKT0SxUxbEJ7uhtVACyiKwc1jM_XbPjbv0RhhgQWj5Q4mr-aSETbgVoeSd_tafYTkUF9w01OFcmHqbg5Z9GfZR7F_-zYx5gGtvQAzIlZOsi4FGoWT5OcHitbEOkn_urLcA Jun 05 08:24:09.058527 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:24:09.058527 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:24:09.058527 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:24:09.058527 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:24:09.058527 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:24:09.058527 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:24:09.058527 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: b74b51bf5aba419d84454fcfcd110610 Jun 05 08:24:09.058527 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1071987933 Jun 05 08:24:09.058527 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:24:09.058527 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:24:09.059684 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b74b51bf5aba419d84454fcfcd110610"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b74b51bf5aba419d84454fcfcd110610"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b74b51bf5aba419d84454fcfcd110610", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b74b51bf5aba419d84454fcfcd110610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:09.059684 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1071987933 Jun 05 08:24:09.059684 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: b74b51bf5aba419d84454fcfcd110610 Jun 05 08:24:09.059684 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1071987933 Jun 05 08:24:09.059684 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-AggregatesAdminNegativeTestJSON-1071987933-project Jun 05 08:24:09.059684 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:24:09.059684 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:24:09.059684 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 5fad2defefb448dcbeae5ec878ea0db3 Jun 05 08:24:09.059684 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1071987933-project Jun 05 08:24:09.059684 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:24:09.059684 n-d-844739-1 devstack@n-api.service[119050]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jun 05 08:24:09.059684 n-d-844739-1 devstack@n-api.service[119050]: action_args: {} Jun 05 08:24:09.060780 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:09.060780 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:09.060780 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:09.060780 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:09.060780 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:09.060780 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:09.060780 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:09.060780 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:09.060780 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jun 05 08:24:09.060780 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jun 05 08:24:09.060780 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:24:09.060780 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:24:09.060780 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:24:09.060780 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:24:09.060780 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:24:09.060780 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:24:09.060780 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:24:09.060780 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:24:09.060780 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:24:09.061925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:24:09.061925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:24:09.061925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:24:09.061925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:24:09.061925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:24:09.061925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jun 05 08:24:09.061925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:09.061925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:09.061925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:09.061925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:09.061925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:09.061925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:09.061925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:24:09.061925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:24:09.061925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jun 05 08:24:09.061925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:09.064501 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b0aa892f-6629-444f-a6fc-d229cbef13e0 tempest-AggregatesAdminNegativeTestJSON-1071987933 tempest-AggregatesAdminNegativeTestJSON-1071987933-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:09.065579 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b0aa892f-6629-444f-a6fc-d229cbef13e0 tempest-AggregatesAdminNegativeTestJSON-1071987933 tempest-AggregatesAdminNegativeTestJSON-1071987933-project] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.020435 Jun 05 08:24:09.066685 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 155/303] 10.222.0.33 () {58 vars in 1142 bytes} [Sun Jun 5 08:24:09 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:24:09.171188 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d9b69800-1737-48e6-9dd5-715f185e1637 tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/14bc3b48-e812-4490-b3c3-d56af618b8ea" status: 202 len: 0 microversion: 2.1 time: 0.407069 Jun 05 08:24:09.172620 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 149/304] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:24:08 2022] DELETE /compute/v2.1/os-security-groups/14bc3b48-e812-4490-b3c3-d56af618b8ea => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:24:09.361749 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8df6bc54-4d70-485d-8879-2b38c2edb89d tempest-HypervisorAdminV228Test-898639603 tempest-HypervisorAdminV228Test-898639603-project-admin] Calling method '.version_select at 0x7f2433f34160>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:09.364009 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:09.364009 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:09.365892 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8df6bc54-4d70-485d-8879-2b38c2edb89d tempest-HypervisorAdminV228Test-898639603 tempest-HypervisorAdminV228Test-898639603-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:09.366679 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8df6bc54-4d70-485d-8879-2b38c2edb89d tempest-HypervisorAdminV228Test-898639603 tempest-HypervisorAdminV228Test-898639603-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:09.387026 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8df6bc54-4d70-485d-8879-2b38c2edb89d tempest-HypervisorAdminV228Test-898639603 tempest-HypervisorAdminV228Test-898639603-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:09.387800 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8df6bc54-4d70-485d-8879-2b38c2edb89d tempest-HypervisorAdminV228Test-898639603 tempest-HypervisorAdminV228Test-898639603-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:09.409165 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8df6bc54-4d70-485d-8879-2b38c2edb89d tempest-HypervisorAdminV228Test-898639603 tempest-HypervisorAdminV228Test-898639603-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:09.410675 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8df6bc54-4d70-485d-8879-2b38c2edb89d tempest-HypervisorAdminV228Test-898639603 tempest-HypervisorAdminV228Test-898639603-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:09.420567 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8df6bc54-4d70-485d-8879-2b38c2edb89d tempest-HypervisorAdminV228Test-898639603 tempest-HypervisorAdminV228Test-898639603-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.351486 Jun 05 08:24:09.422252 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 156/305] 10.222.0.33 () {60 vars in 1186 bytes} [Sun Jun 5 08:24:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:24:09.429340 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7357bbff-5725-415c-ba48-df75bb10ef92 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1653154117"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:09.439550 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:09.439550 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:09.444416 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.aggregate [None req-7357bbff-5725-415c-ba48-df75bb10ef92 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Generated uuid 9d1ac069-6f9e-48f8-bb76-00a0151a4289 for aggregate {{(pid=119050) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 05 08:24:09.480526 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7357bbff-5725-415c-ba48-df75bb10ef92 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.056597 Jun 05 08:24:09.491282 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 157/306] 10.222.0.33 () {60 vars in 1163 bytes} [Sun Jun 5 08:24:09 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:09.498165 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-585eb236-c6c2-4461-85bc-5a6201aa057b tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Calling method '.version_select at 0x7f2433c4b550>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:09.588284 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-48f73124-559e-4460-a440-5c66b2b2db2f tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:09.601702 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-48f73124-559e-4460-a440-5c66b2b2db2f tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:09.615050 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-48f73124-559e-4460-a440-5c66b2b2db2f tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:09.616230 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-48f73124-559e-4460-a440-5c66b2b2db2f tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:09.619316 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-48f73124-559e-4460-a440-5c66b2b2db2f tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:09.620936 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-48f73124-559e-4460-a440-5c66b2b2db2f tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:09.911845 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-48f73124-559e-4460-a440-5c66b2b2db2f tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1645 microversion: 2.1 time: 0.735508 Jun 05 08:24:09.916126 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 150/307] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:09 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1645 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:09.926274 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-27e81826-759a-4b44-a128-29dd6a8781a7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:09.929449 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-27e81826-759a-4b44-a128-29dd6a8781a7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:09.940014 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-27e81826-759a-4b44-a128-29dd6a8781a7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:09.944691 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-27e81826-759a-4b44-a128-29dd6a8781a7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:09.947455 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-27e81826-759a-4b44-a128-29dd6a8781a7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:09.948645 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-27e81826-759a-4b44-a128-29dd6a8781a7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:09.992702 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-585eb236-c6c2-4461-85bc-5a6201aa057b tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/82643568-94b9-4f77-99eb-bb83cde80ab4" status: 202 len: 0 microversion: 2.1 time: 0.498975 Jun 05 08:24:09.993347 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 158/308] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:24:09 2022] DELETE /compute/v2.1/os-security-groups/82643568-94b9-4f77-99eb-bb83cde80ab4 => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:24:10.003603 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-58bb9f75-cdb2-4558-bfe5-686e10bc5e91 tempest-HypervisorAdminV228Test-898639603 tempest-HypervisorAdminV228Test-898639603-project-admin] Calling method '.version_select at 0x7f2433c4b940>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:10.004924 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:10.004924 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:10.006490 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-58bb9f75-cdb2-4558-bfe5-686e10bc5e91 tempest-HypervisorAdminV228Test-898639603 tempest-HypervisorAdminV228Test-898639603-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:10.009335 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-58bb9f75-cdb2-4558-bfe5-686e10bc5e91 tempest-HypervisorAdminV228Test-898639603 tempest-HypervisorAdminV228Test-898639603-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:10.031869 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-58bb9f75-cdb2-4558-bfe5-686e10bc5e91 tempest-HypervisorAdminV228Test-898639603 tempest-HypervisorAdminV228Test-898639603-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:10.033365 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-58bb9f75-cdb2-4558-bfe5-686e10bc5e91 tempest-HypervisorAdminV228Test-898639603 tempest-HypervisorAdminV228Test-898639603-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:10.042133 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-58bb9f75-cdb2-4558-bfe5-686e10bc5e91 tempest-HypervisorAdminV228Test-898639603 tempest-HypervisorAdminV228Test-898639603-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.047312 Jun 05 08:24:10.043416 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 159/309] 10.222.0.33 () {60 vars in 1192 bytes} [Sun Jun 5 08:24:09 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:24:10.048548 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-dd4a3df0-93a0-4d19-ab62-66ce9e81d989 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-844739-1"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:10.050325 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:10.050325 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:10.061564 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dd4a3df0-93a0-4d19-ab62-66ce9e81d989 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:10.062498 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dd4a3df0-93a0-4d19-ab62-66ce9e81d989 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:10.286831 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-dd4a3df0-93a0-4d19-ab62-66ce9e81d989 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.241337 Jun 05 08:24:10.299168 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 160/310] 10.222.0.33 () {60 vars in 1193 bytes} [Sun Jun 5 08:24:10 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:10.325148 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-08e69b7f-f70b-42b3-97dc-758748e3f9ce tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:10.326286 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-08e69b7f-f70b-42b3-97dc-758748e3f9ce tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 98766f8e-7b27-49e9-8565-4bc9c3e808d8] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:10.346207 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-08e69b7f-f70b-42b3-97dc-758748e3f9ce tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:10.346964 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-08e69b7f-f70b-42b3-97dc-758748e3f9ce tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:10.355524 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-08e69b7f-f70b-42b3-97dc-758748e3f9ce tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:10.356600 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-08e69b7f-f70b-42b3-97dc-758748e3f9ce tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:10.497756 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-27e81826-759a-4b44-a128-29dd6a8781a7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:10.524890 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-27e81826-759a-4b44-a128-29dd6a8781a7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1277 microversion: 2.1 time: 0.598922 Jun 05 08:24:10.525558 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 151/311] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:09 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1277 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:10.554146 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e084ff1a-93ef-4961-95a4-34c426a8ad07 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:10.556030 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e084ff1a-93ef-4961-95a4-34c426a8ad07 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:10.571436 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e084ff1a-93ef-4961-95a4-34c426a8ad07 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:10.573075 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e084ff1a-93ef-4961-95a4-34c426a8ad07 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:10.576670 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e084ff1a-93ef-4961-95a4-34c426a8ad07 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:10.577120 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e084ff1a-93ef-4961-95a4-34c426a8ad07 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:10.694125 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-08e69b7f-f70b-42b3-97dc-758748e3f9ce tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:10.713445 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-08e69b7f-f70b-42b3-97dc-758748e3f9ce tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8" status: 200 len: 1319 microversion: 2.1 time: 0.408202 Jun 05 08:24:10.714038 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 161/312] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:10 2022] GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8 => generated 1319 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:10.727431 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-59e5f386-76d9-4b81-a22e-b3896926b563 tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Calling method '.version_select at 0x7f2433c4b940>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:10.980467 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e084ff1a-93ef-4961-95a4-34c426a8ad07 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1645 microversion: 2.1 time: 0.433305 Jun 05 08:24:10.981938 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 152/313] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:10 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1645 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:10.986953 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4ecc1c0d-0eef-4e0b-bd5f-5db3829ff412 tempest-AggregatesAdminNegativeTestJSON-1071987933 tempest-AggregatesAdminNegativeTestJSON-1071987933-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-844739-1"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:10.988507 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:10.988507 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:10.996636 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4ecc1c0d-0eef-4e0b-bd5f-5db3829ff412 tempest-AggregatesAdminNegativeTestJSON-1071987933 tempest-AggregatesAdminNegativeTestJSON-1071987933-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '5fad2defefb448dcbeae5ec878ea0db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74b51bf5aba419d84454fcfcd110610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:10.998703 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4ecc1c0d-0eef-4e0b-bd5f-5db3829ff412 tempest-AggregatesAdminNegativeTestJSON-1071987933 tempest-AggregatesAdminNegativeTestJSON-1071987933-project] Request method failure captured: Jun 05 08:24:10.998703 n-d-844739-1 devstack@n-api.service[119049]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Jun 05 08:24:10.998703 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:24:10.998703 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:24:10.998703 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:24:10.998703 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 42 Jun 05 08:24:10.998703 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:24:10.998703 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:24:10.998703 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:24:10.998703 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:10.998703 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGgFR7BRz94qVsrpu1OMzvz2l0k3w2zx_iPvpQDeGo06IjKT0SxUxbEJ7uhtVACyiKwc1jM_XbPjbv0RhhgQWj5Q4mr-aSETbgVoeSd_tafYTkUF9w01OFcmHqbg5Z9GfZR7F_-zYx5gGtvQAzIlZOsi4FGoWT5OcHitbEOkn_urLcA Jun 05 08:24:10.998703 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:24:10.998703 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:24:10.998703 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:24:10.998703 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:24:10.998703 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:24:10.998703 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:24:10.998703 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: b74b51bf5aba419d84454fcfcd110610 Jun 05 08:24:10.998703 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1071987933 Jun 05 08:24:10.998703 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:24:10.998703 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:24:11.000081 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b74b51bf5aba419d84454fcfcd110610"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b74b51bf5aba419d84454fcfcd110610"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b74b51bf5aba419d84454fcfcd110610", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b74b51bf5aba419d84454fcfcd110610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:11.000081 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1071987933 Jun 05 08:24:11.000081 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: b74b51bf5aba419d84454fcfcd110610 Jun 05 08:24:11.000081 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1071987933 Jun 05 08:24:11.000081 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-AggregatesAdminNegativeTestJSON-1071987933-project Jun 05 08:24:11.000081 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:24:11.000081 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:24:11.000081 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 5fad2defefb448dcbeae5ec878ea0db3 Jun 05 08:24:11.000081 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1071987933-project Jun 05 08:24:11.000081 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:24:11.000081 n-d-844739-1 devstack@n-api.service[119049]: {"remove_host": {"host": "n-h2-844739-1"}} Jun 05 08:24:11.000081 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:24:11.000081 n-d-844739-1 devstack@n-api.service[119049]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jun 05 08:24:11.000953 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-844739-1'}}} Jun 05 08:24:11.000953 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:11.000953 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:11.000953 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:11.000953 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:11.000953 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:11.000953 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:11.000953 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:11.000953 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:11.000953 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:24:11.000953 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:24:11.000953 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jun 05 08:24:11.000953 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jun 05 08:24:11.000953 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:24:11.000953 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:24:11.000953 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:24:11.000953 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:24:11.000953 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:24:11.000953 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:24:11.001903 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:24:11.001903 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:24:11.001903 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:24:11.001903 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:24:11.001903 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:24:11.001903 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:24:11.001903 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:24:11.001903 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:24:11.001903 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jun 05 08:24:11.001903 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:11.001903 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:11.001903 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:11.001903 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:11.001903 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:11.001903 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:11.001903 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:24:11.001903 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:24:11.001903 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jun 05 08:24:11.001903 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:11.003801 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4ecc1c0d-0eef-4e0b-bd5f-5db3829ff412 tempest-AggregatesAdminNegativeTestJSON-1071987933 tempest-AggregatesAdminNegativeTestJSON-1071987933-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:11.005402 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4ecc1c0d-0eef-4e0b-bd5f-5db3829ff412 tempest-AggregatesAdminNegativeTestJSON-1071987933 tempest-AggregatesAdminNegativeTestJSON-1071987933-project] 10.222.0.33 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.021722 Jun 05 08:24:11.006500 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 153/314] 10.222.0.33 () {60 vars in 1193 bytes} [Sun Jun 5 08:24:10 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:24:11.015617 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-1e38f6a5-deac-490e-8b28-8b42c2e247ac req-50a3196b-f52e-4de2-9b05-c3f393e301f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98766f8e-7b27-49e9-8565-4bc9c3e808d8", "tag": "42d59f2a-9047-40e2-9f60-ef062332a62d"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:11.037467 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-1e38f6a5-deac-490e-8b28-8b42c2e247ac req-50a3196b-f52e-4de2-9b05-c3f393e301f1 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:11.037922 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-1e38f6a5-deac-490e-8b28-8b42c2e247ac req-50a3196b-f52e-4de2-9b05-c3f393e301f1 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:11.058401 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-1e38f6a5-deac-490e-8b28-8b42c2e247ac req-50a3196b-f52e-4de2-9b05-c3f393e301f1 service nova] Creating event network-changed:42d59f2a-9047-40e2-9f60-ef062332a62d for instance 98766f8e-7b27-49e9-8565-4bc9c3e808d8 on n-h2-844739-1 Jun 05 08:24:11.074379 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-1e38f6a5-deac-490e-8b28-8b42c2e247ac req-50a3196b-f52e-4de2-9b05-c3f393e301f1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066333 Jun 05 08:24:11.074987 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 154/315] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:11.080144 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fd85915f-a09f-49bb-a98c-cdf6b388f8f0 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:11.081504 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:11.081504 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:11.093329 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fd85915f-a09f-49bb-a98c-cdf6b388f8f0 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:11.094039 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fd85915f-a09f-49bb-a98c-cdf6b388f8f0 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:11.094946 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fd85915f-a09f-49bb-a98c-cdf6b388f8f0 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:11.095482 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fd85915f-a09f-49bb-a98c-cdf6b388f8f0 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:11.148107 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fd85915f-a09f-49bb-a98c-cdf6b388f8f0 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.071813 Jun 05 08:24:11.149064 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 155/316] 10.222.0.33 () {58 vars in 1175 bytes} [Sun Jun 5 08:24:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:11.153540 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-460d92d2-c7ec-4ec4-9d21-1e41c38519d1 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-844739-1"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:11.162757 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:11.162757 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:11.183447 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-460d92d2-c7ec-4ec4-9d21-1e41c38519d1 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:11.183913 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-460d92d2-c7ec-4ec4-9d21-1e41c38519d1 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:11.390478 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-460d92d2-c7ec-4ec4-9d21-1e41c38519d1 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.240337 Jun 05 08:24:11.391792 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 156/317] 10.222.0.33 () {60 vars in 1193 bytes} [Sun Jun 5 08:24:11 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:11.398862 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-59e5f386-76d9-4b81-a22e-b3896926b563 tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/247a35bf-b599-4f42-b346-fc7433572230" status: 202 len: 0 microversion: 2.1 time: 0.683489 Jun 05 08:24:11.400434 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 162/318] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:24:10 2022] DELETE /compute/v2.1/os-security-groups/247a35bf-b599-4f42-b346-fc7433572230 => generated 0 bytes in 685 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:24:11.407951 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d6ddb849-2585-4640-b09d-dae1be0b83fd tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:11.409095 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:11.409095 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:11.420486 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-027eb042-17d9-4142-a160-22f989456996 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-844739-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:11.423028 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-027eb042-17d9-4142-a160-22f989456996 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:11.439431 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-027eb042-17d9-4142-a160-22f989456996 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:11.440454 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-027eb042-17d9-4142-a160-22f989456996 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:11.443142 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-027eb042-17d9-4142-a160-22f989456996 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:11.446987 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-027eb042-17d9-4142-a160-22f989456996 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:11.463667 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d6ddb849-2585-4640-b09d-dae1be0b83fd tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.060871 Jun 05 08:24:11.469314 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 163/319] 10.222.0.33 () {58 vars in 1154 bytes} [Sun Jun 5 08:24:11 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 05 08:24:11.485464 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b8991acb-0b79-4c29-a752-6db6514b07ad tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] Calling method '.version_select at 0x7f2433cbfe50>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:11.591806 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-027eb042-17d9-4142-a160-22f989456996 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lazy-loading 'flavor' on Instance uuid 969237ff-17eb-4838-9c3d-68dcbc1f94ca {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:11.695214 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-027eb042-17d9-4142-a160-22f989456996 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Going to try to live migrate instance to n-h2-844739-1 {{(pid=119049) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 05 08:24:12.097567 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b8991acb-0b79-4c29-a752-6db6514b07ad tempest-SecurityGroupRulesNegativeTestJSON-689221279 tempest-SecurityGroupRulesNegativeTestJSON-689221279-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/9158b01c-a0cd-46c6-9eca-a42c4f5e6d93" status: 202 len: 0 microversion: 2.1 time: 0.626777 Jun 05 08:24:12.099088 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 164/320] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:24:11 2022] DELETE /compute/v2.1/os-security-groups/9158b01c-a0cd-46c6-9eca-a42c4f5e6d93 => generated 0 bytes in 629 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:24:12.108500 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1738f610-580c-4002-b82c-f2ad95957722 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:12.110140 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1738f610-580c-4002-b82c-f2ad95957722 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: e4c09fb3-f67f-4b07-a992-2e70683932bd] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:12.133069 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1738f610-580c-4002-b82c-f2ad95957722 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:12.137096 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1738f610-580c-4002-b82c-f2ad95957722 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:12.138329 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1738f610-580c-4002-b82c-f2ad95957722 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:12.139582 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1738f610-580c-4002-b82c-f2ad95957722 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:12.487377 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1738f610-580c-4002-b82c-f2ad95957722 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:12.501491 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1738f610-580c-4002-b82c-f2ad95957722 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd" status: 200 len: 1588 microversion: 2.1 time: 0.400441 Jun 05 08:24:12.512205 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 165/321] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:12 2022] GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd => generated 1588 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:12.519592 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-46fcee75-f15f-4367-86be-0bb56141b99f tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1542639573"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:12.523870 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:12.523870 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:12.529512 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.aggregate [None req-46fcee75-f15f-4367-86be-0bb56141b99f tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Generated uuid fce3fe0a-74a2-4646-bfa0-fc74f387daeb for aggregate {{(pid=119050) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 05 08:24:12.576272 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-46fcee75-f15f-4367-86be-0bb56141b99f tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.061930 Jun 05 08:24:12.577559 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 166/322] 10.222.0.33 () {60 vars in 1163 bytes} [Sun Jun 5 08:24:12 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:12.588506 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b961ee38-8523-477b-9601-d46bda3ccf10 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:12.595179 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b961ee38-8523-477b-9601-d46bda3ccf10 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:12.604218 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b961ee38-8523-477b-9601-d46bda3ccf10 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:12.609387 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b961ee38-8523-477b-9601-d46bda3ccf10 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:12.610497 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b961ee38-8523-477b-9601-d46bda3ccf10 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:12.612680 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b961ee38-8523-477b-9601-d46bda3ccf10 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:12.952750 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b961ee38-8523-477b-9601-d46bda3ccf10 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:12.961527 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b961ee38-8523-477b-9601-d46bda3ccf10 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1319 microversion: 2.1 time: 0.381917 Jun 05 08:24:12.966035 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 167/323] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:12 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1319 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:12.989979 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d43135d7-655f-4368-b861-fe320f84bdd8 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:12.996502 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d43135d7-655f-4368-b861-fe320f84bdd8 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 98766f8e-7b27-49e9-8565-4bc9c3e808d8] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:13.004004 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d43135d7-655f-4368-b861-fe320f84bdd8 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:13.005267 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d43135d7-655f-4368-b861-fe320f84bdd8 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:13.006245 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d43135d7-655f-4368-b861-fe320f84bdd8 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:13.006960 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d43135d7-655f-4368-b861-fe320f84bdd8 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:13.504332 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d43135d7-655f-4368-b861-fe320f84bdd8 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:13.517873 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d43135d7-655f-4368-b861-fe320f84bdd8 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8" status: 200 len: 1319 microversion: 2.1 time: 0.536302 Jun 05 08:24:13.518705 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 168/324] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:12 2022] GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8 => generated 1319 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:13.525224 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-14cc9157-39ba-46aa-9164-2a747ed39273 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:13.529816 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:13.529816 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:13.554540 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-14cc9157-39ba-46aa-9164-2a747ed39273 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:13.554994 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-14cc9157-39ba-46aa-9164-2a747ed39273 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:13.587182 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-14cc9157-39ba-46aa-9164-2a747ed39273 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:13.589041 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-14cc9157-39ba-46aa-9164-2a747ed39273 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:13.613643 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.compute.aggregates [None req-14cc9157-39ba-46aa-9164-2a747ed39273 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jun 05 08:24:13.615208 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-14cc9157-39ba-46aa-9164-2a747ed39273 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Jun 05 08:24:13.629171 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-14cc9157-39ba-46aa-9164-2a747ed39273 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Request method failure captured: Jun 05 08:24:13.629171 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Jun 05 08:24:13.629171 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:24:13.629171 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:24:13.629171 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:24:13.629171 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 42 Jun 05 08:24:13.629171 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:24:13.629171 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:24:13.629171 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:24:13.629171 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:13.629171 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGgIRZ2w5RYMc-xJAJAW0Au2dlUXKz-nyQAmHbUmmgk7S8GMjTamz5c7cQPYC36qdAn3gD5Y1scW4h_CJuLFHq-YVgLlesWCG79ZEh6998Ouiktqxh8Ungx_1AvcIIZp5TYYkRV595HGTi0WikuwtFk_QhG2D06ZrHaZMk_tsl7sDm8 Jun 05 08:24:13.629171 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:24:13.629171 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:24:13.629171 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:24:13.629171 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:24:13.629171 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:24:13.629171 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:24:13.629171 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: c0c2c53930be48d2a79494d8e5fdf4de Jun 05 08:24:13.629171 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1245114998 Jun 05 08:24:13.629171 n-d-844739-1 devstack@n-api.service[119050]: X-Role: admin,reader,member Jun 05 08:24:13.629171 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: admin,reader,member Jun 05 08:24:13.631909 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c0c2c53930be48d2a79494d8e5fdf4de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0c2c53930be48d2a79494d8e5fdf4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c0c2c53930be48d2a79494d8e5fdf4de", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0c2c53930be48d2a79494d8e5fdf4de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:13.631909 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1245114998 Jun 05 08:24:13.631909 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: c0c2c53930be48d2a79494d8e5fdf4de Jun 05 08:24:13.631909 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1245114998 Jun 05 08:24:13.631909 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin Jun 05 08:24:13.631909 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:24:13.631909 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:24:13.631909 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 2e73595af34542108dfc5bfec02cbe79 Jun 05 08:24:13.631909 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin Jun 05 08:24:13.631909 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:24:13.631909 n-d-844739-1 devstack@n-api.service[119050]: {"remove_host": {"host": "nonexist_host"}} Jun 05 08:24:13.631909 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:24:13.631909 n-d-844739-1 devstack@n-api.service[119050]: exception: Cannot remove host nonexist_host in aggregate 18 Jun 05 08:24:13.633705 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jun 05 08:24:13.633705 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:13.633705 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:13.633705 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jun 05 08:24:13.633705 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jun 05 08:24:13.633705 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:24:13.633705 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:24:13.633705 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 05 08:24:13.633705 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 05 08:24:13.633705 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 05 08:24:13.633705 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 05 08:24:13.633705 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 05 08:24:13.633705 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 05 08:24:13.633705 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jun 05 08:24:13.633705 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:13.633705 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:13.633705 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:13.633705 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:13.633705 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jun 05 08:24:13.633705 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jun 05 08:24:13.635998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 05 08:24:13.635998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 05 08:24:13.635998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 05 08:24:13.635998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:13.635998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:13.635998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:13.635998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:13.635998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jun 05 08:24:13.635998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jun 05 08:24:13.635998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 05 08:24:13.635998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 05 08:24:13.635998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:24:13.635998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:24:13.635998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:24:13.635998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:24:13.635998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 05 08:24:13.635998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 05 08:24:13.635998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jun 05 08:24:13.635998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jun 05 08:24:13.635998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jun 05 08:24:13.637963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jun 05 08:24:13.637963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jun 05 08:24:13.637963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:13.637963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:13.637963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:13.637963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:13.637963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:13.637963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:13.637963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:13.637963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:13.637963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:13.637963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:13.637963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:24:13.637963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:24:13.637963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jun 05 08:24:13.637963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 05 08:24:13.637963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Jun 05 08:24:13.637963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:13.637963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:13.637963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:13.637963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:13.640201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:13.640201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:13.640201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:24:13.640201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:24:13.640201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Jun 05 08:24:13.640201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:13.640201 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-14cc9157-39ba-46aa-9164-2a747ed39273 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:13.640201 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-14cc9157-39ba-46aa-9164-2a747ed39273 tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.111548 Jun 05 08:24:13.640201 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 169/325] 10.222.0.33 () {60 vars in 1193 bytes} [Sun Jun 5 08:24:13 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:24:13.650087 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-c8e1158f-c7ec-4125-aafe-db6375c3d27d req-391b0b0f-7d1b-40e6-ad40-cd511c80b628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4c09fb3-f67f-4b07-a992-2e70683932bd", "tag": "0d4a6d59-7631-4ce9-ba50-a33984101036"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:13.681690 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-c8e1158f-c7ec-4125-aafe-db6375c3d27d req-391b0b0f-7d1b-40e6-ad40-cd511c80b628 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:13.684660 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-c8e1158f-c7ec-4125-aafe-db6375c3d27d req-391b0b0f-7d1b-40e6-ad40-cd511c80b628 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:13.718491 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-c8e1158f-c7ec-4125-aafe-db6375c3d27d req-391b0b0f-7d1b-40e6-ad40-cd511c80b628 service nova] Creating event network-changed:0d4a6d59-7631-4ce9-ba50-a33984101036 for instance e4c09fb3-f67f-4b07-a992-2e70683932bd on n-h1-844739-1 Jun 05 08:24:13.729452 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-c8e1158f-c7ec-4125-aafe-db6375c3d27d req-391b0b0f-7d1b-40e6-ad40-cd511c80b628 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096281 Jun 05 08:24:13.730690 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 170/326] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:13.736254 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-15a87492-ba30-4a57-acfc-6ebde29e5c0d tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:13.737777 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:13.737777 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:13.786639 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-15a87492-ba30-4a57-acfc-6ebde29e5c0d tempest-AggregatesAdminNegativeTestJSON-1245114998 tempest-AggregatesAdminNegativeTestJSON-1245114998-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.053833 Jun 05 08:24:13.787412 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 171/327] 10.222.0.33 () {58 vars in 1154 bytes} [Sun Jun 5 08:24:13 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 05 08:24:14.074023 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-bec3ba75-f357-43e6-b0bf-902a43496f2a tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1072383760", "id": 523397611, "os-flavor-access:is_public": "True"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:14.076251 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:14.076251 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:14.105032 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-bec3ba75-f357-43e6-b0bf-902a43496f2a tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.301458 Jun 05 08:24:14.107536 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 172/328] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:24:13 2022] POST /compute/v2.1/flavors => generated 427 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:24:14.116673 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e6237ae2-4979-4f08-af9b-2c45d23f7532 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:14.118481 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e6237ae2-4979-4f08-af9b-2c45d23f7532 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:14.134515 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e6237ae2-4979-4f08-af9b-2c45d23f7532 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:14.135795 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e6237ae2-4979-4f08-af9b-2c45d23f7532 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:14.137497 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e6237ae2-4979-4f08-af9b-2c45d23f7532 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:14.138869 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e6237ae2-4979-4f08-af9b-2c45d23f7532 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:14.631686 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e6237ae2-4979-4f08-af9b-2c45d23f7532 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:14.648679 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e6237ae2-4979-4f08-af9b-2c45d23f7532 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1319 microversion: 2.1 time: 0.530886 Jun 05 08:24:14.651626 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 173/329] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:14 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1319 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:14.663724 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-337d30e4-06c4-4856-9c80-f535072189d9 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:14.666612 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:14.666612 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:14.698541 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=9,nova_api:DELETE=6 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:14.714830 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-337d30e4-06c4-4856-9c80-f535072189d9 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/523397611" status: 202 len: 0 microversion: 2.1 time: 0.059734 Jun 05 08:24:14.715818 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 174/330] 10.222.0.33 () {58 vars in 1157 bytes} [Sun Jun 5 08:24:14 2022] DELETE /compute/v2.1/flavors/523397611 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:24:14.729231 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0a2ed1c7-aad3-4599-a1da-d205a6569009 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:14.733110 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0a2ed1c7-aad3-4599-a1da-d205a6569009 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 98766f8e-7b27-49e9-8565-4bc9c3e808d8] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:14.745957 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0a2ed1c7-aad3-4599-a1da-d205a6569009 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:14.748257 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0a2ed1c7-aad3-4599-a1da-d205a6569009 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:14.754690 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0a2ed1c7-aad3-4599-a1da-d205a6569009 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:14.755779 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0a2ed1c7-aad3-4599-a1da-d205a6569009 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:15.217445 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0a2ed1c7-aad3-4599-a1da-d205a6569009 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:15.240015 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0a2ed1c7-aad3-4599-a1da-d205a6569009 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8" status: 200 len: 1319 microversion: 2.1 time: 0.520194 Jun 05 08:24:15.242907 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 175/331] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:14 2022] GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8 => generated 1319 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:15.253730 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-386fff28-40f1-4170-b385-0d14e990a03d tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:15.302638 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-386fff28-40f1-4170-b385-0d14e990a03d tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.056115 Jun 05 08:24:15.309207 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 176/332] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:24:15 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:15.330269 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-481c43ba-7e83-497f-9699-abd1db9de5dc tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1149266411", "id": 1914982911, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:15.335203 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:15.335203 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:15.383215 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-481c43ba-7e83-497f-9699-abd1db9de5dc tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.058514 Jun 05 08:24:15.392738 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 177/333] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:24:15 2022] POST /compute/v2.1/flavors => generated 417 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:24:15.439827 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-abba991e-fc54-4b55-afee-693d2495ea02 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:15.505228 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-abba991e-fc54-4b55-afee-693d2495ea02 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 6227 microversion: 2.1 time: 0.084134 Jun 05 08:24:15.523067 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 178/334] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:24:15 2022] GET /compute/v2.1/flavors/detail => generated 6227 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:15.535639 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-33412127-8818-4704-a2b7-c26cdb87b716 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:15.536957 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:15.536957 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:15.557193 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-33412127-8818-4704-a2b7-c26cdb87b716 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1914982911" status: 202 len: 0 microversion: 2.1 time: 0.028380 Jun 05 08:24:15.562393 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 179/335] 10.222.0.33 () {58 vars in 1160 bytes} [Sun Jun 5 08:24:15 2022] DELETE /compute/v2.1/flavors/1914982911 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:24:15.568491 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9cf6b4d6-b876-48eb-a616-da95d421b424 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:15.592337 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9cf6b4d6-b876-48eb-a616-da95d421b424 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.028805 Jun 05 08:24:15.604358 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 180/336] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:24:15 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:15.610552 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6be860c7-e7cc-44d3-8fcd-ba535eaa8477 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-811465878", "id": 1954123187, "os-flavor-access:is_public": "True"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:15.640306 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6be860c7-e7cc-44d3-8fcd-ba535eaa8477 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.034133 Jun 05 08:24:15.641020 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 181/337] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:24:15 2022] POST /compute/v2.1/flavors => generated 428 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:24:15.652583 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-76daa80d-e812-4f5a-87e5-f8c40b15bdc7 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:15.679622 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-76daa80d-e812-4f5a-87e5-f8c40b15bdc7 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1954123187" status: 202 len: 0 microversion: 2.1 time: 0.030711 Jun 05 08:24:15.680466 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 182/338] 10.222.0.33 () {58 vars in 1160 bytes} [Sun Jun 5 08:24:15 2022] DELETE /compute/v2.1/flavors/1954123187 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:24:15.692711 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3045c0a2-1174-4437-9d10-e16fffe328e0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:15.693389 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3045c0a2-1174-4437-9d10-e16fffe328e0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:15.711618 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3045c0a2-1174-4437-9d10-e16fffe328e0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:15.712144 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3045c0a2-1174-4437-9d10-e16fffe328e0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:15.712962 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3045c0a2-1174-4437-9d10-e16fffe328e0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:15.713488 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3045c0a2-1174-4437-9d10-e16fffe328e0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:15.719777 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=100 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:15.748006 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=8 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:16.001717 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3045c0a2-1174-4437-9d10-e16fffe328e0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:16.020171 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3045c0a2-1174-4437-9d10-e16fffe328e0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1319 microversion: 2.1 time: 0.333105 Jun 05 08:24:16.020866 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 183/339] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:15 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1319 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:16.034050 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a2201231-eaea-4677-9517-a713b325e70f tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:16.070323 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a2201231-eaea-4677-9517-a713b325e70f tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.046876 Jun 05 08:24:16.085802 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 184/340] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:24:16 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:16.096535 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-e3aa9b34-9a9e-423f-9215-c57d88510a3d req-e4ecb951-d1a8-4648-a5a4-9891e35238b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4f4188b-2421-4e0a-8ac7-0140bed18989", "tag": "c8b84554-46a8-4496-991a-e3f0704549f6"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:16.108186 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-e3aa9b34-9a9e-423f-9215-c57d88510a3d req-e4ecb951-d1a8-4648-a5a4-9891e35238b0 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:16.109219 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-e3aa9b34-9a9e-423f-9215-c57d88510a3d req-e4ecb951-d1a8-4648-a5a4-9891e35238b0 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:16.126364 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-e3aa9b34-9a9e-423f-9215-c57d88510a3d req-e4ecb951-d1a8-4648-a5a4-9891e35238b0 service nova] Creating event network-changed:c8b84554-46a8-4496-991a-e3f0704549f6 for instance d4f4188b-2421-4e0a-8ac7-0140bed18989 on n-h1-844739-1 Jun 05 08:24:16.136332 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-e3aa9b34-9a9e-423f-9215-c57d88510a3d req-e4ecb951-d1a8-4648-a5a4-9891e35238b0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046732 Jun 05 08:24:16.137561 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 185/341] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:16.147729 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4455e55e-d1dd-448a-a730-dd0c1711afda tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-527924374", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:16.150853 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:16.150853 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:16.185560 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4455e55e-d1dd-448a-a730-dd0c1711afda tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.046267 Jun 05 08:24:16.186745 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 186/342] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:24:16 2022] POST /compute/v2.1/flavors => generated 506 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:16.198506 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1b1d8133-a30b-45c6-9d41-ca632806ffed tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:16.200195 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:16.200195 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:16.218151 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1b1d8133-a30b-45c6-9d41-ca632806ffed tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/af6dd3b8-8635-44ca-8264-e0bd525165ef" status: 202 len: 0 microversion: 2.1 time: 0.023333 Jun 05 08:24:16.219263 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 187/343] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:24:16 2022] DELETE /compute/v2.1/flavors/af6dd3b8-8635-44ca-8264-e0bd525165ef => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:24:16.229142 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-12371110-9f83-433b-a2ce-e4bd6ae368d2 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:16.231476 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-027eb042-17d9-4142-a160-22f989456996 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca/action" status: 202 len: 0 microversion: 2.1 time: 4.838410 Jun 05 08:24:16.237340 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 157/344] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Jun 5 08:24:11 2022] POST /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca/action => generated 0 bytes in 4845 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:24:16.244239 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4a024396-3430-4ddc-8853-324df60754f5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:16.245187 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4a024396-3430-4ddc-8853-324df60754f5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:16.253800 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-12371110-9f83-433b-a2ce-e4bd6ae368d2 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.029007 Jun 05 08:24:16.254598 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4a024396-3430-4ddc-8853-324df60754f5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:16.255315 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 188/345] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:24:16 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:24:16.260024 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ef946f1e-3647-42ba-a049-39cf0c954088 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:16.260763 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ef946f1e-3647-42ba-a049-39cf0c954088 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 98766f8e-7b27-49e9-8565-4bc9c3e808d8] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:16.265955 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4a024396-3430-4ddc-8853-324df60754f5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:16.267272 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4a024396-3430-4ddc-8853-324df60754f5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:16.267736 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4a024396-3430-4ddc-8853-324df60754f5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:16.268784 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ef946f1e-3647-42ba-a049-39cf0c954088 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:16.269492 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ef946f1e-3647-42ba-a049-39cf0c954088 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:16.270471 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ef946f1e-3647-42ba-a049-39cf0c954088 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:16.271065 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ef946f1e-3647-42ba-a049-39cf0c954088 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:16.491492 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ef946f1e-3647-42ba-a049-39cf0c954088 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:16.499427 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ef946f1e-3647-42ba-a049-39cf0c954088 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8" status: 200 len: 1319 microversion: 2.1 time: 0.242977 Jun 05 08:24:16.504355 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 189/346] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:16 2022] GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:16.520415 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c1bd4618-4919-405d-b8d2-cb4559d331f1 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-155278755", "id": "ab58f8f8-cdba-4287-98e3-bd145c387676", "os-flavor-access:is_public": "True"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:16.522357 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:16.522357 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:16.533652 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4a024396-3430-4ddc-8853-324df60754f5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:16.544536 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c1bd4618-4919-405d-b8d2-cb4559d331f1 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.029295 Jun 05 08:24:16.545945 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 190/347] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:24:16 2022] POST /compute/v2.1/flavors => generated 506 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:16.562174 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cdf8b64d-6783-4dc0-a7d8-9b89466d3eaa tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:16.563737 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:16.563737 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:16.565828 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4a024396-3430-4ddc-8853-324df60754f5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1504 microversion: 2.1 time: 0.326524 Jun 05 08:24:16.568511 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 158/348] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:16 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1504 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:16.583315 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-346ae277-0e95-4e36-9761-6fb66d884cdd req-1db91c58-3964-4c9a-b7dc-c0a14b70f3da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98766f8e-7b27-49e9-8565-4bc9c3e808d8", "name": "network-vif-plugged", "status": "completed", "tag": "42d59f2a-9047-40e2-9f60-ef062332a62d"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:16.585736 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-cdf8b64d-6783-4dc0-a7d8-9b89466d3eaa tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/ab58f8f8-cdba-4287-98e3-bd145c387676" status: 202 len: 0 microversion: 2.1 time: 0.032837 Jun 05 08:24:16.589261 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 191/349] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:24:16 2022] DELETE /compute/v2.1/flavors/ab58f8f8-cdba-4287-98e3-bd145c387676 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:24:16.601718 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-346ae277-0e95-4e36-9761-6fb66d884cdd req-1db91c58-3964-4c9a-b7dc-c0a14b70f3da service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:16.602010 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fed5eaca-37fc-456d-a786-a409304dab02 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:16.603410 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-346ae277-0e95-4e36-9761-6fb66d884cdd req-1db91c58-3964-4c9a-b7dc-c0a14b70f3da service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:16.628967 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-346ae277-0e95-4e36-9761-6fb66d884cdd req-1db91c58-3964-4c9a-b7dc-c0a14b70f3da service nova] Creating event network-vif-plugged:42d59f2a-9047-40e2-9f60-ef062332a62d for instance 98766f8e-7b27-49e9-8565-4bc9c3e808d8 on n-h2-844739-1 Jun 05 08:24:16.638449 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-346ae277-0e95-4e36-9761-6fb66d884cdd req-1db91c58-3964-4c9a-b7dc-c0a14b70f3da service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066527 Jun 05 08:24:16.642272 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 159/350] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:16.648317 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fed5eaca-37fc-456d-a786-a409304dab02 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.054426 Jun 05 08:24:16.650281 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 192/351] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:24:16 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:16.666386 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ada8f11c-dfa6-419f-a291-5573ad1bc449 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-468132078", "id": 1944658500, "os-flavor-access:is_public": "True"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:16.668417 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:16.668417 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:16.687637 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ada8f11c-dfa6-419f-a291-5573ad1bc449 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.026156 Jun 05 08:24:16.689129 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 160/352] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:24:16 2022] POST /compute/v2.1/flavors => generated 413 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:24:16.700737 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-27e18971-be17-4106-a594-51ed0818431c tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:16.710933 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-27e18971-be17-4106-a594-51ed0818431c tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/1944658500" status: 200 len: 413 microversion: 2.1 time: 0.014125 Jun 05 08:24:16.711803 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 193/353] 10.222.0.33 () {58 vars in 1157 bytes} [Sun Jun 5 08:24:16 2022] GET /compute/v2.1/flavors/1944658500 => generated 413 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:16.995075 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-60432633-3a04-4717-80e3-a970d34ebf56 tempest-FlavorsAdminTestJSON-2072444619 tempest-FlavorsAdminTestJSON-2072444619-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:17.039426 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-60432633-3a04-4717-80e3-a970d34ebf56 tempest-FlavorsAdminTestJSON-2072444619 tempest-FlavorsAdminTestJSON-2072444619-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.319923 Jun 05 08:24:17.042192 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b7c76539-21cf-4a7c-98f0-1f5f5223b577 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:17.043603 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b7c76539-21cf-4a7c-98f0-1f5f5223b577 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:17.048834 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 161/354] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:24:16 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:17.061104 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b7c76539-21cf-4a7c-98f0-1f5f5223b577 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:17.061930 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fad423d2-e105-45fa-8365-31f083d7dd4a tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:17.062517 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b7c76539-21cf-4a7c-98f0-1f5f5223b577 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:17.062839 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:17.062839 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:17.063310 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b7c76539-21cf-4a7c-98f0-1f5f5223b577 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:17.063752 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b7c76539-21cf-4a7c-98f0-1f5f5223b577 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:17.085332 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fad423d2-e105-45fa-8365-31f083d7dd4a tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1944658500" status: 202 len: 0 microversion: 2.1 time: 0.027795 Jun 05 08:24:17.086630 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 162/355] 10.222.0.33 () {58 vars in 1160 bytes} [Sun Jun 5 08:24:17 2022] DELETE /compute/v2.1/flavors/1944658500 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 05 08:24:17.094780 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-26807c76-42fe-400e-afca-c9116a53bd95 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:17.126431 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-26807c76-42fe-400e-afca-c9116a53bd95 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.035378 Jun 05 08:24:17.126941 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 163/356] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:24:17 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:24:17.146145 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-eed04f93-a891-4b4c-b6c5-045fc1db142f tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1183648525", "id": 1277214158, "os-flavor-access:is_public": "False"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:17.166073 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-eed04f93-a891-4b4c-b6c5-045fc1db142f tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.024609 Jun 05 08:24:17.167209 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 164/357] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:24:17 2022] POST /compute/v2.1/flavors => generated 430 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:24:17.188115 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-23d75ea6-b7a8-4649-bcc1-8e6a2feebe82 tempest-FlavorsAdminTestJSON-2072444619 tempest-FlavorsAdminTestJSON-2072444619-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "1277214158"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:17.200665 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-23d75ea6-b7a8-4649-bcc1-8e6a2feebe82 tempest-FlavorsAdminTestJSON-2072444619 tempest-FlavorsAdminTestJSON-2072444619-project] HTTP exception thrown: Flavor 1277214158 could not be found. Jun 05 08:24:17.203784 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-23d75ea6-b7a8-4649-bcc1-8e6a2feebe82 tempest-FlavorsAdminTestJSON-2072444619 tempest-FlavorsAdminTestJSON-2072444619-project] Request method failure captured: Jun 05 08:24:17.203784 n-d-844739-1 devstack@n-api.service[119049]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 05 08:24:17.203784 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:24:17.203784 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:24:17.203784 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:24:17.203784 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 107 Jun 05 08:24:17.203784 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:24:17.203784 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:24:17.203784 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:24:17.203784 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:17.203784 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGgs8D7c4I54nI9kid3-Ail4bATIVPT8N1OHqKWJjYsd_6JjJGiTOP1FiX-o0N4JIWfhjsPjW__9SC0-Tc2c9cLD7bqAyzwZsoRCblYQpEWClqazJgu4Yfnnd3Xx-EMowddn2HT9F8EhrglTVBLYhP0H-Xzf4EQpyKpvI14rcs-kM98 Jun 05 08:24:17.203784 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:24:17.203784 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:24:17.203784 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:24:17.203784 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:24:17.203784 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:24:17.203784 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:24:17.203784 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: f515d8a4ea3940ffb4b97410e5762636 Jun 05 08:24:17.203784 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-FlavorsAdminTestJSON-2072444619 Jun 05 08:24:17.203784 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:24:17.203784 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:24:17.205316 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f515d8a4ea3940ffb4b97410e5762636"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f515d8a4ea3940ffb4b97410e5762636"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f515d8a4ea3940ffb4b97410e5762636", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f515d8a4ea3940ffb4b97410e5762636"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:17.205316 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-FlavorsAdminTestJSON-2072444619 Jun 05 08:24:17.205316 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: f515d8a4ea3940ffb4b97410e5762636 Jun 05 08:24:17.205316 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-2072444619 Jun 05 08:24:17.205316 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-FlavorsAdminTestJSON-2072444619-project Jun 05 08:24:17.205316 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:24:17.205316 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:24:17.205316 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 94f906aa78354a5899655911ba7950bf Jun 05 08:24:17.205316 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-FlavorsAdminTestJSON-2072444619-project Jun 05 08:24:17.205316 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:24:17.205316 n-d-844739-1 devstack@n-api.service[119049]: {"server": {"name": "test", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "1277214158"}} Jun 05 08:24:17.205316 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:24:17.205316 n-d-844739-1 devstack@n-api.service[119049]: exception: Flavor 1277214158 could not be found. Jun 05 08:24:17.206251 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '1241bde3-ef1f-41a5-b0fa-6f409216229a', 'flavorRef': '1277214158'}}} Jun 05 08:24:17.206251 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:17.206251 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:17.206251 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jun 05 08:24:17.206251 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jun 05 08:24:17.206251 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 05 08:24:17.206251 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 05 08:24:17.206251 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:24:17.206251 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:24:17.206251 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 05 08:24:17.206251 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 05 08:24:17.206251 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 05 08:24:17.206251 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:17.206251 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 05 08:24:17.206251 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 05 08:24:17.206251 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1277214158 could not be found. Jun 05 08:24:17.206251 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:17.206251 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:17.206251 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:17.206251 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:17.208365 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:17.208365 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:17.208365 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:17.208365 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:17.208365 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:17.208365 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:17.208365 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:24:17.208365 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:24:17.208365 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:24:17.208365 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:24:17.208365 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:24:17.208365 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:24:17.208365 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 05 08:24:17.208365 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 05 08:24:17.208365 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 05 08:24:17.208365 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1277214158 could not be found. Jun 05 08:24:17.208365 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:17.208365 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:17.208365 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:17.208365 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:17.208365 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:17.209704 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:17.209704 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:24:17.209704 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:24:17.209704 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1277214158 could not be found. Jun 05 08:24:17.209704 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:17.209704 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-23d75ea6-b7a8-4649-bcc1-8e6a2feebe82 tempest-FlavorsAdminTestJSON-2072444619 tempest-FlavorsAdminTestJSON-2072444619-project] Returning 400 to user: Flavor 1277214158 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:17.210877 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-23d75ea6-b7a8-4649-bcc1-8e6a2feebe82 tempest-FlavorsAdminTestJSON-2072444619 tempest-FlavorsAdminTestJSON-2072444619-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.037462 Jun 05 08:24:17.211902 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 165/358] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:24:17 2022] POST /compute/v2.1/servers => generated 81 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jun 05 08:24:17.222070 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e34a76af-8c00-4901-b615-fab420f459a4 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:17.246214 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e34a76af-8c00-4901-b615-fab420f459a4 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1277214158" status: 202 len: 0 microversion: 2.1 time: 0.029619 Jun 05 08:24:17.248050 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 166/359] 10.222.0.33 () {58 vars in 1160 bytes} [Sun Jun 5 08:24:17 2022] DELETE /compute/v2.1/flavors/1277214158 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 05 08:24:17.256741 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c197ebc0-b3fe-4ed0-925a-a6dd6fd56eb8 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:17.266864 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b7c76539-21cf-4a7c-98f0-1f5f5223b577 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:17.278833 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c197ebc0-b3fe-4ed0-925a-a6dd6fd56eb8 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.026919 Jun 05 08:24:17.280013 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 167/360] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:24:17 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:17.286416 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b7c76539-21cf-4a7c-98f0-1f5f5223b577 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1319 microversion: 2.1 time: 0.244014 Jun 05 08:24:17.287853 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 194/361] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:17 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:24:17.301409 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0293ddd6-9800-4da3-975c-c47f947ea2d7 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-380611115", "id": 1204890139, "os-flavor-access:is_public": "False"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:17.319350 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0293ddd6-9800-4da3-975c-c47f947ea2d7 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.022133 Jun 05 08:24:17.324353 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 168/362] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:24:17 2022] POST /compute/v2.1/flavors => generated 414 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:17.335803 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-88af3b68-0d1c-4b93-a920-197abeb99795 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2075048966", "id": 826362772, "os-flavor-access:is_public": "True"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:17.338676 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:17.338676 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:17.365527 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-88af3b68-0d1c-4b93-a920-197abeb99795 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.037938 Jun 05 08:24:17.366357 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 195/363] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:24:17 2022] POST /compute/v2.1/flavors => generated 411 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:17.378051 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2c7f25d4-971f-4d03-a779-8b7e4d6c0a3b tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:17.397797 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2c7f25d4-971f-4d03-a779-8b7e4d6c0a3b tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.024516 Jun 05 08:24:17.398491 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 169/364] 10.222.0.33 () {58 vars in 1168 bytes} [Sun Jun 5 08:24:17 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:17.409524 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-520f977a-5a93-42b8-89c2-bac1900a8d62 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:17.427957 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-520f977a-5a93-42b8-89c2-bac1900a8d62 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.021957 Jun 05 08:24:17.428598 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 196/365] 10.222.0.33 () {58 vars in 1176 bytes} [Sun Jun 5 08:24:17 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:17.439207 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-49331152-587a-48bc-8ba1-ceac2cb7af06 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:17.448669 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-49331152-587a-48bc-8ba1-ceac2cb7af06 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.012867 Jun 05 08:24:17.449368 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 170/366] 10.222.0.33 () {58 vars in 1170 bytes} [Sun Jun 5 08:24:17 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:17.461130 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7bc331fb-04d2-4547-9f47-dbbd6b2f74c2 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:17.473955 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7bc331fb-04d2-4547-9f47-dbbd6b2f74c2 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.016956 Jun 05 08:24:17.474528 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 197/367] 10.222.0.33 () {58 vars in 1168 bytes} [Sun Jun 5 08:24:17 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:17.485509 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c0cd976c-8d61-4595-8972-1f37cdf3bb2b tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:17.506625 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c0cd976c-8d61-4595-8972-1f37cdf3bb2b tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6221 microversion: 2.1 time: 0.024693 Jun 05 08:24:17.507393 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 171/368] 10.222.0.33 () {58 vars in 1168 bytes} [Sun Jun 5 08:24:17 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6221 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:17.522425 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e393d0c1-8d18-4491-8075-7097731ffc22 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:17.523136 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e393d0c1-8d18-4491-8075-7097731ffc22 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 98766f8e-7b27-49e9-8565-4bc9c3e808d8] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:17.523271 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-dcc758af-f432-4a7a-8bdf-72d2d6586788 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:17.531643 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e393d0c1-8d18-4491-8075-7097731ffc22 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:17.532125 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e393d0c1-8d18-4491-8075-7097731ffc22 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:17.532912 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e393d0c1-8d18-4491-8075-7097731ffc22 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:17.533351 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e393d0c1-8d18-4491-8075-7097731ffc22 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:17.544286 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-dcc758af-f432-4a7a-8bdf-72d2d6586788 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6221 microversion: 2.1 time: 0.025266 Jun 05 08:24:17.544879 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 172/369] 10.222.0.33 () {58 vars in 1174 bytes} [Sun Jun 5 08:24:17 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6221 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:24:17.560018 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-763c9d42-6893-401b-bf6c-43d861827315 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:17.583742 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-763c9d42-6893-401b-bf6c-43d861827315 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6221 microversion: 2.1 time: 0.027126 Jun 05 08:24:17.593982 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 173/370] 10.222.0.33 () {58 vars in 1172 bytes} [Sun Jun 5 08:24:17 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6221 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:24:17.600772 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2fa8f5b4-98af-431c-8ec0-e27cdccb7a42 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:17.602053 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2fa8f5b4-98af-431c-8ec0-e27cdccb7a42 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:17.610550 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2fa8f5b4-98af-431c-8ec0-e27cdccb7a42 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:17.611082 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2fa8f5b4-98af-431c-8ec0-e27cdccb7a42 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:17.611883 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2fa8f5b4-98af-431c-8ec0-e27cdccb7a42 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:17.612413 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2fa8f5b4-98af-431c-8ec0-e27cdccb7a42 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:17.743397 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e393d0c1-8d18-4491-8075-7097731ffc22 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:17.751109 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e393d0c1-8d18-4491-8075-7097731ffc22 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8" status: 200 len: 1319 microversion: 2.1 time: 0.233796 Jun 05 08:24:17.761925 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 198/371] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:17 2022] GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:24:17.771040 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6c0093a7-1998-49d7-a7a6-557255f47038 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:17.802653 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6c0093a7-1998-49d7-a7a6-557255f47038 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6221 microversion: 2.1 time: 0.039324 Jun 05 08:24:17.803260 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 199/372] 10.222.0.33 () {58 vars in 1168 bytes} [Sun Jun 5 08:24:17 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6221 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:17.815153 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2fa8f5b4-98af-431c-8ec0-e27cdccb7a42 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:17.823717 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2fa8f5b4-98af-431c-8ec0-e27cdccb7a42 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1504 microversion: 2.1 time: 0.233989 Jun 05 08:24:17.824867 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 174/373] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:17 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1504 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:17.831351 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f9adcd65-af99-40d2-8f31-86cf364c3ebd tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:17.832959 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:17.832959 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:17.849707 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f9adcd65-af99-40d2-8f31-86cf364c3ebd tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/826362772" status: 202 len: 0 microversion: 2.1 time: 0.023710 Jun 05 08:24:17.850282 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 175/374] 10.222.0.33 () {58 vars in 1157 bytes} [Sun Jun 5 08:24:17 2022] DELETE /compute/v2.1/flavors/826362772 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:24:17.859234 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0174346b-4891-4f08-b0f8-f1df7cc2a1d1 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:17.879843 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0174346b-4891-4f08-b0f8-f1df7cc2a1d1 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.024353 Jun 05 08:24:17.880453 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 176/375] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:24:17 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:17.895945 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8f868688-3fc2-42ec-ac9c-ec49c33f587f tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:17.905279 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=82,nova_api:DELETE=13 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:17.921679 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8f868688-3fc2-42ec-ac9c-ec49c33f587f tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1204890139" status: 202 len: 0 microversion: 2.1 time: 0.029311 Jun 05 08:24:17.926943 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 177/376] 10.222.0.33 () {58 vars in 1160 bytes} [Sun Jun 5 08:24:17 2022] DELETE /compute/v2.1/flavors/1204890139 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 05 08:24:17.932810 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4a9abd11-2e09-4c68-b2c0-d92b4629e263 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:17.968216 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4a9abd11-2e09-4c68-b2c0-d92b4629e263 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.039567 Jun 05 08:24:17.981893 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 178/377] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:24:17 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:17.994532 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f9cd6231-bd6d-4056-bec1-cbd3c6513002 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-354496612", "id": 955829484, "os-flavor-access:is_public": "False"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:17.996941 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:17.996941 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:18.019559 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f9cd6231-bd6d-4056-bec1-cbd3c6513002 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.029265 Jun 05 08:24:18.024193 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 179/378] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:24:17 2022] POST /compute/v2.1/flavors => generated 411 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:24:18.045692 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-61997726-0834-4537-b103-a077e724c12e tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:18.074631 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-61997726-0834-4537-b103-a077e724c12e tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.044476 Jun 05 08:24:18.075741 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 180/379] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:24:18 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:18.092201 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3756bf5d-9244-4963-846b-5fe800784015 tempest-FlavorsAdminTestJSON-2072444619 tempest-FlavorsAdminTestJSON-2072444619-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:18.121482 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3756bf5d-9244-4963-846b-5fe800784015 tempest-FlavorsAdminTestJSON-2072444619 tempest-FlavorsAdminTestJSON-2072444619-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.033266 Jun 05 08:24:18.124474 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 181/380] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:24:18 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:18.140647 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-243a1c07-39fd-4936-b3a1-f2b41a4ca0bb tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:18.160809 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-243a1c07-39fd-4936-b3a1-f2b41a4ca0bb tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/955829484" status: 202 len: 0 microversion: 2.1 time: 0.024359 Jun 05 08:24:18.161636 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 182/381] 10.222.0.33 () {58 vars in 1157 bytes} [Sun Jun 5 08:24:18 2022] DELETE /compute/v2.1/flavors/955829484 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 05 08:24:18.170195 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5de13070-ccfe-49f4-959f-6860fdac1c6e tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:18.194074 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5de13070-ccfe-49f4-959f-6860fdac1c6e tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.027446 Jun 05 08:24:18.206562 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 183/382] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:24:18 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:24:18.212920 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8d9ecd3b-73ba-4fd9-9edd-99fef00fff9c tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-886143543", "id": 366224566, "os-flavor-access:is_public": "True"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:18.237373 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8d9ecd3b-73ba-4fd9-9edd-99fef00fff9c tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.028606 Jun 05 08:24:18.244264 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 184/383] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:24:18 2022] POST /compute/v2.1/flavors => generated 410 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:24:18.250837 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7521a54f-e9e5-4eca-a1ba-dc97576f37d1 tempest-FlavorsAdminTestJSON-2072444619 tempest-FlavorsAdminTestJSON-2072444619-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:18.276323 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7521a54f-e9e5-4eca-a1ba-dc97576f37d1 tempest-FlavorsAdminTestJSON-2072444619 tempest-FlavorsAdminTestJSON-2072444619-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 6220 microversion: 2.1 time: 0.029491 Jun 05 08:24:18.292531 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 185/384] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:24:18 2022] GET /compute/v2.1/flavors/detail => generated 6220 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:18.313694 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c25ba084-70f6-4558-a606-1f80a61f5b7a tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:18.318892 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=8 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:18.347772 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1bc20b61-2840-4e43-b7f7-e43a1ca90e84 tempest-HypervisorAdminNegativeUnderV252Test-1116795697 tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin] Calling method '.version_select at 0x7f2433cbf790>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:18.350406 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:18.350406 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:18.352244 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1bc20b61-2840-4e43-b7f7-e43a1ca90e84 tempest-HypervisorAdminNegativeUnderV252Test-1116795697 tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:18.352954 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1bc20b61-2840-4e43-b7f7-e43a1ca90e84 tempest-HypervisorAdminNegativeUnderV252Test-1116795697 tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:18.366096 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c25ba084-70f6-4558-a606-1f80a61f5b7a tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/366224566" status: 202 len: 0 microversion: 2.1 time: 0.069283 Jun 05 08:24:18.371676 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 186/385] 10.222.0.33 () {58 vars in 1157 bytes} [Sun Jun 5 08:24:18 2022] DELETE /compute/v2.1/flavors/366224566 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:24:18.386321 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7327aec7-591a-40f0-b872-bb9305fe0b34 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:18.387271 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7327aec7-591a-40f0-b872-bb9305fe0b34 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:18.400233 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7327aec7-591a-40f0-b872-bb9305fe0b34 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:18.401318 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7327aec7-591a-40f0-b872-bb9305fe0b34 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:18.402857 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7327aec7-591a-40f0-b872-bb9305fe0b34 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:18.403927 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7327aec7-591a-40f0-b872-bb9305fe0b34 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:18.405847 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1bc20b61-2840-4e43-b7f7-e43a1ca90e84 tempest-HypervisorAdminNegativeUnderV252Test-1116795697 tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:18.406747 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1bc20b61-2840-4e43-b7f7-e43a1ca90e84 tempest-HypervisorAdminNegativeUnderV252Test-1116795697 tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:18.423487 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1bc20b61-2840-4e43-b7f7-e43a1ca90e84 tempest-HypervisorAdminNegativeUnderV252Test-1116795697 tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:18.424459 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1bc20b61-2840-4e43-b7f7-e43a1ca90e84 tempest-HypervisorAdminNegativeUnderV252Test-1116795697 tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:18.434761 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1bc20b61-2840-4e43-b7f7-e43a1ca90e84 tempest-HypervisorAdminNegativeUnderV252Test-1116795697 tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.630182 Jun 05 08:24:18.436374 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 200/386] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:24:17 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:18.445551 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e8d48057-c3a4-4301-a067-93e4d71761e5 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:18.469003 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e8d48057-c3a4-4301-a067-93e4d71761e5 tempest-FlavorsAdminTestJSON-2083904226 tempest-FlavorsAdminTestJSON-2083904226-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.030912 Jun 05 08:24:18.469961 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 201/387] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:24:18 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:18.731602 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7327aec7-591a-40f0-b872-bb9305fe0b34 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:18.755435 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7327aec7-591a-40f0-b872-bb9305fe0b34 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1319 microversion: 2.1 time: 0.379451 Jun 05 08:24:18.756076 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 187/388] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:18 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1319 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:18.781724 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-79e93a6a-9521-47c1-ad45-c9d4a8c367c2 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:18.784230 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-79e93a6a-9521-47c1-ad45-c9d4a8c367c2 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 98766f8e-7b27-49e9-8565-4bc9c3e808d8] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:18.804324 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-79e93a6a-9521-47c1-ad45-c9d4a8c367c2 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:18.810070 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-79e93a6a-9521-47c1-ad45-c9d4a8c367c2 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:18.811147 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-79e93a6a-9521-47c1-ad45-c9d4a8c367c2 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:18.813163 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-79e93a6a-9521-47c1-ad45-c9d4a8c367c2 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:18.895975 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fed303b1-b77e-4b75-9cc0-589191633c88 tempest-HypervisorAdminNegativeUnderV252Test-1369718432 tempest-HypervisorAdminNegativeUnderV252Test-1369718432-project] Calling method '.version_select at 0x7f2433dac430>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:18.898618 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:18.898618 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:18.900073 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-fed303b1-b77e-4b75-9cc0-589191633c88 tempest-HypervisorAdminNegativeUnderV252Test-1369718432 tempest-HypervisorAdminNegativeUnderV252Test-1369718432-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '6012c9b59dc74285a90561aea2f55f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a887151004774feda7b306150005dd61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:18.903440 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fed303b1-b77e-4b75-9cc0-589191633c88 tempest-HypervisorAdminNegativeUnderV252Test-1369718432 tempest-HypervisorAdminNegativeUnderV252Test-1369718432-project] Request method failure captured: Jun 05 08:24:18.903440 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-hypervisors/n-h2-844739-1/search HTTP/1.1 Jun 05 08:24:18.903440 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:24:18.903440 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:24:18.903440 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:24:18.903440 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:24:18.903440 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:24:18.903440 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:24:18.903440 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:24:18.903440 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:18.903440 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGgvU2S0atQMbJPYZnK94s0SfRCOAq7rMx0l_ySUb_cHweQ9jl2RlP9GELsqm7vdTPrhi68KCeluY7XgOOOniKRLQrhcdLJzM6vw0SD8MUGUMUiGk3iT_Iql7f2O8r72zj15TWpndRKnEh3NwZU9tlZeOiexiYVQwmPwKXu28zVONps Jun 05 08:24:18.903440 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:24:18.903440 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:24:18.903440 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:24:18.903440 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:24:18.903440 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:24:18.903440 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:24:18.903440 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: a887151004774feda7b306150005dd61 Jun 05 08:24:18.903440 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1369718432 Jun 05 08:24:18.903440 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:24:18.903440 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:24:18.905175 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a887151004774feda7b306150005dd61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a887151004774feda7b306150005dd61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a887151004774feda7b306150005dd61", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a887151004774feda7b306150005dd61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:18.905175 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1369718432 Jun 05 08:24:18.905175 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: a887151004774feda7b306150005dd61 Jun 05 08:24:18.905175 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1369718432 Jun 05 08:24:18.905175 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1369718432-project Jun 05 08:24:18.905175 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:24:18.905175 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:24:18.905175 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 6012c9b59dc74285a90561aea2f55f97 Jun 05 08:24:18.905175 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1369718432-project Jun 05 08:24:18.905175 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:24:18.905175 n-d-844739-1 devstack@n-api.service[119050]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jun 05 08:24:18.905175 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'n-h2-844739-1'} Jun 05 08:24:18.905934 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:18.905934 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:18.905934 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:18.905934 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:18.905934 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:18.905934 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:18.905934 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:24:18.905934 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:24:18.905934 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:18.905934 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:18.905934 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jun 05 08:24:18.905934 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jun 05 08:24:18.905934 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:24:18.905934 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:24:18.905934 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:24:18.905934 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:24:18.905934 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:24:18.905934 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:24:18.905934 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:24:18.906946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:24:18.906946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:24:18.906946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:24:18.906946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:24:18.906946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:24:18.906946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:24:18.906946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:24:18.906946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jun 05 08:24:18.906946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:18.906946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:18.906946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:18.906946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:18.906946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:18.906946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:18.906946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:24:18.906946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:24:18.906946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jun 05 08:24:18.906946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:18.909774 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fed303b1-b77e-4b75-9cc0-589191633c88 tempest-HypervisorAdminNegativeUnderV252Test-1369718432 tempest-HypervisorAdminNegativeUnderV252Test-1369718432-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:18.910967 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fed303b1-b77e-4b75-9cc0-589191633c88 tempest-HypervisorAdminNegativeUnderV252Test-1369718432 tempest-HypervisorAdminNegativeUnderV252Test-1369718432-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/n-h2-844739-1/search" status: 403 len: 117 microversion: 2.1 time: 0.428555 Jun 05 08:24:18.912447 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 202/389] 10.222.0.33 () {58 vars in 1208 bytes} [Sun Jun 5 08:24:18 2022] GET /compute/v2.1/os-hypervisors/n-h2-844739-1/search => generated 117 bytes in 430 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:24:18.917414 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a6ec2bf7-b9f6-4007-8990-ef6b32d63c62 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:18.918262 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a6ec2bf7-b9f6-4007-8990-ef6b32d63c62 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:18.928427 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a6ec2bf7-b9f6-4007-8990-ef6b32d63c62 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:18.930861 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a6ec2bf7-b9f6-4007-8990-ef6b32d63c62 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:18.932276 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a6ec2bf7-b9f6-4007-8990-ef6b32d63c62 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:18.932921 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a6ec2bf7-b9f6-4007-8990-ef6b32d63c62 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:19.101692 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-79e93a6a-9521-47c1-ad45-c9d4a8c367c2 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:19.118745 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-79e93a6a-9521-47c1-ad45-c9d4a8c367c2 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8" status: 200 len: 1469 microversion: 2.1 time: 0.349279 Jun 05 08:24:19.119563 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 188/390] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:18 2022] GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8 => generated 1469 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:19.131254 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8dc65e1f-00df-42e9-9754-45637f97f2b1 tempest-HypervisorAdminNegativeUnderV252Test-1116795697 tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin] Calling method '.version_select at 0x7f2433e403a0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:19.132213 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:19.132213 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:19.133372 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8dc65e1f-00df-42e9-9754-45637f97f2b1 tempest-HypervisorAdminNegativeUnderV252Test-1116795697 tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:19.133827 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8dc65e1f-00df-42e9-9754-45637f97f2b1 tempest-HypervisorAdminNegativeUnderV252Test-1116795697 tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:19.142650 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-8dc65e1f-00df-42e9-9754-45637f97f2b1 tempest-HypervisorAdminNegativeUnderV252Test-1116795697 tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 05 08:24:19.144521 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8dc65e1f-00df-42e9-9754-45637f97f2b1 tempest-HypervisorAdminNegativeUnderV252Test-1116795697 tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin] Request method failure captured: Jun 05 08:24:19.144521 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jun 05 08:24:19.144521 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:24:19.144521 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:24:19.144521 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:24:19.144521 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:24:19.144521 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:24:19.144521 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:24:19.144521 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:24:19.144521 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:19.144521 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGgx7mkKoo_fchvS9jW0xhlbz1R2w3cwPM_8PHmk5lMwdnD0i4myNQBBtHn5P2OW-DrVF9Xc_P5HCF8uqvMa48Sch9LaB3lVWKPhT6zsSbfnxYvCa9k-RKMuuURO57OSogm38lhV4D5ZeKA7SRLOWy0132gDHQ2Z4w3fW1mw9bAPgl0 Jun 05 08:24:19.144521 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:24:19.144521 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:24:19.144521 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:24:19.144521 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:24:19.144521 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:24:19.144521 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:24:19.144521 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: bb9470ca531348ee81aadd98688e0bb6 Jun 05 08:24:19.144521 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1116795697 Jun 05 08:24:19.144521 n-d-844739-1 devstack@n-api.service[119049]: X-Role: admin,reader,member Jun 05 08:24:19.144521 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: admin,reader,member Jun 05 08:24:19.146068 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bb9470ca531348ee81aadd98688e0bb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bb9470ca531348ee81aadd98688e0bb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bb9470ca531348ee81aadd98688e0bb6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bb9470ca531348ee81aadd98688e0bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:19.146068 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1116795697 Jun 05 08:24:19.146068 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: bb9470ca531348ee81aadd98688e0bb6 Jun 05 08:24:19.146068 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1116795697 Jun 05 08:24:19.146068 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin Jun 05 08:24:19.146068 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:24:19.146068 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:24:19.146068 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 2aa349ecbf344c168a11cca8b5198b44 Jun 05 08:24:19.146068 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin Jun 05 08:24:19.146068 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:24:19.146068 n-d-844739-1 devstack@n-api.service[119049]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 05 08:24:19.146068 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'nonexistent_hypervisor_name'} Jun 05 08:24:19.146773 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:19.146773 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:19.146773 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:19.146773 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:19.146773 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:19.146773 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:19.146773 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:24:19.146773 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:24:19.146773 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:19.146773 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:19.146773 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jun 05 08:24:19.146773 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jun 05 08:24:19.146773 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jun 05 08:24:19.146773 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 05 08:24:19.146773 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 05 08:24:19.146773 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:19.146773 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:19.146773 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:19.146773 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:19.146773 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:19.147874 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:19.147874 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:24:19.147874 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:24:19.147874 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 05 08:24:19.147874 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:19.147874 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8dc65e1f-00df-42e9-9754-45637f97f2b1 tempest-HypervisorAdminNegativeUnderV252Test-1116795697 tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:19.147874 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8dc65e1f-00df-42e9-9754-45637f97f2b1 tempest-HypervisorAdminNegativeUnderV252Test-1116795697 tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.025837 Jun 05 08:24:19.150946 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 189/391] 10.222.0.33 () {58 vars in 1250 bytes} [Sun Jun 5 08:24:19 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:24:19.157395 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4959b52a-59ea-433e-913f-55771dfc7fce tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:19.157969 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4959b52a-59ea-433e-913f-55771dfc7fce tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] [instance: 98766f8e-7b27-49e9-8565-4bc9c3e808d8] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:19.165781 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4959b52a-59ea-433e-913f-55771dfc7fce tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:19.166241 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4959b52a-59ea-433e-913f-55771dfc7fce tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:19.167024 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4959b52a-59ea-433e-913f-55771dfc7fce tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:19.167665 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4959b52a-59ea-433e-913f-55771dfc7fce tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:19.211614 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-4959b52a-59ea-433e-913f-55771dfc7fce tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Lazy-loading 'flavor' on Instance uuid 98766f8e-7b27-49e9-8565-4bc9c3e808d8 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:19.248654 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a6ec2bf7-b9f6-4007-8990-ef6b32d63c62 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:19.259327 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a6ec2bf7-b9f6-4007-8990-ef6b32d63c62 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1504 microversion: 2.1 time: 0.345571 Jun 05 08:24:19.271363 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 203/392] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:18 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1504 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:19.278318 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6bd936e0-3ac8-40b9-a53f-083dc1bf352d tempest-HypervisorAdminNegativeUnderV252Test-1116795697 tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin] Calling method '.version_select at 0x7f2433c513a0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:19.279781 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:19.279781 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:19.282130 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6bd936e0-3ac8-40b9-a53f-083dc1bf352d tempest-HypervisorAdminNegativeUnderV252Test-1116795697 tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:19.282845 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6bd936e0-3ac8-40b9-a53f-083dc1bf352d tempest-HypervisorAdminNegativeUnderV252Test-1116795697 tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:19.306595 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6bd936e0-3ac8-40b9-a53f-083dc1bf352d tempest-HypervisorAdminNegativeUnderV252Test-1116795697 tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:19.308581 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6bd936e0-3ac8-40b9-a53f-083dc1bf352d tempest-HypervisorAdminNegativeUnderV252Test-1116795697 tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:19.325397 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6bd936e0-3ac8-40b9-a53f-083dc1bf352d tempest-HypervisorAdminNegativeUnderV252Test-1116795697 tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:19.326271 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6bd936e0-3ac8-40b9-a53f-083dc1bf352d tempest-HypervisorAdminNegativeUnderV252Test-1116795697 tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:19.335536 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6bd936e0-3ac8-40b9-a53f-083dc1bf352d tempest-HypervisorAdminNegativeUnderV252Test-1116795697 tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.061816 Jun 05 08:24:19.346208 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 204/393] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:24:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:19.358661 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5d544786-f904-4b4f-9196-a3b3d458d130 tempest-HypervisorAdminNegativeUnderV252Test-1369718432 tempest-HypervisorAdminNegativeUnderV252Test-1369718432-project] Calling method '.version_select at 0x7f2433c51af0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:19.360959 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:19.360959 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:19.365052 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4959b52a-59ea-433e-913f-55771dfc7fce tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8/action" status: 202 len: 0 microversion: 2.1 time: 0.210384 Jun 05 08:24:19.366560 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 190/394] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Jun 5 08:24:19 2022] POST /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:24:19.367735 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5d544786-f904-4b4f-9196-a3b3d458d130 tempest-HypervisorAdminNegativeUnderV252Test-1369718432 tempest-HypervisorAdminNegativeUnderV252Test-1369718432-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '6012c9b59dc74285a90561aea2f55f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a887151004774feda7b306150005dd61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:19.374365 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5d544786-f904-4b4f-9196-a3b3d458d130 tempest-HypervisorAdminNegativeUnderV252Test-1369718432 tempest-HypervisorAdminNegativeUnderV252Test-1369718432-project] Request method failure captured: Jun 05 08:24:19.374365 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jun 05 08:24:19.374365 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:24:19.374365 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:24:19.374365 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:24:19.374365 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:24:19.374365 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:24:19.374365 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:24:19.374365 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:24:19.374365 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:19.374365 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGgvU2S0atQMbJPYZnK94s0SfRCOAq7rMx0l_ySUb_cHweQ9jl2RlP9GELsqm7vdTPrhi68KCeluY7XgOOOniKRLQrhcdLJzM6vw0SD8MUGUMUiGk3iT_Iql7f2O8r72zj15TWpndRKnEh3NwZU9tlZeOiexiYVQwmPwKXu28zVONps Jun 05 08:24:19.374365 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:24:19.374365 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:24:19.374365 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:24:19.374365 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:24:19.374365 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:24:19.374365 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:24:19.374365 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: a887151004774feda7b306150005dd61 Jun 05 08:24:19.374365 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1369718432 Jun 05 08:24:19.374365 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:24:19.374365 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:24:19.377050 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a887151004774feda7b306150005dd61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a887151004774feda7b306150005dd61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a887151004774feda7b306150005dd61", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a887151004774feda7b306150005dd61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:19.377050 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1369718432 Jun 05 08:24:19.377050 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: a887151004774feda7b306150005dd61 Jun 05 08:24:19.377050 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1369718432 Jun 05 08:24:19.377050 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1369718432-project Jun 05 08:24:19.377050 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:24:19.377050 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:24:19.377050 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 6012c9b59dc74285a90561aea2f55f97 Jun 05 08:24:19.377050 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1369718432-project Jun 05 08:24:19.377050 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:24:19.377050 n-d-844739-1 devstack@n-api.service[119050]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jun 05 08:24:19.377050 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '1'} Jun 05 08:24:19.378116 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:19.378116 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:19.378116 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:19.378116 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:19.378116 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:19.378116 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:19.378116 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:24:19.378116 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:24:19.378116 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:19.378116 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:19.378116 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jun 05 08:24:19.378116 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jun 05 08:24:19.378116 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:24:19.378116 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:24:19.378116 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:24:19.378116 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:24:19.378116 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:24:19.378116 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:24:19.378116 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:24:19.382150 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:24:19.382150 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:24:19.382150 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:24:19.382150 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:24:19.382150 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:24:19.382150 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:24:19.382150 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:24:19.382150 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jun 05 08:24:19.382150 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:19.382150 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:19.382150 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:19.382150 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:19.382150 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:19.382150 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:19.382150 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:24:19.382150 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:24:19.382150 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jun 05 08:24:19.382150 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:19.386284 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5d544786-f904-4b4f-9196-a3b3d458d130 tempest-HypervisorAdminNegativeUnderV252Test-1369718432 tempest-HypervisorAdminNegativeUnderV252Test-1369718432-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:19.388530 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5d544786-f904-4b4f-9196-a3b3d458d130 tempest-HypervisorAdminNegativeUnderV252Test-1369718432 tempest-HypervisorAdminNegativeUnderV252Test-1369718432-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.040830 Jun 05 08:24:19.395637 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 205/395] 10.222.0.33 () {58 vars in 1175 bytes} [Sun Jun 5 08:24:19 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 48 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:24:19.401294 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-31ec2380-4845-4d64-b3f4-a9c88333b646 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:19.402408 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-31ec2380-4845-4d64-b3f4-a9c88333b646 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 98766f8e-7b27-49e9-8565-4bc9c3e808d8] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:19.406124 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-86d2c8a5-5f74-4ed2-912c-5595fdc2c734 tempest-HypervisorAdminNegativeUnderV252Test-1116795697 tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin] Calling method '.version_select at 0x7f2433c4b9d0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:19.411728 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-86d2c8a5-5f74-4ed2-912c-5595fdc2c734 tempest-HypervisorAdminNegativeUnderV252Test-1116795697 tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:19.412497 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-86d2c8a5-5f74-4ed2-912c-5595fdc2c734 tempest-HypervisorAdminNegativeUnderV252Test-1116795697 tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:19.422697 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-31ec2380-4845-4d64-b3f4-a9c88333b646 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:19.423454 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-31ec2380-4845-4d64-b3f4-a9c88333b646 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:19.424589 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-31ec2380-4845-4d64-b3f4-a9c88333b646 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:19.427518 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-31ec2380-4845-4d64-b3f4-a9c88333b646 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:19.443263 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-86d2c8a5-5f74-4ed2-912c-5595fdc2c734 tempest-HypervisorAdminNegativeUnderV252Test-1116795697 tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin] HTTP exception thrown: No hypervisor matching '33827e25-6ef7-4f0f-84be-a2385f28b63d' could be found. Jun 05 08:24:19.445278 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-86d2c8a5-5f74-4ed2-912c-5595fdc2c734 tempest-HypervisorAdminNegativeUnderV252Test-1116795697 tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin] Request method failure captured: Jun 05 08:24:19.445278 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-hypervisors/33827e25-6ef7-4f0f-84be-a2385f28b63d/servers HTTP/1.1 Jun 05 08:24:19.445278 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:24:19.445278 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:24:19.445278 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:24:19.445278 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:24:19.445278 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:24:19.445278 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:24:19.445278 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:24:19.445278 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:19.445278 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGgx7mkKoo_fchvS9jW0xhlbz1R2w3cwPM_8PHmk5lMwdnD0i4myNQBBtHn5P2OW-DrVF9Xc_P5HCF8uqvMa48Sch9LaB3lVWKPhT6zsSbfnxYvCa9k-RKMuuURO57OSogm38lhV4D5ZeKA7SRLOWy0132gDHQ2Z4w3fW1mw9bAPgl0 Jun 05 08:24:19.445278 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:24:19.445278 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:24:19.445278 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:24:19.445278 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:24:19.445278 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:24:19.445278 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:24:19.445278 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: bb9470ca531348ee81aadd98688e0bb6 Jun 05 08:24:19.445278 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1116795697 Jun 05 08:24:19.445278 n-d-844739-1 devstack@n-api.service[119050]: X-Role: admin,reader,member Jun 05 08:24:19.445278 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: admin,reader,member Jun 05 08:24:19.446458 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bb9470ca531348ee81aadd98688e0bb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bb9470ca531348ee81aadd98688e0bb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bb9470ca531348ee81aadd98688e0bb6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bb9470ca531348ee81aadd98688e0bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:19.446458 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1116795697 Jun 05 08:24:19.446458 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: bb9470ca531348ee81aadd98688e0bb6 Jun 05 08:24:19.446458 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1116795697 Jun 05 08:24:19.446458 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin Jun 05 08:24:19.446458 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:24:19.446458 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:24:19.446458 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 2aa349ecbf344c168a11cca8b5198b44 Jun 05 08:24:19.446458 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin Jun 05 08:24:19.446458 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:24:19.446458 n-d-844739-1 devstack@n-api.service[119050]: exception: No hypervisor matching '33827e25-6ef7-4f0f-84be-a2385f28b63d' could be found. Jun 05 08:24:19.446458 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '33827e25-6ef7-4f0f-84be-a2385f28b63d'} Jun 05 08:24:19.447111 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:19.447111 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:19.447111 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:19.447111 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:19.447111 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:19.447111 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:19.447111 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:24:19.447111 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:24:19.447111 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:19.447111 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:19.447111 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jun 05 08:24:19.447111 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jun 05 08:24:19.447111 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jun 05 08:24:19.447111 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 05 08:24:19.447111 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '33827e25-6ef7-4f0f-84be-a2385f28b63d' could be found. Jun 05 08:24:19.447111 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:19.447111 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:19.447111 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:19.447111 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:19.448128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:19.448128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:19.448128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:24:19.448128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:24:19.448128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '33827e25-6ef7-4f0f-84be-a2385f28b63d' could be found. Jun 05 08:24:19.448128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:19.451170 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-86d2c8a5-5f74-4ed2-912c-5595fdc2c734 tempest-HypervisorAdminNegativeUnderV252Test-1116795697 tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin] Returning 404 to user: No hypervisor matching '33827e25-6ef7-4f0f-84be-a2385f28b63d' could be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:19.452914 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-86d2c8a5-5f74-4ed2-912c-5595fdc2c734 tempest-HypervisorAdminNegativeUnderV252Test-1116795697 tempest-HypervisorAdminNegativeUnderV252Test-1116795697-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/33827e25-6ef7-4f0f-84be-a2385f28b63d/servers" status: 404 len: 123 microversion: 2.1 time: 0.055510 Jun 05 08:24:19.458566 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 206/396] 10.222.0.33 () {58 vars in 1280 bytes} [Sun Jun 5 08:24:19 2022] GET /compute/v2.1/os-hypervisors/33827e25-6ef7-4f0f-84be-a2385f28b63d/servers => generated 123 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:24:19.666325 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-31ec2380-4845-4d64-b3f4-a9c88333b646 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:19.688388 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-31ec2380-4845-4d64-b3f4-a9c88333b646 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8" status: 200 len: 1477 microversion: 2.1 time: 0.317061 Jun 05 08:24:19.690162 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 191/397] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:19 2022] GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8 => generated 1477 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:19.775197 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5b1628ce-8730-44dc-9bd3-83b0f332ab2c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:19.776112 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5b1628ce-8730-44dc-9bd3-83b0f332ab2c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:19.780002 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=15,nova_api:INSERT=5 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:19.791870 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5b1628ce-8730-44dc-9bd3-83b0f332ab2c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:19.792435 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5b1628ce-8730-44dc-9bd3-83b0f332ab2c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:19.793370 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5b1628ce-8730-44dc-9bd3-83b0f332ab2c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:19.794306 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5b1628ce-8730-44dc-9bd3-83b0f332ab2c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:20.127382 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5b1628ce-8730-44dc-9bd3-83b0f332ab2c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:20.137317 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5b1628ce-8730-44dc-9bd3-83b0f332ab2c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1319 microversion: 2.1 time: 0.366966 Jun 05 08:24:20.140542 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 207/398] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:19 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:20.279264 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a8f96fbf-876c-47f1-8991-5b723afe3259 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:20.279911 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a8f96fbf-876c-47f1-8991-5b723afe3259 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:20.301607 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a8f96fbf-876c-47f1-8991-5b723afe3259 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:20.302127 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a8f96fbf-876c-47f1-8991-5b723afe3259 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:20.302865 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a8f96fbf-876c-47f1-8991-5b723afe3259 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:20.305274 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a8f96fbf-876c-47f1-8991-5b723afe3259 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:20.535497 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2978c265-63ee-4aa8-bc63-4db7e5d531f2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1388130542", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "5e152ab5-e6ab-45e6-98dc-54b68e92eeb0"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:20.650251 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-2978c265-63ee-4aa8-bc63-4db7e5d531f2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] validate_networks() for [('5e152ab5-e6ab-45e6-98dc-54b68e92eeb0', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:24:20.948235 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a8f96fbf-876c-47f1-8991-5b723afe3259 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:20.961233 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a8f96fbf-876c-47f1-8991-5b723afe3259 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1504 microversion: 2.1 time: 0.685616 Jun 05 08:24:20.962354 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 208/399] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:20 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1504 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:24:20.977630 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3f7c99e4-02bf-446d-aa70-a7d4399a630d tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:20.980566 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3f7c99e4-02bf-446d-aa70-a7d4399a630d tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 98766f8e-7b27-49e9-8565-4bc9c3e808d8] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:20.991923 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3f7c99e4-02bf-446d-aa70-a7d4399a630d tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:20.992827 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3f7c99e4-02bf-446d-aa70-a7d4399a630d tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:20.996093 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3f7c99e4-02bf-446d-aa70-a7d4399a630d tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:20.996799 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3f7c99e4-02bf-446d-aa70-a7d4399a630d tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:21.115724 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=10 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:21.357530 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3f7c99e4-02bf-446d-aa70-a7d4399a630d tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:21.371358 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3f7c99e4-02bf-446d-aa70-a7d4399a630d tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8" status: 200 len: 1460 microversion: 2.1 time: 0.403321 Jun 05 08:24:21.373059 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 209/400] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:20 2022] GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8 => generated 1460 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:21.384759 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-c23fc79f-a9de-4ee0-9cf5-b790749d1aef req-2890b069-c548-417f-9161-84188b01dbf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "969237ff-17eb-4838-9c3d-68dcbc1f94ca", "name": "network-vif-unplugged", "status": "completed", "tag": "b5f2e58e-0349-480d-8927-484d2f39dee5"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:21.408556 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-c23fc79f-a9de-4ee0-9cf5-b790749d1aef req-2890b069-c548-417f-9161-84188b01dbf4 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:21.409961 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-c23fc79f-a9de-4ee0-9cf5-b790749d1aef req-2890b069-c548-417f-9161-84188b01dbf4 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:21.440969 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-c23fc79f-a9de-4ee0-9cf5-b790749d1aef req-2890b069-c548-417f-9161-84188b01dbf4 service nova] Creating event network-vif-unplugged:b5f2e58e-0349-480d-8927-484d2f39dee5 for instance 969237ff-17eb-4838-9c3d-68dcbc1f94ca on n-h1-844739-1 Jun 05 08:24:21.455403 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-c23fc79f-a9de-4ee0-9cf5-b790749d1aef req-2890b069-c548-417f-9161-84188b01dbf4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078195 Jun 05 08:24:21.457721 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-2978c265-63ee-4aa8-bc63-4db7e5d531f2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:24:21.458217 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 210/401] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:21.458325 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-2978c265-63ee-4aa8-bc63-4db7e5d531f2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:24:21.458867 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-2978c265-63ee-4aa8-bc63-4db7e5d531f2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:24:21.459724 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-2978c265-63ee-4aa8-bc63-4db7e5d531f2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:24:21.460234 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-2978c265-63ee-4aa8-bc63-4db7e5d531f2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:24:21.472080 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2978c265-63ee-4aa8-bc63-4db7e5d531f2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:21.472619 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2978c265-63ee-4aa8-bc63-4db7e5d531f2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:21.474483 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2978c265-63ee-4aa8-bc63-4db7e5d531f2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:21.474969 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2978c265-63ee-4aa8-bc63-4db7e5d531f2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:21.475232 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a36287fe-6cdb-465c-a0e7-d803253f3380 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:21.476178 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a36287fe-6cdb-465c-a0e7-d803253f3380 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:21.491555 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a36287fe-6cdb-465c-a0e7-d803253f3380 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:21.492020 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a36287fe-6cdb-465c-a0e7-d803253f3380 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:21.492843 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a36287fe-6cdb-465c-a0e7-d803253f3380 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:21.493302 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a36287fe-6cdb-465c-a0e7-d803253f3380 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:21.500015 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-2978c265-63ee-4aa8-bc63-4db7e5d531f2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Getting quotas for project 3801b3ebfcdd446c93e054b3f7baa53f. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:24:21.505255 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-2978c265-63ee-4aa8-bc63-4db7e5d531f2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Getting quotas for user 74ce8e767dfe4eb29c2c8402c79b01c2 and project 3801b3ebfcdd446c93e054b3f7baa53f. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:24:21.525303 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2978c265-63ee-4aa8-bc63-4db7e5d531f2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:24:21.528875 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2978c265-63ee-4aa8-bc63-4db7e5d531f2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] [instance: a51cf7cd-6764-454d-9efe-075a34cbff11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:24:21.605475 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2978c265-63ee-4aa8-bc63-4db7e5d531f2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.539819 Jun 05 08:24:21.607344 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 192/402] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:24:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:24:21.616954 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-98be3e7f-3885-47ee-84ba-3a33855cb2a7 tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:21.617878 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-98be3e7f-3885-47ee-84ba-3a33855cb2a7 tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] [instance: 98766f8e-7b27-49e9-8565-4bc9c3e808d8] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:21.626589 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-98be3e7f-3885-47ee-84ba-3a33855cb2a7 tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:21.627601 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-98be3e7f-3885-47ee-84ba-3a33855cb2a7 tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:21.628718 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-98be3e7f-3885-47ee-84ba-3a33855cb2a7 tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:21.629718 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-98be3e7f-3885-47ee-84ba-3a33855cb2a7 tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:21.730919 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:21.790191 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a36287fe-6cdb-465c-a0e7-d803253f3380 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:21.803291 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a36287fe-6cdb-465c-a0e7-d803253f3380 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1319 microversion: 2.1 time: 0.343206 Jun 05 08:24:21.812486 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 211/403] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:21 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1319 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:21.819227 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-92f7a983-7cf3-4741-aca9-c72a201ad834 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:21.820266 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-92f7a983-7cf3-4741-aca9-c72a201ad834 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] [instance: a51cf7cd-6764-454d-9efe-075a34cbff11] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:21.972025 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-92f7a983-7cf3-4741-aca9-c72a201ad834 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ce8e767dfe4eb29c2c8402c79b01c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3801b3ebfcdd446c93e054b3f7baa53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:21.981014 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-92f7a983-7cf3-4741-aca9-c72a201ad834 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] 10.222.0.33 "GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11" status: 200 len: 1217 microversion: 2.1 time: 0.175735 Jun 05 08:24:21.983627 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 212/404] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:21 2022] GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11 => generated 1217 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:21.993507 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f9030e8d-ff81-474d-926c-38b739d63045 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:21.994148 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f9030e8d-ff81-474d-926c-38b739d63045 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:22.010765 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f9030e8d-ff81-474d-926c-38b739d63045 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:22.011132 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f9030e8d-ff81-474d-926c-38b739d63045 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:22.011920 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f9030e8d-ff81-474d-926c-38b739d63045 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:22.014533 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f9030e8d-ff81-474d-926c-38b739d63045 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:22.425606 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-98be3e7f-3885-47ee-84ba-3a33855cb2a7 tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8" status: 200 len: 1611 microversion: 2.1 time: 0.816925 Jun 05 08:24:22.426730 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 193/405] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:21 2022] GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8 => generated 1611 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:22.433207 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f9030e8d-ff81-474d-926c-38b739d63045 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:22.452421 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f9030e8d-ff81-474d-926c-38b739d63045 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1504 microversion: 2.1 time: 0.467550 Jun 05 08:24:22.460129 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bd439369-49d1-4d63-b5ad-6ab8f2ae444d tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:22.460129 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:22.460129 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:22.460129 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bd439369-49d1-4d63-b5ad-6ab8f2ae444d tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:22.460129 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bd439369-49d1-4d63-b5ad-6ab8f2ae444d tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:22.460710 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bd439369-49d1-4d63-b5ad-6ab8f2ae444d tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:22.463708 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 213/406] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:21 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1504 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:22.463862 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bd439369-49d1-4d63-b5ad-6ab8f2ae444d tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:22.511880 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bd439369-49d1-4d63-b5ad-6ab8f2ae444d tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.067515 Jun 05 08:24:22.520006 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 194/407] 10.222.0.33 () {58 vars in 1175 bytes} [Sun Jun 5 08:24:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:22.532571 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e61bfed6-e15e-46b8-8c2b-238c5becfa0f tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-844739-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:22.534463 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e61bfed6-e15e-46b8-8c2b-238c5becfa0f tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] [instance: 98766f8e-7b27-49e9-8565-4bc9c3e808d8] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:22.544543 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e61bfed6-e15e-46b8-8c2b-238c5becfa0f tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:22.545014 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e61bfed6-e15e-46b8-8c2b-238c5becfa0f tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:22.546755 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e61bfed6-e15e-46b8-8c2b-238c5becfa0f tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:22.547290 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e61bfed6-e15e-46b8-8c2b-238c5becfa0f tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:22.578382 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-e61bfed6-e15e-46b8-8c2b-238c5becfa0f tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Lazy-loading 'flavor' on Instance uuid 98766f8e-7b27-49e9-8565-4bc9c3e808d8 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:22.595610 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-e61bfed6-e15e-46b8-8c2b-238c5becfa0f tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 98766f8e-7b27-49e9-8565-4bc9c3e808d8 while it is in vm_state suspended Jun 05 08:24:22.598496 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e61bfed6-e15e-46b8-8c2b-238c5becfa0f tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Request method failure captured: Jun 05 08:24:22.598496 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8/action HTTP/1.1 Jun 05 08:24:22.598496 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:24:22.598496 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:24:22.598496 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:24:22.598496 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 97 Jun 05 08:24:22.598496 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:24:22.598496 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:24:22.598496 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:24:22.598496 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:22.598496 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGgUAmPGceYxyhYnzI2pmf8IdhrzLHxUfD7C2bhonDjL29g2wzg2W0ukdjBjW63iHFUSTrFv3KRfY4ZQUIUQB3yoO2S6a3YDt0Fg2g1QMj7v2jJym8W9mrzdLDhpKc8kB6NywJ9mK7KP05f6NHoKfR04RO2_tVnVBBhka9ODS4mVJiE Jun 05 08:24:22.598496 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:24:22.598496 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:24:22.598496 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:24:22.598496 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:24:22.598496 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:24:22.598496 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:24:22.598496 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 4d18dde2fee8424c851d3c5bfbf69b82 Jun 05 08:24:22.598496 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-LiveMigrationNegativeTest-44922645 Jun 05 08:24:22.598496 n-d-844739-1 devstack@n-api.service[119050]: X-Role: admin,reader,member Jun 05 08:24:22.598496 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: admin,reader,member Jun 05 08:24:22.599909 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4d18dde2fee8424c851d3c5bfbf69b82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4d18dde2fee8424c851d3c5bfbf69b82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4d18dde2fee8424c851d3c5bfbf69b82", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4d18dde2fee8424c851d3c5bfbf69b82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:22.599909 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-LiveMigrationNegativeTest-44922645 Jun 05 08:24:22.599909 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 4d18dde2fee8424c851d3c5bfbf69b82 Jun 05 08:24:22.599909 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-44922645 Jun 05 08:24:22.599909 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-LiveMigrationNegativeTest-44922645-project-admin Jun 05 08:24:22.599909 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:24:22.599909 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:24:22.599909 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 7f7d6df94b7b4188bd287591f82778b4 Jun 05 08:24:22.599909 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-LiveMigrationNegativeTest-44922645-project-admin Jun 05 08:24:22.599909 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:24:22.599909 n-d-844739-1 devstack@n-api.service[119050]: {"os-migrateLive": {"host": "n-h1-844739-1", "block_migration": true, "disk_over_commit": false}} Jun 05 08:24:22.599909 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:24:22.600898 n-d-844739-1 devstack@n-api.service[119050]: exception: Cannot 'os-migrateLive' instance 98766f8e-7b27-49e9-8565-4bc9c3e808d8 while it is in vm_state suspended Jun 05 08:24:22.600898 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '98766f8e-7b27-49e9-8565-4bc9c3e808d8', 'body': {'os-migrateLive': {'host': 'n-h1-844739-1', 'block_migration': True, 'disk_over_commit': False}}} Jun 05 08:24:22.600898 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:22.600898 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:22.600898 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jun 05 08:24:22.600898 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jun 05 08:24:22.600898 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 05 08:24:22.600898 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 05 08:24:22.600898 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 05 08:24:22.600898 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 05 08:24:22.600898 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 05 08:24:22.600898 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 05 08:24:22.600898 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 05 08:24:22.600898 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 05 08:24:22.600898 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 05 08:24:22.600898 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 05 08:24:22.600898 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jun 05 08:24:22.600898 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 05 08:24:22.602075 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 05 08:24:22.602075 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 05 08:24:22.602075 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 05 08:24:22.602075 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 05 08:24:22.602075 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 98766f8e-7b27-49e9-8565-4bc9c3e808d8 in vm_state suspended. Cannot live_migrate while the instance is in this state. Jun 05 08:24:22.602075 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:22.602075 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:22.602075 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:22.602075 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:22.602075 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:22.602075 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:22.602075 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:22.602075 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:22.602075 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:22.602075 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:22.602075 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:24:22.602075 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:24:22.602075 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:24:22.602075 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:24:22.602075 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:24:22.603418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:24:22.603418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 05 08:24:22.603418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jun 05 08:24:22.603418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 05 08:24:22.603418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 05 08:24:22.603418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 05 08:24:22.603418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 98766f8e-7b27-49e9-8565-4bc9c3e808d8 while it is in vm_state suspended Jun 05 08:24:22.603418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:22.603418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:22.603418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:22.603418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:22.603418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:22.603418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:22.603418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:24:22.603418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:24:22.603418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 98766f8e-7b27-49e9-8565-4bc9c3e808d8 while it is in vm_state suspended Jun 05 08:24:22.603418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:24:22.605864 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e61bfed6-e15e-46b8-8c2b-238c5becfa0f tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 98766f8e-7b27-49e9-8565-4bc9c3e808d8 while it is in vm_state suspended {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:22.606977 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e61bfed6-e15e-46b8-8c2b-238c5becfa0f tempest-LiveMigrationNegativeTest-44922645 tempest-LiveMigrationNegativeTest-44922645-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8/action" status: 409 len: 155 microversion: 2.1 time: 0.079237 Jun 05 08:24:22.608403 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 214/408] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Jun 5 08:24:22 2022] POST /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8/action => generated 155 bytes in 81 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:24:22.623837 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-90e91be3-8902-4e11-8072-36c911f857f1 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:22.624654 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-90e91be3-8902-4e11-8072-36c911f857f1 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 98766f8e-7b27-49e9-8565-4bc9c3e808d8] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:22.634070 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-90e91be3-8902-4e11-8072-36c911f857f1 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:22.634761 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-90e91be3-8902-4e11-8072-36c911f857f1 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:22.635749 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-90e91be3-8902-4e11-8072-36c911f857f1 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:22.636957 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-90e91be3-8902-4e11-8072-36c911f857f1 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:22.669186 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-90e91be3-8902-4e11-8072-36c911f857f1 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 98766f8e-7b27-49e9-8565-4bc9c3e808d8] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:24:22.794962 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-ad25dc85-04ab-46e6-92f3-f3350078248f req-abe8b846-92dc-45fa-99eb-58a5a2bba7ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4f4188b-2421-4e0a-8ac7-0140bed18989", "name": "network-vif-plugged", "status": "completed", "tag": "c8b84554-46a8-4496-991a-e3f0704549f6"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:22.807051 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-90e91be3-8902-4e11-8072-36c911f857f1 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "DELETE /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8" status: 204 len: 0 microversion: 2.1 time: 0.190201 Jun 05 08:24:22.808803 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 195/409] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:24:22 2022] DELETE /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:24:22.822627 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-779fda97-d77e-49cc-91e6-ccd341d02a6b tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:22.823738 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-779fda97-d77e-49cc-91e6-ccd341d02a6b tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 98766f8e-7b27-49e9-8565-4bc9c3e808d8] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:22.824248 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-ad25dc85-04ab-46e6-92f3-f3350078248f req-abe8b846-92dc-45fa-99eb-58a5a2bba7ac service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:22.824990 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-ad25dc85-04ab-46e6-92f3-f3350078248f req-abe8b846-92dc-45fa-99eb-58a5a2bba7ac service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:22.834617 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-779fda97-d77e-49cc-91e6-ccd341d02a6b tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:22.835589 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-779fda97-d77e-49cc-91e6-ccd341d02a6b tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:22.837964 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-779fda97-d77e-49cc-91e6-ccd341d02a6b tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:22.839739 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-779fda97-d77e-49cc-91e6-ccd341d02a6b tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:22.854638 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-ad25dc85-04ab-46e6-92f3-f3350078248f req-abe8b846-92dc-45fa-99eb-58a5a2bba7ac service nova] Creating event network-vif-plugged:c8b84554-46a8-4496-991a-e3f0704549f6 for instance d4f4188b-2421-4e0a-8ac7-0140bed18989 on n-h1-844739-1 Jun 05 08:24:22.866166 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-ad25dc85-04ab-46e6-92f3-f3350078248f req-abe8b846-92dc-45fa-99eb-58a5a2bba7ac service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077254 Jun 05 08:24:22.867001 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 215/410] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:22.879534 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-84b5d0f4-07bd-4ec2-86bc-eff3a9b9940e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:22.880536 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-84b5d0f4-07bd-4ec2-86bc-eff3a9b9940e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:22.898482 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-84b5d0f4-07bd-4ec2-86bc-eff3a9b9940e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:22.898973 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-84b5d0f4-07bd-4ec2-86bc-eff3a9b9940e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:22.903676 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-84b5d0f4-07bd-4ec2-86bc-eff3a9b9940e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:22.905806 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-84b5d0f4-07bd-4ec2-86bc-eff3a9b9940e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:23.078923 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-779fda97-d77e-49cc-91e6-ccd341d02a6b tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:23.091153 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-779fda97-d77e-49cc-91e6-ccd341d02a6b tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8" status: 200 len: 1466 microversion: 2.1 time: 0.276702 Jun 05 08:24:23.093465 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 196/411] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:22 2022] GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8 => generated 1466 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:24:23.126898 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-84b5d0f4-07bd-4ec2-86bc-eff3a9b9940e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:23.136537 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-84b5d0f4-07bd-4ec2-86bc-eff3a9b9940e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1319 microversion: 2.1 time: 0.267491 Jun 05 08:24:23.137429 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 216/412] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:22 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:23.150021 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b55a64ca-2eae-4564-bd84-f83fbde7eefb tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:23.150858 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b55a64ca-2eae-4564-bd84-f83fbde7eefb tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] [instance: a51cf7cd-6764-454d-9efe-075a34cbff11] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:23.157093 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b55a64ca-2eae-4564-bd84-f83fbde7eefb tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:23.157581 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b55a64ca-2eae-4564-bd84-f83fbde7eefb tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:23.158382 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b55a64ca-2eae-4564-bd84-f83fbde7eefb tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:23.158824 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b55a64ca-2eae-4564-bd84-f83fbde7eefb tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:23.229514 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b55a64ca-2eae-4564-bd84-f83fbde7eefb tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ce8e767dfe4eb29c2c8402c79b01c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3801b3ebfcdd446c93e054b3f7baa53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:23.237006 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b55a64ca-2eae-4564-bd84-f83fbde7eefb tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] 10.222.0.33 "GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11" status: 200 len: 1269 microversion: 2.1 time: 0.098246 Jun 05 08:24:23.237619 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 217/413] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:23 2022] GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11 => generated 1269 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:23.338408 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5b9a266a-3c69-4692-bbe5-635b52b3efb3 tempest-HypervisorAdminUnderV252Test-1822508637 tempest-HypervisorAdminUnderV252Test-1822508637-project-admin] Calling method '.version_select at 0x7f2433d70670>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:23.341060 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:23.341060 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:23.343577 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5b9a266a-3c69-4692-bbe5-635b52b3efb3 tempest-HypervisorAdminUnderV252Test-1822508637 tempest-HypervisorAdminUnderV252Test-1822508637-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:23.344488 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5b9a266a-3c69-4692-bbe5-635b52b3efb3 tempest-HypervisorAdminUnderV252Test-1822508637 tempest-HypervisorAdminUnderV252Test-1822508637-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:23.371928 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5b9a266a-3c69-4692-bbe5-635b52b3efb3 tempest-HypervisorAdminUnderV252Test-1822508637 tempest-HypervisorAdminUnderV252Test-1822508637-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:23.372225 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5b9a266a-3c69-4692-bbe5-635b52b3efb3 tempest-HypervisorAdminUnderV252Test-1822508637 tempest-HypervisorAdminUnderV252Test-1822508637-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:23.382210 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5b9a266a-3c69-4692-bbe5-635b52b3efb3 tempest-HypervisorAdminUnderV252Test-1822508637 tempest-HypervisorAdminUnderV252Test-1822508637-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:23.382598 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5b9a266a-3c69-4692-bbe5-635b52b3efb3 tempest-HypervisorAdminUnderV252Test-1822508637 tempest-HypervisorAdminUnderV252Test-1822508637-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:23.388486 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5b9a266a-3c69-4692-bbe5-635b52b3efb3 tempest-HypervisorAdminUnderV252Test-1822508637 tempest-HypervisorAdminUnderV252Test-1822508637-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.290596 Jun 05 08:24:23.393644 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 197/414] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:24:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:23.399732 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ba09e1b3-b981-40f9-9ef7-495f9c0ccbdb tempest-HypervisorAdminUnderV252Test-1822508637 tempest-HypervisorAdminUnderV252Test-1822508637-project-admin] Calling method '.version_select at 0x7f2433c34160>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:23.400725 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:23.400725 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:23.401983 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ba09e1b3-b981-40f9-9ef7-495f9c0ccbdb tempest-HypervisorAdminUnderV252Test-1822508637 tempest-HypervisorAdminUnderV252Test-1822508637-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:23.402699 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ba09e1b3-b981-40f9-9ef7-495f9c0ccbdb tempest-HypervisorAdminUnderV252Test-1822508637 tempest-HypervisorAdminUnderV252Test-1822508637-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:23.416503 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ba09e1b3-b981-40f9-9ef7-495f9c0ccbdb tempest-HypervisorAdminUnderV252Test-1822508637 tempest-HypervisorAdminUnderV252Test-1822508637-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:23.417269 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ba09e1b3-b981-40f9-9ef7-495f9c0ccbdb tempest-HypervisorAdminUnderV252Test-1822508637 tempest-HypervisorAdminUnderV252Test-1822508637-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:23.420419 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=100 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:23.446238 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ba09e1b3-b981-40f9-9ef7-495f9c0ccbdb tempest-HypervisorAdminUnderV252Test-1822508637 tempest-HypervisorAdminUnderV252Test-1822508637-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:23.447502 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ba09e1b3-b981-40f9-9ef7-495f9c0ccbdb tempest-HypervisorAdminUnderV252Test-1822508637 tempest-HypervisorAdminUnderV252Test-1822508637-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:23.454149 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ba09e1b3-b981-40f9-9ef7-495f9c0ccbdb tempest-HypervisorAdminUnderV252Test-1822508637 tempest-HypervisorAdminUnderV252Test-1822508637-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/n-h2-844739-1/servers" status: 200 len: 433 microversion: 2.1 time: 0.059237 Jun 05 08:24:23.454880 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 218/415] 10.222.0.33 () {58 vars in 1211 bytes} [Sun Jun 5 08:24:23 2022] GET /compute/v2.1/os-hypervisors/n-h2-844739-1/servers => generated 433 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:23.466223 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a24796a4-ae13-41a6-9175-c027b349ed5f tempest-HypervisorAdminUnderV252Test-1822508637 tempest-HypervisorAdminUnderV252Test-1822508637-project-admin] Calling method '.version_select at 0x7f2433e40dc0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:23.467234 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:23.467234 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:23.469407 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a24796a4-ae13-41a6-9175-c027b349ed5f tempest-HypervisorAdminUnderV252Test-1822508637 tempest-HypervisorAdminUnderV252Test-1822508637-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:23.470094 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a24796a4-ae13-41a6-9175-c027b349ed5f tempest-HypervisorAdminUnderV252Test-1822508637 tempest-HypervisorAdminUnderV252Test-1822508637-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:23.471681 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e9d74389-1c50-40a4-a510-ed3bdd593014 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:23.473506 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e9d74389-1c50-40a4-a510-ed3bdd593014 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:23.482521 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e9d74389-1c50-40a4-a510-ed3bdd593014 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:23.482978 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e9d74389-1c50-40a4-a510-ed3bdd593014 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:23.484960 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e9d74389-1c50-40a4-a510-ed3bdd593014 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:23.486549 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e9d74389-1c50-40a4-a510-ed3bdd593014 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:23.486815 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a24796a4-ae13-41a6-9175-c027b349ed5f tempest-HypervisorAdminUnderV252Test-1822508637 tempest-HypervisorAdminUnderV252Test-1822508637-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:23.487332 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a24796a4-ae13-41a6-9175-c027b349ed5f tempest-HypervisorAdminUnderV252Test-1822508637 tempest-HypervisorAdminUnderV252Test-1822508637-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:23.498729 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a24796a4-ae13-41a6-9175-c027b349ed5f tempest-HypervisorAdminUnderV252Test-1822508637 tempest-HypervisorAdminUnderV252Test-1822508637-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:23.499181 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a24796a4-ae13-41a6-9175-c027b349ed5f tempest-HypervisorAdminUnderV252Test-1822508637 tempest-HypervisorAdminUnderV252Test-1822508637-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:23.505908 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a24796a4-ae13-41a6-9175-c027b349ed5f tempest-HypervisorAdminUnderV252Test-1822508637 tempest-HypervisorAdminUnderV252Test-1822508637-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.043511 Jun 05 08:24:23.506937 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 198/416] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:24:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:23.515777 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-9ffc3a5d-9e77-4aad-816b-c19047ce8042 req-317431cb-9dcf-47bd-93e6-1be9bc521186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "969237ff-17eb-4838-9c3d-68dcbc1f94ca", "tag": "b5f2e58e-0349-480d-8927-484d2f39dee5"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:23.526445 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-9ffc3a5d-9e77-4aad-816b-c19047ce8042 req-317431cb-9dcf-47bd-93e6-1be9bc521186 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:23.527147 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-9ffc3a5d-9e77-4aad-816b-c19047ce8042 req-317431cb-9dcf-47bd-93e6-1be9bc521186 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:23.550194 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-9ffc3a5d-9e77-4aad-816b-c19047ce8042 req-317431cb-9dcf-47bd-93e6-1be9bc521186 service nova] Creating event network-changed:b5f2e58e-0349-480d-8927-484d2f39dee5 for instance 969237ff-17eb-4838-9c3d-68dcbc1f94ca on n-h1-844739-1 Jun 05 08:24:23.558175 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-9ffc3a5d-9e77-4aad-816b-c19047ce8042 req-317431cb-9dcf-47bd-93e6-1be9bc521186 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049636 Jun 05 08:24:23.559144 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 199/417] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:23.569462 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3f4b9ca0-8db3-439a-92bd-23fbc8f3fe2a tempest-HypervisorAdminUnderV252Test-1822508637 tempest-HypervisorAdminUnderV252Test-1822508637-project-admin] Calling method '.version_select at 0x7f2433e27670>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:23.571246 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:23.571246 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:23.573285 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3f4b9ca0-8db3-439a-92bd-23fbc8f3fe2a tempest-HypervisorAdminUnderV252Test-1822508637 tempest-HypervisorAdminUnderV252Test-1822508637-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:23.574049 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3f4b9ca0-8db3-439a-92bd-23fbc8f3fe2a tempest-HypervisorAdminUnderV252Test-1822508637 tempest-HypervisorAdminUnderV252Test-1822508637-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:23.577203 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=6 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:23.595744 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3f4b9ca0-8db3-439a-92bd-23fbc8f3fe2a tempest-HypervisorAdminUnderV252Test-1822508637 tempest-HypervisorAdminUnderV252Test-1822508637-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:23.596495 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3f4b9ca0-8db3-439a-92bd-23fbc8f3fe2a tempest-HypervisorAdminUnderV252Test-1822508637 tempest-HypervisorAdminUnderV252Test-1822508637-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:23.607498 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3f4b9ca0-8db3-439a-92bd-23fbc8f3fe2a tempest-HypervisorAdminUnderV252Test-1822508637 tempest-HypervisorAdminUnderV252Test-1822508637-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/n-h2-844739-1/search" status: 200 len: 104 microversion: 2.1 time: 0.045763 Jun 05 08:24:23.612193 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 200/418] 10.222.0.33 () {58 vars in 1208 bytes} [Sun Jun 5 08:24:23 2022] GET /compute/v2.1/os-hypervisors/n-h2-844739-1/search => generated 104 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:23.675431 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e9d74389-1c50-40a4-a510-ed3bdd593014 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:23.689704 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e9d74389-1c50-40a4-a510-ed3bdd593014 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1504 microversion: 2.1 time: 0.223410 Jun 05 08:24:23.690155 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 219/419] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:23 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1504 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:24:24.110950 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8a94fd7c-b949-467f-94fa-dd6e148390d3 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:24.112297 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8a94fd7c-b949-467f-94fa-dd6e148390d3 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 98766f8e-7b27-49e9-8565-4bc9c3e808d8] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:24.122120 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8a94fd7c-b949-467f-94fa-dd6e148390d3 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:24.122563 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8a94fd7c-b949-467f-94fa-dd6e148390d3 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:24.123491 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8a94fd7c-b949-467f-94fa-dd6e148390d3 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:24.124110 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8a94fd7c-b949-467f-94fa-dd6e148390d3 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:24.153473 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5e66e800-fc87-4c3c-bbbd-42b314da6056 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:24.154868 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5e66e800-fc87-4c3c-bbbd-42b314da6056 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:24.165563 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5e66e800-fc87-4c3c-bbbd-42b314da6056 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:24.167377 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5e66e800-fc87-4c3c-bbbd-42b314da6056 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:24.169018 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5e66e800-fc87-4c3c-bbbd-42b314da6056 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:24.170152 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5e66e800-fc87-4c3c-bbbd-42b314da6056 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:24.383298 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8a94fd7c-b949-467f-94fa-dd6e148390d3 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:24.392142 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8a94fd7c-b949-467f-94fa-dd6e148390d3 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8" status: 200 len: 1466 microversion: 2.1 time: 0.284896 Jun 05 08:24:24.412837 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 201/420] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:24 2022] GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8 => generated 1466 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:24.430198 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4dae9abb-dbb0-4a6c-a131-1c22cc76e162 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:24.430854 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4dae9abb-dbb0-4a6c-a131-1c22cc76e162 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] [instance: a51cf7cd-6764-454d-9efe-075a34cbff11] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:24.454742 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4dae9abb-dbb0-4a6c-a131-1c22cc76e162 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:24.455201 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4dae9abb-dbb0-4a6c-a131-1c22cc76e162 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:24.456183 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4dae9abb-dbb0-4a6c-a131-1c22cc76e162 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:24.456622 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4dae9abb-dbb0-4a6c-a131-1c22cc76e162 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:24.513059 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5e66e800-fc87-4c3c-bbbd-42b314da6056 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:24.526506 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5e66e800-fc87-4c3c-bbbd-42b314da6056 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1319 microversion: 2.1 time: 0.376060 Jun 05 08:24:24.531147 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 220/421] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:24 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1319 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:24:24.710630 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6de479bf-2197-4f9c-bb52-94548b56c028 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:24.712065 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6de479bf-2197-4f9c-bb52-94548b56c028 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:24.725606 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4dae9abb-dbb0-4a6c-a131-1c22cc76e162 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ce8e767dfe4eb29c2c8402c79b01c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3801b3ebfcdd446c93e054b3f7baa53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:24.732778 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6de479bf-2197-4f9c-bb52-94548b56c028 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:24.733572 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6de479bf-2197-4f9c-bb52-94548b56c028 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:24.736681 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4dae9abb-dbb0-4a6c-a131-1c22cc76e162 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] 10.222.0.33 "GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11" status: 200 len: 1277 microversion: 2.1 time: 0.312243 Jun 05 08:24:24.737279 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 202/422] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:24 2022] GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11 => generated 1277 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:24.748681 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6de479bf-2197-4f9c-bb52-94548b56c028 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:24.749502 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6de479bf-2197-4f9c-bb52-94548b56c028 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:25.069876 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6de479bf-2197-4f9c-bb52-94548b56c028 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:25.077520 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6de479bf-2197-4f9c-bb52-94548b56c028 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1504 microversion: 2.1 time: 0.374363 Jun 05 08:24:25.078098 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 221/423] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:24 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1504 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:25.121132 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-602c4eeb-ab22-4108-b8e5-ae243a695185 tempest-QuotaClassesAdmin257Test-1768218147 tempest-QuotaClassesAdmin257Test-1768218147-project-admin] Calling method '.version_select at 0x7f2433cd3f70>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:25.122462 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:25.122462 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:25.137200 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-602c4eeb-ab22-4108-b8e5-ae243a695185 tempest-QuotaClassesAdmin257Test-1768218147 tempest-QuotaClassesAdmin257Test-1768218147-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.322054 Jun 05 08:24:25.138069 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 203/424] 10.222.0.33 () {60 vars in 1225 bytes} [Sun Jun 5 08:24:24 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 05 08:24:25.148304 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f96294ec-a266-431d-b321-1559dbb21c22 tempest-QuotaClassesAdmin257Test-1768218147 tempest-QuotaClassesAdmin257Test-1768218147-project-admin] Action: 'update', calling method: .version_select at 0x7f2433cd3af0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:25.151486 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:25.151486 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:25.162913 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-56430358-5e7e-421b-8bae-4aed04484469 tempest-FlavorMetadataValidation-568820074 tempest-FlavorMetadataValidation-568820074-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1946398263", "id": 1806400963, "os-flavor-access:is_public": "True"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:25.164690 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:25.164690 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:25.193159 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:DELETE=8,nova_api:SELECT=84,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:25.194954 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-56430358-5e7e-421b-8bae-4aed04484469 tempest-FlavorMetadataValidation-568820074 tempest-FlavorMetadataValidation-568820074-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.105433 Jun 05 08:24:25.196769 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 222/425] 10.222.0.33 () {62 vars in 1187 bytes} [Sun Jun 5 08:24:25 2022] POST /compute/v2.1/flavors => generated 471 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:24:25.208798 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cb20c4ae-244f-4953-b913-89c1c071dcf9 tempest-FlavorMetadataValidation-568820074 tempest-FlavorMetadataValidation-568820074-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:25.211999 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:25.211999 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:25.431202 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-cb20c4ae-244f-4953-b913-89c1c071dcf9 tempest-FlavorMetadataValidation-568820074 tempest-FlavorMetadataValidation-568820074-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1806400963/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.227334 Jun 05 08:24:25.432356 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 223/426] 10.222.0.33 () {62 vars in 1264 bytes} [Sun Jun 5 08:24:25 2022] POST /compute/v2.1/flavors/1806400963/os-extra_specs => generated 62 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:24:25.441078 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1bb3210e-71f3-4a8b-9175-48c8c22533b1 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:25.442757 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1bb3210e-71f3-4a8b-9175-48c8c22533b1 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 98766f8e-7b27-49e9-8565-4bc9c3e808d8] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:25.451397 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1bb3210e-71f3-4a8b-9175-48c8c22533b1 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:25.452251 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1bb3210e-71f3-4a8b-9175-48c8c22533b1 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:25.453397 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1bb3210e-71f3-4a8b-9175-48c8c22533b1 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:25.454099 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1bb3210e-71f3-4a8b-9175-48c8c22533b1 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:25.463961 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f96294ec-a266-431d-b321-1559dbb21c22 tempest-QuotaClassesAdmin257Test-1768218147 tempest-QuotaClassesAdmin257Test-1768218147-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.319416 Jun 05 08:24:25.465266 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 204/427] 10.222.0.33 () {62 vars in 1246 bytes} [Sun Jun 5 08:24:25 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:24:25.479526 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6940f313-155c-44a1-afd6-536a452066f5 tempest-FlavorMetadataValidation-568820074 tempest-FlavorMetadataValidation-568820074-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:25.481849 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:25.481849 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:25.529961 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6940f313-155c-44a1-afd6-536a452066f5 tempest-FlavorMetadataValidation-568820074 tempest-FlavorMetadataValidation-568820074-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1806400963" status: 202 len: 0 microversion: 2.86 time: 0.061787 Jun 05 08:24:25.531564 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 205/428] 10.222.0.33 () {60 vars in 1201 bytes} [Sun Jun 5 08:24:25 2022] DELETE /compute/v2.1/flavors/1806400963 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:24:25.538130 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1654e0cf-b83b-44ee-882b-aecde9237b0d tempest-QuotaClassesAdmin257Test-1768218147 tempest-QuotaClassesAdmin257Test-1768218147-project-admin] Calling method '.version_select at 0x7f2433e40280>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:25.555258 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1654e0cf-b83b-44ee-882b-aecde9237b0d tempest-QuotaClassesAdmin257Test-1768218147 tempest-QuotaClassesAdmin257Test-1768218147-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.022308 Jun 05 08:24:25.556443 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 206/429] 10.222.0.33 () {60 vars in 1225 bytes} [Sun Jun 5 08:24:25 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:24:25.561522 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-be19e7eb-99e7-4c03-8c23-42ad78c86dff tempest-FlavorMetadataValidation-568820074 tempest-FlavorMetadataValidation-568820074-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:25.585912 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-be19e7eb-99e7-4c03-8c23-42ad78c86dff tempest-FlavorMetadataValidation-568820074 tempest-FlavorMetadataValidation-568820074-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 6684 microversion: 2.86 time: 0.028122 Jun 05 08:24:25.586788 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 207/430] 10.222.0.33 () {60 vars in 1186 bytes} [Sun Jun 5 08:24:25 2022] GET /compute/v2.1/flavors/detail => generated 6684 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:24:25.591710 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b0ae0561-ec34-42d6-bcae-1ab0ca1bc9e3 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:25.592633 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b0ae0561-ec34-42d6-bcae-1ab0ca1bc9e3 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:25.602699 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b0ae0561-ec34-42d6-bcae-1ab0ca1bc9e3 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:25.603348 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b0ae0561-ec34-42d6-bcae-1ab0ca1bc9e3 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:25.612335 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b0ae0561-ec34-42d6-bcae-1ab0ca1bc9e3 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:25.613015 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b0ae0561-ec34-42d6-bcae-1ab0ca1bc9e3 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:25.709300 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1bb3210e-71f3-4a8b-9175-48c8c22533b1 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:25.718673 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1bb3210e-71f3-4a8b-9175-48c8c22533b1 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8" status: 200 len: 1424 microversion: 2.1 time: 0.283700 Jun 05 08:24:25.723648 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 224/431] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:25 2022] GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8 => generated 1424 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:25.728777 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2a922533-e01c-4a33-9f5d-0c6b4bf9a8a9 tempest-QuotaClassesAdmin257Test-1768218147 tempest-QuotaClassesAdmin257Test-1768218147-project-admin] Action: 'update', calling method: .version_select at 0x7f2433c1dc10>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:25.736625 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:25.736625 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:25.867361 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2a922533-e01c-4a33-9f5d-0c6b4bf9a8a9 tempest-QuotaClassesAdmin257Test-1768218147 tempest-QuotaClassesAdmin257Test-1768218147-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.142075 Jun 05 08:24:25.868630 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 225/432] 10.222.0.33 () {62 vars in 1246 bytes} [Sun Jun 5 08:24:25 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:24:25.890686 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-9dbd8d06-0af9-453b-af63-c13e98e8206d req-5f0ae244-c650-4fd6-ae64-1f0a77b82409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98766f8e-7b27-49e9-8565-4bc9c3e808d8", "name": "network-vif-deleted", "tag": "42d59f2a-9047-40e2-9f60-ef062332a62d"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:25.914630 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-9dbd8d06-0af9-453b-af63-c13e98e8206d req-5f0ae244-c650-4fd6-ae64-1f0a77b82409 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:25.915112 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-9dbd8d06-0af9-453b-af63-c13e98e8206d req-5f0ae244-c650-4fd6-ae64-1f0a77b82409 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:25.920351 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b0ae0561-ec34-42d6-bcae-1ab0ca1bc9e3 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:25.935474 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b0ae0561-ec34-42d6-bcae-1ab0ca1bc9e3 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1469 microversion: 2.1 time: 0.347470 Jun 05 08:24:25.937303 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-9dbd8d06-0af9-453b-af63-c13e98e8206d req-5f0ae244-c650-4fd6-ae64-1f0a77b82409 service nova] Creating event network-vif-deleted:42d59f2a-9047-40e2-9f60-ef062332a62d for instance 98766f8e-7b27-49e9-8565-4bc9c3e808d8 on n-h2-844739-1 Jun 05 08:24:25.937437 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 208/433] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:25 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1469 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:25.944305 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-96038f4d-63ff-495f-a9a6-7dee90060927 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:25.944988 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-96038f4d-63ff-495f-a9a6-7dee90060927 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] [instance: a51cf7cd-6764-454d-9efe-075a34cbff11] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:25.948510 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-9dbd8d06-0af9-453b-af63-c13e98e8206d req-5f0ae244-c650-4fd6-ae64-1f0a77b82409 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078126 Jun 05 08:24:25.949172 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 226/434] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:25.961413 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-96038f4d-63ff-495f-a9a6-7dee90060927 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:25.962482 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-96038f4d-63ff-495f-a9a6-7dee90060927 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:25.963802 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-96038f4d-63ff-495f-a9a6-7dee90060927 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:25.965179 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-96038f4d-63ff-495f-a9a6-7dee90060927 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:25.967116 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a7a5ac5a-af64-4382-a5a1-44503ed96e6f tempest-DeleteServersAdminTestJSON-27414384 tempest-DeleteServersAdminTestJSON-27414384-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:25.968590 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a7a5ac5a-af64-4382-a5a1-44503ed96e6f tempest-DeleteServersAdminTestJSON-27414384 tempest-DeleteServersAdminTestJSON-27414384-project-admin] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:25.987951 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a7a5ac5a-af64-4382-a5a1-44503ed96e6f tempest-DeleteServersAdminTestJSON-27414384 tempest-DeleteServersAdminTestJSON-27414384-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:25.992293 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a7a5ac5a-af64-4382-a5a1-44503ed96e6f tempest-DeleteServersAdminTestJSON-27414384 tempest-DeleteServersAdminTestJSON-27414384-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:25.994084 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a7a5ac5a-af64-4382-a5a1-44503ed96e6f tempest-DeleteServersAdminTestJSON-27414384 tempest-DeleteServersAdminTestJSON-27414384-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:25.994570 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a7a5ac5a-af64-4382-a5a1-44503ed96e6f tempest-DeleteServersAdminTestJSON-27414384 tempest-DeleteServersAdminTestJSON-27414384-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:26.132312 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a7a5ac5a-af64-4382-a5a1-44503ed96e6f tempest-DeleteServersAdminTestJSON-27414384 tempest-DeleteServersAdminTestJSON-27414384-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989/action" status: 202 len: 0 microversion: 2.1 time: 0.171261 Jun 05 08:24:26.133960 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 227/435] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Jun 5 08:24:25 2022] POST /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 05 08:24:26.142985 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-21617892-d82a-4943-82a3-b8ade9dfe21d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:26.146990 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-21617892-d82a-4943-82a3-b8ade9dfe21d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:26.165864 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-21617892-d82a-4943-82a3-b8ade9dfe21d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:26.166710 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-21617892-d82a-4943-82a3-b8ade9dfe21d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:26.168155 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-21617892-d82a-4943-82a3-b8ade9dfe21d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:26.170144 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-21617892-d82a-4943-82a3-b8ade9dfe21d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:26.171101 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-96038f4d-63ff-495f-a9a6-7dee90060927 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ce8e767dfe4eb29c2c8402c79b01c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3801b3ebfcdd446c93e054b3f7baa53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:26.189813 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-96038f4d-63ff-495f-a9a6-7dee90060927 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] 10.222.0.33 "GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11" status: 200 len: 1317 microversion: 2.1 time: 0.251221 Jun 05 08:24:26.190721 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 209/436] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:25 2022] GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:26.206752 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c4107a18-e2d6-4140-b110-2fafee7cd2ab tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:26.207416 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c4107a18-e2d6-4140-b110-2fafee7cd2ab tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:26.214007 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c4107a18-e2d6-4140-b110-2fafee7cd2ab tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:26.214456 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c4107a18-e2d6-4140-b110-2fafee7cd2ab tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:26.215218 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c4107a18-e2d6-4140-b110-2fafee7cd2ab tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:26.215923 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c4107a18-e2d6-4140-b110-2fafee7cd2ab tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:26.264698 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c4107a18-e2d6-4140-b110-2fafee7cd2ab tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:26.265152 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c4107a18-e2d6-4140-b110-2fafee7cd2ab tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:26.266391 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-c4107a18-e2d6-4140-b110-2fafee7cd2ab tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:26.401264 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-21617892-d82a-4943-82a3-b8ade9dfe21d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:26.412461 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-21617892-d82a-4943-82a3-b8ade9dfe21d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1504 microversion: 2.1 time: 0.277204 Jun 05 08:24:26.422866 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 228/437] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:26 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1504 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:26.487899 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c4107a18-e2d6-4140-b110-2fafee7cd2ab tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:26.497478 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c4107a18-e2d6-4140-b110-2fafee7cd2ab tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1452 microversion: 2.1 time: 0.299556 Jun 05 08:24:26.498055 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 210/438] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:26 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1452 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:26.515326 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b3408d4d-ff55-4d26-9229-f3c6e690a6de tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:26.516338 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b3408d4d-ff55-4d26-9229-f3c6e690a6de tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:26.523195 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b3408d4d-ff55-4d26-9229-f3c6e690a6de tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:26.523942 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b3408d4d-ff55-4d26-9229-f3c6e690a6de tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:26.525084 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b3408d4d-ff55-4d26-9229-f3c6e690a6de tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:26.525738 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b3408d4d-ff55-4d26-9229-f3c6e690a6de tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:26.556497 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b3408d4d-ff55-4d26-9229-f3c6e690a6de tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:24:26.656907 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b3408d4d-ff55-4d26-9229-f3c6e690a6de tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 204 len: 0 microversion: 2.1 time: 0.145998 Jun 05 08:24:26.657832 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 229/439] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:24:26 2022] DELETE /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:24:26.666900 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-75bf7def-3288-4d3b-8653-36ef5ec76536 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:26.667607 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-75bf7def-3288-4d3b-8653-36ef5ec76536 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:26.674794 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-75bf7def-3288-4d3b-8653-36ef5ec76536 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:26.675333 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-75bf7def-3288-4d3b-8653-36ef5ec76536 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:26.676231 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-75bf7def-3288-4d3b-8653-36ef5ec76536 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:26.676953 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-75bf7def-3288-4d3b-8653-36ef5ec76536 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:26.731212 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-75bf7def-3288-4d3b-8653-36ef5ec76536 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:26.738346 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8b81fd6f-19f8-48e0-8f95-d33d50b9125c tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:26.739945 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8b81fd6f-19f8-48e0-8f95-d33d50b9125c tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 98766f8e-7b27-49e9-8565-4bc9c3e808d8] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:26.743328 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-75bf7def-3288-4d3b-8653-36ef5ec76536 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:26.744069 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-75bf7def-3288-4d3b-8653-36ef5ec76536 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:26.747992 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8b81fd6f-19f8-48e0-8f95-d33d50b9125c tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:26.748549 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8b81fd6f-19f8-48e0-8f95-d33d50b9125c tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:26.749759 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8b81fd6f-19f8-48e0-8f95-d33d50b9125c tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:26.750527 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8b81fd6f-19f8-48e0-8f95-d33d50b9125c tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:26.786796 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8b81fd6f-19f8-48e0-8f95-d33d50b9125c tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:26.787143 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8b81fd6f-19f8-48e0-8f95-d33d50b9125c tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:26.787609 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-8b81fd6f-19f8-48e0-8f95-d33d50b9125c tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lazy-loading 'fault' on Instance uuid 98766f8e-7b27-49e9-8565-4bc9c3e808d8 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:26.871869 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8b81fd6f-19f8-48e0-8f95-d33d50b9125c tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:26.882159 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8b81fd6f-19f8-48e0-8f95-d33d50b9125c tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8" status: 200 len: 1364 microversion: 2.1 time: 0.148872 Jun 05 08:24:26.883521 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 230/440] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:26 2022] GET /compute/v2.1/servers/98766f8e-7b27-49e9-8565-4bc9c3e808d8 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:26.900984 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c401abe3-2367-4f9d-82ba-fbfa6af39a8c tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:26.901619 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c401abe3-2367-4f9d-82ba-fbfa6af39a8c tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 121df5fc-10cc-4f27-bbe8-878791f857a2] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:26.908725 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c401abe3-2367-4f9d-82ba-fbfa6af39a8c tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:26.909253 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c401abe3-2367-4f9d-82ba-fbfa6af39a8c tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:26.910139 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c401abe3-2367-4f9d-82ba-fbfa6af39a8c tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:26.910717 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c401abe3-2367-4f9d-82ba-fbfa6af39a8c tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:26.943782 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c401abe3-2367-4f9d-82ba-fbfa6af39a8c tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 121df5fc-10cc-4f27-bbe8-878791f857a2] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:24:26.947385 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-75bf7def-3288-4d3b-8653-36ef5ec76536 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:26.955248 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-75bf7def-3288-4d3b-8653-36ef5ec76536 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1458 microversion: 2.1 time: 0.292983 Jun 05 08:24:26.955956 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 211/441] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:26 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1458 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:27.032492 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c401abe3-2367-4f9d-82ba-fbfa6af39a8c tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "DELETE /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2" status: 204 len: 0 microversion: 2.1 time: 0.134447 Jun 05 08:24:27.033353 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 231/442] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:24:26 2022] DELETE /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:24:27.042306 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5a3b4ffb-c456-4434-bbf3-e6bbb541f927 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:27.043059 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5a3b4ffb-c456-4434-bbf3-e6bbb541f927 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 121df5fc-10cc-4f27-bbe8-878791f857a2] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:27.049243 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a3b4ffb-c456-4434-bbf3-e6bbb541f927 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:27.049724 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a3b4ffb-c456-4434-bbf3-e6bbb541f927 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:27.050510 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a3b4ffb-c456-4434-bbf3-e6bbb541f927 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:27.051510 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a3b4ffb-c456-4434-bbf3-e6bbb541f927 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:27.208965 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fb55ca74-8b47-43d9-9fb4-b5fe670c737c tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:27.210182 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-fb55ca74-8b47-43d9-9fb4-b5fe670c737c tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] [instance: a51cf7cd-6764-454d-9efe-075a34cbff11] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:27.217692 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fb55ca74-8b47-43d9-9fb4-b5fe670c737c tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:27.218395 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fb55ca74-8b47-43d9-9fb4-b5fe670c737c tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:27.219398 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fb55ca74-8b47-43d9-9fb4-b5fe670c737c tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:27.220184 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fb55ca74-8b47-43d9-9fb4-b5fe670c737c tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:27.220536 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5a3b4ffb-c456-4434-bbf3-e6bbb541f927 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:27.231321 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5a3b4ffb-c456-4434-bbf3-e6bbb541f927 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2" status: 200 len: 1474 microversion: 2.1 time: 0.192601 Jun 05 08:24:27.231970 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 212/443] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:27 2022] GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2 => generated 1474 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:24:27.430147 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-796fff99-7a08-4925-a13a-1eeb0f79bde2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:27.430833 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-796fff99-7a08-4925-a13a-1eeb0f79bde2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:27.437911 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-fb55ca74-8b47-43d9-9fb4-b5fe670c737c tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ce8e767dfe4eb29c2c8402c79b01c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3801b3ebfcdd446c93e054b3f7baa53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:27.439548 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-796fff99-7a08-4925-a13a-1eeb0f79bde2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:27.440005 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-796fff99-7a08-4925-a13a-1eeb0f79bde2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:27.440809 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-796fff99-7a08-4925-a13a-1eeb0f79bde2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:27.441277 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-796fff99-7a08-4925-a13a-1eeb0f79bde2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:27.454928 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fb55ca74-8b47-43d9-9fb4-b5fe670c737c tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] 10.222.0.33 "GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11" status: 200 len: 1317 microversion: 2.1 time: 0.248068 Jun 05 08:24:27.456113 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 232/444] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:27 2022] GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:24:27.604183 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-796fff99-7a08-4925-a13a-1eeb0f79bde2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:27.612610 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-796fff99-7a08-4925-a13a-1eeb0f79bde2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1504 microversion: 2.1 time: 0.186856 Jun 05 08:24:27.614646 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 213/445] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:27 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1504 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:24:27.668175 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-3fbd9d6f-b314-4737-b5b1-e17caed0af05 req-b59cffb6-90eb-4435-86ea-1b65b307609a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a51cf7cd-6764-454d-9efe-075a34cbff11", "tag": "b0edc0b9-9da5-4076-a71a-441b8059a064"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:27.692976 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-3fbd9d6f-b314-4737-b5b1-e17caed0af05 req-b59cffb6-90eb-4435-86ea-1b65b307609a service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:27.693436 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-3fbd9d6f-b314-4737-b5b1-e17caed0af05 req-b59cffb6-90eb-4435-86ea-1b65b307609a service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:27.712401 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-3fbd9d6f-b314-4737-b5b1-e17caed0af05 req-b59cffb6-90eb-4435-86ea-1b65b307609a service nova] Creating event network-changed:b0edc0b9-9da5-4076-a71a-441b8059a064 for instance a51cf7cd-6764-454d-9efe-075a34cbff11 on n-h2-844739-1 Jun 05 08:24:27.717836 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-3fbd9d6f-b314-4737-b5b1-e17caed0af05 req-b59cffb6-90eb-4435-86ea-1b65b307609a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056983 Jun 05 08:24:27.718454 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 233/446] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:24:27.977153 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-85b8cff4-e70e-46a3-bd01-348198a099a7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:27.977927 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-85b8cff4-e70e-46a3-bd01-348198a099a7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:27.999066 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-85b8cff4-e70e-46a3-bd01-348198a099a7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:28.000767 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-85b8cff4-e70e-46a3-bd01-348198a099a7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:28.006793 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-85b8cff4-e70e-46a3-bd01-348198a099a7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:28.008083 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-85b8cff4-e70e-46a3-bd01-348198a099a7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:28.037000 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:28.084799 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-85b8cff4-e70e-46a3-bd01-348198a099a7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:28.085827 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-85b8cff4-e70e-46a3-bd01-348198a099a7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:28.086730 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-85b8cff4-e70e-46a3-bd01-348198a099a7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:28.260600 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cc3e4802-3a58-4cd0-b63c-d4da61224afd tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:28.262096 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-cc3e4802-3a58-4cd0-b63c-d4da61224afd tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 121df5fc-10cc-4f27-bbe8-878791f857a2] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:28.273534 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cc3e4802-3a58-4cd0-b63c-d4da61224afd tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:28.274157 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cc3e4802-3a58-4cd0-b63c-d4da61224afd tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:28.275839 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cc3e4802-3a58-4cd0-b63c-d4da61224afd tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:28.276322 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cc3e4802-3a58-4cd0-b63c-d4da61224afd tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:28.342212 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:28.388238 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=9 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:28.610239 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-85b8cff4-e70e-46a3-bd01-348198a099a7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:28.624127 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-85b8cff4-e70e-46a3-bd01-348198a099a7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1458 microversion: 2.1 time: 0.655417 Jun 05 08:24:28.624959 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 214/447] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:27 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1458 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:28.632812 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-146b562b-79e0-4cac-a847-ac514417a905 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:28.635124 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-146b562b-79e0-4cac-a847-ac514417a905 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] [instance: a51cf7cd-6764-454d-9efe-075a34cbff11] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:28.646835 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-146b562b-79e0-4cac-a847-ac514417a905 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:28.647683 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-146b562b-79e0-4cac-a847-ac514417a905 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:28.650408 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-146b562b-79e0-4cac-a847-ac514417a905 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:28.651385 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-146b562b-79e0-4cac-a847-ac514417a905 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:28.976405 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-cc3e4802-3a58-4cd0-b63c-d4da61224afd tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:28.988661 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-cc3e4802-3a58-4cd0-b63c-d4da61224afd tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2" status: 200 len: 1474 microversion: 2.1 time: 0.735569 Jun 05 08:24:28.989710 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 234/448] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:28 2022] GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2 => generated 1474 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:24:29.003047 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-12cf05e1-1497-40df-b0dc-7e5d1c9d30dd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:29.006169 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-12cf05e1-1497-40df-b0dc-7e5d1c9d30dd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:29.021386 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-12cf05e1-1497-40df-b0dc-7e5d1c9d30dd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:29.022304 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-12cf05e1-1497-40df-b0dc-7e5d1c9d30dd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:29.025144 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-12cf05e1-1497-40df-b0dc-7e5d1c9d30dd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:29.026888 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-12cf05e1-1497-40df-b0dc-7e5d1c9d30dd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:29.664871 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-146b562b-79e0-4cac-a847-ac514417a905 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ce8e767dfe4eb29c2c8402c79b01c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3801b3ebfcdd446c93e054b3f7baa53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:29.673415 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-146b562b-79e0-4cac-a847-ac514417a905 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] 10.222.0.33 "GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11" status: 200 len: 1317 microversion: 2.1 time: 1.047049 Jun 05 08:24:29.685854 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 215/449] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:28 2022] GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11 => generated 1317 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:29.690222 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-494ccb18-f57e-47b3-86a8-2a5cffca46d5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:29.690963 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-494ccb18-f57e-47b3-86a8-2a5cffca46d5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:29.699464 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-494ccb18-f57e-47b3-86a8-2a5cffca46d5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:29.704309 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-494ccb18-f57e-47b3-86a8-2a5cffca46d5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:29.705254 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-494ccb18-f57e-47b3-86a8-2a5cffca46d5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:29.705783 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-494ccb18-f57e-47b3-86a8-2a5cffca46d5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:29.750206 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-494ccb18-f57e-47b3-86a8-2a5cffca46d5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:29.750770 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-494ccb18-f57e-47b3-86a8-2a5cffca46d5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:29.751306 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-494ccb18-f57e-47b3-86a8-2a5cffca46d5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:30.070967 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-12cf05e1-1497-40df-b0dc-7e5d1c9d30dd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:30.087631 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-12cf05e1-1497-40df-b0dc-7e5d1c9d30dd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1504 microversion: 2.1 time: 1.096550 Jun 05 08:24:30.088752 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 235/450] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:28 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1504 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:30.232205 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-494ccb18-f57e-47b3-86a8-2a5cffca46d5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:30.242011 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-494ccb18-f57e-47b3-86a8-2a5cffca46d5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1458 microversion: 2.1 time: 0.563098 Jun 05 08:24:30.242975 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 216/451] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:29 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1458 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:30.248883 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-55a19611-c8f5-4d57-9802-212976512a7d tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:30.250284 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-55a19611-c8f5-4d57-9802-212976512a7d tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 121df5fc-10cc-4f27-bbe8-878791f857a2] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:30.258500 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-55a19611-c8f5-4d57-9802-212976512a7d tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:30.259154 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-55a19611-c8f5-4d57-9802-212976512a7d tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:30.260141 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-55a19611-c8f5-4d57-9802-212976512a7d tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:30.261107 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-55a19611-c8f5-4d57-9802-212976512a7d tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:30.433727 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-33364dfa-4180-4cbf-99ec-1f5d04dd7a59 tempest-KeyPairsV210TestJSON-1490281759 tempest-KeyPairsV210TestJSON-1490281759-project-admin] Action: 'create', calling method: .version_select at 0x7f2433bcaaf0>, body: {"keypair": {"name": "tempest-keypair-549658384", "type": "ssh", "user_id": "16b47e30fb9a46d483f347a72aa0649d", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiUUDtS0kNmcTDMAXrx/BBp/kQJgaRTKSmQUG8S1+i1WA/vseeM+qFuH+wHW4u3+kKvs41MFB96n7xrasb37Pe/fF/OOy4HVECWEOW5bZuI3NmBlpoY/r5rCU2lVEzJwg=="}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:30.517539 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-33364dfa-4180-4cbf-99ec-1f5d04dd7a59 tempest-KeyPairsV210TestJSON-1490281759 tempest-KeyPairsV210TestJSON-1490281759-project-admin] Getting quotas for project 072510460bee444abc13870e90c9a884. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:24:30.536305 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-33364dfa-4180-4cbf-99ec-1f5d04dd7a59 tempest-KeyPairsV210TestJSON-1490281759 tempest-KeyPairsV210TestJSON-1490281759-project-admin] Getting quotas for user 4917f6b7a5064f23b3d94eab695a3353 and project 072510460bee444abc13870e90c9a884. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:24:30.610782 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-33364dfa-4180-4cbf-99ec-1f5d04dd7a59 tempest-KeyPairsV210TestJSON-1490281759 tempest-KeyPairsV210TestJSON-1490281759-project-admin] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.512284 Jun 05 08:24:30.612414 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 236/452] 10.222.0.33 () {62 vars in 1199 bytes} [Sun Jun 5 08:24:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 515 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 05 08:24:30.632985 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-28e69ef0-5703-40fd-9122-54399b083e1f tempest-KeyPairsV210TestJSON-1490281759 tempest-KeyPairsV210TestJSON-1490281759-project-admin] Action: 'create', calling method: .version_select at 0x7f2433b95820>, body: {"keypair": {"name": "tempest-keypair-590824349", "type": "ssh", "user_id": "16b47e30fb9a46d483f347a72aa0649d", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/gO4Pb35LdkJu1zrBVxSW/g1PQZ1OsDMJdfbC4RB+Mtt1gml5zJVMt8wj7EHp7SXggswLA5XeHASIXkc1Teo9RwbtmSt0jpWtZa7XBSIx7tR6YAVnbgjZKziYvzKvw2Q=="}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:30.683847 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-28e69ef0-5703-40fd-9122-54399b083e1f tempest-KeyPairsV210TestJSON-1490281759 tempest-KeyPairsV210TestJSON-1490281759-project-admin] Getting quotas for project 072510460bee444abc13870e90c9a884. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:24:30.696727 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-28e69ef0-5703-40fd-9122-54399b083e1f tempest-KeyPairsV210TestJSON-1490281759 tempest-KeyPairsV210TestJSON-1490281759-project-admin] Getting quotas for user 4917f6b7a5064f23b3d94eab695a3353 and project 072510460bee444abc13870e90c9a884. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:24:30.762197 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-28e69ef0-5703-40fd-9122-54399b083e1f tempest-KeyPairsV210TestJSON-1490281759 tempest-KeyPairsV210TestJSON-1490281759-project-admin] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.137841 Jun 05 08:24:30.763878 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 237/453] 10.222.0.33 () {62 vars in 1199 bytes} [Sun Jun 5 08:24:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 141 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 05 08:24:30.784983 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-85222a0a-8450-426c-9a19-70d816a41b5f req-403e0f91-3ce4-41b9-8fe6-1997850fff7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4f4188b-2421-4e0a-8ac7-0140bed18989", "name": "network-vif-deleted", "tag": "c8b84554-46a8-4496-991a-e3f0704549f6"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:30.803324 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-85222a0a-8450-426c-9a19-70d816a41b5f req-403e0f91-3ce4-41b9-8fe6-1997850fff7f service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:30.805518 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-85222a0a-8450-426c-9a19-70d816a41b5f req-403e0f91-3ce4-41b9-8fe6-1997850fff7f service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:30.822651 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-85222a0a-8450-426c-9a19-70d816a41b5f req-403e0f91-3ce4-41b9-8fe6-1997850fff7f service nova] Creating event network-vif-deleted:c8b84554-46a8-4496-991a-e3f0704549f6 for instance d4f4188b-2421-4e0a-8ac7-0140bed18989 on n-h1-844739-1 Jun 05 08:24:30.828344 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-85222a0a-8450-426c-9a19-70d816a41b5f req-403e0f91-3ce4-41b9-8fe6-1997850fff7f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062060 Jun 05 08:24:30.828912 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 238/454] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:30.846150 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6526563f-c31f-41dd-9c8d-516f974c8495 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:30.847433 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6526563f-c31f-41dd-9c8d-516f974c8495 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] [instance: a51cf7cd-6764-454d-9efe-075a34cbff11] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:30.854194 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6526563f-c31f-41dd-9c8d-516f974c8495 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:30.854649 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6526563f-c31f-41dd-9c8d-516f974c8495 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:30.855436 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6526563f-c31f-41dd-9c8d-516f974c8495 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:30.856056 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6526563f-c31f-41dd-9c8d-516f974c8495 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:31.063128 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-55a19611-c8f5-4d57-9802-212976512a7d tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:31.080215 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-55a19611-c8f5-4d57-9802-212976512a7d tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2" status: 200 len: 1474 microversion: 2.1 time: 0.835803 Jun 05 08:24:31.089338 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 217/455] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:30 2022] GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2 => generated 1474 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:31.099349 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-524ae7fb-78d6-4558-9bea-ac686cc47605 tempest-KeyPairsV210TestJSON-1490281759 tempest-KeyPairsV210TestJSON-1490281759-project-admin] Calling method '.version_select at 0x7f2433d73c10>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:31.135726 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-524ae7fb-78d6-4558-9bea-ac686cc47605 tempest-KeyPairsV210TestJSON-1490281759 tempest-KeyPairsV210TestJSON-1490281759-project-admin] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-549658384?user_id=16b47e30fb9a46d483f347a72aa0649d" status: 200 len: 511 microversion: 2.10 time: 0.044970 Jun 05 08:24:31.139081 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 218/456] 10.222.0.33 () {60 vars in 1336 bytes} [Sun Jun 5 08:24:31 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-549658384?user_id=16b47e30fb9a46d483f347a72aa0649d => generated 511 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:24:31.161754 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fc14f70a-734c-48ad-93e4-9e7c93cf67c5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:31.163511 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-fc14f70a-734c-48ad-93e4-9e7c93cf67c5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:31.175116 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fc14f70a-734c-48ad-93e4-9e7c93cf67c5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:31.177545 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fc14f70a-734c-48ad-93e4-9e7c93cf67c5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:31.182961 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fc14f70a-734c-48ad-93e4-9e7c93cf67c5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:31.185359 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fc14f70a-734c-48ad-93e4-9e7c93cf67c5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:31.192837 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6526563f-c31f-41dd-9c8d-516f974c8495 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ce8e767dfe4eb29c2c8402c79b01c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3801b3ebfcdd446c93e054b3f7baa53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:31.201291 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6526563f-c31f-41dd-9c8d-516f974c8495 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] 10.222.0.33 "GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11" status: 200 len: 1317 microversion: 2.1 time: 0.371046 Jun 05 08:24:31.202557 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 239/457] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:30 2022] GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11 => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:31.207785 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-26fea401-8644-4e55-ad29-81701e801907 tempest-KeyPairsV210TestJSON-1490281759 tempest-KeyPairsV210TestJSON-1490281759-project-admin] Action: 'create', calling method: .version_select at 0x7f2433c34670>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1207171063", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChr2EVkkHlwNMqAZN5eKtvxNZF3VofbfX/L703fUsED4CDt8RipJY64VUnWnZCTc86vraEuLhS8hVd7B29IPdVeynjuG2RDoHM0xM4HzUYq+IkRQtUTzvBdsLg9qQ8UMw=="}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:31.224660 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-26fea401-8644-4e55-ad29-81701e801907 tempest-KeyPairsV210TestJSON-1490281759 tempest-KeyPairsV210TestJSON-1490281759-project-admin] Getting quotas for project 072510460bee444abc13870e90c9a884. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:24:31.231211 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-26fea401-8644-4e55-ad29-81701e801907 tempest-KeyPairsV210TestJSON-1490281759 tempest-KeyPairsV210TestJSON-1490281759-project-admin] Getting quotas for user 4917f6b7a5064f23b3d94eab695a3353 and project 072510460bee444abc13870e90c9a884. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:24:31.277037 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-26fea401-8644-4e55-ad29-81701e801907 tempest-KeyPairsV210TestJSON-1490281759 tempest-KeyPairsV210TestJSON-1490281759-project-admin] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.073078 Jun 05 08:24:31.277896 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 240/458] 10.222.0.33 () {62 vars in 1199 bytes} [Sun Jun 5 08:24:31 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 75 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 05 08:24:31.357231 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-fc14f70a-734c-48ad-93e4-9e7c93cf67c5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:31.371888 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fc14f70a-734c-48ad-93e4-9e7c93cf67c5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1494 microversion: 2.1 time: 0.218862 Jun 05 08:24:31.372574 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 219/459] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:31 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1494 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:31.378166 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-85373b4f-7622-4ce4-af4a-f2062033ff02 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:31.378968 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-85373b4f-7622-4ce4-af4a-f2062033ff02 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:31.386394 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-85373b4f-7622-4ce4-af4a-f2062033ff02 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:31.386744 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-85373b4f-7622-4ce4-af4a-f2062033ff02 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:31.387563 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-85373b4f-7622-4ce4-af4a-f2062033ff02 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:31.387999 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-85373b4f-7622-4ce4-af4a-f2062033ff02 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:31.423288 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-85373b4f-7622-4ce4-af4a-f2062033ff02 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:31.423774 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-85373b4f-7622-4ce4-af4a-f2062033ff02 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:31.424256 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-85373b4f-7622-4ce4-af4a-f2062033ff02 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:31.490346 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-85373b4f-7622-4ce4-af4a-f2062033ff02 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:31.499679 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-85373b4f-7622-4ce4-af4a-f2062033ff02 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.125221 Jun 05 08:24:31.504517 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 220/460] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:31 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:31.510639 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-123cc5f7-8b22-47b3-99f4-980f832de8d4 tempest-KeyPairsV210TestJSON-1490281759 tempest-KeyPairsV210TestJSON-1490281759-project-admin] Calling method '.version_select at 0x7f2433c94820>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:31.514117 n-d-844739-1 devstack@n-api.service[119049]: WARNING oslo_db.sqlalchemy.utils [None req-123cc5f7-8b22-47b3-99f4-980f832de8d4 tempest-KeyPairsV210TestJSON-1490281759 tempest-KeyPairsV210TestJSON-1490281759-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jun 05 08:24:31.523063 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-123cc5f7-8b22-47b3-99f4-980f832de8d4 tempest-KeyPairsV210TestJSON-1490281759 tempest-KeyPairsV210TestJSON-1490281759-project-admin] 10.222.0.33 "GET /compute/v2.1/os-keypairs?user_id=16b47e30fb9a46d483f347a72aa0649d" status: 200 len: 724 microversion: 2.10 time: 0.017349 Jun 05 08:24:31.524139 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 221/461] 10.222.0.33 () {60 vars in 1258 bytes} [Sun Jun 5 08:24:31 2022] GET /compute/v2.1/os-keypairs?user_id=16b47e30fb9a46d483f347a72aa0649d => generated 724 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:24:31.530672 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8a739910-3e22-4491-ad26-c8c02514db35 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Calling method '.version_select at 0x7f2433d733a0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:31.533145 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8a739910-3e22-4491-ad26-c8c02514db35 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:31.533599 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8a739910-3e22-4491-ad26-c8c02514db35 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:31.550502 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8a739910-3e22-4491-ad26-c8c02514db35 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 398 microversion: 2.1 time: 0.025024 Jun 05 08:24:31.551137 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 222/462] 10.222.0.33 () {58 vars in 1142 bytes} [Sun Jun 5 08:24:31 2022] GET /compute/v2.1/os-migrations => generated 398 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:31.555543 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8b5ccaee-62d3-47ea-8277-72c95d2dae07 tempest-KeyPairsV210TestJSON-1490281759 tempest-KeyPairsV210TestJSON-1490281759-project-admin] Calling method '.version_select at 0x7f2433d6dee0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:31.575399 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8b5ccaee-62d3-47ea-8277-72c95d2dae07 tempest-KeyPairsV210TestJSON-1490281759 tempest-KeyPairsV210TestJSON-1490281759-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1207171063" status: 204 len: 0 microversion: 2.10 time: 0.023139 Jun 05 08:24:31.576079 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 223/463] 10.222.0.33 () {60 vars in 1324 bytes} [Sun Jun 5 08:24:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1207171063 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:24:31.582528 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-34d08eac-f285-4d56-b068-0d8456814cdc tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:31.582528 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-34d08eac-f285-4d56-b068-0d8456814cdc tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:31.588648 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-34d08eac-f285-4d56-b068-0d8456814cdc tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:31.589184 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-34d08eac-f285-4d56-b068-0d8456814cdc tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:31.590123 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-34d08eac-f285-4d56-b068-0d8456814cdc tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:31.590759 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-34d08eac-f285-4d56-b068-0d8456814cdc tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:31.595858 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5629dabb-d16a-40cd-b26c-8ff3d1e3cabe tempest-QuotasAdminTestV257-804764781 tempest-QuotasAdminTestV257-804764781-project-admin] Action: 'update', calling method: .version_select at 0x7f2433b47280>, body: {"quota_set": {"ram": "5120"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:31.768991 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-34d08eac-f285-4d56-b068-0d8456814cdc tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1645 microversion: 2.1 time: 0.191677 Jun 05 08:24:31.770664 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 224/464] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:31 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1645 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:31.776580 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f9747d2f-c902-4f90-9ccf-45b1a82a228e tempest-KeyPairsV210TestJSON-1490281759 tempest-KeyPairsV210TestJSON-1490281759-project-admin] Calling method '.version_select at 0x7f2433c76040>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:31.806578 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f9747d2f-c902-4f90-9ccf-45b1a82a228e tempest-KeyPairsV210TestJSON-1490281759 tempest-KeyPairsV210TestJSON-1490281759-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-590824349?user_id=16b47e30fb9a46d483f347a72aa0649d" status: 204 len: 0 microversion: 2.10 time: 0.034223 Jun 05 08:24:31.807163 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 225/465] 10.222.0.33 () {60 vars in 1339 bytes} [Sun Jun 5 08:24:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-590824349?user_id=16b47e30fb9a46d483f347a72aa0649d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:24:31.815796 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6cc96c9f-1c55-4e4e-9443-00acc40557e7 tempest-KeyPairsV210TestJSON-1490281759 tempest-KeyPairsV210TestJSON-1490281759-project-admin] Calling method '.version_select at 0x7f2433c76ee0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:31.842071 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6cc96c9f-1c55-4e4e-9443-00acc40557e7 tempest-KeyPairsV210TestJSON-1490281759 tempest-KeyPairsV210TestJSON-1490281759-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-549658384?user_id=16b47e30fb9a46d483f347a72aa0649d" status: 204 len: 0 microversion: 2.10 time: 0.030505 Jun 05 08:24:31.843360 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 226/466] 10.222.0.33 () {60 vars in 1339 bytes} [Sun Jun 5 08:24:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-549658384?user_id=16b47e30fb9a46d483f347a72aa0649d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:24:31.855338 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5629dabb-d16a-40cd-b26c-8ff3d1e3cabe tempest-QuotasAdminTestV257-804764781 tempest-QuotasAdminTestV257-804764781-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:31.857346 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5629dabb-d16a-40cd-b26c-8ff3d1e3cabe tempest-QuotasAdminTestV257-804764781 tempest-QuotasAdminTestV257-804764781-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:31.858618 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5629dabb-d16a-40cd-b26c-8ff3d1e3cabe tempest-QuotasAdminTestV257-804764781 tempest-QuotasAdminTestV257-804764781-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:31.860306 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5629dabb-d16a-40cd-b26c-8ff3d1e3cabe tempest-QuotasAdminTestV257-804764781 tempest-QuotasAdminTestV257-804764781-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:31.932130 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5629dabb-d16a-40cd-b26c-8ff3d1e3cabe tempest-QuotasAdminTestV257-804764781 tempest-QuotasAdminTestV257-804764781-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/28dd597307a448498f4a5450391a882c" status: 200 len: 148 microversion: 2.57 time: 0.653127 Jun 05 08:24:31.932747 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 241/467] 10.222.0.33 () {62 vars in 1302 bytes} [Sun Jun 5 08:24:31 2022] PUT /compute/v2.1/os-quota-sets/28dd597307a448498f4a5450391a882c => generated 148 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:24:31.943413 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-12b7859c-76a6-4e4c-84ed-e2bb30a3e7ca tempest-QuotasAdminTestV257-804764781 tempest-QuotasAdminTestV257-804764781-project-admin] Calling method '.version_select at 0x7f2433d655e0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:31.953144 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e98c4f49-277c-4d5f-b789-b89c98bba3ca tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1999393034", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "d6fc5636-9c8b-4238-8a2c-cf51a213fbbf"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:32.016231 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-e98c4f49-277c-4d5f-b789-b89c98bba3ca tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] validate_networks() for [('d6fc5636-9c8b-4238-8a2c-cf51a213fbbf', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:24:32.311093 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:UPDATE=6,nova_api:SELECT=82,nova_api:INSERT=6,nova_api:DELETE=6 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:32.320614 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-12b7859c-76a6-4e4c-84ed-e2bb30a3e7ca tempest-QuotasAdminTestV257-804764781 tempest-QuotasAdminTestV257-804764781-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:32.321322 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-12b7859c-76a6-4e4c-84ed-e2bb30a3e7ca tempest-QuotasAdminTestV257-804764781 tempest-QuotasAdminTestV257-804764781-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:32.322555 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-12b7859c-76a6-4e4c-84ed-e2bb30a3e7ca tempest-QuotasAdminTestV257-804764781 tempest-QuotasAdminTestV257-804764781-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:32.323139 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-12b7859c-76a6-4e4c-84ed-e2bb30a3e7ca tempest-QuotasAdminTestV257-804764781 tempest-QuotasAdminTestV257-804764781-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:32.349909 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-12b7859c-76a6-4e4c-84ed-e2bb30a3e7ca tempest-QuotasAdminTestV257-804764781 tempest-QuotasAdminTestV257-804764781-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/28dd597307a448498f4a5450391a882c/detail" status: 200 len: 463 microversion: 2.57 time: 0.410952 Jun 05 08:24:32.351065 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 227/468] 10.222.0.33 () {60 vars in 1303 bytes} [Sun Jun 5 08:24:31 2022] GET /compute/v2.1/os-quota-sets/28dd597307a448498f4a5450391a882c/detail => generated 463 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:24:32.356064 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-024b6231-6a57-4845-8268-2f291044d171 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:32.356879 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-024b6231-6a57-4845-8268-2f291044d171 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] [instance: 121df5fc-10cc-4f27-bbe8-878791f857a2] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:32.364632 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-024b6231-6a57-4845-8268-2f291044d171 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:32.365087 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-024b6231-6a57-4845-8268-2f291044d171 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:32.366025 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-024b6231-6a57-4845-8268-2f291044d171 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:32.366605 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-024b6231-6a57-4845-8268-2f291044d171 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:32.413692 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-024b6231-6a57-4845-8268-2f291044d171 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:32.414325 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-024b6231-6a57-4845-8268-2f291044d171 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:32.414926 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-024b6231-6a57-4845-8268-2f291044d171 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Lazy-loading 'fault' on Instance uuid 121df5fc-10cc-4f27-bbe8-878791f857a2 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:32.495611 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-024b6231-6a57-4845-8268-2f291044d171 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec38465e5e8e4925ba6c71a6b1e3246d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bdb8ea7b9848e598fadcaa8e92a86e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:32.506797 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-024b6231-6a57-4845-8268-2f291044d171 tempest-LiveMigrationNegativeTest-1546668528 tempest-LiveMigrationNegativeTest-1546668528-project] 10.222.0.33 "GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2" status: 200 len: 1363 microversion: 2.1 time: 0.154554 Jun 05 08:24:32.508521 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 228/469] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:32 2022] GET /compute/v2.1/servers/121df5fc-10cc-4f27-bbe8-878791f857a2 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:32.514824 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-642e8de1-c49f-40d4-9ac9-b9424b102b62 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:32.515429 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-642e8de1-c49f-40d4-9ac9-b9424b102b62 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] [instance: a51cf7cd-6764-454d-9efe-075a34cbff11] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:32.521593 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-e98c4f49-277c-4d5f-b789-b89c98bba3ca tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:24:32.522064 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-e98c4f49-277c-4d5f-b789-b89c98bba3ca tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:24:32.522478 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-e98c4f49-277c-4d5f-b789-b89c98bba3ca tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:24:32.522889 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-e98c4f49-277c-4d5f-b789-b89c98bba3ca tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:24:32.523305 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-e98c4f49-277c-4d5f-b789-b89c98bba3ca tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:24:32.525789 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-642e8de1-c49f-40d4-9ac9-b9424b102b62 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:32.526709 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-642e8de1-c49f-40d4-9ac9-b9424b102b62 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:32.527728 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-642e8de1-c49f-40d4-9ac9-b9424b102b62 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:32.528330 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-642e8de1-c49f-40d4-9ac9-b9424b102b62 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:32.532315 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e98c4f49-277c-4d5f-b789-b89c98bba3ca tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:32.532924 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e98c4f49-277c-4d5f-b789-b89c98bba3ca tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:32.533867 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e98c4f49-277c-4d5f-b789-b89c98bba3ca tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:32.534598 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e98c4f49-277c-4d5f-b789-b89c98bba3ca tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:32.556502 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-e98c4f49-277c-4d5f-b789-b89c98bba3ca tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Getting quotas for project 4d03f2fd71b942c58157558bc37213b2. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:24:32.590738 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-e98c4f49-277c-4d5f-b789-b89c98bba3ca tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Getting quotas for user 63a93651985b4efaa4b0b2fde0f91010 and project 4d03f2fd71b942c58157558bc37213b2. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:24:32.619335 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e98c4f49-277c-4d5f-b789-b89c98bba3ca tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:24:32.623618 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e98c4f49-277c-4d5f-b789-b89c98bba3ca tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:24:32.689479 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e98c4f49-277c-4d5f-b789-b89c98bba3ca tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.741822 Jun 05 08:24:32.696407 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 242/470] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:24:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:24:32.702779 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3d426c8c-fb72-4573-852e-2629cfa82d94 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:32.703828 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3d426c8c-fb72-4573-852e-2629cfa82d94 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:32.713977 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3d426c8c-fb72-4573-852e-2629cfa82d94 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:32.714739 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3d426c8c-fb72-4573-852e-2629cfa82d94 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:32.715736 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3d426c8c-fb72-4573-852e-2629cfa82d94 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:32.716636 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3d426c8c-fb72-4573-852e-2629cfa82d94 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:32.758735 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3d426c8c-fb72-4573-852e-2629cfa82d94 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:32.759481 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3d426c8c-fb72-4573-852e-2629cfa82d94 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:32.760266 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-3d426c8c-fb72-4573-852e-2629cfa82d94 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:32.773366 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-642e8de1-c49f-40d4-9ac9-b9424b102b62 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ce8e767dfe4eb29c2c8402c79b01c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3801b3ebfcdd446c93e054b3f7baa53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:32.787886 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-642e8de1-c49f-40d4-9ac9-b9424b102b62 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] 10.222.0.33 "GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11" status: 200 len: 1317 microversion: 2.1 time: 0.278190 Jun 05 08:24:32.793878 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 229/471] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:32 2022] GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11 => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:32.821205 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1da58696-a3af-4e8c-8d4e-cf6cc5190073 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:32.821864 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1da58696-a3af-4e8c-8d4e-cf6cc5190073 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:32.834134 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3d426c8c-fb72-4573-852e-2629cfa82d94 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:32.849539 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3d426c8c-fb72-4573-852e-2629cfa82d94 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.151780 Jun 05 08:24:32.850717 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 243/472] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:32 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:32.856217 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1a4ac559-f96d-4af0-afdf-a982d39f9aab tempest-QuotasAdminTestV257-804764781 tempest-QuotasAdminTestV257-804764781-project-admin] Action: 'update', calling method: .version_select at 0x7f2433c68670>, body: {"quota_set": {"ram": "2048"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:32.971498 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-1da58696-a3af-4e8c-8d4e-cf6cc5190073 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:32.981045 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1da58696-a3af-4e8c-8d4e-cf6cc5190073 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21" status: 200 len: 1211 microversion: 2.1 time: 0.185800 Jun 05 08:24:32.984557 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 230/473] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:32 2022] GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21 => generated 1211 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:32.997013 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-aaf381e8-ba1a-4d7f-b8f6-fbc5c9d0eea6 req-6b39eada-1de4-4764-82e8-d8debe00467a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "121df5fc-10cc-4f27-bbe8-878791f857a2", "name": "network-vif-deleted", "tag": "c049258a-e044-42be-8df2-e43356b5756c"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:33.015595 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-aaf381e8-ba1a-4d7f-b8f6-fbc5c9d0eea6 req-6b39eada-1de4-4764-82e8-d8debe00467a service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:33.016545 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-aaf381e8-ba1a-4d7f-b8f6-fbc5c9d0eea6 req-6b39eada-1de4-4764-82e8-d8debe00467a service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:33.033762 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-aaf381e8-ba1a-4d7f-b8f6-fbc5c9d0eea6 req-6b39eada-1de4-4764-82e8-d8debe00467a service nova] Creating event network-vif-deleted:c049258a-e044-42be-8df2-e43356b5756c for instance 121df5fc-10cc-4f27-bbe8-878791f857a2 on n-h2-844739-1 Jun 05 08:24:33.040948 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-aaf381e8-ba1a-4d7f-b8f6-fbc5c9d0eea6 req-6b39eada-1de4-4764-82e8-d8debe00467a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054693 Jun 05 08:24:33.041659 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 231/474] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:33.222161 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1a4ac559-f96d-4af0-afdf-a982d39f9aab tempest-QuotasAdminTestV257-804764781 tempest-QuotasAdminTestV257-804764781-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:33.223409 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1a4ac559-f96d-4af0-afdf-a982d39f9aab tempest-QuotasAdminTestV257-804764781 tempest-QuotasAdminTestV257-804764781-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:33.224388 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1a4ac559-f96d-4af0-afdf-a982d39f9aab tempest-QuotasAdminTestV257-804764781 tempest-QuotasAdminTestV257-804764781-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:33.225068 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1a4ac559-f96d-4af0-afdf-a982d39f9aab tempest-QuotasAdminTestV257-804764781 tempest-QuotasAdminTestV257-804764781-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:33.266261 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1a4ac559-f96d-4af0-afdf-a982d39f9aab tempest-QuotasAdminTestV257-804764781 tempest-QuotasAdminTestV257-804764781-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:33.267048 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1a4ac559-f96d-4af0-afdf-a982d39f9aab tempest-QuotasAdminTestV257-804764781 tempest-QuotasAdminTestV257-804764781-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:33.268342 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1a4ac559-f96d-4af0-afdf-a982d39f9aab tempest-QuotasAdminTestV257-804764781 tempest-QuotasAdminTestV257-804764781-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:33.268931 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1a4ac559-f96d-4af0-afdf-a982d39f9aab tempest-QuotasAdminTestV257-804764781 tempest-QuotasAdminTestV257-804764781-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:33.322262 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-132dc09a-7c63-44a8-b753-3511238f79ee tempest-SecurityGroupsTestAdminJSON-281968609 tempest-SecurityGroupsTestAdminJSON-281968609-project] Action: 'create', calling method: .version_select at 0x7f2433c94940>, body: {"security_group": {"name": "tempest-securitygroup-2127407694", "description": "tempest-description-1012094849"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:33.356739 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1a4ac559-f96d-4af0-afdf-a982d39f9aab tempest-QuotasAdminTestV257-804764781 tempest-QuotasAdminTestV257-804764781-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/28dd597307a448498f4a5450391a882c?user_id=5251e66e60a944cd9dcbd9784fc88aae" status: 200 len: 148 microversion: 2.57 time: 0.503628 Jun 05 08:24:33.357806 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 244/475] 10.222.0.33 () {62 vars in 1383 bytes} [Sun Jun 5 08:24:32 2022] PUT /compute/v2.1/os-quota-sets/28dd597307a448498f4a5450391a882c?user_id=5251e66e60a944cd9dcbd9784fc88aae => generated 148 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:24:33.370822 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c54422bf-d6df-4dc1-b317-36452119e894 tempest-QuotasAdminTestV257-804764781 tempest-QuotasAdminTestV257-804764781-project-admin] Calling method '.version_select at 0x7f2433c1d430>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:33.687993 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-132dc09a-7c63-44a8-b753-3511238f79ee tempest-SecurityGroupsTestAdminJSON-281968609 tempest-SecurityGroupsTestAdminJSON-281968609-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.644919 Jun 05 08:24:33.688583 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 232/476] 10.222.0.33 () {60 vars in 1179 bytes} [Sun Jun 5 08:24:33 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:33.710050 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f60fd0ad-a9de-4c06-a700-2371d3c99e11 tempest-SecurityGroupsTestAdminJSON-281968609 tempest-SecurityGroupsTestAdminJSON-281968609-project] Action: 'create', calling method: .version_select at 0x7f2433c76430>, body: {"security_group": {"name": "tempest-securitygroup-365022944", "description": "tempest-description-1506418277"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:33.900060 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:33.947733 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c54422bf-d6df-4dc1-b317-36452119e894 tempest-QuotasAdminTestV257-804764781 tempest-QuotasAdminTestV257-804764781-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/28dd597307a448498f4a5450391a882c?user_id=5251e66e60a944cd9dcbd9784fc88aae" status: 200 len: 190 microversion: 2.57 time: 0.583879 Jun 05 08:24:33.948852 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 245/477] 10.222.0.33 () {60 vars in 1363 bytes} [Sun Jun 5 08:24:33 2022] GET /compute/v2.1/os-quota-sets/28dd597307a448498f4a5450391a882c?user_id=5251e66e60a944cd9dcbd9784fc88aae => generated 190 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:24:33.956226 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-80fe6745-4d58-4758-9ed5-d396edb2f014 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:33.957777 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-80fe6745-4d58-4758-9ed5-d396edb2f014 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] [instance: a51cf7cd-6764-454d-9efe-075a34cbff11] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:33.964454 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-80fe6745-4d58-4758-9ed5-d396edb2f014 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:33.965180 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-80fe6745-4d58-4758-9ed5-d396edb2f014 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:33.966163 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-80fe6745-4d58-4758-9ed5-d396edb2f014 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:33.966804 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-80fe6745-4d58-4758-9ed5-d396edb2f014 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:33.977660 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f60fd0ad-a9de-4c06-a700-2371d3c99e11 tempest-SecurityGroupsTestAdminJSON-281968609 tempest-SecurityGroupsTestAdminJSON-281968609-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.276563 Jun 05 08:24:33.979556 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 233/478] 10.222.0.33 () {60 vars in 1179 bytes} [Sun Jun 5 08:24:33 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:33.985485 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6cd15330-a1cf-4577-ab35-7a5d71008182 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:33.986349 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6cd15330-a1cf-4577-ab35-7a5d71008182 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:34.001560 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6cd15330-a1cf-4577-ab35-7a5d71008182 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:34.002467 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6cd15330-a1cf-4577-ab35-7a5d71008182 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:34.004755 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6cd15330-a1cf-4577-ab35-7a5d71008182 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:34.005343 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6cd15330-a1cf-4577-ab35-7a5d71008182 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:34.062018 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6cd15330-a1cf-4577-ab35-7a5d71008182 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:34.063335 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6cd15330-a1cf-4577-ab35-7a5d71008182 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:34.064020 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-6cd15330-a1cf-4577-ab35-7a5d71008182 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:34.181364 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6cd15330-a1cf-4577-ab35-7a5d71008182 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:34.212214 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6cd15330-a1cf-4577-ab35-7a5d71008182 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.224923 Jun 05 08:24:34.213414 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 234/479] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:33 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:34.304568 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-80fe6745-4d58-4758-9ed5-d396edb2f014 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ce8e767dfe4eb29c2c8402c79b01c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3801b3ebfcdd446c93e054b3f7baa53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:34.317529 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-80fe6745-4d58-4758-9ed5-d396edb2f014 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] 10.222.0.33 "GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11" status: 200 len: 1317 microversion: 2.1 time: 0.366569 Jun 05 08:24:34.318746 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 246/480] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:33 2022] GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11 => generated 1317 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:34.329679 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-46b8a6e2-3372-41e8-9842-4e235ad13c04 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:34.330668 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-46b8a6e2-3372-41e8-9842-4e235ad13c04 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:34.338312 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-46b8a6e2-3372-41e8-9842-4e235ad13c04 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:34.338822 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-46b8a6e2-3372-41e8-9842-4e235ad13c04 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:34.339880 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-46b8a6e2-3372-41e8-9842-4e235ad13c04 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:34.340387 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-46b8a6e2-3372-41e8-9842-4e235ad13c04 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:34.431388 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-46b8a6e2-3372-41e8-9842-4e235ad13c04 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:34.440627 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-46b8a6e2-3372-41e8-9842-4e235ad13c04 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21" status: 200 len: 1269 microversion: 2.1 time: 0.120015 Jun 05 08:24:34.442116 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 247/481] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:34 2022] GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21 => generated 1269 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:34.822830 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fb6f544c-5811-4aa9-8994-78d765a0f711 tempest-SecurityGroupsTestAdminJSON-804161934 tempest-SecurityGroupsTestAdminJSON-804161934-project-admin] Action: 'create', calling method: .version_select at 0x7f2433c03310>, body: {"security_group": {"name": "tempest-securitygroup-1078451466", "description": "tempest-description-1608936705"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:35.235627 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5e921a24-0c16-4b91-a848-5c16e2a6e95c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:35.236948 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5e921a24-0c16-4b91-a848-5c16e2a6e95c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:35.252601 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5e921a24-0c16-4b91-a848-5c16e2a6e95c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:35.256471 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5e921a24-0c16-4b91-a848-5c16e2a6e95c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:35.259889 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5e921a24-0c16-4b91-a848-5c16e2a6e95c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:35.261743 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5e921a24-0c16-4b91-a848-5c16e2a6e95c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:35.321008 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5e921a24-0c16-4b91-a848-5c16e2a6e95c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:35.321536 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5e921a24-0c16-4b91-a848-5c16e2a6e95c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:35.322007 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-5e921a24-0c16-4b91-a848-5c16e2a6e95c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:35.408135 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5e921a24-0c16-4b91-a848-5c16e2a6e95c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:35.417875 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5e921a24-0c16-4b91-a848-5c16e2a6e95c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.191898 Jun 05 08:24:35.419774 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 248/482] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:35 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:24:35.434784 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8a8421b7-2419-4b77-b545-11714bced7d2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:35.436331 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8a8421b7-2419-4b77-b545-11714bced7d2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] [instance: a51cf7cd-6764-454d-9efe-075a34cbff11] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:35.438201 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fb6f544c-5811-4aa9-8994-78d765a0f711 tempest-SecurityGroupsTestAdminJSON-804161934 tempest-SecurityGroupsTestAdminJSON-804161934-project-admin] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.222897 Jun 05 08:24:35.439466 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 235/483] 10.222.0.33 () {60 vars in 1179 bytes} [Sun Jun 5 08:24:34 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:35.451918 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8a8421b7-2419-4b77-b545-11714bced7d2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:35.452908 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-531682be-57fa-4b67-9467-ab69cad5257f tempest-SecurityGroupsTestAdminJSON-804161934 tempest-SecurityGroupsTestAdminJSON-804161934-project-admin] Action: 'create', calling method: .version_select at 0x7f2433c03ee0>, body: {"security_group": {"name": "tempest-securitygroup-2047916959", "description": "tempest-description-352270016"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:35.454455 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8a8421b7-2419-4b77-b545-11714bced7d2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:35.455827 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8a8421b7-2419-4b77-b545-11714bced7d2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:35.458401 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8a8421b7-2419-4b77-b545-11714bced7d2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:36.050555 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8a8421b7-2419-4b77-b545-11714bced7d2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ce8e767dfe4eb29c2c8402c79b01c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3801b3ebfcdd446c93e054b3f7baa53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:36.059172 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8a8421b7-2419-4b77-b545-11714bced7d2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] 10.222.0.33 "GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11" status: 200 len: 1317 microversion: 2.1 time: 0.637886 Jun 05 08:24:36.068985 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 249/484] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:35 2022] GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11 => generated 1317 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:36.074474 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a314a28f-3278-4653-bbeb-6b473e2d7fab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:36.075418 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a314a28f-3278-4653-bbeb-6b473e2d7fab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:36.084776 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a314a28f-3278-4653-bbeb-6b473e2d7fab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:36.085453 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a314a28f-3278-4653-bbeb-6b473e2d7fab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:36.086400 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a314a28f-3278-4653-bbeb-6b473e2d7fab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:36.087018 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a314a28f-3278-4653-bbeb-6b473e2d7fab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:36.190435 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-531682be-57fa-4b67-9467-ab69cad5257f tempest-SecurityGroupsTestAdminJSON-804161934 tempest-SecurityGroupsTestAdminJSON-804161934-project-admin] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.742540 Jun 05 08:24:36.192844 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 236/485] 10.222.0.33 () {60 vars in 1179 bytes} [Sun Jun 5 08:24:35 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:36.203865 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8284cdef-1fa5-4e84-8556-5033ba44b302 tempest-SecurityGroupsTestAdminJSON-804161934 tempest-SecurityGroupsTestAdminJSON-804161934-project-admin] Calling method '.version_select at 0x7f2433c76040>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:36.489441 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a314a28f-3278-4653-bbeb-6b473e2d7fab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:36.505192 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a314a28f-3278-4653-bbeb-6b473e2d7fab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21" status: 200 len: 1311 microversion: 2.1 time: 0.432767 Jun 05 08:24:36.506441 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 250/486] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:36 2022] GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21 => generated 1311 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:36.523158 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-bdec0c26-17b5-43e6-bc9c-8c1f08e66b5b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:36.524117 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-bdec0c26-17b5-43e6-bc9c-8c1f08e66b5b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:36.535175 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bdec0c26-17b5-43e6-bc9c-8c1f08e66b5b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:36.538091 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bdec0c26-17b5-43e6-bc9c-8c1f08e66b5b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:36.541589 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bdec0c26-17b5-43e6-bc9c-8c1f08e66b5b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:36.542700 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bdec0c26-17b5-43e6-bc9c-8c1f08e66b5b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:36.614669 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bdec0c26-17b5-43e6-bc9c-8c1f08e66b5b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:36.617232 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bdec0c26-17b5-43e6-bc9c-8c1f08e66b5b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:36.617992 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-bdec0c26-17b5-43e6-bc9c-8c1f08e66b5b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:36.821110 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-bdec0c26-17b5-43e6-bc9c-8c1f08e66b5b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:36.832761 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-bdec0c26-17b5-43e6-bc9c-8c1f08e66b5b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.322480 Jun 05 08:24:36.847791 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 251/487] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:36 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:36.847791 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-4d3451da-9c44-4edd-8c06-1fc05d1ae376 req-a5800e39-81bc-4cbf-9362-cf6aa9c76236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a51cf7cd-6764-454d-9efe-075a34cbff11", "name": "network-vif-plugged", "status": "completed", "tag": "b0edc0b9-9da5-4076-a71a-441b8059a064"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:36.872688 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-4d3451da-9c44-4edd-8c06-1fc05d1ae376 req-a5800e39-81bc-4cbf-9362-cf6aa9c76236 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:36.875437 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-4d3451da-9c44-4edd-8c06-1fc05d1ae376 req-a5800e39-81bc-4cbf-9362-cf6aa9c76236 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:36.907960 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-4d3451da-9c44-4edd-8c06-1fc05d1ae376 req-a5800e39-81bc-4cbf-9362-cf6aa9c76236 service nova] Creating event network-vif-plugged:b0edc0b9-9da5-4076-a71a-441b8059a064 for instance a51cf7cd-6764-454d-9efe-075a34cbff11 on n-h2-844739-1 Jun 05 08:24:36.914546 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-4d3451da-9c44-4edd-8c06-1fc05d1ae376 req-a5800e39-81bc-4cbf-9362-cf6aa9c76236 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077707 Jun 05 08:24:36.915526 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 252/488] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:37.077351 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c05d17b7-1935-42c9-b967-a44cd6cb63ed tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:37.078056 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c05d17b7-1935-42c9-b967-a44cd6cb63ed tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] [instance: a51cf7cd-6764-454d-9efe-075a34cbff11] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:37.085901 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c05d17b7-1935-42c9-b967-a44cd6cb63ed tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:37.086353 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c05d17b7-1935-42c9-b967-a44cd6cb63ed tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:37.087130 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c05d17b7-1935-42c9-b967-a44cd6cb63ed tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:37.087570 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c05d17b7-1935-42c9-b967-a44cd6cb63ed tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:37.618193 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c05d17b7-1935-42c9-b967-a44cd6cb63ed tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ce8e767dfe4eb29c2c8402c79b01c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3801b3ebfcdd446c93e054b3f7baa53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:37.626836 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c05d17b7-1935-42c9-b967-a44cd6cb63ed tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] 10.222.0.33 "GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11" status: 200 len: 1317 microversion: 2.1 time: 0.554616 Jun 05 08:24:37.627846 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 253/489] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:37 2022] GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11 => generated 1317 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:24:37.995082 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e35fb19d-ab59-4e69-9320-a3581f499e1c tempest-NetworksTest-922531311 tempest-NetworksTest-922531311-project-admin] Calling method '.version_select at 0x7f2433c349d0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:38.318647 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e35fb19d-ab59-4e69-9320-a3581f499e1c tempest-NetworksTest-922531311 tempest-NetworksTest-922531311-project-admin] 10.222.0.33 "GET /compute/v2.1/os-networks" status: 200 len: 6060 microversion: 2.1 time: 0.688878 Jun 05 08:24:38.319820 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 254/490] 10.222.0.33 () {58 vars in 1136 bytes} [Sun Jun 5 08:24:37 2022] GET /compute/v2.1/os-networks => generated 6060 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:38.325248 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-d937cb90-9636-4144-95fa-411043ef2155 req-3c908068-5420-4305-b5f3-8c4b42fbbb79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef99ada2-1c39-422e-8a61-e4f7d00cbe21", "tag": "252d7f78-09ea-4658-a0fc-b18556671cf4"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:38.336298 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-d937cb90-9636-4144-95fa-411043ef2155 req-3c908068-5420-4305-b5f3-8c4b42fbbb79 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:38.337051 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-d937cb90-9636-4144-95fa-411043ef2155 req-3c908068-5420-4305-b5f3-8c4b42fbbb79 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:38.350332 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-d937cb90-9636-4144-95fa-411043ef2155 req-3c908068-5420-4305-b5f3-8c4b42fbbb79 service nova] Creating event network-changed:252d7f78-09ea-4658-a0fc-b18556671cf4 for instance ef99ada2-1c39-422e-8a61-e4f7d00cbe21 on n-h1-844739-1 Jun 05 08:24:38.356424 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-d937cb90-9636-4144-95fa-411043ef2155 req-3c908068-5420-4305-b5f3-8c4b42fbbb79 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034306 Jun 05 08:24:38.357324 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 255/491] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:38.364454 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-60c91cd5-dbf1-44ac-b159-4627650b6433 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:38.365160 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-60c91cd5-dbf1-44ac-b159-4627650b6433 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:38.375467 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-60c91cd5-dbf1-44ac-b159-4627650b6433 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:38.376256 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-60c91cd5-dbf1-44ac-b159-4627650b6433 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:38.377242 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-60c91cd5-dbf1-44ac-b159-4627650b6433 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:38.377692 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-60c91cd5-dbf1-44ac-b159-4627650b6433 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:38.683665 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-60c91cd5-dbf1-44ac-b159-4627650b6433 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:38.692733 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-60c91cd5-dbf1-44ac-b159-4627650b6433 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21" status: 200 len: 1311 microversion: 2.1 time: 0.333735 Jun 05 08:24:38.703699 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 256/492] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:38 2022] GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21 => generated 1311 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:38.709719 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-42ddefd1-10e8-4aa1-9b14-e4d8a855d04d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:38.710620 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-42ddefd1-10e8-4aa1-9b14-e4d8a855d04d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:38.717449 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-42ddefd1-10e8-4aa1-9b14-e4d8a855d04d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:38.718186 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-42ddefd1-10e8-4aa1-9b14-e4d8a855d04d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:38.719209 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-42ddefd1-10e8-4aa1-9b14-e4d8a855d04d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:38.719887 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-42ddefd1-10e8-4aa1-9b14-e4d8a855d04d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:38.766604 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-42ddefd1-10e8-4aa1-9b14-e4d8a855d04d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:38.767308 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-42ddefd1-10e8-4aa1-9b14-e4d8a855d04d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:38.767986 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-42ddefd1-10e8-4aa1-9b14-e4d8a855d04d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:38.841044 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-42ddefd1-10e8-4aa1-9b14-e4d8a855d04d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:38.844573 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=100 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:38.851123 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-42ddefd1-10e8-4aa1-9b14-e4d8a855d04d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.145490 Jun 05 08:24:38.851731 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 257/493] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:38 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:38.856522 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b33cb493-ba7d-4bf7-b06f-087f82c154cf tempest-NetworksTest-922531311 tempest-NetworksTest-922531311-project-admin] Calling method '.version_select at 0x7f2433bcadc0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:39.060026 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b33cb493-ba7d-4bf7-b06f-087f82c154cf tempest-NetworksTest-922531311 tempest-NetworksTest-922531311-project-admin] 10.222.0.33 "GET /compute/v2.1/os-networks/481248fe-79fe-40ce-8960-d13aca527363" status: 200 len: 652 microversion: 2.1 time: 0.207182 Jun 05 08:24:39.060884 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 258/494] 10.222.0.33 () {58 vars in 1247 bytes} [Sun Jun 5 08:24:38 2022] GET /compute/v2.1/os-networks/481248fe-79fe-40ce-8960-d13aca527363 => generated 652 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:39.067043 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-44a667db-883b-465b-ab45-4925cc76bfb1 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:39.068680 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-44a667db-883b-465b-ab45-4925cc76bfb1 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] [instance: a51cf7cd-6764-454d-9efe-075a34cbff11] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:39.080857 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-44a667db-883b-465b-ab45-4925cc76bfb1 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:39.082334 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-44a667db-883b-465b-ab45-4925cc76bfb1 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:39.085048 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-44a667db-883b-465b-ab45-4925cc76bfb1 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:39.085735 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-44a667db-883b-465b-ab45-4925cc76bfb1 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:39.335468 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-44a667db-883b-465b-ab45-4925cc76bfb1 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ce8e767dfe4eb29c2c8402c79b01c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3801b3ebfcdd446c93e054b3f7baa53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:39.344437 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-44a667db-883b-465b-ab45-4925cc76bfb1 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] 10.222.0.33 "GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11" status: 200 len: 1507 microversion: 2.1 time: 0.281692 Jun 05 08:24:39.345484 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 259/495] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:39 2022] GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11 => generated 1507 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:39.368998 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6ddeac75-1081-4b43-805c-aecc0a0de9c0 tempest-NetworksTest-922531311 tempest-NetworksTest-922531311-project-admin] Calling method '.version_select at 0x7f2433b959d0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:39.544560 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6ddeac75-1081-4b43-805c-aecc0a0de9c0 tempest-NetworksTest-922531311 tempest-NetworksTest-922531311-project-admin] 10.222.0.33 "GET /compute/v2.1/os-networks" status: 200 len: 6752 microversion: 2.1 time: 0.197223 Jun 05 08:24:39.545139 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 260/496] 10.222.0.33 () {58 vars in 1136 bytes} [Sun Jun 5 08:24:39 2022] GET /compute/v2.1/os-networks => generated 6752 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:39.715041 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-687950cd-8533-42db-9879-3b377f602018 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-805618392", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "a7010e4a-eda5-41d8-af56-68a4d3196193"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:39.773008 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-687950cd-8533-42db-9879-3b377f602018 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] validate_networks() for [('a7010e4a-eda5-41d8-af56-68a4d3196193', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:24:40.035964 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8284cdef-1fa5-4e84-8556-5033ba44b302 tempest-SecurityGroupsTestAdminJSON-804161934 tempest-SecurityGroupsTestAdminJSON-804161934-project-admin] 10.222.0.33 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 9685 microversion: 2.1 time: 3.835736 Jun 05 08:24:40.036719 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 237/497] 10.222.0.33 () {58 vars in 1190 bytes} [Sun Jun 5 08:24:36 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 9685 bytes in 3837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:24:40.043801 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d69392e9-9c1f-4323-91b2-a998b6a3a30f tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:40.043801 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d69392e9-9c1f-4323-91b2-a998b6a3a30f tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] [instance: a51cf7cd-6764-454d-9efe-075a34cbff11] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:40.053453 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d69392e9-9c1f-4323-91b2-a998b6a3a30f tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:40.053901 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d69392e9-9c1f-4323-91b2-a998b6a3a30f tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:40.054665 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d69392e9-9c1f-4323-91b2-a998b6a3a30f tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:40.055145 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d69392e9-9c1f-4323-91b2-a998b6a3a30f tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:40.089754 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d69392e9-9c1f-4323-91b2-a998b6a3a30f tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '74ce8e767dfe4eb29c2c8402c79b01c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3801b3ebfcdd446c93e054b3f7baa53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:40.090651 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d69392e9-9c1f-4323-91b2-a998b6a3a30f tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] 10.222.0.33 "GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11/os-instance-actions/req-2978c265-63ee-4aa8-bc63-4db7e5d531f2" status: 200 len: 313 microversion: 2.1 time: 0.053017 Jun 05 08:24:40.091401 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 238/498] 10.222.0.33 () {58 vars in 1418 bytes} [Sun Jun 5 08:24:40 2022] GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11/os-instance-actions/req-2978c265-63ee-4aa8-bc63-4db7e5d531f2 => generated 313 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:40.287885 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6942911d-5728-4db6-bde5-eb5471c5091c tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1473109265", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:40.340113 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-687950cd-8533-42db-9879-3b377f602018 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:24:40.340729 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-687950cd-8533-42db-9879-3b377f602018 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:24:40.341481 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-687950cd-8533-42db-9879-3b377f602018 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:24:40.342076 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-687950cd-8533-42db-9879-3b377f602018 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:24:40.342651 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-687950cd-8533-42db-9879-3b377f602018 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:24:40.350508 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-6942911d-5728-4db6-bde5-eb5471c5091c tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] validate_networks() for None {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:24:40.351615 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-687950cd-8533-42db-9879-3b377f602018 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:40.352089 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-687950cd-8533-42db-9879-3b377f602018 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:40.352895 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-687950cd-8533-42db-9879-3b377f602018 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:40.353334 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-687950cd-8533-42db-9879-3b377f602018 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:40.370174 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-687950cd-8533-42db-9879-3b377f602018 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Getting quotas for project fb5c1766af9c4e079f74b67177db0246. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:24:40.374835 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-687950cd-8533-42db-9879-3b377f602018 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Getting quotas for user 03720c07cc1e4ae6a2c621b1d3feed9a and project fb5c1766af9c4e079f74b67177db0246. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:24:40.387470 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-687950cd-8533-42db-9879-3b377f602018 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:24:40.389757 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-687950cd-8533-42db-9879-3b377f602018 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:24:40.454965 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-687950cd-8533-42db-9879-3b377f602018 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.908787 Jun 05 08:24:40.459206 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 261/499] 10.222.0.33 () {62 vars in 1187 bytes} [Sun Jun 5 08:24:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 05 08:24:40.469613 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-34d6f0fa-7b9c-4c3a-ac05-76112a67632b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:40.471501 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-34d6f0fa-7b9c-4c3a-ac05-76112a67632b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:40.481088 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-34d6f0fa-7b9c-4c3a-ac05-76112a67632b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:40.481719 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-34d6f0fa-7b9c-4c3a-ac05-76112a67632b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:40.482506 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-34d6f0fa-7b9c-4c3a-ac05-76112a67632b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:40.482935 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-34d6f0fa-7b9c-4c3a-ac05-76112a67632b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:40.671964 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-6942911d-5728-4db6-bde5-eb5471c5091c tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:24:40.672436 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-6942911d-5728-4db6-bde5-eb5471c5091c tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:24:40.672908 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-6942911d-5728-4db6-bde5-eb5471c5091c tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:24:40.673332 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-6942911d-5728-4db6-bde5-eb5471c5091c tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:24:40.673762 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-6942911d-5728-4db6-bde5-eb5471c5091c tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:24:40.691292 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6942911d-5728-4db6-bde5-eb5471c5091c tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:40.691751 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6942911d-5728-4db6-bde5-eb5471c5091c tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:40.693009 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6942911d-5728-4db6-bde5-eb5471c5091c tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:40.693621 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6942911d-5728-4db6-bde5-eb5471c5091c tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:40.718208 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-6942911d-5728-4db6-bde5-eb5471c5091c tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Getting quotas for project da8b37e66d354ce09c4bef01d28ef7a3. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:24:40.724525 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-6942911d-5728-4db6-bde5-eb5471c5091c tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Getting quotas for user 704cd9e8b0984139b58ec6abe3579576 and project da8b37e66d354ce09c4bef01d28ef7a3. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:24:40.739547 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6942911d-5728-4db6-bde5-eb5471c5091c tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:24:40.742673 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6942911d-5728-4db6-bde5-eb5471c5091c tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 828624fb-b333-41c7-81a2-28d9bb4e1d88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:24:40.805636 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6942911d-5728-4db6-bde5-eb5471c5091c tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.713190 Jun 05 08:24:40.807106 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 239/500] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:24:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:24:40.815465 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-485d454a-b513-4ff9-a3c8-4085bfac995f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:40.816669 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-485d454a-b513-4ff9-a3c8-4085bfac995f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:40.823849 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-485d454a-b513-4ff9-a3c8-4085bfac995f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:40.824576 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-485d454a-b513-4ff9-a3c8-4085bfac995f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:40.825493 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-485d454a-b513-4ff9-a3c8-4085bfac995f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:40.826066 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-485d454a-b513-4ff9-a3c8-4085bfac995f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:40.859261 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-34d6f0fa-7b9c-4c3a-ac05-76112a67632b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:40.869925 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-485d454a-b513-4ff9-a3c8-4085bfac995f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:40.870295 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-34d6f0fa-7b9c-4c3a-ac05-76112a67632b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21" status: 200 len: 1311 microversion: 2.1 time: 0.409729 Jun 05 08:24:40.872822 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 262/501] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:40 2022] GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21 => generated 1311 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:40.873451 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-485d454a-b513-4ff9-a3c8-4085bfac995f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:40.874535 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-485d454a-b513-4ff9-a3c8-4085bfac995f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:40.886884 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-279604bd-ef9c-4012-87ac-94d1c599c5cc tempest-SecurityGroupsTestAdminJSON-281968609 tempest-SecurityGroupsTestAdminJSON-281968609-project] Calling method '.version_select at 0x7f2433b7ce50>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:40.965410 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-485d454a-b513-4ff9-a3c8-4085bfac995f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:40.988800 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-485d454a-b513-4ff9-a3c8-4085bfac995f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.179346 Jun 05 08:24:40.993031 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 240/502] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:40 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:41.036720 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3f7fe301-2d3a-4448-96bc-05f880e29dc8 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:41.037827 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3f7fe301-2d3a-4448-96bc-05f880e29dc8 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] [instance: a51cf7cd-6764-454d-9efe-075a34cbff11] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:41.059132 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3f7fe301-2d3a-4448-96bc-05f880e29dc8 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:41.063284 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3f7fe301-2d3a-4448-96bc-05f880e29dc8 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:41.066383 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3f7fe301-2d3a-4448-96bc-05f880e29dc8 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:41.067653 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3f7fe301-2d3a-4448-96bc-05f880e29dc8 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:41.194763 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:41.209818 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3f7fe301-2d3a-4448-96bc-05f880e29dc8 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] 10.222.0.33 "POST /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11/action" status: 202 len: 0 microversion: 2.1 time: 0.206349 Jun 05 08:24:41.211966 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 241/503] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Jun 5 08:24:41 2022] POST /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:24:41.219742 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-86907582-ba2a-4f37-befd-b4132fc0cd71 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:41.220533 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-86907582-ba2a-4f37-befd-b4132fc0cd71 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:41.228902 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-86907582-ba2a-4f37-befd-b4132fc0cd71 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:41.229868 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-86907582-ba2a-4f37-befd-b4132fc0cd71 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:41.230805 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-86907582-ba2a-4f37-befd-b4132fc0cd71 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:41.231429 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-86907582-ba2a-4f37-befd-b4132fc0cd71 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:41.427855 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-86907582-ba2a-4f37-befd-b4132fc0cd71 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:41.438096 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-86907582-ba2a-4f37-befd-b4132fc0cd71 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:41.439397 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-86907582-ba2a-4f37-befd-b4132fc0cd71 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:41.441337 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-86907582-ba2a-4f37-befd-b4132fc0cd71 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 1257 microversion: 2.25 time: 0.226858 Jun 05 08:24:41.449223 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 242/504] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:24:41 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 1257 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:24:41.456208 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0e81f8c9-15fe-4b10-b4ed-778b75a3f144 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:41.457129 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0e81f8c9-15fe-4b10-b4ed-778b75a3f144 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 828624fb-b333-41c7-81a2-28d9bb4e1d88] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:41.596132 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0e81f8c9-15fe-4b10-b4ed-778b75a3f144 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704cd9e8b0984139b58ec6abe3579576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8b37e66d354ce09c4bef01d28ef7a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:41.610494 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0e81f8c9-15fe-4b10-b4ed-778b75a3f144 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "GET /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88" status: 200 len: 1222 microversion: 2.1 time: 0.154381 Jun 05 08:24:41.610494 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 243/505] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:41 2022] GET /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88 => generated 1222 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:41.630718 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bb49006c-9f94-4561-b73a-4b6707b86755 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:41.631266 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-bb49006c-9f94-4561-b73a-4b6707b86755 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] [instance: a51cf7cd-6764-454d-9efe-075a34cbff11] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:41.637293 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bb49006c-9f94-4561-b73a-4b6707b86755 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:41.637746 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bb49006c-9f94-4561-b73a-4b6707b86755 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:41.638520 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bb49006c-9f94-4561-b73a-4b6707b86755 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:41.638967 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bb49006c-9f94-4561-b73a-4b6707b86755 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:41.933205 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-279604bd-ef9c-4012-87ac-94d1c599c5cc tempest-SecurityGroupsTestAdminJSON-281968609 tempest-SecurityGroupsTestAdminJSON-281968609-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 1.059187 Jun 05 08:24:41.934344 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 263/506] 10.222.0.33 () {58 vars in 1190 bytes} [Sun Jun 5 08:24:40 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:41.940216 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-529ded6e-9c9b-4c15-84d5-f0ca06f88083 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:41.941762 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-529ded6e-9c9b-4c15-84d5-f0ca06f88083 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:41.955388 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-529ded6e-9c9b-4c15-84d5-f0ca06f88083 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:41.956848 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-529ded6e-9c9b-4c15-84d5-f0ca06f88083 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:41.958815 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-529ded6e-9c9b-4c15-84d5-f0ca06f88083 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:41.959441 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-529ded6e-9c9b-4c15-84d5-f0ca06f88083 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:42.227685 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-bb49006c-9f94-4561-b73a-4b6707b86755 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ce8e767dfe4eb29c2c8402c79b01c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3801b3ebfcdd446c93e054b3f7baa53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:42.235520 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bb49006c-9f94-4561-b73a-4b6707b86755 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] 10.222.0.33 "GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11" status: 200 len: 1509 microversion: 2.1 time: 0.628961 Jun 05 08:24:42.236124 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 244/507] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:41 2022] GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11 => generated 1509 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:42.252832 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-55672c1f-e9e5-491e-bd9b-69411f14d985 tempest-SecurityGroupsTestAdminJSON-804161934 tempest-SecurityGroupsTestAdminJSON-804161934-project-admin] Calling method '.version_select at 0x7f2433c1ff70>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:42.436398 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-529ded6e-9c9b-4c15-84d5-f0ca06f88083 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:42.448962 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-529ded6e-9c9b-4c15-84d5-f0ca06f88083 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21" status: 200 len: 1311 microversion: 2.1 time: 0.513363 Jun 05 08:24:42.450333 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 264/508] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:41 2022] GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21 => generated 1311 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:42.458149 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-849d5b89-2880-4b97-ae2a-66a726aa6484 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:42.458992 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-849d5b89-2880-4b97-ae2a-66a726aa6484 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:42.469435 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-849d5b89-2880-4b97-ae2a-66a726aa6484 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:42.471212 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-849d5b89-2880-4b97-ae2a-66a726aa6484 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:42.473811 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-849d5b89-2880-4b97-ae2a-66a726aa6484 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:42.474756 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-849d5b89-2880-4b97-ae2a-66a726aa6484 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:42.539367 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-849d5b89-2880-4b97-ae2a-66a726aa6484 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:42.539822 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-849d5b89-2880-4b97-ae2a-66a726aa6484 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:42.540479 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-849d5b89-2880-4b97-ae2a-66a726aa6484 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:42.630107 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-849d5b89-2880-4b97-ae2a-66a726aa6484 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:42.642896 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-849d5b89-2880-4b97-ae2a-66a726aa6484 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.187870 Jun 05 08:24:42.646020 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 265/509] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:42 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:42.655520 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-408b4f36-b1eb-406c-acc0-c4b062932e5b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:42.661917 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-408b4f36-b1eb-406c-acc0-c4b062932e5b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:42.672997 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-408b4f36-b1eb-406c-acc0-c4b062932e5b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:42.673716 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-408b4f36-b1eb-406c-acc0-c4b062932e5b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:42.678230 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-408b4f36-b1eb-406c-acc0-c4b062932e5b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:42.679702 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-408b4f36-b1eb-406c-acc0-c4b062932e5b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:42.736942 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-55672c1f-e9e5-491e-bd9b-69411f14d985 tempest-SecurityGroupsTestAdminJSON-804161934 tempest-SecurityGroupsTestAdminJSON-804161934-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/6c54643a-2fb3-4320-a25b-e3dbd4db68b6" status: 202 len: 0 microversion: 2.1 time: 0.487655 Jun 05 08:24:42.738103 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 245/510] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:24:42 2022] DELETE /compute/v2.1/os-security-groups/6c54643a-2fb3-4320-a25b-e3dbd4db68b6 => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:24:42.744480 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d70ec7d7-42ce-43a8-8b21-5fb729963907 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:42.745306 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d70ec7d7-42ce-43a8-8b21-5fb729963907 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 828624fb-b333-41c7-81a2-28d9bb4e1d88] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:42.764026 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d70ec7d7-42ce-43a8-8b21-5fb729963907 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:42.764507 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d70ec7d7-42ce-43a8-8b21-5fb729963907 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:42.767012 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d70ec7d7-42ce-43a8-8b21-5fb729963907 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:42.770259 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d70ec7d7-42ce-43a8-8b21-5fb729963907 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:42.913162 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d70ec7d7-42ce-43a8-8b21-5fb729963907 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704cd9e8b0984139b58ec6abe3579576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8b37e66d354ce09c4bef01d28ef7a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:42.932966 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d70ec7d7-42ce-43a8-8b21-5fb729963907 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "GET /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88" status: 200 len: 1280 microversion: 2.1 time: 0.193352 Jun 05 08:24:42.946240 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 246/511] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:42 2022] GET /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88 => generated 1280 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:42.956153 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-408b4f36-b1eb-406c-acc0-c4b062932e5b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:42.957387 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fd032380-2641-4502-99fc-354b7711cf24 tempest-SecurityGroupsTestAdminJSON-804161934 tempest-SecurityGroupsTestAdminJSON-804161934-project-admin] Calling method '.version_select at 0x7f2433c03790>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:42.966888 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-408b4f36-b1eb-406c-acc0-c4b062932e5b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:42.969489 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-408b4f36-b1eb-406c-acc0-c4b062932e5b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:42.971315 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-408b4f36-b1eb-406c-acc0-c4b062932e5b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 1361 microversion: 2.25 time: 0.323339 Jun 05 08:24:42.972109 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 266/512] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:24:42 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 1361 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:24:43.196822 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fd032380-2641-4502-99fc-354b7711cf24 tempest-SecurityGroupsTestAdminJSON-804161934 tempest-SecurityGroupsTestAdminJSON-804161934-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/a8976478-e459-4400-9da8-88b506aadaf7" status: 202 len: 0 microversion: 2.1 time: 0.247850 Jun 05 08:24:43.198962 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 247/513] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:24:42 2022] DELETE /compute/v2.1/os-security-groups/a8976478-e459-4400-9da8-88b506aadaf7 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:24:43.208664 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-16e45347-9397-4391-9448-74b9ea953e20 tempest-SecurityGroupsTestAdminJSON-281968609 tempest-SecurityGroupsTestAdminJSON-281968609-project] Calling method '.version_select at 0x7f2433b31820>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:43.255340 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8c16d05c-88bd-428c-9c0f-a9bf0c2a5375 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:43.256202 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8c16d05c-88bd-428c-9c0f-a9bf0c2a5375 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] [instance: a51cf7cd-6764-454d-9efe-075a34cbff11] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:43.269862 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8c16d05c-88bd-428c-9c0f-a9bf0c2a5375 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:43.270780 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8c16d05c-88bd-428c-9c0f-a9bf0c2a5375 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:43.271962 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8c16d05c-88bd-428c-9c0f-a9bf0c2a5375 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:43.272702 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8c16d05c-88bd-428c-9c0f-a9bf0c2a5375 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:43.511194 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8c16d05c-88bd-428c-9c0f-a9bf0c2a5375 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ce8e767dfe4eb29c2c8402c79b01c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3801b3ebfcdd446c93e054b3f7baa53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:43.523814 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8c16d05c-88bd-428c-9c0f-a9bf0c2a5375 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] 10.222.0.33 "GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11" status: 200 len: 1514 microversion: 2.1 time: 0.273998 Jun 05 08:24:43.527644 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 248/514] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:43 2022] GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11 => generated 1514 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:43.585676 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-16e45347-9397-4391-9448-74b9ea953e20 tempest-SecurityGroupsTestAdminJSON-281968609 tempest-SecurityGroupsTestAdminJSON-281968609-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/ab318d3d-c17f-45dc-9bab-aaa51490ef88" status: 202 len: 0 microversion: 2.1 time: 0.382345 Jun 05 08:24:43.587171 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 267/515] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:24:43 2022] DELETE /compute/v2.1/os-security-groups/ab318d3d-c17f-45dc-9bab-aaa51490ef88 => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:24:43.593148 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3d1682f7-14eb-45e6-a7d2-17bc038f9103 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:43.593912 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3d1682f7-14eb-45e6-a7d2-17bc038f9103 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:43.601177 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3d1682f7-14eb-45e6-a7d2-17bc038f9103 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:43.601971 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3d1682f7-14eb-45e6-a7d2-17bc038f9103 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:43.603001 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3d1682f7-14eb-45e6-a7d2-17bc038f9103 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:43.603870 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3d1682f7-14eb-45e6-a7d2-17bc038f9103 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:43.710949 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-74734403-c03c-459a-8421-48787d7e8881 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-553560888", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:43.765759 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-74734403-c03c-459a-8421-48787d7e8881 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] validate_networks() for None {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:24:43.770139 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3d1682f7-14eb-45e6-a7d2-17bc038f9103 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:43.780616 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3d1682f7-14eb-45e6-a7d2-17bc038f9103 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21" status: 200 len: 1311 microversion: 2.1 time: 0.191719 Jun 05 08:24:43.788650 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 268/516] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:43 2022] GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21 => generated 1311 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:43.795137 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1e5ab85a-307b-4887-b0f7-31d5d904b103 tempest-SecurityGroupsTestAdminJSON-281968609 tempest-SecurityGroupsTestAdminJSON-281968609-project] Calling method '.version_select at 0x7f2433b7cee0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:44.044922 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-74734403-c03c-459a-8421-48787d7e8881 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:24:44.045783 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-74734403-c03c-459a-8421-48787d7e8881 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:24:44.046586 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-74734403-c03c-459a-8421-48787d7e8881 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:24:44.047236 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-74734403-c03c-459a-8421-48787d7e8881 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:24:44.047858 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-74734403-c03c-459a-8421-48787d7e8881 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:24:44.059654 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-74734403-c03c-459a-8421-48787d7e8881 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:44.060473 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-74734403-c03c-459a-8421-48787d7e8881 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:44.063731 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-74734403-c03c-459a-8421-48787d7e8881 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:44.064645 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-74734403-c03c-459a-8421-48787d7e8881 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:44.092225 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-74734403-c03c-459a-8421-48787d7e8881 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Getting quotas for project 56c3c05bd3e84382aa808d1361072433. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:24:44.099697 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-74734403-c03c-459a-8421-48787d7e8881 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Getting quotas for user 89b8a11ed3f5412d8ad6783cbcd324d5 and project 56c3c05bd3e84382aa808d1361072433. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:24:44.115745 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-74734403-c03c-459a-8421-48787d7e8881 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:24:44.118646 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-74734403-c03c-459a-8421-48787d7e8881 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] [instance: 3f551f85-c8f2-45d5-b5ac-20949558181c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:24:44.126664 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1e5ab85a-307b-4887-b0f7-31d5d904b103 tempest-SecurityGroupsTestAdminJSON-281968609 tempest-SecurityGroupsTestAdminJSON-281968609-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/a1927f97-2009-4f7b-9ce7-33e901eb368b" status: 202 len: 0 microversion: 2.1 time: 0.336595 Jun 05 08:24:44.127243 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 269/517] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:24:43 2022] DELETE /compute/v2.1/os-security-groups/a1927f97-2009-4f7b-9ce7-33e901eb368b => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:24:44.137755 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-dd35737c-83c2-4597-b293-a869c8ec7d09 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:44.138538 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-dd35737c-83c2-4597-b293-a869c8ec7d09 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:44.152436 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dd35737c-83c2-4597-b293-a869c8ec7d09 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:44.154900 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dd35737c-83c2-4597-b293-a869c8ec7d09 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:44.155716 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dd35737c-83c2-4597-b293-a869c8ec7d09 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:44.156178 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dd35737c-83c2-4597-b293-a869c8ec7d09 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:44.245333 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-74734403-c03c-459a-8421-48787d7e8881 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.716425 Jun 05 08:24:44.246816 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 249/518] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:24:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:24:44.257258 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dd35737c-83c2-4597-b293-a869c8ec7d09 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:44.274697 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dd35737c-83c2-4597-b293-a869c8ec7d09 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:44.275243 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-dd35737c-83c2-4597-b293-a869c8ec7d09 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:44.280296 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b7038478-8fc1-4a6a-afd0-4bb6607ad306 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:44.281512 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b7038478-8fc1-4a6a-afd0-4bb6607ad306 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 828624fb-b333-41c7-81a2-28d9bb4e1d88] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:44.305150 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b7038478-8fc1-4a6a-afd0-4bb6607ad306 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:44.306393 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b7038478-8fc1-4a6a-afd0-4bb6607ad306 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:44.307472 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b7038478-8fc1-4a6a-afd0-4bb6607ad306 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:44.308256 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b7038478-8fc1-4a6a-afd0-4bb6607ad306 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:44.421928 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-dd35737c-83c2-4597-b293-a869c8ec7d09 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:44.438525 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-dd35737c-83c2-4597-b293-a869c8ec7d09 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.308215 Jun 05 08:24:44.439944 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 270/519] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:44 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:44.446568 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-de793b18-b7bc-4fd9-8665-ec03863846bb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:44.447507 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-de793b18-b7bc-4fd9-8665-ec03863846bb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:44.454556 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-de793b18-b7bc-4fd9-8665-ec03863846bb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:44.455344 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-de793b18-b7bc-4fd9-8665-ec03863846bb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:44.456397 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-de793b18-b7bc-4fd9-8665-ec03863846bb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:44.456993 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-de793b18-b7bc-4fd9-8665-ec03863846bb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:44.646178 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b7038478-8fc1-4a6a-afd0-4bb6607ad306 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704cd9e8b0984139b58ec6abe3579576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8b37e66d354ce09c4bef01d28ef7a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:44.658204 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b7038478-8fc1-4a6a-afd0-4bb6607ad306 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "GET /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88" status: 200 len: 1322 microversion: 2.1 time: 0.407411 Jun 05 08:24:44.662535 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 250/520] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:44 2022] GET /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88 => generated 1322 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:44.667689 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bd778643-7e07-429f-a7a3-861af588b893 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:44.668480 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-bd778643-7e07-429f-a7a3-861af588b893 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] [instance: 3f551f85-c8f2-45d5-b5ac-20949558181c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:44.689925 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-de793b18-b7bc-4fd9-8665-ec03863846bb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:44.715792 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-de793b18-b7bc-4fd9-8665-ec03863846bb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:44.717758 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-de793b18-b7bc-4fd9-8665-ec03863846bb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:44.720237 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-de793b18-b7bc-4fd9-8665-ec03863846bb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 1361 microversion: 2.25 time: 0.277639 Jun 05 08:24:44.738714 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 271/521] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:24:44 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 1361 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:24:44.748504 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-e0c18b64-77e2-49bd-ae95-680f4e1e9af9 req-539bb099-7d22-42fc-b639-e698716ab979 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "035abb75-eda1-447d-b034-2bbb171f704e", "tag": "a81939c6-14ec-4dcc-99cd-55f57077719c"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:44.771284 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-e0c18b64-77e2-49bd-ae95-680f4e1e9af9 req-539bb099-7d22-42fc-b639-e698716ab979 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:44.774600 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-e0c18b64-77e2-49bd-ae95-680f4e1e9af9 req-539bb099-7d22-42fc-b639-e698716ab979 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:44.799726 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-e0c18b64-77e2-49bd-ae95-680f4e1e9af9 req-539bb099-7d22-42fc-b639-e698716ab979 service nova] Creating event network-changed:a81939c6-14ec-4dcc-99cd-55f57077719c for instance 035abb75-eda1-447d-b034-2bbb171f704e on n-h1-844739-1 Jun 05 08:24:44.805504 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-e0c18b64-77e2-49bd-ae95-680f4e1e9af9 req-539bb099-7d22-42fc-b639-e698716ab979 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065403 Jun 05 08:24:44.806860 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 272/522] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:44.816278 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b3422f17-059c-4aa8-80a1-359f0fd461b6 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:44.830317 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b3422f17-059c-4aa8-80a1-359f0fd461b6 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] [instance: a51cf7cd-6764-454d-9efe-075a34cbff11] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:44.844631 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b3422f17-059c-4aa8-80a1-359f0fd461b6 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:44.845354 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b3422f17-059c-4aa8-80a1-359f0fd461b6 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:44.846295 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b3422f17-059c-4aa8-80a1-359f0fd461b6 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:44.847775 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b3422f17-059c-4aa8-80a1-359f0fd461b6 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:44.867872 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-bd778643-7e07-429f-a7a3-861af588b893 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8a11ed3f5412d8ad6783cbcd324d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3c05bd3e84382aa808d1361072433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:44.878352 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bd778643-7e07-429f-a7a3-861af588b893 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] 10.222.0.33 "GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c" status: 200 len: 1222 microversion: 2.1 time: 0.211949 Jun 05 08:24:44.880066 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 251/523] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:44 2022] GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c => generated 1222 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:44.898443 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-af8eff4b-e133-4d63-af5f-07172fa3b7c3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:44.902378 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-af8eff4b-e133-4d63-af5f-07172fa3b7c3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:44.917841 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-af8eff4b-e133-4d63-af5f-07172fa3b7c3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:44.923254 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-af8eff4b-e133-4d63-af5f-07172fa3b7c3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:44.924460 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-af8eff4b-e133-4d63-af5f-07172fa3b7c3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:44.925634 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-af8eff4b-e133-4d63-af5f-07172fa3b7c3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:45.149369 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b3422f17-059c-4aa8-80a1-359f0fd461b6 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ce8e767dfe4eb29c2c8402c79b01c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3801b3ebfcdd446c93e054b3f7baa53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:45.160279 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b3422f17-059c-4aa8-80a1-359f0fd461b6 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] 10.222.0.33 "GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11" status: 200 len: 1507 microversion: 2.1 time: 0.350681 Jun 05 08:24:45.172077 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 273/524] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:44 2022] GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11 => generated 1507 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:45.172077 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-a66977c9-6020-4408-bb7f-b6bd6205a80f req-89c737dc-bc8a-4f5d-b10e-42dea3026ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef99ada2-1c39-422e-8a61-e4f7d00cbe21", "name": "network-vif-plugged", "status": "completed", "tag": "252d7f78-09ea-4658-a0fc-b18556671cf4"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:45.176298 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-a66977c9-6020-4408-bb7f-b6bd6205a80f req-89c737dc-bc8a-4f5d-b10e-42dea3026ef2 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:45.177057 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-a66977c9-6020-4408-bb7f-b6bd6205a80f req-89c737dc-bc8a-4f5d-b10e-42dea3026ef2 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:45.189842 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-a66977c9-6020-4408-bb7f-b6bd6205a80f req-89c737dc-bc8a-4f5d-b10e-42dea3026ef2 service nova] Creating event network-vif-plugged:252d7f78-09ea-4658-a0fc-b18556671cf4 for instance ef99ada2-1c39-422e-8a61-e4f7d00cbe21 on n-h1-844739-1 Jun 05 08:24:45.195896 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-a66977c9-6020-4408-bb7f-b6bd6205a80f req-89c737dc-bc8a-4f5d-b10e-42dea3026ef2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033458 Jun 05 08:24:45.197112 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 274/525] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:45.203931 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e9b2059b-cab8-4cb9-8b07-6aaa21d527b2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Calling method '.version_select at 0x7f2433b1e0d0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:45.204698 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e9b2059b-cab8-4cb9-8b07-6aaa21d527b2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] [instance: a51cf7cd-6764-454d-9efe-075a34cbff11] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:45.207557 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-af8eff4b-e133-4d63-af5f-07172fa3b7c3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:45.212387 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e9b2059b-cab8-4cb9-8b07-6aaa21d527b2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:45.212860 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e9b2059b-cab8-4cb9-8b07-6aaa21d527b2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:45.213663 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e9b2059b-cab8-4cb9-8b07-6aaa21d527b2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:45.214208 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e9b2059b-cab8-4cb9-8b07-6aaa21d527b2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:45.223750 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-af8eff4b-e133-4d63-af5f-07172fa3b7c3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21" status: 200 len: 1311 microversion: 2.1 time: 0.342223 Jun 05 08:24:45.235950 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 252/526] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:44 2022] GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21 => generated 1311 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:45.250662 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e9b2059b-cab8-4cb9-8b07-6aaa21d527b2 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] 10.222.0.33 "GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.051864 Jun 05 08:24:45.254490 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 275/527] 10.222.0.33 () {58 vars in 1295 bytes} [Sun Jun 5 08:24:45 2022] GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11/os-instance-actions => generated 611 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:45.264805 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-88bc316e-4230-439b-8b73-f378cb912265 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:45.265886 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-88bc316e-4230-439b-8b73-f378cb912265 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] [instance: a51cf7cd-6764-454d-9efe-075a34cbff11] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:45.274203 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-88bc316e-4230-439b-8b73-f378cb912265 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:45.275039 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-88bc316e-4230-439b-8b73-f378cb912265 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:45.276269 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-88bc316e-4230-439b-8b73-f378cb912265 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:45.277073 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-88bc316e-4230-439b-8b73-f378cb912265 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:45.316689 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-88bc316e-4230-439b-8b73-f378cb912265 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] [instance: a51cf7cd-6764-454d-9efe-075a34cbff11] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:24:45.417271 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-88bc316e-4230-439b-8b73-f378cb912265 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11" status: 204 len: 0 microversion: 2.1 time: 0.156573 Jun 05 08:24:45.418505 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 253/528] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:24:45 2022] DELETE /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:24:45.427749 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-db732a44-22e6-40f5-8171-bec4e2690d5c tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:45.428788 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-db732a44-22e6-40f5-8171-bec4e2690d5c tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] [instance: a51cf7cd-6764-454d-9efe-075a34cbff11] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:45.435312 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-db732a44-22e6-40f5-8171-bec4e2690d5c tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:45.436593 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-db732a44-22e6-40f5-8171-bec4e2690d5c tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:45.437811 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-db732a44-22e6-40f5-8171-bec4e2690d5c tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:45.438439 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-db732a44-22e6-40f5-8171-bec4e2690d5c tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:45.463615 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b72197ee-ae91-4c05-add5-9a992185581c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:45.464173 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b72197ee-ae91-4c05-add5-9a992185581c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:45.472014 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b72197ee-ae91-4c05-add5-9a992185581c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:45.472839 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b72197ee-ae91-4c05-add5-9a992185581c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:45.474013 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b72197ee-ae91-4c05-add5-9a992185581c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:45.474827 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b72197ee-ae91-4c05-add5-9a992185581c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:45.510748 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b72197ee-ae91-4c05-add5-9a992185581c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:45.511203 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b72197ee-ae91-4c05-add5-9a992185581c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:45.511764 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-b72197ee-ae91-4c05-add5-9a992185581c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:45.566123 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b72197ee-ae91-4c05-add5-9a992185581c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:45.575119 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b72197ee-ae91-4c05-add5-9a992185581c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.119144 Jun 05 08:24:45.576669 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 254/529] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:45 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:45.607579 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-db732a44-22e6-40f5-8171-bec4e2690d5c tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ce8e767dfe4eb29c2c8402c79b01c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3801b3ebfcdd446c93e054b3f7baa53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:45.615533 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-db732a44-22e6-40f5-8171-bec4e2690d5c tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] 10.222.0.33 "GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11" status: 200 len: 1513 microversion: 2.1 time: 0.192248 Jun 05 08:24:45.616333 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 276/530] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:45 2022] GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11 => generated 1513 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:45.684557 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a001f598-7faf-407e-9bfa-1f3242a2309a tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:45.685254 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a001f598-7faf-407e-9bfa-1f3242a2309a tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 828624fb-b333-41c7-81a2-28d9bb4e1d88] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:45.697434 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a001f598-7faf-407e-9bfa-1f3242a2309a tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:45.697965 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a001f598-7faf-407e-9bfa-1f3242a2309a tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:45.699586 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a001f598-7faf-407e-9bfa-1f3242a2309a tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:45.700133 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a001f598-7faf-407e-9bfa-1f3242a2309a tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:45.743131 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-539663ee-d646-4d7d-a75b-e28d8851d1a1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:45.743856 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-539663ee-d646-4d7d-a75b-e28d8851d1a1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:45.752763 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-539663ee-d646-4d7d-a75b-e28d8851d1a1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:45.754184 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-539663ee-d646-4d7d-a75b-e28d8851d1a1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:45.755180 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-539663ee-d646-4d7d-a75b-e28d8851d1a1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:45.756013 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-539663ee-d646-4d7d-a75b-e28d8851d1a1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:45.968418 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a001f598-7faf-407e-9bfa-1f3242a2309a tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704cd9e8b0984139b58ec6abe3579576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8b37e66d354ce09c4bef01d28ef7a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:45.980987 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a001f598-7faf-407e-9bfa-1f3242a2309a tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "GET /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88" status: 200 len: 1322 microversion: 2.1 time: 0.306231 Jun 05 08:24:45.981796 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 255/531] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:45 2022] GET /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88 => generated 1322 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:45.987799 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-27c9d19f-2a3f-412f-8f8a-3f394b50dce6 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:45.988808 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-27c9d19f-2a3f-412f-8f8a-3f394b50dce6 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] [instance: 3f551f85-c8f2-45d5-b5ac-20949558181c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:45.996129 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-27c9d19f-2a3f-412f-8f8a-3f394b50dce6 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:45.996874 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-27c9d19f-2a3f-412f-8f8a-3f394b50dce6 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:45.998145 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-27c9d19f-2a3f-412f-8f8a-3f394b50dce6 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:45.998587 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-27c9d19f-2a3f-412f-8f8a-3f394b50dce6 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:46.000014 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-539663ee-d646-4d7d-a75b-e28d8851d1a1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:46.030494 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-539663ee-d646-4d7d-a75b-e28d8851d1a1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:46.039768 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-539663ee-d646-4d7d-a75b-e28d8851d1a1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:46.042700 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-539663ee-d646-4d7d-a75b-e28d8851d1a1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 1361 microversion: 2.25 time: 0.302323 Jun 05 08:24:46.054012 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 277/532] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:24:45 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 1361 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:24:46.075860 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-27c9d19f-2a3f-412f-8f8a-3f394b50dce6 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8a11ed3f5412d8ad6783cbcd324d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3c05bd3e84382aa808d1361072433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:46.083677 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-27c9d19f-2a3f-412f-8f8a-3f394b50dce6 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] 10.222.0.33 "GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c" status: 200 len: 1274 microversion: 2.1 time: 0.100617 Jun 05 08:24:46.084295 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 256/533] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:45 2022] GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c => generated 1274 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:46.242508 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0c6774dc-5cea-442b-9580-22d0c1ee2200 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:46.243216 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0c6774dc-5cea-442b-9580-22d0c1ee2200 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:46.249565 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0c6774dc-5cea-442b-9580-22d0c1ee2200 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:46.250082 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0c6774dc-5cea-442b-9580-22d0c1ee2200 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:46.250856 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0c6774dc-5cea-442b-9580-22d0c1ee2200 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:46.251319 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0c6774dc-5cea-442b-9580-22d0c1ee2200 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:46.394678 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0c6774dc-5cea-442b-9580-22d0c1ee2200 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:46.405510 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0c6774dc-5cea-442b-9580-22d0c1ee2200 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21" status: 200 len: 1311 microversion: 2.1 time: 0.167830 Jun 05 08:24:46.406591 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 278/534] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:46 2022] GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21 => generated 1311 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:24:46.593097 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8d061fc0-0c48-411b-9a52-a04b720a5604 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:46.593714 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8d061fc0-0c48-411b-9a52-a04b720a5604 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:46.598357 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:46.601201 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8d061fc0-0c48-411b-9a52-a04b720a5604 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:46.601653 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8d061fc0-0c48-411b-9a52-a04b720a5604 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:46.602423 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8d061fc0-0c48-411b-9a52-a04b720a5604 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:46.602857 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8d061fc0-0c48-411b-9a52-a04b720a5604 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:46.633246 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8421c060-eb96-4a52-b4d9-91acb7d64095 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:46.633460 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8421c060-eb96-4a52-b4d9-91acb7d64095 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] [instance: a51cf7cd-6764-454d-9efe-075a34cbff11] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:46.636740 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8d061fc0-0c48-411b-9a52-a04b720a5604 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:46.637266 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8d061fc0-0c48-411b-9a52-a04b720a5604 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:46.637791 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-8d061fc0-0c48-411b-9a52-a04b720a5604 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:46.640021 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8421c060-eb96-4a52-b4d9-91acb7d64095 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:46.640913 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8421c060-eb96-4a52-b4d9-91acb7d64095 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:46.641280 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8421c060-eb96-4a52-b4d9-91acb7d64095 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:46.641718 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8421c060-eb96-4a52-b4d9-91acb7d64095 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:46.692015 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8d061fc0-0c48-411b-9a52-a04b720a5604 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:46.708937 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8d061fc0-0c48-411b-9a52-a04b720a5604 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.119554 Jun 05 08:24:46.720239 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 257/535] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:46 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:46.811802 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8421c060-eb96-4a52-b4d9-91acb7d64095 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ce8e767dfe4eb29c2c8402c79b01c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3801b3ebfcdd446c93e054b3f7baa53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:46.821308 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8421c060-eb96-4a52-b4d9-91acb7d64095 tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] 10.222.0.33 "GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11" status: 200 len: 1513 microversion: 2.1 time: 0.192142 Jun 05 08:24:46.821809 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 279/536] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:46 2022] GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11 => generated 1513 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:24:46.839571 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-4f2a555b-2ac0-4dc1-8c5f-20a924ebf37a req-c66eb59d-755e-45d6-9aae-8ac7f4d2dcc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "828624fb-b333-41c7-81a2-28d9bb4e1d88", "tag": "df9bf56e-171a-4e64-a006-203773f700a6"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:46.848114 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-4f2a555b-2ac0-4dc1-8c5f-20a924ebf37a req-c66eb59d-755e-45d6-9aae-8ac7f4d2dcc7 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:46.849316 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-4f2a555b-2ac0-4dc1-8c5f-20a924ebf37a req-c66eb59d-755e-45d6-9aae-8ac7f4d2dcc7 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:46.859839 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-4f2a555b-2ac0-4dc1-8c5f-20a924ebf37a req-c66eb59d-755e-45d6-9aae-8ac7f4d2dcc7 service nova] Creating event network-changed:df9bf56e-171a-4e64-a006-203773f700a6 for instance 828624fb-b333-41c7-81a2-28d9bb4e1d88 on n-h1-844739-1 Jun 05 08:24:46.868029 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-4f2a555b-2ac0-4dc1-8c5f-20a924ebf37a req-c66eb59d-755e-45d6-9aae-8ac7f4d2dcc7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030220 Jun 05 08:24:46.868029 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 258/537] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:46.998811 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3c867b16-46ff-4671-8e2d-abcef796f115 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:46.999453 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3c867b16-46ff-4671-8e2d-abcef796f115 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 828624fb-b333-41c7-81a2-28d9bb4e1d88] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:47.005795 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3c867b16-46ff-4671-8e2d-abcef796f115 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:47.006257 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3c867b16-46ff-4671-8e2d-abcef796f115 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:47.007035 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3c867b16-46ff-4671-8e2d-abcef796f115 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:47.007491 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3c867b16-46ff-4671-8e2d-abcef796f115 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:47.063050 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-65f94169-0bc1-43a3-9155-0ebaa2af5c85 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:47.064180 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-65f94169-0bc1-43a3-9155-0ebaa2af5c85 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:47.071020 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-65f94169-0bc1-43a3-9155-0ebaa2af5c85 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:47.071871 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-65f94169-0bc1-43a3-9155-0ebaa2af5c85 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:47.073130 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-65f94169-0bc1-43a3-9155-0ebaa2af5c85 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:47.073789 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-65f94169-0bc1-43a3-9155-0ebaa2af5c85 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:47.655073 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3c867b16-46ff-4671-8e2d-abcef796f115 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704cd9e8b0984139b58ec6abe3579576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8b37e66d354ce09c4bef01d28ef7a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:47.658657 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=100 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:47.663388 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3c867b16-46ff-4671-8e2d-abcef796f115 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "GET /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88" status: 200 len: 1322 microversion: 2.1 time: 0.668545 Jun 05 08:24:47.664091 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 280/538] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:46 2022] GET /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88 => generated 1322 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:47.668502 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a4fdfe9c-eccd-4188-8b67-b95a2e9c7405 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:47.669194 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a4fdfe9c-eccd-4188-8b67-b95a2e9c7405 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] [instance: 3f551f85-c8f2-45d5-b5ac-20949558181c] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:47.675766 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a4fdfe9c-eccd-4188-8b67-b95a2e9c7405 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:47.677092 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a4fdfe9c-eccd-4188-8b67-b95a2e9c7405 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:47.678173 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a4fdfe9c-eccd-4188-8b67-b95a2e9c7405 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:47.678810 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a4fdfe9c-eccd-4188-8b67-b95a2e9c7405 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:47.722565 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-65f94169-0bc1-43a3-9155-0ebaa2af5c85 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:47.730853 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-65f94169-0bc1-43a3-9155-0ebaa2af5c85 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:47.732489 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-65f94169-0bc1-43a3-9155-0ebaa2af5c85 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:47.733695 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-65f94169-0bc1-43a3-9155-0ebaa2af5c85 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 1361 microversion: 2.25 time: 0.675928 Jun 05 08:24:47.734337 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 259/539] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:24:47 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 1361 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:24:47.788180 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a4fdfe9c-eccd-4188-8b67-b95a2e9c7405 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8a11ed3f5412d8ad6783cbcd324d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3c05bd3e84382aa808d1361072433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:47.796189 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a4fdfe9c-eccd-4188-8b67-b95a2e9c7405 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] 10.222.0.33 "GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c" status: 200 len: 1280 microversion: 2.1 time: 0.131153 Jun 05 08:24:47.796769 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 281/540] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:47 2022] GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c => generated 1280 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:47.801716 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-daa57ac3-74d1-4934-adaf-bc1081b71474 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:47.802332 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-daa57ac3-74d1-4934-adaf-bc1081b71474 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:47.808775 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-daa57ac3-74d1-4934-adaf-bc1081b71474 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:47.808883 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-daa57ac3-74d1-4934-adaf-bc1081b71474 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:47.809647 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-daa57ac3-74d1-4934-adaf-bc1081b71474 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:47.810081 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-daa57ac3-74d1-4934-adaf-bc1081b71474 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:47.871316 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b40e23c0-ea6a-44eb-9bf5-2fdaa40bd0af tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] Action: 'create', calling method: .version_select at 0x7f2433c249d0>, body: {"keypair": {"name": "tempest-keypair-1567358104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCboQxrpwH1q7qgqQ0ATOrW+d0Jgiv6plN/SfwzVH5F2Q+miqywgAqwXEIBVI4NFNLsbWwE+Cm0GTMmOk/P/pFhlC01etenEptqwa4DJvXqzefxLfB3M42LQcNCXSyINw=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:47.890249 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-b40e23c0-ea6a-44eb-9bf5-2fdaa40bd0af tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] Getting quotas for project ebcab48404db41dfa7e9b596d0982d8d. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:24:47.895640 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-b40e23c0-ea6a-44eb-9bf5-2fdaa40bd0af tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] Getting quotas for user 1ffdce9dda0a4801876bf5d3b1c5017c and project ebcab48404db41dfa7e9b596d0982d8d. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:24:47.921612 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b40e23c0-ea6a-44eb-9bf5-2fdaa40bd0af tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.185953 Jun 05 08:24:47.922139 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 260/541] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:24:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:47.928055 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9d0a62bd-dc0a-48d3-b0d4-091a13347250 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:47.928752 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9d0a62bd-dc0a-48d3-b0d4-091a13347250 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:47.934763 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9d0a62bd-dc0a-48d3-b0d4-091a13347250 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:47.935209 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9d0a62bd-dc0a-48d3-b0d4-091a13347250 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:47.935964 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9d0a62bd-dc0a-48d3-b0d4-091a13347250 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:47.936470 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9d0a62bd-dc0a-48d3-b0d4-091a13347250 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:47.970475 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9d0a62bd-dc0a-48d3-b0d4-091a13347250 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:47.970926 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9d0a62bd-dc0a-48d3-b0d4-091a13347250 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:47.971433 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-9d0a62bd-dc0a-48d3-b0d4-091a13347250 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:48.051023 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9d0a62bd-dc0a-48d3-b0d4-091a13347250 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:48.058486 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9d0a62bd-dc0a-48d3-b0d4-091a13347250 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.135337 Jun 05 08:24:48.059065 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 261/542] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:47 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:48.063475 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b99db393-13cd-425c-83e7-d68825320e6d tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:48.064277 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b99db393-13cd-425c-83e7-d68825320e6d tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] [instance: a51cf7cd-6764-454d-9efe-075a34cbff11] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:48.071103 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b99db393-13cd-425c-83e7-d68825320e6d tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:48.071563 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b99db393-13cd-425c-83e7-d68825320e6d tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:48.072364 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b99db393-13cd-425c-83e7-d68825320e6d tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:48.072879 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b99db393-13cd-425c-83e7-d68825320e6d tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:48.076958 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:48.094086 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-daa57ac3-74d1-4934-adaf-bc1081b71474 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:48.102719 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-daa57ac3-74d1-4934-adaf-bc1081b71474 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21" status: 200 len: 1311 microversion: 2.1 time: 0.304689 Jun 05 08:24:48.103627 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 282/543] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:47 2022] GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21 => generated 1311 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:48.108786 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fffc0c47-08a6-47ab-be86-c8d2207e39e5 tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] Calling method '.version_select at 0x7f2433c68670>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:48.117093 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fffc0c47-08a6-47ab-be86-c8d2207e39e5 tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-1567358104" status: 200 len: 497 microversion: 2.1 time: 0.012130 Jun 05 08:24:48.117876 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 283/544] 10.222.0.33 () {58 vars in 1217 bytes} [Sun Jun 5 08:24:48 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1567358104 => generated 497 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:48.128751 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b38ccda0-b103-4e87-976a-68fbface2f95 tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] Calling method '.version_select at 0x7f2433b95310>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:48.148645 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b38ccda0-b103-4e87-976a-68fbface2f95 tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1567358104" status: 202 len: 0 microversion: 2.1 time: 0.024611 Jun 05 08:24:48.149232 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 284/545] 10.222.0.33 () {58 vars in 1220 bytes} [Sun Jun 5 08:24:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1567358104 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:24:48.161438 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4c4189d7-7585-42b2-bc4a-ac00d1187f68 tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] Action: 'create', calling method: .version_select at 0x7f2433ae6160>, body: {"keypair": {"name": "tempest-keypair-967981858", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAy0lbYbR2Mj2UOzNZ6ZF7DjDLUssdK9JmN9wcQE9CEiJcctLKP/RXDuwTOk5SDBxZZvCdXosqUGGxI0v+jO7qdPLKFU/OR/F0UCNsJfLI6gWUi9nlt+wW2v+gGJeUNuVQ=="}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:48.169966 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:48.175893 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=53 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:48.178762 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-4c4189d7-7585-42b2-bc4a-ac00d1187f68 tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] Getting quotas for project ebcab48404db41dfa7e9b596d0982d8d. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:24:48.184793 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-4c4189d7-7585-42b2-bc4a-ac00d1187f68 tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] Getting quotas for user 1ffdce9dda0a4801876bf5d3b1c5017c and project ebcab48404db41dfa7e9b596d0982d8d. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:24:48.210053 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4c4189d7-7585-42b2-bc4a-ac00d1187f68 tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052484 Jun 05 08:24:48.210768 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 285/546] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:24:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:24:48.220321 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-439ace7a-8996-401a-a68e-205043340f60 tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] Calling method '.version_select at 0x7f2433ae69d0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:48.241172 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-439ace7a-8996-401a-a68e-205043340f60 tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-967981858" status: 202 len: 0 microversion: 2.1 time: 0.024651 Jun 05 08:24:48.241978 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 286/547] 10.222.0.33 () {58 vars in 1217 bytes} [Sun Jun 5 08:24:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-967981858 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 05 08:24:48.250565 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d470719d-d457-4a16-adb6-0472dfd57465 tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] Action: 'create', calling method: .version_select at 0x7f2433b31790>, body: {"keypair": {"name": "tempest-keypair-52383736", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:48.265453 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-d470719d-d457-4a16-adb6-0472dfd57465 tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] Getting quotas for project ebcab48404db41dfa7e9b596d0982d8d. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:24:48.270145 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-d470719d-d457-4a16-adb6-0472dfd57465 tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] Getting quotas for user 1ffdce9dda0a4801876bf5d3b1c5017c and project ebcab48404db41dfa7e9b596d0982d8d. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:24:48.295388 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d470719d-d457-4a16-adb6-0472dfd57465 tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 572 microversion: 2.1 time: 0.048551 Jun 05 08:24:48.296424 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 287/548] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:24:48 2022] POST /compute/v2.1/os-keypairs => generated 572 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:24:48.306192 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d6c69c61-7f43-4c06-982e-061a2fab440d tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] Calling method '.version_select at 0x7f2433b95040>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:48.323667 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d6c69c61-7f43-4c06-982e-061a2fab440d tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-52383736" status: 202 len: 0 microversion: 2.1 time: 0.021241 Jun 05 08:24:48.324416 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 288/549] 10.222.0.33 () {58 vars in 1214 bytes} [Sun Jun 5 08:24:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-52383736 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:24:48.335641 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-364a052c-c068-49c9-9b0f-c0a7f3e753f3 tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] Action: 'create', calling method: .version_select at 0x7f2433b95f70>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-31558439", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPP5bRTTndflx8GSEN0o3DfIFCH9ea+Sajf/ytfj1L0m5sAs7BDX/rrMZK5jlP2LAuZxkW3nekAA9N56pGjchw1SIZNs0IxNIIqiM0W/J7ssvncnNlZywoTRgVuUmtvIg=="}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:48.350114 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-364a052c-c068-49c9-9b0f-c0a7f3e753f3 tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] Getting quotas for project ebcab48404db41dfa7e9b596d0982d8d. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:24:48.354637 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-364a052c-c068-49c9-9b0f-c0a7f3e753f3 tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] Getting quotas for user 1ffdce9dda0a4801876bf5d3b1c5017c and project ebcab48404db41dfa7e9b596d0982d8d. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:24:48.381370 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-364a052c-c068-49c9-9b0f-c0a7f3e753f3 tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.049467 Jun 05 08:24:48.381974 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 289/550] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:24:48 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:24:48.394826 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-35d9cce0-8e7d-40ae-9d87-f48bc0d26118 tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] Action: 'create', calling method: .version_select at 0x7f2433c68790>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1892593665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4VXiL3Vn37YtNiti7vpO3DkU+pXjX7Bv/OuUkizZjQXpO1gIH4wc+MdgYRUNk4JT7Vl4VO/RZCJ+1X56Ys1V3/9Z3fvOc9Yw1UzNEQrP03bQUNZCFOhZQt73atB+miAQ=="}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:48.417169 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-35d9cce0-8e7d-40ae-9d87-f48bc0d26118 tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] Getting quotas for project ebcab48404db41dfa7e9b596d0982d8d. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:24:48.422384 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-35d9cce0-8e7d-40ae-9d87-f48bc0d26118 tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] Getting quotas for user 1ffdce9dda0a4801876bf5d3b1c5017c and project ebcab48404db41dfa7e9b596d0982d8d. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:24:48.454049 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-35d9cce0-8e7d-40ae-9d87-f48bc0d26118 tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.063244 Jun 05 08:24:48.454979 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 290/551] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:24:48 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:48.464817 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b99db393-13cd-425c-83e7-d68825320e6d tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ce8e767dfe4eb29c2c8402c79b01c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3801b3ebfcdd446c93e054b3f7baa53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:48.467436 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-251fcf1c-fcaf-4888-b753-db22c5bfa5d7 req-f30ee93c-24c7-40d7-8af6-167f01479084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a51cf7cd-6764-454d-9efe-075a34cbff11", "name": "network-vif-deleted", "tag": "b0edc0b9-9da5-4076-a71a-441b8059a064"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:48.476543 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b99db393-13cd-425c-83e7-d68825320e6d tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] 10.222.0.33 "GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11" status: 200 len: 1513 microversion: 2.1 time: 0.415275 Jun 05 08:24:48.476872 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-251fcf1c-fcaf-4888-b753-db22c5bfa5d7 req-f30ee93c-24c7-40d7-8af6-167f01479084 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:48.477321 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-251fcf1c-fcaf-4888-b753-db22c5bfa5d7 req-f30ee93c-24c7-40d7-8af6-167f01479084 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:48.478374 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 262/552] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:48 2022] GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11 => generated 1513 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:48.489669 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-251fcf1c-fcaf-4888-b753-db22c5bfa5d7 req-f30ee93c-24c7-40d7-8af6-167f01479084 service nova] Creating event network-vif-deleted:b0edc0b9-9da5-4076-a71a-441b8059a064 for instance a51cf7cd-6764-454d-9efe-075a34cbff11 on n-h2-844739-1 Jun 05 08:24:48.493715 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c96b5e7a-ba74-46af-94cb-6890a9ca804f tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] Action: 'create', calling method: .version_select at 0x7f2433d6dee0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1069815050", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXWDMWlLpqSnXGRRlva8L8xHZkaryMGzD1aVgwQbaRxvsfUu0p0RwRTEXeWHpUJExJMACf6cC8cGpqjkNMg2gcr5L0gv7aF1EcaHMxnC9X+Kl9A6nwRF8EuX38mNVM1Iw=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:48.494545 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-251fcf1c-fcaf-4888-b753-db22c5bfa5d7 req-f30ee93c-24c7-40d7-8af6-167f01479084 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030976 Jun 05 08:24:48.495711 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 291/553] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:48.522391 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=58,nova_cell0:UPDATE=7 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:48.535519 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-c96b5e7a-ba74-46af-94cb-6890a9ca804f tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] Getting quotas for project ebcab48404db41dfa7e9b596d0982d8d. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:24:48.544164 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-c96b5e7a-ba74-46af-94cb-6890a9ca804f tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] Getting quotas for user 1ffdce9dda0a4801876bf5d3b1c5017c and project ebcab48404db41dfa7e9b596d0982d8d. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:24:48.568719 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c96b5e7a-ba74-46af-94cb-6890a9ca804f tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.087179 Jun 05 08:24:48.569665 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 263/554] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:24:48 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:48.583159 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8fe7fdad-c486-4ae3-85ae-b59304f54e32 tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] Calling method '.version_select at 0x7f2433ae6790>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:48.585816 n-d-844739-1 devstack@n-api.service[119050]: WARNING oslo_db.sqlalchemy.utils [None req-8fe7fdad-c486-4ae3-85ae-b59304f54e32 tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 05 08:24:48.593348 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8fe7fdad-c486-4ae3-85ae-b59304f54e32 tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.015929 Jun 05 08:24:48.611764 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-26eabb6a-a7f2-436e-9db4-282bda9eff9b tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] Calling method '.version_select at 0x7f2433c24040>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:48.613073 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 292/555] 10.222.0.33 () {58 vars in 1136 bytes} [Sun Jun 5 08:24:48 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:48.642658 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-26eabb6a-a7f2-436e-9db4-282bda9eff9b tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1069815050" status: 202 len: 0 microversion: 2.1 time: 0.039977 Jun 05 08:24:48.644348 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 264/556] 10.222.0.33 () {58 vars in 1277 bytes} [Sun Jun 5 08:24:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1069815050 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:24:48.652769 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4f5f2329-33e5-4a88-afb6-39a211e063f6 tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] Calling method '.version_select at 0x7f2433b31040>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:48.684921 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4f5f2329-33e5-4a88-afb6-39a211e063f6 tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1892593665" status: 202 len: 0 microversion: 2.1 time: 0.035799 Jun 05 08:24:48.687262 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 293/557] 10.222.0.33 () {58 vars in 1277 bytes} [Sun Jun 5 08:24:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1892593665 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:24:48.690280 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-763585ff-78c0-4a47-a92e-d53f123c9cba tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:48.691001 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-763585ff-78c0-4a47-a92e-d53f123c9cba tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 828624fb-b333-41c7-81a2-28d9bb4e1d88] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:48.696931 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-218bd630-d6bc-4984-8ff8-bc4b6c38fa6a tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] Calling method '.version_select at 0x7f2433b1ef70>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:48.725918 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-763585ff-78c0-4a47-a92e-d53f123c9cba tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:48.726513 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-763585ff-78c0-4a47-a92e-d53f123c9cba tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:48.727303 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-763585ff-78c0-4a47-a92e-d53f123c9cba tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:48.727915 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-763585ff-78c0-4a47-a92e-d53f123c9cba tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:48.734617 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-218bd630-d6bc-4984-8ff8-bc4b6c38fa6a tempest-KeyPairsV2TestJSON-1065983589 tempest-KeyPairsV2TestJSON-1065983589-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-31558439" status: 202 len: 0 microversion: 2.1 time: 0.040596 Jun 05 08:24:48.736077 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 294/558] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:24:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-31558439 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:24:48.753382 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-97b998f4-3cea-4fb1-8b39-23ebe07edd5a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:48.755003 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-97b998f4-3cea-4fb1-8b39-23ebe07edd5a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:48.765770 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-97b998f4-3cea-4fb1-8b39-23ebe07edd5a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:48.769274 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-97b998f4-3cea-4fb1-8b39-23ebe07edd5a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:48.770420 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-97b998f4-3cea-4fb1-8b39-23ebe07edd5a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:48.771058 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-97b998f4-3cea-4fb1-8b39-23ebe07edd5a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:49.031474 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-763585ff-78c0-4a47-a92e-d53f123c9cba tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704cd9e8b0984139b58ec6abe3579576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8b37e66d354ce09c4bef01d28ef7a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:49.045023 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-763585ff-78c0-4a47-a92e-d53f123c9cba tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "GET /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88" status: 200 len: 1322 microversion: 2.1 time: 0.367816 Jun 05 08:24:49.054863 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 265/559] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:48 2022] GET /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88 => generated 1322 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:49.060189 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-af882e8c-9f63-452c-80ab-032deb3404a7 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:49.061114 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-af882e8c-9f63-452c-80ab-032deb3404a7 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] [instance: 3f551f85-c8f2-45d5-b5ac-20949558181c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:49.069018 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-af882e8c-9f63-452c-80ab-032deb3404a7 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:49.071561 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-af882e8c-9f63-452c-80ab-032deb3404a7 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:49.072653 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-af882e8c-9f63-452c-80ab-032deb3404a7 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:49.073326 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-af882e8c-9f63-452c-80ab-032deb3404a7 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:49.101331 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-97b998f4-3cea-4fb1-8b39-23ebe07edd5a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:49.115017 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-97b998f4-3cea-4fb1-8b39-23ebe07edd5a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:49.117950 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-97b998f4-3cea-4fb1-8b39-23ebe07edd5a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:49.119777 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-97b998f4-3cea-4fb1-8b39-23ebe07edd5a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 1361 microversion: 2.25 time: 0.372950 Jun 05 08:24:49.120592 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 295/560] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:24:48 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 1361 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:24:49.140825 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6e2cbc31-a3ec-4fe3-9275-3f4c211346e0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:49.141693 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6e2cbc31-a3ec-4fe3-9275-3f4c211346e0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:49.149538 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6e2cbc31-a3ec-4fe3-9275-3f4c211346e0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:49.150263 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6e2cbc31-a3ec-4fe3-9275-3f4c211346e0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:49.151474 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6e2cbc31-a3ec-4fe3-9275-3f4c211346e0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:49.152147 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6e2cbc31-a3ec-4fe3-9275-3f4c211346e0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:49.215713 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6e2cbc31-a3ec-4fe3-9275-3f4c211346e0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:49.216474 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6e2cbc31-a3ec-4fe3-9275-3f4c211346e0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:49.217487 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-6e2cbc31-a3ec-4fe3-9275-3f4c211346e0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:49.322024 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6e2cbc31-a3ec-4fe3-9275-3f4c211346e0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:49.334597 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6e2cbc31-a3ec-4fe3-9275-3f4c211346e0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.212932 Jun 05 08:24:49.335883 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 296/561] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:49 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:49.341936 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-54f7fd17-bbb1-44f2-bf9e-2449c32b1794 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:49.342730 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-54f7fd17-bbb1-44f2-bf9e-2449c32b1794 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:49.351109 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-54f7fd17-bbb1-44f2-bf9e-2449c32b1794 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:49.351800 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-54f7fd17-bbb1-44f2-bf9e-2449c32b1794 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:49.352918 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-54f7fd17-bbb1-44f2-bf9e-2449c32b1794 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:49.353513 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-54f7fd17-bbb1-44f2-bf9e-2449c32b1794 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:49.433533 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-af882e8c-9f63-452c-80ab-032deb3404a7 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8a11ed3f5412d8ad6783cbcd324d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3c05bd3e84382aa808d1361072433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:49.445646 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-af882e8c-9f63-452c-80ab-032deb3404a7 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] 10.222.0.33 "GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c" status: 200 len: 1322 microversion: 2.1 time: 0.389211 Jun 05 08:24:49.457593 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 266/562] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:49 2022] GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c => generated 1322 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:49.500379 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e7c72987-2afb-42dc-834d-2e610bac56fd tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:49.501098 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e7c72987-2afb-42dc-834d-2e610bac56fd tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] [instance: a51cf7cd-6764-454d-9efe-075a34cbff11] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:49.507757 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e7c72987-2afb-42dc-834d-2e610bac56fd tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:49.508797 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e7c72987-2afb-42dc-834d-2e610bac56fd tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:49.509277 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e7c72987-2afb-42dc-834d-2e610bac56fd tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:49.510353 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e7c72987-2afb-42dc-834d-2e610bac56fd tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:49.562120 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e7c72987-2afb-42dc-834d-2e610bac56fd tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:49.563439 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e7c72987-2afb-42dc-834d-2e610bac56fd tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:49.564109 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-e7c72987-2afb-42dc-834d-2e610bac56fd tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Lazy-loading 'fault' on Instance uuid a51cf7cd-6764-454d-9efe-075a34cbff11 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:49.667193 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e7c72987-2afb-42dc-834d-2e610bac56fd tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ce8e767dfe4eb29c2c8402c79b01c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3801b3ebfcdd446c93e054b3f7baa53f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:49.676157 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e7c72987-2afb-42dc-834d-2e610bac56fd tempest-InstanceActionsTestJSON-494066916 tempest-InstanceActionsTestJSON-494066916-project] 10.222.0.33 "GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11" status: 200 len: 1362 microversion: 2.1 time: 0.182561 Jun 05 08:24:49.676677 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 267/563] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:49 2022] GET /compute/v2.1/servers/a51cf7cd-6764-454d-9efe-075a34cbff11 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:24:49.693582 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-54f7fd17-bbb1-44f2-bf9e-2449c32b1794 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:49.707838 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-54f7fd17-bbb1-44f2-bf9e-2449c32b1794 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21" status: 200 len: 1494 microversion: 2.1 time: 0.370304 Jun 05 08:24:49.716070 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 297/564] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:49 2022] GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21 => generated 1494 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:49.724815 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9939172c-fdfd-4ba4-9a78-89abfbe33557 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:49.725451 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9939172c-fdfd-4ba4-9a78-89abfbe33557 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:49.731682 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9939172c-fdfd-4ba4-9a78-89abfbe33557 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:49.732427 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9939172c-fdfd-4ba4-9a78-89abfbe33557 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:49.732998 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9939172c-fdfd-4ba4-9a78-89abfbe33557 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:49.733358 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9939172c-fdfd-4ba4-9a78-89abfbe33557 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:49.978691 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9939172c-fdfd-4ba4-9a78-89abfbe33557 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21" status: 200 len: 1645 microversion: 2.1 time: 0.258250 Jun 05 08:24:49.979271 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 268/565] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:49 2022] GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21 => generated 1645 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:49.998296 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a8ddcbc3-82ff-44bd-b04d-37dbeb1cd1c1 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:49.999515 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a8ddcbc3-82ff-44bd-b04d-37dbeb1cd1c1 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:50.008980 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a8ddcbc3-82ff-44bd-b04d-37dbeb1cd1c1 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:50.009803 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a8ddcbc3-82ff-44bd-b04d-37dbeb1cd1c1 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:50.011067 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a8ddcbc3-82ff-44bd-b04d-37dbeb1cd1c1 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:50.011716 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a8ddcbc3-82ff-44bd-b04d-37dbeb1cd1c1 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:50.061655 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4627db71-9385-4aa8-b171-b7057656fbde tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:50.062280 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4627db71-9385-4aa8-b171-b7057656fbde tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 828624fb-b333-41c7-81a2-28d9bb4e1d88] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:50.070106 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4627db71-9385-4aa8-b171-b7057656fbde tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:50.070565 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4627db71-9385-4aa8-b171-b7057656fbde tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:50.071350 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4627db71-9385-4aa8-b171-b7057656fbde tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:50.071857 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4627db71-9385-4aa8-b171-b7057656fbde tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:50.360989 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=11 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:50.451421 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a8ddcbc3-82ff-44bd-b04d-37dbeb1cd1c1 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21" status: 200 len: 1645 microversion: 2.1 time: 0.460082 Jun 05 08:24:50.452340 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 298/566] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:49 2022] GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21 => generated 1645 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:50.457342 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c9194f0b-fe52-4316-9714-64b8d18398a7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:50.458381 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c9194f0b-fe52-4316-9714-64b8d18398a7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:50.462635 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4627db71-9385-4aa8-b171-b7057656fbde tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704cd9e8b0984139b58ec6abe3579576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8b37e66d354ce09c4bef01d28ef7a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:50.467688 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c9194f0b-fe52-4316-9714-64b8d18398a7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:50.468686 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c9194f0b-fe52-4316-9714-64b8d18398a7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:50.469681 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c9194f0b-fe52-4316-9714-64b8d18398a7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:50.469919 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4627db71-9385-4aa8-b171-b7057656fbde tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "GET /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88" status: 200 len: 1322 microversion: 2.1 time: 0.412020 Jun 05 08:24:50.470320 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c9194f0b-fe52-4316-9714-64b8d18398a7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:50.479998 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 269/567] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:50 2022] GET /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88 => generated 1322 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:50.485304 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e8606ab3-2173-40c6-9894-72ebaa1d7348 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:50.486157 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e8606ab3-2173-40c6-9894-72ebaa1d7348 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:50.495699 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e8606ab3-2173-40c6-9894-72ebaa1d7348 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:50.496449 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e8606ab3-2173-40c6-9894-72ebaa1d7348 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:50.497562 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e8606ab3-2173-40c6-9894-72ebaa1d7348 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:50.498152 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e8606ab3-2173-40c6-9894-72ebaa1d7348 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:50.536175 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e8606ab3-2173-40c6-9894-72ebaa1d7348 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:50.536631 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e8606ab3-2173-40c6-9894-72ebaa1d7348 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:50.537084 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-e8606ab3-2173-40c6-9894-72ebaa1d7348 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:50.667424 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e8606ab3-2173-40c6-9894-72ebaa1d7348 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:50.675530 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e8606ab3-2173-40c6-9894-72ebaa1d7348 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.193510 Jun 05 08:24:50.676815 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 270/568] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:50 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:50.687738 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b71a0f62-7bd2-4bb6-befd-c8aa9c577265 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:50.689584 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b71a0f62-7bd2-4bb6-befd-c8aa9c577265 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] [instance: 3f551f85-c8f2-45d5-b5ac-20949558181c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:50.706478 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b71a0f62-7bd2-4bb6-befd-c8aa9c577265 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:50.709215 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b71a0f62-7bd2-4bb6-befd-c8aa9c577265 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:50.711721 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b71a0f62-7bd2-4bb6-befd-c8aa9c577265 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:50.712346 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b71a0f62-7bd2-4bb6-befd-c8aa9c577265 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:51.214806 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c9194f0b-fe52-4316-9714-64b8d18398a7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:51.225680 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c9194f0b-fe52-4316-9714-64b8d18398a7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:51.227637 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c9194f0b-fe52-4316-9714-64b8d18398a7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:51.229476 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c9194f0b-fe52-4316-9714-64b8d18398a7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 1361 microversion: 2.25 time: 0.775891 Jun 05 08:24:51.232060 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 299/569] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:24:50 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 1361 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:24:51.257095 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1cba0e3e-e7dd-4dbb-990a-121604d41029 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:51.263441 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:51.263441 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:24:51.269661 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1cba0e3e-e7dd-4dbb-990a-121604d41029 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:51.270971 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1cba0e3e-e7dd-4dbb-990a-121604d41029 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:51.272274 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1cba0e3e-e7dd-4dbb-990a-121604d41029 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:51.274071 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1cba0e3e-e7dd-4dbb-990a-121604d41029 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:51.315736 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1cba0e3e-e7dd-4dbb-990a-121604d41029 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.080569 Jun 05 08:24:51.316613 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 300/570] 10.222.0.33 () {58 vars in 1175 bytes} [Sun Jun 5 08:24:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:51.329077 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-37f8329a-c5ce-4d32-bbdf-24e58e337e1f tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:51.329844 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-37f8329a-c5ce-4d32-bbdf-24e58e337e1f tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:51.338388 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-37f8329a-c5ce-4d32-bbdf-24e58e337e1f tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:51.338876 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-37f8329a-c5ce-4d32-bbdf-24e58e337e1f tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:51.341118 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-37f8329a-c5ce-4d32-bbdf-24e58e337e1f tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:51.341344 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-37f8329a-c5ce-4d32-bbdf-24e58e337e1f tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:51.505466 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b71a0f62-7bd2-4bb6-befd-c8aa9c577265 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8a11ed3f5412d8ad6783cbcd324d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3c05bd3e84382aa808d1361072433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:51.515795 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-37f8329a-c5ce-4d32-bbdf-24e58e337e1f tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21/action" status: 202 len: 0 microversion: 2.1 time: 0.189980 Jun 05 08:24:51.521214 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 301/571] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Jun 5 08:24:51 2022] POST /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:24:51.524329 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b71a0f62-7bd2-4bb6-befd-c8aa9c577265 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] 10.222.0.33 "GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c" status: 200 len: 1322 microversion: 2.1 time: 0.842724 Jun 05 08:24:51.526872 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 271/572] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:50 2022] GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c => generated 1322 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:51.543875 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-84d592a1-bf87-40d8-8005-b619763843a0 req-edb539a8-ef82-492d-a6ff-1182e4fb26b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f551f85-c8f2-45d5-b5ac-20949558181c", "tag": "e2e5f4e6-8cf4-44b8-bb31-5fc701aaca63"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:51.544684 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3ee90ab5-b8e5-4a8b-8072-5451b3f2c286 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:51.546705 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3ee90ab5-b8e5-4a8b-8072-5451b3f2c286 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 828624fb-b333-41c7-81a2-28d9bb4e1d88] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:51.566761 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3ee90ab5-b8e5-4a8b-8072-5451b3f2c286 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:51.570617 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3ee90ab5-b8e5-4a8b-8072-5451b3f2c286 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:51.582449 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-84d592a1-bf87-40d8-8005-b619763843a0 req-edb539a8-ef82-492d-a6ff-1182e4fb26b3 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:51.582832 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3ee90ab5-b8e5-4a8b-8072-5451b3f2c286 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:51.582952 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-84d592a1-bf87-40d8-8005-b619763843a0 req-edb539a8-ef82-492d-a6ff-1182e4fb26b3 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:51.583603 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3ee90ab5-b8e5-4a8b-8072-5451b3f2c286 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:51.597020 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-84d592a1-bf87-40d8-8005-b619763843a0 req-edb539a8-ef82-492d-a6ff-1182e4fb26b3 service nova] Creating event network-changed:e2e5f4e6-8cf4-44b8-bb31-5fc701aaca63 for instance 3f551f85-c8f2-45d5-b5ac-20949558181c on n-h2-844739-1 Jun 05 08:24:51.604509 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-84d592a1-bf87-40d8-8005-b619763843a0 req-edb539a8-ef82-492d-a6ff-1182e4fb26b3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080510 Jun 05 08:24:51.605830 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 302/573] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:51.612643 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4cd38230-92ca-418b-932f-7aaca4883afe tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:51.613886 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4cd38230-92ca-418b-932f-7aaca4883afe tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:51.621840 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4cd38230-92ca-418b-932f-7aaca4883afe tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:51.622298 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4cd38230-92ca-418b-932f-7aaca4883afe tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:51.623169 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4cd38230-92ca-418b-932f-7aaca4883afe tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:51.623618 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4cd38230-92ca-418b-932f-7aaca4883afe tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:51.912250 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3ee90ab5-b8e5-4a8b-8072-5451b3f2c286 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704cd9e8b0984139b58ec6abe3579576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8b37e66d354ce09c4bef01d28ef7a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:51.929144 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3ee90ab5-b8e5-4a8b-8072-5451b3f2c286 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "GET /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88" status: 200 len: 1322 microversion: 2.1 time: 0.395573 Jun 05 08:24:51.929836 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 272/574] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:51 2022] GET /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88 => generated 1322 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:51.934767 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6b2c9b7d-fe91-45de-960f-ea3330ee5160 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:51.935379 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6b2c9b7d-fe91-45de-960f-ea3330ee5160 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:51.943534 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6b2c9b7d-fe91-45de-960f-ea3330ee5160 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:51.946090 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6b2c9b7d-fe91-45de-960f-ea3330ee5160 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:51.946887 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6b2c9b7d-fe91-45de-960f-ea3330ee5160 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:51.947332 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6b2c9b7d-fe91-45de-960f-ea3330ee5160 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:51.979896 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4cd38230-92ca-418b-932f-7aaca4883afe tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21" status: 200 len: 1650 microversion: 2.1 time: 0.372390 Jun 05 08:24:51.980865 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 303/575] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:51 2022] GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21 => generated 1650 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:52.010652 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6b2c9b7d-fe91-45de-960f-ea3330ee5160 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:52.011314 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6b2c9b7d-fe91-45de-960f-ea3330ee5160 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:52.011935 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-6b2c9b7d-fe91-45de-960f-ea3330ee5160 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:52.146326 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6b2c9b7d-fe91-45de-960f-ea3330ee5160 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:52.162423 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6b2c9b7d-fe91-45de-960f-ea3330ee5160 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.231009 Jun 05 08:24:52.163048 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 273/576] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:51 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:52.260912 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7ffb840d-ff43-4d0a-8d81-830b0d131a58 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:52.263149 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7ffb840d-ff43-4d0a-8d81-830b0d131a58 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:52.277412 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7ffb840d-ff43-4d0a-8d81-830b0d131a58 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:52.279224 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7ffb840d-ff43-4d0a-8d81-830b0d131a58 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:52.280616 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7ffb840d-ff43-4d0a-8d81-830b0d131a58 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:52.282225 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7ffb840d-ff43-4d0a-8d81-830b0d131a58 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:52.470280 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7ffb840d-ff43-4d0a-8d81-830b0d131a58 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:52.480114 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7ffb840d-ff43-4d0a-8d81-830b0d131a58 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:52.481695 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7ffb840d-ff43-4d0a-8d81-830b0d131a58 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:52.482805 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7ffb840d-ff43-4d0a-8d81-830b0d131a58 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 1361 microversion: 2.25 time: 0.235225 Jun 05 08:24:52.487609 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 304/577] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:24:52 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 1361 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:24:52.537028 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6d9ac05a-794a-4418-8f81-df364541a269 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-835699022", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "84ea03f8-de6d-4d69-98f7-fab996eece83"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:52.547222 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-da60a0b3-5a13-418d-b2d0-6a9b18621901 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:52.547868 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-da60a0b3-5a13-418d-b2d0-6a9b18621901 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] [instance: 3f551f85-c8f2-45d5-b5ac-20949558181c] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:52.554020 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-da60a0b3-5a13-418d-b2d0-6a9b18621901 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:52.554474 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-da60a0b3-5a13-418d-b2d0-6a9b18621901 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:52.555280 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-da60a0b3-5a13-418d-b2d0-6a9b18621901 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:52.555940 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-da60a0b3-5a13-418d-b2d0-6a9b18621901 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:52.598452 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-6d9ac05a-794a-4418-8f81-df364541a269 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] validate_networks() for [('84ea03f8-de6d-4d69-98f7-fab996eece83', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:24:52.834155 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-da60a0b3-5a13-418d-b2d0-6a9b18621901 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8a11ed3f5412d8ad6783cbcd324d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3c05bd3e84382aa808d1361072433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:52.843107 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-da60a0b3-5a13-418d-b2d0-6a9b18621901 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] 10.222.0.33 "GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c" status: 200 len: 1322 microversion: 2.1 time: 0.300988 Jun 05 08:24:52.854506 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 305/578] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:52 2022] GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:52.946536 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ff2ace95-75aa-403a-b82a-092ec975122b tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:52.947171 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ff2ace95-75aa-403a-b82a-092ec975122b tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 828624fb-b333-41c7-81a2-28d9bb4e1d88] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:52.954522 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ff2ace95-75aa-403a-b82a-092ec975122b tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:52.955002 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ff2ace95-75aa-403a-b82a-092ec975122b tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:52.956879 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ff2ace95-75aa-403a-b82a-092ec975122b tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:52.957083 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ff2ace95-75aa-403a-b82a-092ec975122b tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:53.207760 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-6d9ac05a-794a-4418-8f81-df364541a269 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:24:53.208345 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-6d9ac05a-794a-4418-8f81-df364541a269 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:24:53.208931 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-6d9ac05a-794a-4418-8f81-df364541a269 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:24:53.209418 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-6d9ac05a-794a-4418-8f81-df364541a269 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:24:53.209900 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-6d9ac05a-794a-4418-8f81-df364541a269 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:24:53.224009 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6d9ac05a-794a-4418-8f81-df364541a269 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:53.224914 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6d9ac05a-794a-4418-8f81-df364541a269 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:53.225947 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6d9ac05a-794a-4418-8f81-df364541a269 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:53.227231 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6d9ac05a-794a-4418-8f81-df364541a269 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:53.241746 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=11 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:53.254347 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ff2ace95-75aa-403a-b82a-092ec975122b tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704cd9e8b0984139b58ec6abe3579576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8b37e66d354ce09c4bef01d28ef7a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:53.265749 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ff2ace95-75aa-403a-b82a-092ec975122b tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "GET /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88" status: 200 len: 1322 microversion: 2.1 time: 0.322709 Jun 05 08:24:53.267255 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 306/579] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:52 2022] GET /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88 => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:53.272005 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-6d9ac05a-794a-4418-8f81-df364541a269 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Getting quotas for project 3690560330ef4d5985fa664d3c4773d9. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:24:53.280788 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c971a7a1-d8e5-4b19-9af3-4e2502796d62 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:53.282256 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-6d9ac05a-794a-4418-8f81-df364541a269 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Getting quotas for user af823091e4574d3c8ad0576ed3d1fec0 and project 3690560330ef4d5985fa664d3c4773d9. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:24:53.286089 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c971a7a1-d8e5-4b19-9af3-4e2502796d62 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:53.301997 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c971a7a1-d8e5-4b19-9af3-4e2502796d62 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:53.303463 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6d9ac05a-794a-4418-8f81-df364541a269 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:24:53.304273 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c971a7a1-d8e5-4b19-9af3-4e2502796d62 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:53.305163 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c971a7a1-d8e5-4b19-9af3-4e2502796d62 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:53.305609 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c971a7a1-d8e5-4b19-9af3-4e2502796d62 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:53.308194 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6d9ac05a-794a-4418-8f81-df364541a269 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] [instance: 34e2fe19-835a-4a68-a5ed-6570a7edcd2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:24:53.384608 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6d9ac05a-794a-4418-8f81-df364541a269 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 0.984630 Jun 05 08:24:53.387653 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 274/580] 10.222.0.33 () {62 vars in 1187 bytes} [Sun Jun 5 08:24:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 05 08:24:53.399626 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-5c8b0bf3-8499-41c2-bbd2-997d567e277b req-d39bd866-3c18-4d9f-8066-25bbd4b71a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "035abb75-eda1-447d-b034-2bbb171f704e", "name": "network-vif-plugged", "status": "completed", "tag": "a81939c6-14ec-4dcc-99cd-55f57077719c"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:53.414282 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-5c8b0bf3-8499-41c2-bbd2-997d567e277b req-d39bd866-3c18-4d9f-8066-25bbd4b71a15 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:53.415075 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-5c8b0bf3-8499-41c2-bbd2-997d567e277b req-d39bd866-3c18-4d9f-8066-25bbd4b71a15 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:53.430148 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-5c8b0bf3-8499-41c2-bbd2-997d567e277b req-d39bd866-3c18-4d9f-8066-25bbd4b71a15 service nova] Creating event network-vif-plugged:a81939c6-14ec-4dcc-99cd-55f57077719c for instance 035abb75-eda1-447d-b034-2bbb171f704e on n-h1-844739-1 Jun 05 08:24:53.436825 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-5c8b0bf3-8499-41c2-bbd2-997d567e277b req-d39bd866-3c18-4d9f-8066-25bbd4b71a15 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047247 Jun 05 08:24:53.439736 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 275/581] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:53.452908 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ae614a28-90f5-4005-96eb-1a88f220e43f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:53.454407 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ae614a28-90f5-4005-96eb-1a88f220e43f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:53.471831 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ae614a28-90f5-4005-96eb-1a88f220e43f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:53.472657 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ae614a28-90f5-4005-96eb-1a88f220e43f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:53.473985 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ae614a28-90f5-4005-96eb-1a88f220e43f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:53.474663 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ae614a28-90f5-4005-96eb-1a88f220e43f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:53.545019 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ae614a28-90f5-4005-96eb-1a88f220e43f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:53.546810 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ae614a28-90f5-4005-96eb-1a88f220e43f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:53.548519 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-ae614a28-90f5-4005-96eb-1a88f220e43f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:53.706686 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ae614a28-90f5-4005-96eb-1a88f220e43f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:53.714609 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ae614a28-90f5-4005-96eb-1a88f220e43f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.270482 Jun 05 08:24:53.715509 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 276/582] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:53 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:53.731759 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0328d472-c43d-420e-b63f-3b93f86271eb tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:53.732756 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0328d472-c43d-420e-b63f-3b93f86271eb tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] [instance: 34e2fe19-835a-4a68-a5ed-6570a7edcd2e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:53.850654 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0328d472-c43d-420e-b63f-3b93f86271eb tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:53.853085 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c971a7a1-d8e5-4b19-9af3-4e2502796d62 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21" status: 200 len: 1630 microversion: 2.1 time: 0.579918 Jun 05 08:24:53.866746 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 307/583] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:53 2022] GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21 => generated 1630 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:53.868751 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0328d472-c43d-420e-b63f-3b93f86271eb tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:53.871322 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0328d472-c43d-420e-b63f-3b93f86271eb tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:53.872656 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0328d472-c43d-420e-b63f-3b93f86271eb tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] 10.222.0.33 "GET /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e" status: 200 len: 1258 microversion: 2.21 time: 0.156204 Jun 05 08:24:53.873487 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 277/584] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:24:53 2022] GET /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:24:53.885863 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-51d5ddc6-df1a-4adf-a52d-9b621c1ecd08 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:53.887375 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-51d5ddc6-df1a-4adf-a52d-9b621c1ecd08 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:53.889403 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-70679eea-3e2e-4d58-a1a8-b785130234ce tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:53.890229 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-70679eea-3e2e-4d58-a1a8-b785130234ce tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] [instance: 3f551f85-c8f2-45d5-b5ac-20949558181c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:53.898090 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-51d5ddc6-df1a-4adf-a52d-9b621c1ecd08 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:53.899055 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-51d5ddc6-df1a-4adf-a52d-9b621c1ecd08 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:53.899485 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-51d5ddc6-df1a-4adf-a52d-9b621c1ecd08 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:53.900178 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-51d5ddc6-df1a-4adf-a52d-9b621c1ecd08 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:53.902397 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-70679eea-3e2e-4d58-a1a8-b785130234ce tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:53.904676 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-70679eea-3e2e-4d58-a1a8-b785130234ce tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:53.908253 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-70679eea-3e2e-4d58-a1a8-b785130234ce tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:53.909501 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-70679eea-3e2e-4d58-a1a8-b785130234ce tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:54.171445 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-51d5ddc6-df1a-4adf-a52d-9b621c1ecd08 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:54.184130 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-51d5ddc6-df1a-4adf-a52d-9b621c1ecd08 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:54.190312 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-51d5ddc6-df1a-4adf-a52d-9b621c1ecd08 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:54.191438 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-51d5ddc6-df1a-4adf-a52d-9b621c1ecd08 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 1361 microversion: 2.25 time: 0.323574 Jun 05 08:24:54.192312 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 308/585] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:24:53 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 1361 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:24:54.217139 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-70679eea-3e2e-4d58-a1a8-b785130234ce tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8a11ed3f5412d8ad6783cbcd324d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3c05bd3e84382aa808d1361072433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:54.218071 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-85e57514-242d-4a1c-b843-61abd80e74bd tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-844739-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:54.219727 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-85e57514-242d-4a1c-b843-61abd80e74bd tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:54.229328 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-85e57514-242d-4a1c-b843-61abd80e74bd tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:54.229789 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-85e57514-242d-4a1c-b843-61abd80e74bd tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:54.230692 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-70679eea-3e2e-4d58-a1a8-b785130234ce tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] 10.222.0.33 "GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c" status: 200 len: 1322 microversion: 2.1 time: 0.342778 Jun 05 08:24:54.231752 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 278/586] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:53 2022] GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c => generated 1322 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:54.231862 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-85e57514-242d-4a1c-b843-61abd80e74bd tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:54.232498 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-85e57514-242d-4a1c-b843-61abd80e74bd tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:54.244917 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:54.274942 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-85e57514-242d-4a1c-b843-61abd80e74bd tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lazy-loading 'flavor' on Instance uuid ef99ada2-1c39-422e-8a61-e4f7d00cbe21 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:54.284111 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-cec734a9-f05b-489e-86b7-1dafe37a2139 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:54.284885 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-cec734a9-f05b-489e-86b7-1dafe37a2139 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 828624fb-b333-41c7-81a2-28d9bb4e1d88] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:54.292993 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-85e57514-242d-4a1c-b843-61abd80e74bd tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Going to try to live migrate instance to n-h2-844739-1 {{(pid=119050) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 05 08:24:54.300721 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cec734a9-f05b-489e-86b7-1dafe37a2139 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:54.301175 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cec734a9-f05b-489e-86b7-1dafe37a2139 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:54.301962 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cec734a9-f05b-489e-86b7-1dafe37a2139 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:54.302401 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cec734a9-f05b-489e-86b7-1dafe37a2139 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:54.309522 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=4 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:54.449892 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-cec734a9-f05b-489e-86b7-1dafe37a2139 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704cd9e8b0984139b58ec6abe3579576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8b37e66d354ce09c4bef01d28ef7a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:54.457908 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-cec734a9-f05b-489e-86b7-1dafe37a2139 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "GET /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88" status: 200 len: 1322 microversion: 2.1 time: 0.179105 Jun 05 08:24:54.458687 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 279/587] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:54 2022] GET /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:24:54.584376 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bfcc1fca-4d60-4249-b7ca-006b3a39d64c tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1332691492", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "4311e43c-0acf-4c48-810f-0c900e1067b2"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:54.658238 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-bfcc1fca-4d60-4249-b7ca-006b3a39d64c tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] validate_networks() for [('4311e43c-0acf-4c48-810f-0c900e1067b2', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:24:55.424111 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-bfcc1fca-4d60-4249-b7ca-006b3a39d64c tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:24:55.424762 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-bfcc1fca-4d60-4249-b7ca-006b3a39d64c tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:24:55.425926 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-bfcc1fca-4d60-4249-b7ca-006b3a39d64c tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:24:55.426414 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-bfcc1fca-4d60-4249-b7ca-006b3a39d64c tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:24:55.426929 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-bfcc1fca-4d60-4249-b7ca-006b3a39d64c tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:24:55.439255 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bfcc1fca-4d60-4249-b7ca-006b3a39d64c tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:55.439703 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bfcc1fca-4d60-4249-b7ca-006b3a39d64c tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:55.440586 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bfcc1fca-4d60-4249-b7ca-006b3a39d64c tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:55.441356 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bfcc1fca-4d60-4249-b7ca-006b3a39d64c tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:55.458228 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:55.470041 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-bfcc1fca-4d60-4249-b7ca-006b3a39d64c tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Getting quotas for project 0bcfc655897c48069119ef6b184c8d2f. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:24:55.478013 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-bfcc1fca-4d60-4249-b7ca-006b3a39d64c tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Getting quotas for user aedf622071d04dada841a5b21a942e51 and project 0bcfc655897c48069119ef6b184c8d2f. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:24:55.491436 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-bfcc1fca-4d60-4249-b7ca-006b3a39d64c tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:24:55.493806 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-bfcc1fca-4d60-4249-b7ca-006b3a39d64c tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] [instance: 5c84911f-3880-4b7c-a589-fc39d158a22b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:24:55.544648 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bfcc1fca-4d60-4249-b7ca-006b3a39d64c tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.084763 Jun 05 08:24:55.551228 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 280/588] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:24:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:24:55.557393 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5a00db32-1e3d-494f-97aa-6556eceef166 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:55.558073 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5a00db32-1e3d-494f-97aa-6556eceef166 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:55.570250 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a00db32-1e3d-494f-97aa-6556eceef166 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:55.570815 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a00db32-1e3d-494f-97aa-6556eceef166 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:55.572000 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a00db32-1e3d-494f-97aa-6556eceef166 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:55.572815 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a00db32-1e3d-494f-97aa-6556eceef166 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:55.613390 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a00db32-1e3d-494f-97aa-6556eceef166 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:55.613990 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a00db32-1e3d-494f-97aa-6556eceef166 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:55.614408 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-5a00db32-1e3d-494f-97aa-6556eceef166 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:55.670361 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5a00db32-1e3d-494f-97aa-6556eceef166 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:55.682117 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5a00db32-1e3d-494f-97aa-6556eceef166 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.129725 Jun 05 08:24:55.682728 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 281/589] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:55 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:55.691153 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-de5a4d9e-b3f4-4080-b54c-b8adcfe9660b tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:55.691953 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-de5a4d9e-b3f4-4080-b54c-b8adcfe9660b tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] [instance: 34e2fe19-835a-4a68-a5ed-6570a7edcd2e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:55.708752 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-de5a4d9e-b3f4-4080-b54c-b8adcfe9660b tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:55.709221 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-de5a4d9e-b3f4-4080-b54c-b8adcfe9660b tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:55.711106 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-de5a4d9e-b3f4-4080-b54c-b8adcfe9660b tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:55.711483 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-de5a4d9e-b3f4-4080-b54c-b8adcfe9660b tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:55.717940 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=100 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:55.957523 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-85e57514-242d-4a1c-b843-61abd80e74bd tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21/action" status: 202 len: 0 microversion: 2.1 time: 1.747198 Jun 05 08:24:55.960324 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-de5a4d9e-b3f4-4080-b54c-b8adcfe9660b tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:55.961804 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 309/590] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Jun 5 08:24:54 2022] POST /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21/action => generated 0 bytes in 1769 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:24:55.969633 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-74aa81d8-6095-40b2-9b54-25de2b080cdb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:55.970633 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-74aa81d8-6095-40b2-9b54-25de2b080cdb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:55.974155 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-de5a4d9e-b3f4-4080-b54c-b8adcfe9660b tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:55.977514 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-de5a4d9e-b3f4-4080-b54c-b8adcfe9660b tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:55.982173 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-74aa81d8-6095-40b2-9b54-25de2b080cdb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:55.982883 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-74aa81d8-6095-40b2-9b54-25de2b080cdb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:55.984004 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-74aa81d8-6095-40b2-9b54-25de2b080cdb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:55.984612 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-74aa81d8-6095-40b2-9b54-25de2b080cdb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:55.990849 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-de5a4d9e-b3f4-4080-b54c-b8adcfe9660b tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] 10.222.0.33 "GET /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e" status: 200 len: 1358 microversion: 2.21 time: 0.304322 Jun 05 08:24:56.000140 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 282/591] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:24:55 2022] GET /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e => generated 1358 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:24:56.003366 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8d90c7c9-9712-4fbb-b569-3b4afce28277 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:56.006513 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8d90c7c9-9712-4fbb-b569-3b4afce28277 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] [instance: 3f551f85-c8f2-45d5-b5ac-20949558181c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:56.024719 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8d90c7c9-9712-4fbb-b569-3b4afce28277 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:56.025208 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8d90c7c9-9712-4fbb-b569-3b4afce28277 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:56.029015 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8d90c7c9-9712-4fbb-b569-3b4afce28277 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:56.031087 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8d90c7c9-9712-4fbb-b569-3b4afce28277 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:56.335196 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-74aa81d8-6095-40b2-9b54-25de2b080cdb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:56.343802 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-74aa81d8-6095-40b2-9b54-25de2b080cdb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:56.345361 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-74aa81d8-6095-40b2-9b54-25de2b080cdb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:56.347139 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-74aa81d8-6095-40b2-9b54-25de2b080cdb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 1558 microversion: 2.25 time: 0.383501 Jun 05 08:24:56.347706 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 310/592] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:24:55 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 1558 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:24:56.352205 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-796c9fdd-628c-4f93-b8ae-5e45f6231250 req-b0a52e3e-b2bb-40b7-8c78-4570b466b732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "828624fb-b333-41c7-81a2-28d9bb4e1d88", "name": "network-vif-plugged", "status": "completed", "tag": "df9bf56e-171a-4e64-a006-203773f700a6"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:56.363427 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-796c9fdd-628c-4f93-b8ae-5e45f6231250 req-b0a52e3e-b2bb-40b7-8c78-4570b466b732 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:56.363878 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-796c9fdd-628c-4f93-b8ae-5e45f6231250 req-b0a52e3e-b2bb-40b7-8c78-4570b466b732 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:56.374308 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-796c9fdd-628c-4f93-b8ae-5e45f6231250 req-b0a52e3e-b2bb-40b7-8c78-4570b466b732 service nova] Creating event network-vif-plugged:df9bf56e-171a-4e64-a006-203773f700a6 for instance 828624fb-b333-41c7-81a2-28d9bb4e1d88 on n-h1-844739-1 Jun 05 08:24:56.379217 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-796c9fdd-628c-4f93-b8ae-5e45f6231250 req-b0a52e3e-b2bb-40b7-8c78-4570b466b732 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030294 Jun 05 08:24:56.380269 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 311/593] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:56.386365 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-82b70918-bdc0-41fe-82e1-ad6de01c483d tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:56.387065 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-82b70918-bdc0-41fe-82e1-ad6de01c483d tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 828624fb-b333-41c7-81a2-28d9bb4e1d88] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:56.393871 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-82b70918-bdc0-41fe-82e1-ad6de01c483d tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:56.394325 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-82b70918-bdc0-41fe-82e1-ad6de01c483d tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:56.395112 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-82b70918-bdc0-41fe-82e1-ad6de01c483d tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:56.395549 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-82b70918-bdc0-41fe-82e1-ad6de01c483d tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:56.489535 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8d90c7c9-9712-4fbb-b569-3b4afce28277 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8a11ed3f5412d8ad6783cbcd324d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3c05bd3e84382aa808d1361072433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:56.499243 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8d90c7c9-9712-4fbb-b569-3b4afce28277 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] 10.222.0.33 "GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c" status: 200 len: 1322 microversion: 2.1 time: 0.506051 Jun 05 08:24:56.504764 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 283/594] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:55 2022] GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c => generated 1322 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:56.525703 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7f856995-dd0b-4df9-80e7-6ab1de50f03e tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:56.528522 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7f856995-dd0b-4df9-80e7-6ab1de50f03e tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] [instance: 5c84911f-3880-4b7c-a589-fc39d158a22b] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:56.554109 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7f856995-dd0b-4df9-80e7-6ab1de50f03e tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:56.554596 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7f856995-dd0b-4df9-80e7-6ab1de50f03e tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:56.555419 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7f856995-dd0b-4df9-80e7-6ab1de50f03e tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:56.558253 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7f856995-dd0b-4df9-80e7-6ab1de50f03e tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:57.020742 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7f856995-dd0b-4df9-80e7-6ab1de50f03e tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedf622071d04dada841a5b21a942e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcfc655897c48069119ef6b184c8d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:57.029387 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7f856995-dd0b-4df9-80e7-6ab1de50f03e tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] 10.222.0.33 "GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b" status: 200 len: 1277 microversion: 2.1 time: 0.514030 Jun 05 08:24:57.030252 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 284/595] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:56 2022] GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b => generated 1277 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:57.035283 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b7409964-ba9e-4906-81bc-e79c44b1b842 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:57.036150 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b7409964-ba9e-4906-81bc-e79c44b1b842 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:57.043519 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b7409964-ba9e-4906-81bc-e79c44b1b842 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:57.043961 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b7409964-ba9e-4906-81bc-e79c44b1b842 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:57.044772 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b7409964-ba9e-4906-81bc-e79c44b1b842 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:57.045209 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b7409964-ba9e-4906-81bc-e79c44b1b842 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:57.256936 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-82b70918-bdc0-41fe-82e1-ad6de01c483d tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704cd9e8b0984139b58ec6abe3579576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8b37e66d354ce09c4bef01d28ef7a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:57.265044 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-82b70918-bdc0-41fe-82e1-ad6de01c483d tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "GET /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88" status: 200 len: 1322 microversion: 2.1 time: 0.883410 Jun 05 08:24:57.265625 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 312/596] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:56 2022] GET /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88 => generated 1322 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:57.408012 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b7409964-ba9e-4906-81bc-e79c44b1b842 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:57.425253 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b7409964-ba9e-4906-81bc-e79c44b1b842 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21" status: 200 len: 1504 microversion: 2.1 time: 0.392929 Jun 05 08:24:57.425773 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 285/597] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:57 2022] GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21 => generated 1504 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:57.427483 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-90dae419-491a-4c3b-9348-8e1abc83510a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:57.437654 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-90dae419-491a-4c3b-9348-8e1abc83510a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:57.439023 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-31f1e1cb-b26a-4719-992a-5594963f6c21 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:57.439661 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-31f1e1cb-b26a-4719-992a-5594963f6c21 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:57.447044 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-31f1e1cb-b26a-4719-992a-5594963f6c21 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:57.447551 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-31f1e1cb-b26a-4719-992a-5594963f6c21 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:57.448544 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-31f1e1cb-b26a-4719-992a-5594963f6c21 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:57.448997 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-31f1e1cb-b26a-4719-992a-5594963f6c21 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:57.450381 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-90dae419-491a-4c3b-9348-8e1abc83510a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:57.450845 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-90dae419-491a-4c3b-9348-8e1abc83510a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:57.453340 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-90dae419-491a-4c3b-9348-8e1abc83510a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:57.456651 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-90dae419-491a-4c3b-9348-8e1abc83510a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:57.516811 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-31f1e1cb-b26a-4719-992a-5594963f6c21 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:57.517522 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-31f1e1cb-b26a-4719-992a-5594963f6c21 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:57.518170 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-31f1e1cb-b26a-4719-992a-5594963f6c21 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:57.603847 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-31f1e1cb-b26a-4719-992a-5594963f6c21 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:57.612464 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-31f1e1cb-b26a-4719-992a-5594963f6c21 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.184801 Jun 05 08:24:57.613732 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 286/598] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:57 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:57.621386 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3d0e539f-bedb-4a1b-be17-d8010153ee97 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:57.622277 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3d0e539f-bedb-4a1b-be17-d8010153ee97 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] [instance: 34e2fe19-835a-4a68-a5ed-6570a7edcd2e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:57.631326 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3d0e539f-bedb-4a1b-be17-d8010153ee97 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:57.632676 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3d0e539f-bedb-4a1b-be17-d8010153ee97 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:57.633455 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3d0e539f-bedb-4a1b-be17-d8010153ee97 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:57.634827 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3d0e539f-bedb-4a1b-be17-d8010153ee97 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:57.808222 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-90dae419-491a-4c3b-9348-8e1abc83510a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lazy-loading 'services' on Instance uuid 035abb75-eda1-447d-b034-2bbb171f704e {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:57.880961 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-90dae419-491a-4c3b-9348-8e1abc83510a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 2050 microversion: 2.25 time: 0.614084 Jun 05 08:24:57.881856 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 313/599] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:24:57 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 2050 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:24:57.898757 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8da88929-1413-41fb-8e42-8aa002cf546a tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:57.899607 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8da88929-1413-41fb-8e42-8aa002cf546a tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] [instance: 3f551f85-c8f2-45d5-b5ac-20949558181c] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:57.906579 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8da88929-1413-41fb-8e42-8aa002cf546a tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:57.907034 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8da88929-1413-41fb-8e42-8aa002cf546a tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:57.907867 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8da88929-1413-41fb-8e42-8aa002cf546a tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:57.908387 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8da88929-1413-41fb-8e42-8aa002cf546a tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:58.029529 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3d0e539f-bedb-4a1b-be17-d8010153ee97 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:58.044097 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3d0e539f-bedb-4a1b-be17-d8010153ee97 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:58.046358 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3d0e539f-bedb-4a1b-be17-d8010153ee97 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:58.047727 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3d0e539f-bedb-4a1b-be17-d8010153ee97 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] 10.222.0.33 "GET /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e" status: 200 len: 1358 microversion: 2.21 time: 0.432585 Jun 05 08:24:58.048545 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 287/600] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:24:57 2022] GET /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e => generated 1358 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:24:58.054490 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-dacf5a1d-cb9a-4259-9f7d-f6459b7172f3 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:58.055272 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-dacf5a1d-cb9a-4259-9f7d-f6459b7172f3 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:58.062233 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dacf5a1d-cb9a-4259-9f7d-f6459b7172f3 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:58.062861 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dacf5a1d-cb9a-4259-9f7d-f6459b7172f3 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:58.063817 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dacf5a1d-cb9a-4259-9f7d-f6459b7172f3 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:58.064438 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dacf5a1d-cb9a-4259-9f7d-f6459b7172f3 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:58.195145 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8da88929-1413-41fb-8e42-8aa002cf546a tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8a11ed3f5412d8ad6783cbcd324d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3c05bd3e84382aa808d1361072433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:58.203469 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8da88929-1413-41fb-8e42-8aa002cf546a tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] 10.222.0.33 "GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c" status: 200 len: 1322 microversion: 2.1 time: 0.320294 Jun 05 08:24:58.204357 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 314/601] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:57 2022] GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c => generated 1322 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:58.209375 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1e850523-17cb-46c6-8853-ab7d2fcc7750 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:58.210125 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1e850523-17cb-46c6-8853-ab7d2fcc7750 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] [instance: 5c84911f-3880-4b7c-a589-fc39d158a22b] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:58.216496 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1e850523-17cb-46c6-8853-ab7d2fcc7750 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:58.216958 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1e850523-17cb-46c6-8853-ab7d2fcc7750 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:58.217740 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1e850523-17cb-46c6-8853-ab7d2fcc7750 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:58.218359 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1e850523-17cb-46c6-8853-ab7d2fcc7750 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:58.433026 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=15 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:24:58.445448 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-dacf5a1d-cb9a-4259-9f7d-f6459b7172f3 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lazy-loading 'services' on Instance uuid 035abb75-eda1-447d-b034-2bbb171f704e {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:58.505760 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-dacf5a1d-cb9a-4259-9f7d-f6459b7172f3 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 2050 microversion: 2.25 time: 0.455159 Jun 05 08:24:58.506586 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 288/602] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:24:58 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 2050 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:24:58.517100 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-f32742e2-346b-4a5a-b750-d8778cd15dec req-be22fb83-af1f-439c-9973-c1c28f580b7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34e2fe19-835a-4a68-a5ed-6570a7edcd2e", "tag": "f473c9c3-61a3-448f-b7f2-edc957d4d62a"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:58.527488 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-f32742e2-346b-4a5a-b750-d8778cd15dec req-be22fb83-af1f-439c-9973-c1c28f580b7d service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:58.527937 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-f32742e2-346b-4a5a-b750-d8778cd15dec req-be22fb83-af1f-439c-9973-c1c28f580b7d service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:58.541845 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-f32742e2-346b-4a5a-b750-d8778cd15dec req-be22fb83-af1f-439c-9973-c1c28f580b7d service nova] Creating event network-changed:f473c9c3-61a3-448f-b7f2-edc957d4d62a for instance 34e2fe19-835a-4a68-a5ed-6570a7edcd2e on n-h2-844739-1 Jun 05 08:24:58.548892 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-f32742e2-346b-4a5a-b750-d8778cd15dec req-be22fb83-af1f-439c-9973-c1c28f580b7d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039162 Jun 05 08:24:58.550183 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 289/603] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:58.555850 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-871d0be4-adf9-4c52-a24d-844d3f2d90c7 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:58.556566 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-871d0be4-adf9-4c52-a24d-844d3f2d90c7 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 828624fb-b333-41c7-81a2-28d9bb4e1d88] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:58.563202 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-871d0be4-adf9-4c52-a24d-844d3f2d90c7 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:58.563656 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-871d0be4-adf9-4c52-a24d-844d3f2d90c7 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:58.564489 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-871d0be4-adf9-4c52-a24d-844d3f2d90c7 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:58.564966 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-871d0be4-adf9-4c52-a24d-844d3f2d90c7 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:58.586739 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1e850523-17cb-46c6-8853-ab7d2fcc7750 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedf622071d04dada841a5b21a942e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcfc655897c48069119ef6b184c8d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:58.593296 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1e850523-17cb-46c6-8853-ab7d2fcc7750 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] 10.222.0.33 "GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b" status: 200 len: 1325 microversion: 2.1 time: 0.387714 Jun 05 08:24:58.594108 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 315/604] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:58 2022] GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b => generated 1325 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:58.607545 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-a4897bf6-8968-4bd7-8b2a-5310264851d1 req-64564391-26cf-406d-bae3-7641f65bd00f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f551f85-c8f2-45d5-b5ac-20949558181c", "name": "network-vif-plugged", "status": "completed", "tag": "e2e5f4e6-8cf4-44b8-bb31-5fc701aaca63"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:58.616694 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-a4897bf6-8968-4bd7-8b2a-5310264851d1 req-64564391-26cf-406d-bae3-7641f65bd00f service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:58.617522 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-a4897bf6-8968-4bd7-8b2a-5310264851d1 req-64564391-26cf-406d-bae3-7641f65bd00f service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:58.629076 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-a4897bf6-8968-4bd7-8b2a-5310264851d1 req-64564391-26cf-406d-bae3-7641f65bd00f service nova] Creating event network-vif-plugged:e2e5f4e6-8cf4-44b8-bb31-5fc701aaca63 for instance 3f551f85-c8f2-45d5-b5ac-20949558181c on n-h2-844739-1 Jun 05 08:24:58.634691 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-a4897bf6-8968-4bd7-8b2a-5310264851d1 req-64564391-26cf-406d-bae3-7641f65bd00f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038831 Jun 05 08:24:58.635914 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 316/605] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:58.645786 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ad6b548d-f84e-49fa-8587-9bbdeec44164 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:58.646763 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ad6b548d-f84e-49fa-8587-9bbdeec44164 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:58.654106 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ad6b548d-f84e-49fa-8587-9bbdeec44164 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:58.655007 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ad6b548d-f84e-49fa-8587-9bbdeec44164 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:58.656008 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ad6b548d-f84e-49fa-8587-9bbdeec44164 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:58.656740 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ad6b548d-f84e-49fa-8587-9bbdeec44164 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:58.959148 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-871d0be4-adf9-4c52-a24d-844d3f2d90c7 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704cd9e8b0984139b58ec6abe3579576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8b37e66d354ce09c4bef01d28ef7a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:58.976289 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-871d0be4-adf9-4c52-a24d-844d3f2d90c7 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "GET /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88" status: 200 len: 1472 microversion: 2.1 time: 0.424956 Jun 05 08:24:58.976906 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 290/606] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:58 2022] GET /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88 => generated 1472 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:58.981790 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5615b541-1e39-4a7c-93f4-df95d4d696fa tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:58.983146 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:24:58.983146 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:24:58.984769 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5615b541-1e39-4a7c-93f4-df95d4d696fa tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:58.986492 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5615b541-1e39-4a7c-93f4-df95d4d696fa tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:58.987569 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5615b541-1e39-4a7c-93f4-df95d4d696fa tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:58.993995 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ad6b548d-f84e-49fa-8587-9bbdeec44164 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:58.999393 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5615b541-1e39-4a7c-93f4-df95d4d696fa tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:59.008321 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ad6b548d-f84e-49fa-8587-9bbdeec44164 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21" status: 200 len: 1504 microversion: 2.1 time: 0.370837 Jun 05 08:24:59.021920 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 317/607] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:58 2022] GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21 => generated 1504 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:59.021920 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7ca126d2-9786-4aa0-bb7f-27ff76b14c5d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:59.021920 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7ca126d2-9786-4aa0-bb7f-27ff76b14c5d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:59.027217 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7ca126d2-9786-4aa0-bb7f-27ff76b14c5d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:59.027740 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7ca126d2-9786-4aa0-bb7f-27ff76b14c5d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:59.028874 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7ca126d2-9786-4aa0-bb7f-27ff76b14c5d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:59.029291 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5615b541-1e39-4a7c-93f4-df95d4d696fa tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.050643 Jun 05 08:24:59.029777 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7ca126d2-9786-4aa0-bb7f-27ff76b14c5d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:59.029904 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 291/608] 10.222.0.33 () {60 vars in 1216 bytes} [Sun Jun 5 08:24:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:24:59.040183 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-b8ae1336-4136-405e-82ec-92573a95dd32 req-8c998a79-d0a1-4c2e-bade-2ebf7e06395b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c84911f-3880-4b7c-a589-fc39d158a22b", "tag": "b21e549c-cb08-4577-9af4-80b6c7cb43fb"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:59.052777 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-b8ae1336-4136-405e-82ec-92573a95dd32 req-8c998a79-d0a1-4c2e-bade-2ebf7e06395b service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:59.053223 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-b8ae1336-4136-405e-82ec-92573a95dd32 req-8c998a79-d0a1-4c2e-bade-2ebf7e06395b service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:59.069511 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7ca126d2-9786-4aa0-bb7f-27ff76b14c5d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:59.070264 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7ca126d2-9786-4aa0-bb7f-27ff76b14c5d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:59.070946 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-b8ae1336-4136-405e-82ec-92573a95dd32 req-8c998a79-d0a1-4c2e-bade-2ebf7e06395b service nova] Creating event network-changed:b21e549c-cb08-4577-9af4-80b6c7cb43fb for instance 5c84911f-3880-4b7c-a589-fc39d158a22b on n-h2-844739-1 Jun 05 08:24:59.071521 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-7ca126d2-9786-4aa0-bb7f-27ff76b14c5d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:59.077699 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-b8ae1336-4136-405e-82ec-92573a95dd32 req-8c998a79-d0a1-4c2e-bade-2ebf7e06395b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045999 Jun 05 08:24:59.078898 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 292/609] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:24:59.180586 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7ca126d2-9786-4aa0-bb7f-27ff76b14c5d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:59.189500 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7ca126d2-9786-4aa0-bb7f-27ff76b14c5d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.175855 Jun 05 08:24:59.194201 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 318/610] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:59 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:59.209583 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-65bd6bd6-5f46-458f-9931-832c8fe9aa5f tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-844739-1", "block_migration": "auto"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:59.213194 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-65bd6bd6-5f46-458f-9931-832c8fe9aa5f tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:59.227591 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-65bd6bd6-5f46-458f-9931-832c8fe9aa5f tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:59.228512 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-65bd6bd6-5f46-458f-9931-832c8fe9aa5f tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:59.233803 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-65bd6bd6-5f46-458f-9931-832c8fe9aa5f tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:59.237676 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-65bd6bd6-5f46-458f-9931-832c8fe9aa5f tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:59.264707 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-da9613d7-8161-40b6-97fe-dc1ed5b364a6 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:59.265358 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-da9613d7-8161-40b6-97fe-dc1ed5b364a6 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] [instance: 836ee060-8c85-455d-a5c4-64c86e5d6f73] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:59.274635 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-da9613d7-8161-40b6-97fe-dc1ed5b364a6 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] HTTP exception thrown: Instance 836ee060-8c85-455d-a5c4-64c86e5d6f73 could not be found. Jun 05 08:24:59.277045 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-da9613d7-8161-40b6-97fe-dc1ed5b364a6 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Request method failure captured: Jun 05 08:24:59.277045 n-d-844739-1 devstack@n-api.service[119049]: request: POST /compute/v2.1/servers/836ee060-8c85-455d-a5c4-64c86e5d6f73/action HTTP/1.1 Jun 05 08:24:59.277045 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:24:59.277045 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:24:59.277045 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:24:59.277045 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 15 Jun 05 08:24:59.277045 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:24:59.277045 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:24:59.277045 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:24:59.277045 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:24:59.277045 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGhH2PotCnO8-KI1vbAL7yHvxYW1RfsAKSSDjvWVKJI_2zZgpgQxHtJ66D581i94QEDoiDNhIeebXM6v2x49P-1olCQjkByKpMUMKfA8SZQnfEYu9LhMDYOCMzzVw7CN72_pXlmMkPoggQij99AWRVGH7A2sHPFyV2cxT3Q9N5K1AWw Jun 05 08:24:59.277045 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:24:59.277045 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:24:59.277045 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:24:59.277045 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:24:59.277045 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:24:59.277045 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:24:59.277045 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 81a08ddb66314b5ea740cf83434d8a9e Jun 05 08:24:59.277045 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1425902367 Jun 05 08:24:59.277045 n-d-844739-1 devstack@n-api.service[119049]: X-Role: admin,reader,member Jun 05 08:24:59.277045 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: admin,reader,member Jun 05 08:24:59.278576 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/81a08ddb66314b5ea740cf83434d8a9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/81a08ddb66314b5ea740cf83434d8a9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_81a08ddb66314b5ea740cf83434d8a9e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/81a08ddb66314b5ea740cf83434d8a9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:24:59.278576 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1425902367 Jun 05 08:24:59.278576 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 81a08ddb66314b5ea740cf83434d8a9e Jun 05 08:24:59.278576 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1425902367 Jun 05 08:24:59.278576 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ServersAdminNegativeTestJSON-1425902367-project-admin Jun 05 08:24:59.278576 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:24:59.278576 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:24:59.278576 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: b1d4e395484a46b791636b8b76c09fd9 Jun 05 08:24:59.278576 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1425902367-project-admin Jun 05 08:24:59.278576 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:24:59.278576 n-d-844739-1 devstack@n-api.service[119049]: {"migrate": {}} Jun 05 08:24:59.278576 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:24:59.278576 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 836ee060-8c85-455d-a5c4-64c86e5d6f73 could not be found. Jun 05 08:24:59.279742 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '836ee060-8c85-455d-a5c4-64c86e5d6f73', 'body': {'migrate': {}}} Jun 05 08:24:59.279742 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:24:59.279742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:59.279742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:24:59.279742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:24:59.279742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:24:59.279742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:24:59.279742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 05 08:24:59.279742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 05 08:24:59.279742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 836ee060-8c85-455d-a5c4-64c86e5d6f73 could not be found. Jun 05 08:24:59.279742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:59.279742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:59.279742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:59.279742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:59.279742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:59.279742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:59.279742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:24:59.279742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:24:59.279742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:24:59.279742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:24:59.281709 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:24:59.281709 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:24:59.281709 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jun 05 08:24:59.281709 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jun 05 08:24:59.281709 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:24:59.281709 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:24:59.281709 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 836ee060-8c85-455d-a5c4-64c86e5d6f73 could not be found. Jun 05 08:24:59.281709 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:59.281709 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:24:59.281709 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:59.281709 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:24:59.281709 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:24:59.281709 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:24:59.281709 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:24:59.281709 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:24:59.281709 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 836ee060-8c85-455d-a5c4-64c86e5d6f73 could not be found. Jun 05 08:24:59.281709 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:24:59.282958 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-da9613d7-8161-40b6-97fe-dc1ed5b364a6 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Returning 404 to user: Instance 836ee060-8c85-455d-a5c4-64c86e5d6f73 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:24:59.282958 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-da9613d7-8161-40b6-97fe-dc1ed5b364a6 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/836ee060-8c85-455d-a5c4-64c86e5d6f73/action" status: 404 len: 111 microversion: 2.1 time: 0.198246 Jun 05 08:24:59.282958 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 293/611] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Jun 5 08:24:59 2022] POST /compute/v2.1/servers/836ee060-8c85-455d-a5c4-64c86e5d6f73/action => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:24:59.292134 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-65bd6bd6-5f46-458f-9931-832c8fe9aa5f tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lazy-loading 'flavor' on Instance uuid 035abb75-eda1-447d-b034-2bbb171f704e {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:24:59.296267 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4ced90b8-7761-43ec-8b44-46ec723c1b6f tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:59.296882 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4ced90b8-7761-43ec-8b44-46ec723c1b6f tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] [instance: 34e2fe19-835a-4a68-a5ed-6570a7edcd2e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:59.305073 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4ced90b8-7761-43ec-8b44-46ec723c1b6f tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:59.305506 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4ced90b8-7761-43ec-8b44-46ec723c1b6f tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:59.306282 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4ced90b8-7761-43ec-8b44-46ec723c1b6f tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:59.306717 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4ced90b8-7761-43ec-8b44-46ec723c1b6f tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:59.309894 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-65bd6bd6-5f46-458f-9931-832c8fe9aa5f tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Going to try to live migrate instance to n-h2-844739-1 {{(pid=119050) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 05 08:24:59.538801 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4ced90b8-7761-43ec-8b44-46ec723c1b6f tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:59.553157 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4ced90b8-7761-43ec-8b44-46ec723c1b6f tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:59.558150 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4ced90b8-7761-43ec-8b44-46ec723c1b6f tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:59.560672 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4ced90b8-7761-43ec-8b44-46ec723c1b6f tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] 10.222.0.33 "GET /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e" status: 200 len: 1358 microversion: 2.21 time: 0.280535 Jun 05 08:24:59.561741 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 294/612] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:24:59 2022] GET /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e => generated 1358 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:24:59.568488 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9e25986f-afa4-4c68-92e6-fd3849389dc2 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:24:59.569201 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9e25986f-afa4-4c68-92e6-fd3849389dc2 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] [instance: 3f551f85-c8f2-45d5-b5ac-20949558181c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:24:59.575719 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9e25986f-afa4-4c68-92e6-fd3849389dc2 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:59.576219 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9e25986f-afa4-4c68-92e6-fd3849389dc2 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:59.577001 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9e25986f-afa4-4c68-92e6-fd3849389dc2 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:24:59.577447 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9e25986f-afa4-4c68-92e6-fd3849389dc2 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:24:59.762005 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9e25986f-afa4-4c68-92e6-fd3849389dc2 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8a11ed3f5412d8ad6783cbcd324d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3c05bd3e84382aa808d1361072433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:24:59.774303 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9e25986f-afa4-4c68-92e6-fd3849389dc2 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] 10.222.0.33 "GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c" status: 200 len: 1322 microversion: 2.1 time: 0.211667 Jun 05 08:24:59.775057 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 295/613] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:24:59 2022] GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:24:59.780340 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d044de6c-392c-49c5-98f6-0f7559e193a9 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-966215032", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:24:59.838186 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-d044de6c-392c-49c5-98f6-0f7559e193a9 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] validate_networks() for None {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:25:00.052311 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-d044de6c-392c-49c5-98f6-0f7559e193a9 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:25:00.052900 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-d044de6c-392c-49c5-98f6-0f7559e193a9 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:25:00.053223 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-d044de6c-392c-49c5-98f6-0f7559e193a9 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:25:00.053628 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-d044de6c-392c-49c5-98f6-0f7559e193a9 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:25:00.054095 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-d044de6c-392c-49c5-98f6-0f7559e193a9 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:25:00.062858 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d044de6c-392c-49c5-98f6-0f7559e193a9 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:00.063303 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d044de6c-392c-49c5-98f6-0f7559e193a9 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:00.064129 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d044de6c-392c-49c5-98f6-0f7559e193a9 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:00.064568 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d044de6c-392c-49c5-98f6-0f7559e193a9 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:00.081892 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-d044de6c-392c-49c5-98f6-0f7559e193a9 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Getting quotas for project da8b37e66d354ce09c4bef01d28ef7a3. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:25:00.086541 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-d044de6c-392c-49c5-98f6-0f7559e193a9 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Getting quotas for user 704cd9e8b0984139b58ec6abe3579576 and project da8b37e66d354ce09c4bef01d28ef7a3. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:25:00.099249 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d044de6c-392c-49c5-98f6-0f7559e193a9 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:25:00.101502 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d044de6c-392c-49c5-98f6-0f7559e193a9 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 66aeb103-f664-4b53-921a-79ae7685365e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:25:00.144659 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d044de6c-392c-49c5-98f6-0f7559e193a9 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.368263 Jun 05 08:25:00.145300 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 296/614] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:24:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:25:00.149785 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-952c9f72-b53a-4d19-9238-3ce73ca671aa tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:00.150390 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-952c9f72-b53a-4d19-9238-3ce73ca671aa tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] [instance: 5c84911f-3880-4b7c-a589-fc39d158a22b] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:00.156711 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-952c9f72-b53a-4d19-9238-3ce73ca671aa tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:00.157163 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-952c9f72-b53a-4d19-9238-3ce73ca671aa tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:00.157925 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-952c9f72-b53a-4d19-9238-3ce73ca671aa tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:00.158974 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-952c9f72-b53a-4d19-9238-3ce73ca671aa tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:00.295727 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-952c9f72-b53a-4d19-9238-3ce73ca671aa tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedf622071d04dada841a5b21a942e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcfc655897c48069119ef6b184c8d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:00.304503 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-952c9f72-b53a-4d19-9238-3ce73ca671aa tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] 10.222.0.33 "GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b" status: 200 len: 1325 microversion: 2.1 time: 0.158056 Jun 05 08:25:00.305043 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 297/615] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:00 2022] GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b => generated 1325 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:00.309552 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0c52bc6c-380f-4463-99ad-d966b7573bab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:00.310160 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0c52bc6c-380f-4463-99ad-d966b7573bab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:00.317043 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0c52bc6c-380f-4463-99ad-d966b7573bab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:00.317503 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0c52bc6c-380f-4463-99ad-d966b7573bab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:00.318277 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0c52bc6c-380f-4463-99ad-d966b7573bab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:00.318729 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0c52bc6c-380f-4463-99ad-d966b7573bab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:00.508964 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0c52bc6c-380f-4463-99ad-d966b7573bab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:00.527072 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0c52bc6c-380f-4463-99ad-d966b7573bab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21" status: 200 len: 1504 microversion: 2.1 time: 0.219047 Jun 05 08:25:00.540857 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 298/616] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:00 2022] GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21 => generated 1504 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:00.557259 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0db57f0a-18ac-455e-a5ac-5f69e499c3f6 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:00.557909 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0db57f0a-18ac-455e-a5ac-5f69e499c3f6 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 66aeb103-f664-4b53-921a-79ae7685365e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:00.575681 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0db57f0a-18ac-455e-a5ac-5f69e499c3f6 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:00.576167 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0db57f0a-18ac-455e-a5ac-5f69e499c3f6 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:00.576952 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0db57f0a-18ac-455e-a5ac-5f69e499c3f6 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:00.577393 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0db57f0a-18ac-455e-a5ac-5f69e499c3f6 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:00.694567 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0db57f0a-18ac-455e-a5ac-5f69e499c3f6 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704cd9e8b0984139b58ec6abe3579576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8b37e66d354ce09c4bef01d28ef7a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:00.703132 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0db57f0a-18ac-455e-a5ac-5f69e499c3f6 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e" status: 200 len: 1225 microversion: 2.1 time: 0.158781 Jun 05 08:25:00.713300 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 299/617] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:00 2022] GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e => generated 1225 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:00.713300 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9bb3109d-2a1f-402d-ada2-91a4a4d4b90c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:00.713300 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9bb3109d-2a1f-402d-ada2-91a4a4d4b90c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:00.717972 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9bb3109d-2a1f-402d-ada2-91a4a4d4b90c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:00.718423 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9bb3109d-2a1f-402d-ada2-91a4a4d4b90c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:00.719221 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9bb3109d-2a1f-402d-ada2-91a4a4d4b90c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:00.719699 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9bb3109d-2a1f-402d-ada2-91a4a4d4b90c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:00.753925 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9bb3109d-2a1f-402d-ada2-91a4a4d4b90c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:00.754838 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9bb3109d-2a1f-402d-ada2-91a4a4d4b90c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:00.754838 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-9bb3109d-2a1f-402d-ada2-91a4a4d4b90c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:00.805675 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9bb3109d-2a1f-402d-ada2-91a4a4d4b90c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:00.816433 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9bb3109d-2a1f-402d-ada2-91a4a4d4b90c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.111074 Jun 05 08:25:00.817090 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 300/618] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:00 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:00.821983 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-c74d07d7-a999-4b3d-9985-01f9de57ba9f req-228d6e32-da2c-4d6a-87ed-c4ea85fa44c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef99ada2-1c39-422e-8a61-e4f7d00cbe21", "name": "network-vif-unplugged", "status": "completed", "tag": "252d7f78-09ea-4658-a0fc-b18556671cf4"}, {"name": "network-changed", "server_uuid": "ef99ada2-1c39-422e-8a61-e4f7d00cbe21", "tag": "252d7f78-09ea-4658-a0fc-b18556671cf4"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:00.834706 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-c74d07d7-a999-4b3d-9985-01f9de57ba9f req-228d6e32-da2c-4d6a-87ed-c4ea85fa44c3 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:00.835238 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-c74d07d7-a999-4b3d-9985-01f9de57ba9f req-228d6e32-da2c-4d6a-87ed-c4ea85fa44c3 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:00.847762 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-c74d07d7-a999-4b3d-9985-01f9de57ba9f req-228d6e32-da2c-4d6a-87ed-c4ea85fa44c3 service nova] Creating event network-vif-unplugged:252d7f78-09ea-4658-a0fc-b18556671cf4 for instance ef99ada2-1c39-422e-8a61-e4f7d00cbe21 on n-h1-844739-1 Jun 05 08:25:00.848408 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-c74d07d7-a999-4b3d-9985-01f9de57ba9f req-228d6e32-da2c-4d6a-87ed-c4ea85fa44c3 service nova] Creating event network-changed:252d7f78-09ea-4658-a0fc-b18556671cf4 for instance ef99ada2-1c39-422e-8a61-e4f7d00cbe21 on n-h1-844739-1 Jun 05 08:25:00.853965 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-c74d07d7-a999-4b3d-9985-01f9de57ba9f req-228d6e32-da2c-4d6a-87ed-c4ea85fa44c3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.035590 Jun 05 08:25:00.854576 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 301/619] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:00.860324 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-16733871-6076-4aa4-81e0-29dd32de427f tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:00.861025 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-16733871-6076-4aa4-81e0-29dd32de427f tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] [instance: 34e2fe19-835a-4a68-a5ed-6570a7edcd2e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:00.867982 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-16733871-6076-4aa4-81e0-29dd32de427f tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:00.871540 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-16733871-6076-4aa4-81e0-29dd32de427f tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:00.872358 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-16733871-6076-4aa4-81e0-29dd32de427f tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:00.873264 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-16733871-6076-4aa4-81e0-29dd32de427f tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:00.875736 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=100 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:01.011931 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-16733871-6076-4aa4-81e0-29dd32de427f tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:01.025728 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-16733871-6076-4aa4-81e0-29dd32de427f tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:01.027257 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-16733871-6076-4aa4-81e0-29dd32de427f tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:01.028405 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-16733871-6076-4aa4-81e0-29dd32de427f tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] 10.222.0.33 "GET /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e" status: 200 len: 1358 microversion: 2.21 time: 0.172588 Jun 05 08:25:01.029239 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 302/620] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:00 2022] GET /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:01.034182 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0ef6a5e9-68ea-454c-add8-4013b3ed2335 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:01.035443 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0ef6a5e9-68ea-454c-add8-4013b3ed2335 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] [instance: 3f551f85-c8f2-45d5-b5ac-20949558181c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:01.041407 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0ef6a5e9-68ea-454c-add8-4013b3ed2335 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:01.042040 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0ef6a5e9-68ea-454c-add8-4013b3ed2335 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:01.043000 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0ef6a5e9-68ea-454c-add8-4013b3ed2335 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:01.043612 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0ef6a5e9-68ea-454c-add8-4013b3ed2335 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:01.286603 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:01.408071 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0ef6a5e9-68ea-454c-add8-4013b3ed2335 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8a11ed3f5412d8ad6783cbcd324d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3c05bd3e84382aa808d1361072433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:01.417260 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0ef6a5e9-68ea-454c-add8-4013b3ed2335 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] 10.222.0.33 "GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c" status: 200 len: 1472 microversion: 2.1 time: 0.387014 Jun 05 08:25:01.418041 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 303/621] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:01 2022] GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c => generated 1472 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:01.433752 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-82caa310-2385-4d4f-ade6-fc86c330d8cb tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:01.434732 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-82caa310-2385-4d4f-ade6-fc86c330d8cb tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] [instance: 5c84911f-3880-4b7c-a589-fc39d158a22b] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:01.442187 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-82caa310-2385-4d4f-ade6-fc86c330d8cb tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:01.442645 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-82caa310-2385-4d4f-ade6-fc86c330d8cb tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:01.443426 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-82caa310-2385-4d4f-ade6-fc86c330d8cb tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:01.443866 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-82caa310-2385-4d4f-ade6-fc86c330d8cb tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:01.584473 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-82caa310-2385-4d4f-ade6-fc86c330d8cb tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedf622071d04dada841a5b21a942e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcfc655897c48069119ef6b184c8d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:01.591888 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-82caa310-2385-4d4f-ade6-fc86c330d8cb tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] 10.222.0.33 "GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b" status: 200 len: 1325 microversion: 2.1 time: 0.162624 Jun 05 08:25:01.592499 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 304/622] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:01 2022] GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b => generated 1325 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:01.606514 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d65536b2-1216-45eb-a654-d7214decfd1b tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:01.607007 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d65536b2-1216-45eb-a654-d7214decfd1b tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] [instance: 3f551f85-c8f2-45d5-b5ac-20949558181c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:01.612918 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d65536b2-1216-45eb-a654-d7214decfd1b tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:01.613365 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d65536b2-1216-45eb-a654-d7214decfd1b tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:01.614125 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d65536b2-1216-45eb-a654-d7214decfd1b tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:01.614559 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d65536b2-1216-45eb-a654-d7214decfd1b tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:01.637436 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d65536b2-1216-45eb-a654-d7214decfd1b tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '89b8a11ed3f5412d8ad6783cbcd324d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3c05bd3e84382aa808d1361072433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:01.639316 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d65536b2-1216-45eb-a654-d7214decfd1b tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Request method failure captured: Jun 05 08:25:01.639316 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c/diagnostics HTTP/1.1 Jun 05 08:25:01.639316 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:25:01.639316 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:25:01.639316 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:25:01.639316 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:25:01.639316 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:25:01.639316 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:25:01.639316 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:25:01.639316 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:25:01.639316 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGhK7fc7-6D4N8azmAn0z1d12ZdUr4mD2gbkU3sbQxqLvHojjhxxwEwUyrAnJyxduaOK3g0BkKVeufsbOczvoLsqJYcjqagz1AGbuCuoJUbuKQCTRbExqC_4GCva3GvrYTZyWkDMR_VjynwuXyoBe_dfTZxTjq56L2XYHg_FdvDGbGA Jun 05 08:25:01.639316 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:25:01.639316 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:25:01.639316 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:25:01.639316 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:25:01.639316 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:25:01.639316 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:25:01.639316 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 56c3c05bd3e84382aa808d1361072433 Jun 05 08:25:01.639316 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-270383782 Jun 05 08:25:01.639316 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:25:01.639316 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:25:01.640818 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/56c3c05bd3e84382aa808d1361072433"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56c3c05bd3e84382aa808d1361072433"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_56c3c05bd3e84382aa808d1361072433", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56c3c05bd3e84382aa808d1361072433"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:25:01.640818 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-270383782 Jun 05 08:25:01.640818 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 56c3c05bd3e84382aa808d1361072433 Jun 05 08:25:01.640818 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-270383782 Jun 05 08:25:01.640818 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ServerDiagnosticsNegativeTest-270383782-project Jun 05 08:25:01.640818 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:25:01.640818 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:25:01.640818 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 89b8a11ed3f5412d8ad6783cbcd324d5 Jun 05 08:25:01.640818 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-270383782-project Jun 05 08:25:01.640818 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:25:01.640818 n-d-844739-1 devstack@n-api.service[119049]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jun 05 08:25:01.641587 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'server_id': '3f551f85-c8f2-45d5-b5ac-20949558181c'} Jun 05 08:25:01.641587 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:25:01.641587 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:25:01.641587 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:25:01.641587 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:25:01.641587 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:25:01.641587 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:25:01.641587 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:25:01.641587 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:25:01.641587 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jun 05 08:25:01.641587 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jun 05 08:25:01.641587 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:25:01.641587 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:25:01.641587 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:25:01.641587 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:25:01.641587 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:25:01.641587 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:25:01.641587 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:25:01.641587 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:25:01.641587 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:25:01.643302 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:25:01.643302 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:25:01.643302 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:25:01.643302 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:25:01.643302 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:25:01.643302 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jun 05 08:25:01.643302 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:25:01.643302 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:25:01.643302 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:25:01.643302 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:25:01.643302 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:25:01.643302 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:25:01.643302 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:25:01.643302 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:25:01.643302 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jun 05 08:25:01.643302 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:25:01.643302 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d65536b2-1216-45eb-a654-d7214decfd1b tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:25:01.644259 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d65536b2-1216-45eb-a654-d7214decfd1b tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] 10.222.0.33 "GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.038493 Jun 05 08:25:01.644259 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 305/623] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:25:01 2022] GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c/diagnostics => generated 117 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:25:01.647475 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5a41bc56-ac55-4847-84e6-19871f93604b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:01.648137 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5a41bc56-ac55-4847-84e6-19871f93604b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:01.654203 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a41bc56-ac55-4847-84e6-19871f93604b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:01.654658 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a41bc56-ac55-4847-84e6-19871f93604b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:01.655433 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a41bc56-ac55-4847-84e6-19871f93604b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:01.655873 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a41bc56-ac55-4847-84e6-19871f93604b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:01.797056 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5a41bc56-ac55-4847-84e6-19871f93604b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:01.810753 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5a41bc56-ac55-4847-84e6-19871f93604b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21" status: 200 len: 1504 microversion: 2.1 time: 0.167339 Jun 05 08:25:01.812582 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 306/624] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:01 2022] GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:01.823116 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-09826c01-b644-45c8-948c-9fdfb4be0e40 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:01.824077 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-09826c01-b644-45c8-948c-9fdfb4be0e40 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] [instance: 3f551f85-c8f2-45d5-b5ac-20949558181c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:01.837752 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-09826c01-b644-45c8-948c-9fdfb4be0e40 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:01.838124 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-09826c01-b644-45c8-948c-9fdfb4be0e40 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:01.839220 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-09826c01-b644-45c8-948c-9fdfb4be0e40 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:01.839659 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-09826c01-b644-45c8-948c-9fdfb4be0e40 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:01.886286 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-09826c01-b644-45c8-948c-9fdfb4be0e40 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] [instance: 3f551f85-c8f2-45d5-b5ac-20949558181c] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:25:01.971755 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-09826c01-b644-45c8-948c-9fdfb4be0e40 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c" status: 204 len: 0 microversion: 2.1 time: 0.157624 Jun 05 08:25:01.975412 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 307/625] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:25:01 2022] DELETE /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:25:01.979936 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-76e865ac-44e0-47e9-9624-63ad02fa1adb tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:01.980729 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-76e865ac-44e0-47e9-9624-63ad02fa1adb tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 66aeb103-f664-4b53-921a-79ae7685365e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:01.989920 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-76e865ac-44e0-47e9-9624-63ad02fa1adb tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:01.990991 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-76e865ac-44e0-47e9-9624-63ad02fa1adb tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:01.991793 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-76e865ac-44e0-47e9-9624-63ad02fa1adb tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:01.992257 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-76e865ac-44e0-47e9-9624-63ad02fa1adb tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:02.068126 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-76e865ac-44e0-47e9-9624-63ad02fa1adb tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704cd9e8b0984139b58ec6abe3579576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8b37e66d354ce09c4bef01d28ef7a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:02.076023 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-76e865ac-44e0-47e9-9624-63ad02fa1adb tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e" status: 200 len: 1279 microversion: 2.1 time: 0.102333 Jun 05 08:25:02.076824 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 308/626] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:01 2022] GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e => generated 1279 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:02.081746 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-27e167e4-581c-4228-a3a0-717c75c8fea8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:02.082463 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-27e167e4-581c-4228-a3a0-717c75c8fea8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:02.088345 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-27e167e4-581c-4228-a3a0-717c75c8fea8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:02.088737 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-27e167e4-581c-4228-a3a0-717c75c8fea8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:02.089499 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-27e167e4-581c-4228-a3a0-717c75c8fea8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:02.089935 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-27e167e4-581c-4228-a3a0-717c75c8fea8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:02.121055 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-27e167e4-581c-4228-a3a0-717c75c8fea8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:02.121511 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-27e167e4-581c-4228-a3a0-717c75c8fea8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:02.121980 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-27e167e4-581c-4228-a3a0-717c75c8fea8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:02.168327 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-27e167e4-581c-4228-a3a0-717c75c8fea8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:02.176837 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-27e167e4-581c-4228-a3a0-717c75c8fea8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.099230 Jun 05 08:25:02.177412 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 309/627] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:02 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:02.181861 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c5a2f6e3-4708-49e7-8f0a-4261b46ab4dc tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:02.182464 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c5a2f6e3-4708-49e7-8f0a-4261b46ab4dc tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] [instance: 3f551f85-c8f2-45d5-b5ac-20949558181c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:02.185440 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:02.189550 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c5a2f6e3-4708-49e7-8f0a-4261b46ab4dc tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:02.190623 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c5a2f6e3-4708-49e7-8f0a-4261b46ab4dc tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:02.191537 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c5a2f6e3-4708-49e7-8f0a-4261b46ab4dc tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:02.192090 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c5a2f6e3-4708-49e7-8f0a-4261b46ab4dc tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:02.326077 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c5a2f6e3-4708-49e7-8f0a-4261b46ab4dc tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8a11ed3f5412d8ad6783cbcd324d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3c05bd3e84382aa808d1361072433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:02.334683 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c5a2f6e3-4708-49e7-8f0a-4261b46ab4dc tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] 10.222.0.33 "GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c" status: 200 len: 1478 microversion: 2.1 time: 0.156299 Jun 05 08:25:02.335304 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 310/628] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:02 2022] GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c => generated 1478 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:02.340333 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c8b7802f-aeb9-4014-84cb-9e9aa5e711b5 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:02.340465 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c8b7802f-aeb9-4014-84cb-9e9aa5e711b5 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] [instance: 34e2fe19-835a-4a68-a5ed-6570a7edcd2e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:02.346103 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c8b7802f-aeb9-4014-84cb-9e9aa5e711b5 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:02.347144 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c8b7802f-aeb9-4014-84cb-9e9aa5e711b5 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:02.348354 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c8b7802f-aeb9-4014-84cb-9e9aa5e711b5 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:02.348791 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c8b7802f-aeb9-4014-84cb-9e9aa5e711b5 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:02.483369 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c8b7802f-aeb9-4014-84cb-9e9aa5e711b5 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:02.494640 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c8b7802f-aeb9-4014-84cb-9e9aa5e711b5 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:02.496176 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c8b7802f-aeb9-4014-84cb-9e9aa5e711b5 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:02.497597 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c8b7802f-aeb9-4014-84cb-9e9aa5e711b5 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] 10.222.0.33 "GET /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e" status: 200 len: 1358 microversion: 2.21 time: 0.161125 Jun 05 08:25:02.516080 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 311/629] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:02 2022] GET /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:02.558537 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-65bd6bd6-5f46-458f-9931-832c8fe9aa5f tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e/action" status: 202 len: 0 microversion: 2.25 time: 3.361728 Jun 05 08:25:02.559154 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 319/630] 10.222.0.33 () {62 vars in 1318 bytes} [Sun Jun 5 08:24:59 2022] POST /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e/action => generated 0 bytes in 3364 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:25:02.568729 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a02290c5-2403-41a5-b1e6-cdd16293693b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:02.569593 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a02290c5-2403-41a5-b1e6-cdd16293693b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:02.584000 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a02290c5-2403-41a5-b1e6-cdd16293693b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:02.584605 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a02290c5-2403-41a5-b1e6-cdd16293693b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:02.586264 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a02290c5-2403-41a5-b1e6-cdd16293693b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:02.586967 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a02290c5-2403-41a5-b1e6-cdd16293693b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:02.609863 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7550e375-4e20-433f-b136-bee4bec839b8 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:02.610535 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7550e375-4e20-433f-b136-bee4bec839b8 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] [instance: 5c84911f-3880-4b7c-a589-fc39d158a22b] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:02.626970 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7550e375-4e20-433f-b136-bee4bec839b8 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:02.627947 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7550e375-4e20-433f-b136-bee4bec839b8 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:02.634582 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7550e375-4e20-433f-b136-bee4bec839b8 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:02.635247 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7550e375-4e20-433f-b136-bee4bec839b8 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:02.845761 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a02290c5-2403-41a5-b1e6-cdd16293693b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:02.856170 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a02290c5-2403-41a5-b1e6-cdd16293693b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:02.857902 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a02290c5-2403-41a5-b1e6-cdd16293693b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:02.859396 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a02290c5-2403-41a5-b1e6-cdd16293693b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 1568 microversion: 2.25 time: 0.295194 Jun 05 08:25:02.860642 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 312/631] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:02 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 1568 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:02.866072 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a0b37065-549b-4547-a38b-0dbf9bdcf9ef tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:02.866742 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a0b37065-549b-4547-a38b-0dbf9bdcf9ef tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:02.877860 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a0b37065-549b-4547-a38b-0dbf9bdcf9ef tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:02.878585 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a0b37065-549b-4547-a38b-0dbf9bdcf9ef tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:02.879520 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a0b37065-549b-4547-a38b-0dbf9bdcf9ef tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:02.880188 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a0b37065-549b-4547-a38b-0dbf9bdcf9ef tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:02.909034 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7550e375-4e20-433f-b136-bee4bec839b8 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedf622071d04dada841a5b21a942e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcfc655897c48069119ef6b184c8d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:02.918794 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7550e375-4e20-433f-b136-bee4bec839b8 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] 10.222.0.33 "GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b" status: 200 len: 1325 microversion: 2.1 time: 0.313859 Jun 05 08:25:02.920881 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 320/632] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:02 2022] GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b => generated 1325 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:25:03.042695 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a0b37065-549b-4547-a38b-0dbf9bdcf9ef tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:03.054285 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a0b37065-549b-4547-a38b-0dbf9bdcf9ef tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21" status: 200 len: 1504 microversion: 2.1 time: 0.191496 Jun 05 08:25:03.055602 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 313/633] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:02 2022] GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21 => generated 1504 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:03.094404 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f3467c42-5af9-4c2d-a947-6b4c2edc9def tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:03.095264 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f3467c42-5af9-4c2d-a947-6b4c2edc9def tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 66aeb103-f664-4b53-921a-79ae7685365e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:03.101996 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f3467c42-5af9-4c2d-a947-6b4c2edc9def tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:03.102450 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f3467c42-5af9-4c2d-a947-6b4c2edc9def tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:03.103229 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f3467c42-5af9-4c2d-a947-6b4c2edc9def tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:03.103676 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f3467c42-5af9-4c2d-a947-6b4c2edc9def tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:03.194644 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b1e24f3e-9d44-47ff-a324-cffad7891f2a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:03.195478 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b1e24f3e-9d44-47ff-a324-cffad7891f2a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:03.202649 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b1e24f3e-9d44-47ff-a324-cffad7891f2a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:03.203305 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b1e24f3e-9d44-47ff-a324-cffad7891f2a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:03.204111 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b1e24f3e-9d44-47ff-a324-cffad7891f2a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:03.204548 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b1e24f3e-9d44-47ff-a324-cffad7891f2a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:03.255498 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b1e24f3e-9d44-47ff-a324-cffad7891f2a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:03.256148 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b1e24f3e-9d44-47ff-a324-cffad7891f2a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:03.256758 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-b1e24f3e-9d44-47ff-a324-cffad7891f2a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:03.257480 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f3467c42-5af9-4c2d-a947-6b4c2edc9def tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704cd9e8b0984139b58ec6abe3579576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8b37e66d354ce09c4bef01d28ef7a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:03.266922 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f3467c42-5af9-4c2d-a947-6b4c2edc9def tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e" status: 200 len: 1321 microversion: 2.1 time: 0.176882 Jun 05 08:25:03.267782 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 321/634] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:03 2022] GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:03.310835 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b1e24f3e-9d44-47ff-a324-cffad7891f2a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:03.321278 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b1e24f3e-9d44-47ff-a324-cffad7891f2a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.131432 Jun 05 08:25:03.321949 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 314/635] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:03 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:25:03.352280 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5c54d02f-5771-4c8d-9256-9b72236dd41a tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:03.352909 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5c54d02f-5771-4c8d-9256-9b72236dd41a tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] [instance: 3f551f85-c8f2-45d5-b5ac-20949558181c] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:03.360391 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5c54d02f-5771-4c8d-9256-9b72236dd41a tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:03.361214 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5c54d02f-5771-4c8d-9256-9b72236dd41a tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:03.362210 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5c54d02f-5771-4c8d-9256-9b72236dd41a tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:03.362899 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5c54d02f-5771-4c8d-9256-9b72236dd41a tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:03.389920 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:03.525095 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2cffdeea-47d1-4afb-bf96-4437d22fc48a tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:03.525860 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2cffdeea-47d1-4afb-bf96-4437d22fc48a tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] [instance: 34e2fe19-835a-4a68-a5ed-6570a7edcd2e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:03.532531 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2cffdeea-47d1-4afb-bf96-4437d22fc48a tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:03.533117 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2cffdeea-47d1-4afb-bf96-4437d22fc48a tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:03.535042 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2cffdeea-47d1-4afb-bf96-4437d22fc48a tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:03.535697 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2cffdeea-47d1-4afb-bf96-4437d22fc48a tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:03.663902 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5c54d02f-5771-4c8d-9256-9b72236dd41a tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8a11ed3f5412d8ad6783cbcd324d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3c05bd3e84382aa808d1361072433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:03.672863 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5c54d02f-5771-4c8d-9256-9b72236dd41a tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] 10.222.0.33 "GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c" status: 200 len: 1478 microversion: 2.1 time: 0.325262 Jun 05 08:25:03.673469 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 322/636] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:03 2022] GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c => generated 1478 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:03.802821 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2cffdeea-47d1-4afb-bf96-4437d22fc48a tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:03.813624 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2cffdeea-47d1-4afb-bf96-4437d22fc48a tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:03.816685 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2cffdeea-47d1-4afb-bf96-4437d22fc48a tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:03.818410 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2cffdeea-47d1-4afb-bf96-4437d22fc48a tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] 10.222.0.33 "GET /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e" status: 200 len: 1358 microversion: 2.21 time: 0.296679 Jun 05 08:25:03.824321 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 315/637] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:03 2022] GET /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e => generated 1358 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:25:03.879753 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d82b19cf-12b6-4c80-be67-ab96234a8aa9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:03.880322 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d82b19cf-12b6-4c80-be67-ab96234a8aa9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:03.887065 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d82b19cf-12b6-4c80-be67-ab96234a8aa9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:03.887740 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d82b19cf-12b6-4c80-be67-ab96234a8aa9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:03.888729 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d82b19cf-12b6-4c80-be67-ab96234a8aa9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:03.889172 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d82b19cf-12b6-4c80-be67-ab96234a8aa9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:03.937720 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0a6a86b6-8aab-428b-985f-5cc3306baacf tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:03.938694 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0a6a86b6-8aab-428b-985f-5cc3306baacf tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] [instance: 5c84911f-3880-4b7c-a589-fc39d158a22b] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:03.945986 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0a6a86b6-8aab-428b-985f-5cc3306baacf tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:03.946757 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0a6a86b6-8aab-428b-985f-5cc3306baacf tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:03.947799 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0a6a86b6-8aab-428b-985f-5cc3306baacf tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:03.948496 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0a6a86b6-8aab-428b-985f-5cc3306baacf tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:04.246939 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0a6a86b6-8aab-428b-985f-5cc3306baacf tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedf622071d04dada841a5b21a942e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcfc655897c48069119ef6b184c8d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:04.251459 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:04.268247 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d82b19cf-12b6-4c80-be67-ab96234a8aa9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:04.285648 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0a6a86b6-8aab-428b-985f-5cc3306baacf tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] 10.222.0.33 "GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b" status: 200 len: 1325 microversion: 2.1 time: 0.351696 Jun 05 08:25:04.288893 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 316/638] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:03 2022] GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b => generated 1325 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:04.297551 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-30a85275-92ee-4754-9961-c7e4004cc3d7 req-089e11a9-0f4e-4897-9524-e5b53cc7b393 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66aeb103-f664-4b53-921a-79ae7685365e", "tag": "69e0434d-65a6-4b9f-849b-02a37c0de9ac"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:04.303534 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d82b19cf-12b6-4c80-be67-ab96234a8aa9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:04.308569 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d82b19cf-12b6-4c80-be67-ab96234a8aa9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:04.309017 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-30a85275-92ee-4754-9961-c7e4004cc3d7 req-089e11a9-0f4e-4897-9524-e5b53cc7b393 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:04.309811 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-30a85275-92ee-4754-9961-c7e4004cc3d7 req-089e11a9-0f4e-4897-9524-e5b53cc7b393 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:04.315978 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d82b19cf-12b6-4c80-be67-ab96234a8aa9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 1568 microversion: 2.25 time: 0.441475 Jun 05 08:25:04.317142 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 323/639] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:03 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 1568 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:04.323269 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e11a5826-50e2-45bd-80db-a2167754c2fa tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:04.324321 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e11a5826-50e2-45bd-80db-a2167754c2fa tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:04.335121 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e11a5826-50e2-45bd-80db-a2167754c2fa tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:04.335977 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e11a5826-50e2-45bd-80db-a2167754c2fa tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:04.337032 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e11a5826-50e2-45bd-80db-a2167754c2fa tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:04.337830 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e11a5826-50e2-45bd-80db-a2167754c2fa tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:04.340195 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-30a85275-92ee-4754-9961-c7e4004cc3d7 req-089e11a9-0f4e-4897-9524-e5b53cc7b393 service nova] Creating event network-changed:69e0434d-65a6-4b9f-849b-02a37c0de9ac for instance 66aeb103-f664-4b53-921a-79ae7685365e on n-h1-844739-1 Jun 05 08:25:04.345096 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-30a85275-92ee-4754-9961-c7e4004cc3d7 req-089e11a9-0f4e-4897-9524-e5b53cc7b393 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054759 Jun 05 08:25:04.346565 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 317/640] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:04.352514 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-3bb9cc62-fa95-45c1-ad03-5468f7bc6221 req-f76779e1-13e4-44c9-9d3a-32757cc0d8f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f551f85-c8f2-45d5-b5ac-20949558181c", "name": "network-vif-deleted", "tag": "e2e5f4e6-8cf4-44b8-bb31-5fc701aaca63"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:04.362373 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-3bb9cc62-fa95-45c1-ad03-5468f7bc6221 req-f76779e1-13e4-44c9-9d3a-32757cc0d8f5 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:04.362826 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-3bb9cc62-fa95-45c1-ad03-5468f7bc6221 req-f76779e1-13e4-44c9-9d3a-32757cc0d8f5 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:04.375235 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-3bb9cc62-fa95-45c1-ad03-5468f7bc6221 req-f76779e1-13e4-44c9-9d3a-32757cc0d8f5 service nova] Creating event network-vif-deleted:e2e5f4e6-8cf4-44b8-bb31-5fc701aaca63 for instance 3f551f85-c8f2-45d5-b5ac-20949558181c on n-h2-844739-1 Jun 05 08:25:04.381243 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-3bb9cc62-fa95-45c1-ad03-5468f7bc6221 req-f76779e1-13e4-44c9-9d3a-32757cc0d8f5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033227 Jun 05 08:25:04.381773 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 318/641] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:04.386997 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-96724191-cbf7-4f6a-81b5-93a2706efedb tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:04.387832 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-96724191-cbf7-4f6a-81b5-93a2706efedb tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 66aeb103-f664-4b53-921a-79ae7685365e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:04.397519 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-96724191-cbf7-4f6a-81b5-93a2706efedb tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:04.397980 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-96724191-cbf7-4f6a-81b5-93a2706efedb tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:04.398823 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-96724191-cbf7-4f6a-81b5-93a2706efedb tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:04.399274 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-96724191-cbf7-4f6a-81b5-93a2706efedb tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:04.602992 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-96724191-cbf7-4f6a-81b5-93a2706efedb tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704cd9e8b0984139b58ec6abe3579576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8b37e66d354ce09c4bef01d28ef7a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:04.606777 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e11a5826-50e2-45bd-80db-a2167754c2fa tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:04.611221 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-96724191-cbf7-4f6a-81b5-93a2706efedb tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e" status: 200 len: 1321 microversion: 2.1 time: 0.228196 Jun 05 08:25:04.614101 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 319/642] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:04 2022] GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:04.623776 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e11a5826-50e2-45bd-80db-a2167754c2fa tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21" status: 200 len: 1504 microversion: 2.1 time: 0.304990 Jun 05 08:25:04.624697 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 324/643] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:04 2022] GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21 => generated 1504 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:04.637926 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7674e41b-1c80-4555-80a1-c088ddf6b487 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:04.638598 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7674e41b-1c80-4555-80a1-c088ddf6b487 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:04.645539 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7674e41b-1c80-4555-80a1-c088ddf6b487 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:04.646153 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7674e41b-1c80-4555-80a1-c088ddf6b487 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:04.647069 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7674e41b-1c80-4555-80a1-c088ddf6b487 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:04.647616 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7674e41b-1c80-4555-80a1-c088ddf6b487 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:04.683078 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7674e41b-1c80-4555-80a1-c088ddf6b487 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:04.683078 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7674e41b-1c80-4555-80a1-c088ddf6b487 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:04.683078 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-7674e41b-1c80-4555-80a1-c088ddf6b487 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:04.699156 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-35ff6aaf-aac8-4405-bee9-eb1e1fa3de60 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:04.701431 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-35ff6aaf-aac8-4405-bee9-eb1e1fa3de60 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] [instance: 3f551f85-c8f2-45d5-b5ac-20949558181c] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:04.715151 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-35ff6aaf-aac8-4405-bee9-eb1e1fa3de60 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:04.715678 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-35ff6aaf-aac8-4405-bee9-eb1e1fa3de60 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:04.717300 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-35ff6aaf-aac8-4405-bee9-eb1e1fa3de60 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:04.717789 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-35ff6aaf-aac8-4405-bee9-eb1e1fa3de60 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:04.762711 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7674e41b-1c80-4555-80a1-c088ddf6b487 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:04.762952 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-35ff6aaf-aac8-4405-bee9-eb1e1fa3de60 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:04.763902 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-35ff6aaf-aac8-4405-bee9-eb1e1fa3de60 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:04.764579 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-35ff6aaf-aac8-4405-bee9-eb1e1fa3de60 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Lazy-loading 'fault' on Instance uuid 3f551f85-c8f2-45d5-b5ac-20949558181c {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:04.772711 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7674e41b-1c80-4555-80a1-c088ddf6b487 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.147728 Jun 05 08:25:04.782152 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 320/644] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:04 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:04.817717 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-35ff6aaf-aac8-4405-bee9-eb1e1fa3de60 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b8a11ed3f5412d8ad6783cbcd324d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c3c05bd3e84382aa808d1361072433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:04.825667 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-35ff6aaf-aac8-4405-bee9-eb1e1fa3de60 tempest-ServerDiagnosticsNegativeTest-270383782 tempest-ServerDiagnosticsNegativeTest-270383782-project] 10.222.0.33 "GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c" status: 200 len: 1367 microversion: 2.1 time: 0.138824 Jun 05 08:25:04.826549 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 325/645] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:04 2022] GET /compute/v2.1/servers/3f551f85-c8f2-45d5-b5ac-20949558181c => generated 1367 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:04.843626 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b81a9d45-041e-47ba-a400-0354dab9cdc1 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:04.844483 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b81a9d45-041e-47ba-a400-0354dab9cdc1 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] [instance: 34e2fe19-835a-4a68-a5ed-6570a7edcd2e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:04.853839 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b81a9d45-041e-47ba-a400-0354dab9cdc1 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:04.854547 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b81a9d45-041e-47ba-a400-0354dab9cdc1 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:04.856506 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b81a9d45-041e-47ba-a400-0354dab9cdc1 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:04.860170 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b81a9d45-041e-47ba-a400-0354dab9cdc1 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:05.052925 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b81a9d45-041e-47ba-a400-0354dab9cdc1 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:05.065329 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b81a9d45-041e-47ba-a400-0354dab9cdc1 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:05.071566 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b81a9d45-041e-47ba-a400-0354dab9cdc1 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:05.072959 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b81a9d45-041e-47ba-a400-0354dab9cdc1 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] 10.222.0.33 "GET /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e" status: 200 len: 1358 microversion: 2.21 time: 0.238514 Jun 05 08:25:05.076559 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 321/646] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:04 2022] GET /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:05.091215 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-a993d658-54ac-454b-a953-a8735391ede8 req-eab388bf-f58c-4ff9-bb10-10c618abc979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34e2fe19-835a-4a68-a5ed-6570a7edcd2e", "name": "network-vif-plugged", "status": "completed", "tag": "f473c9c3-61a3-448f-b7f2-edc957d4d62a"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:05.101497 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-a993d658-54ac-454b-a953-a8735391ede8 req-eab388bf-f58c-4ff9-bb10-10c618abc979 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:05.102271 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-a993d658-54ac-454b-a953-a8735391ede8 req-eab388bf-f58c-4ff9-bb10-10c618abc979 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:05.116280 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-a993d658-54ac-454b-a953-a8735391ede8 req-eab388bf-f58c-4ff9-bb10-10c618abc979 service nova] Creating event network-vif-plugged:f473c9c3-61a3-448f-b7f2-edc957d4d62a for instance 34e2fe19-835a-4a68-a5ed-6570a7edcd2e on n-h2-844739-1 Jun 05 08:25:05.127871 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-a993d658-54ac-454b-a953-a8735391ede8 req-eab388bf-f58c-4ff9-bb10-10c618abc979 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051392 Jun 05 08:25:05.129684 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 326/647] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:05.304116 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-979cdf0c-d95e-4294-a1a6-3a235a3ff66c tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:05.305276 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-979cdf0c-d95e-4294-a1a6-3a235a3ff66c tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] [instance: 5c84911f-3880-4b7c-a589-fc39d158a22b] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:05.312024 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-979cdf0c-d95e-4294-a1a6-3a235a3ff66c tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:05.312537 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-979cdf0c-d95e-4294-a1a6-3a235a3ff66c tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:05.313326 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-979cdf0c-d95e-4294-a1a6-3a235a3ff66c tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:05.313798 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-979cdf0c-d95e-4294-a1a6-3a235a3ff66c tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:05.335430 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c902bb3c-bd63-4444-815b-451d745936c4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:05.336285 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c902bb3c-bd63-4444-815b-451d745936c4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:05.342816 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c902bb3c-bd63-4444-815b-451d745936c4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:05.343366 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c902bb3c-bd63-4444-815b-451d745936c4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:05.344321 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c902bb3c-bd63-4444-815b-451d745936c4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:05.344854 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c902bb3c-bd63-4444-815b-451d745936c4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:05.525288 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-979cdf0c-d95e-4294-a1a6-3a235a3ff66c tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedf622071d04dada841a5b21a942e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcfc655897c48069119ef6b184c8d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:05.537492 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-979cdf0c-d95e-4294-a1a6-3a235a3ff66c tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] 10.222.0.33 "GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b" status: 200 len: 1325 microversion: 2.1 time: 0.238517 Jun 05 08:25:05.538299 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 322/648] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:05 2022] GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b => generated 1325 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:05.552717 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c902bb3c-bd63-4444-815b-451d745936c4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:05.561268 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c902bb3c-bd63-4444-815b-451d745936c4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:05.562798 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c902bb3c-bd63-4444-815b-451d745936c4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:05.563972 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c902bb3c-bd63-4444-815b-451d745936c4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 1568 microversion: 2.25 time: 0.232925 Jun 05 08:25:05.564614 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 327/649] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:05 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 1568 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:25:05.629290 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a907bebd-1e6b-4479-bfe2-e129f1de1928 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:05.629904 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a907bebd-1e6b-4479-bfe2-e129f1de1928 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 66aeb103-f664-4b53-921a-79ae7685365e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:05.636142 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a907bebd-1e6b-4479-bfe2-e129f1de1928 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:05.636599 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a907bebd-1e6b-4479-bfe2-e129f1de1928 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:05.637417 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a907bebd-1e6b-4479-bfe2-e129f1de1928 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:05.637862 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a907bebd-1e6b-4479-bfe2-e129f1de1928 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:05.640720 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d503838e-467c-4368-89b1-ffc45da14d48 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:05.641346 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d503838e-467c-4368-89b1-ffc45da14d48 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:05.647765 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d503838e-467c-4368-89b1-ffc45da14d48 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:05.648341 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d503838e-467c-4368-89b1-ffc45da14d48 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:05.649466 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d503838e-467c-4368-89b1-ffc45da14d48 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:05.649977 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d503838e-467c-4368-89b1-ffc45da14d48 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:05.849028 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a907bebd-1e6b-4479-bfe2-e129f1de1928 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704cd9e8b0984139b58ec6abe3579576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8b37e66d354ce09c4bef01d28ef7a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:05.851394 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d503838e-467c-4368-89b1-ffc45da14d48 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:05.857982 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a907bebd-1e6b-4479-bfe2-e129f1de1928 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e" status: 200 len: 1321 microversion: 2.1 time: 0.232270 Jun 05 08:25:05.858967 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 323/650] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:05 2022] GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:05.860528 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d503838e-467c-4368-89b1-ffc45da14d48 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21" status: 200 len: 1504 microversion: 2.1 time: 0.223509 Jun 05 08:25:05.861107 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 328/651] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:05 2022] GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21 => generated 1504 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:05.864889 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-581d6785-659e-4512-ad04-1e23e91b2714 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:05.865553 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-581d6785-659e-4512-ad04-1e23e91b2714 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:05.871445 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-581d6785-659e-4512-ad04-1e23e91b2714 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:05.871889 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-581d6785-659e-4512-ad04-1e23e91b2714 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:05.872809 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-581d6785-659e-4512-ad04-1e23e91b2714 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:05.873245 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-581d6785-659e-4512-ad04-1e23e91b2714 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:05.906674 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-581d6785-659e-4512-ad04-1e23e91b2714 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:05.907130 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-581d6785-659e-4512-ad04-1e23e91b2714 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:05.907587 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-581d6785-659e-4512-ad04-1e23e91b2714 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:05.951323 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-581d6785-659e-4512-ad04-1e23e91b2714 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:05.958924 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-581d6785-659e-4512-ad04-1e23e91b2714 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.098935 Jun 05 08:25:05.959492 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 324/652] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:05 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:06.095302 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0cc7e044-16ce-4663-86d9-8aa7c1035c8d tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:06.096596 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0cc7e044-16ce-4663-86d9-8aa7c1035c8d tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] [instance: 34e2fe19-835a-4a68-a5ed-6570a7edcd2e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:06.102948 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0cc7e044-16ce-4663-86d9-8aa7c1035c8d tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:06.103418 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0cc7e044-16ce-4663-86d9-8aa7c1035c8d tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:06.104259 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0cc7e044-16ce-4663-86d9-8aa7c1035c8d tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:06.104710 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0cc7e044-16ce-4663-86d9-8aa7c1035c8d tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:06.253939 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0cc7e044-16ce-4663-86d9-8aa7c1035c8d tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:06.262876 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0cc7e044-16ce-4663-86d9-8aa7c1035c8d tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:06.264492 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0cc7e044-16ce-4663-86d9-8aa7c1035c8d tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:06.265555 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0cc7e044-16ce-4663-86d9-8aa7c1035c8d tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] 10.222.0.33 "GET /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e" status: 200 len: 1358 microversion: 2.21 time: 0.174776 Jun 05 08:25:06.266107 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 329/653] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:06 2022] GET /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:06.554497 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d4338a77-692a-4cdf-8d4e-9e7cc7dd871e tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:06.555112 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d4338a77-692a-4cdf-8d4e-9e7cc7dd871e tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] [instance: 5c84911f-3880-4b7c-a589-fc39d158a22b] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:06.562720 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d4338a77-692a-4cdf-8d4e-9e7cc7dd871e tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:06.563348 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d4338a77-692a-4cdf-8d4e-9e7cc7dd871e tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:06.564329 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d4338a77-692a-4cdf-8d4e-9e7cc7dd871e tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:06.565035 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d4338a77-692a-4cdf-8d4e-9e7cc7dd871e tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:06.582822 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-07a4a6c5-66b8-4623-b919-5917e6f56ba6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:06.583593 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-07a4a6c5-66b8-4623-b919-5917e6f56ba6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:06.595198 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-07a4a6c5-66b8-4623-b919-5917e6f56ba6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:06.596278 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-07a4a6c5-66b8-4623-b919-5917e6f56ba6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:06.597258 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-07a4a6c5-66b8-4623-b919-5917e6f56ba6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:06.598028 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-07a4a6c5-66b8-4623-b919-5917e6f56ba6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:06.820224 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d4338a77-692a-4cdf-8d4e-9e7cc7dd871e tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedf622071d04dada841a5b21a942e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcfc655897c48069119ef6b184c8d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:06.823691 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-07a4a6c5-66b8-4623-b919-5917e6f56ba6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:06.830288 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d4338a77-692a-4cdf-8d4e-9e7cc7dd871e tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] 10.222.0.33 "GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b" status: 200 len: 1325 microversion: 2.1 time: 0.279436 Jun 05 08:25:06.830879 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 325/654] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:06 2022] GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b => generated 1325 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:06.832113 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-07a4a6c5-66b8-4623-b919-5917e6f56ba6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:06.833872 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-07a4a6c5-66b8-4623-b919-5917e6f56ba6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:06.835283 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-07a4a6c5-66b8-4623-b919-5917e6f56ba6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 1568 microversion: 2.25 time: 0.257134 Jun 05 08:25:06.835823 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 330/655] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:06 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 1568 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:06.875718 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bc379eba-fe58-48d6-9c15-bfb7cd92801c tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:06.876708 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-bc379eba-fe58-48d6-9c15-bfb7cd92801c tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 66aeb103-f664-4b53-921a-79ae7685365e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:06.877520 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a3363113-a0ba-42a6-a02e-e75eebee5f50 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:06.878515 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a3363113-a0ba-42a6-a02e-e75eebee5f50 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:06.884757 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bc379eba-fe58-48d6-9c15-bfb7cd92801c tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:06.885524 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bc379eba-fe58-48d6-9c15-bfb7cd92801c tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:06.886511 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a3363113-a0ba-42a6-a02e-e75eebee5f50 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:06.886797 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bc379eba-fe58-48d6-9c15-bfb7cd92801c tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:06.886965 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a3363113-a0ba-42a6-a02e-e75eebee5f50 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:06.887521 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bc379eba-fe58-48d6-9c15-bfb7cd92801c tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:06.887747 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a3363113-a0ba-42a6-a02e-e75eebee5f50 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:06.888214 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a3363113-a0ba-42a6-a02e-e75eebee5f50 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:07.279762 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a3363113-a0ba-42a6-a02e-e75eebee5f50 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:07.292969 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a3363113-a0ba-42a6-a02e-e75eebee5f50 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21" status: 200 len: 1504 microversion: 2.1 time: 0.419342 Jun 05 08:25:07.294226 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 331/656] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:06 2022] GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21 => generated 1504 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:25:07.300438 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-814bd601-0de0-43f5-aeb3-d57de6624086 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:07.301669 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-814bd601-0de0-43f5-aeb3-d57de6624086 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:07.309970 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-814bd601-0de0-43f5-aeb3-d57de6624086 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:07.311138 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-814bd601-0de0-43f5-aeb3-d57de6624086 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:07.312512 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-814bd601-0de0-43f5-aeb3-d57de6624086 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:07.313065 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-814bd601-0de0-43f5-aeb3-d57de6624086 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:07.358247 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-814bd601-0de0-43f5-aeb3-d57de6624086 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:07.358960 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-814bd601-0de0-43f5-aeb3-d57de6624086 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:07.359807 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-814bd601-0de0-43f5-aeb3-d57de6624086 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:07.390212 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-bc379eba-fe58-48d6-9c15-bfb7cd92801c tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704cd9e8b0984139b58ec6abe3579576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8b37e66d354ce09c4bef01d28ef7a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:07.399731 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bc379eba-fe58-48d6-9c15-bfb7cd92801c tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e" status: 200 len: 1321 microversion: 2.1 time: 0.527864 Jun 05 08:25:07.401115 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 326/657] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:06 2022] GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e => generated 1321 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:07.406624 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-910601a3-4872-4380-8ede-5cc144ea9df5 req-4ea6fefe-9630-439c-9eed-860d579f5099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c84911f-3880-4b7c-a589-fc39d158a22b", "name": "network-vif-plugged", "status": "completed", "tag": "b21e549c-cb08-4577-9af4-80b6c7cb43fb"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:07.420348 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-814bd601-0de0-43f5-aeb3-d57de6624086 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:07.424118 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-910601a3-4872-4380-8ede-5cc144ea9df5 req-4ea6fefe-9630-439c-9eed-860d579f5099 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:07.427325 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-910601a3-4872-4380-8ede-5cc144ea9df5 req-4ea6fefe-9630-439c-9eed-860d579f5099 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:07.429710 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-814bd601-0de0-43f5-aeb3-d57de6624086 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.134179 Jun 05 08:25:07.432594 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 332/658] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:07 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:07.445480 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8cd3b799-8d1e-4796-9805-43c00c24bfa7 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:07.448741 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8cd3b799-8d1e-4796-9805-43c00c24bfa7 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] [instance: 34e2fe19-835a-4a68-a5ed-6570a7edcd2e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:07.455241 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-910601a3-4872-4380-8ede-5cc144ea9df5 req-4ea6fefe-9630-439c-9eed-860d579f5099 service nova] Creating event network-vif-plugged:b21e549c-cb08-4577-9af4-80b6c7cb43fb for instance 5c84911f-3880-4b7c-a589-fc39d158a22b on n-h2-844739-1 Jun 05 08:25:07.460263 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8cd3b799-8d1e-4796-9805-43c00c24bfa7 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:07.463314 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8cd3b799-8d1e-4796-9805-43c00c24bfa7 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:07.464321 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8cd3b799-8d1e-4796-9805-43c00c24bfa7 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:07.465823 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8cd3b799-8d1e-4796-9805-43c00c24bfa7 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:07.467627 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-910601a3-4872-4380-8ede-5cc144ea9df5 req-4ea6fefe-9630-439c-9eed-860d579f5099 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064991 Jun 05 08:25:07.468672 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 327/659] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:07.688748 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8cd3b799-8d1e-4796-9805-43c00c24bfa7 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:07.697238 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8cd3b799-8d1e-4796-9805-43c00c24bfa7 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:07.698767 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8cd3b799-8d1e-4796-9805-43c00c24bfa7 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:07.699946 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8cd3b799-8d1e-4796-9805-43c00c24bfa7 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] 10.222.0.33 "GET /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e" status: 200 len: 1551 microversion: 2.21 time: 0.265400 Jun 05 08:25:07.708783 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 333/660] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:07 2022] GET /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e => generated 1551 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:07.719710 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9fdb63c8-2980-406a-a3bc-cb715b844c75 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:07.720542 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9fdb63c8-2980-406a-a3bc-cb715b844c75 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] [instance: 34e2fe19-835a-4a68-a5ed-6570a7edcd2e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:07.726677 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9fdb63c8-2980-406a-a3bc-cb715b844c75 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:07.727125 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9fdb63c8-2980-406a-a3bc-cb715b844c75 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:07.727889 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9fdb63c8-2980-406a-a3bc-cb715b844c75 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:07.728352 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9fdb63c8-2980-406a-a3bc-cb715b844c75 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:07.753998 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9fdb63c8-2980-406a-a3bc-cb715b844c75 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] [instance: 34e2fe19-835a-4a68-a5ed-6570a7edcd2e] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:25:07.842567 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9fdb63c8-2980-406a-a3bc-cb715b844c75 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] 10.222.0.33 "DELETE /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e" status: 204 len: 0 microversion: 2.21 time: 0.126738 Jun 05 08:25:07.848111 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 328/661] 10.222.0.33 () {60 vars in 1279 bytes} [Sun Jun 5 08:25:07 2022] DELETE /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:25:07.850331 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-568011b0-ca01-462d-a313-4460d001192d tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:07.851089 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-568011b0-ca01-462d-a313-4460d001192d tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] [instance: 5c84911f-3880-4b7c-a589-fc39d158a22b] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:07.858149 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-568011b0-ca01-462d-a313-4460d001192d tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:07.858735 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-568011b0-ca01-462d-a313-4460d001192d tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:07.859741 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-568011b0-ca01-462d-a313-4460d001192d tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:07.860221 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-568011b0-ca01-462d-a313-4460d001192d tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:07.876015 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cf1563ad-ffe7-474d-8f32-90873c0714b8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-551342247", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:07.931112 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-cf1563ad-ffe7-474d-8f32-90873c0714b8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] validate_networks() for None {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:25:08.093284 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-568011b0-ca01-462d-a313-4460d001192d tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedf622071d04dada841a5b21a942e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcfc655897c48069119ef6b184c8d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:08.100941 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-568011b0-ca01-462d-a313-4460d001192d tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] 10.222.0.33 "GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b" status: 200 len: 1325 microversion: 2.1 time: 0.256058 Jun 05 08:25:08.101505 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 329/662] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:07 2022] GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b => generated 1325 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:08.108848 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-545cfd04-c831-4259-aa00-46891a7b0b58 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:08.109506 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-545cfd04-c831-4259-aa00-46891a7b0b58 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:08.116193 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-545cfd04-c831-4259-aa00-46891a7b0b58 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:08.116667 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-545cfd04-c831-4259-aa00-46891a7b0b58 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:08.117431 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-545cfd04-c831-4259-aa00-46891a7b0b58 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:08.117863 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-545cfd04-c831-4259-aa00-46891a7b0b58 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:08.180378 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-cf1563ad-ffe7-474d-8f32-90873c0714b8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:25:08.180803 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-cf1563ad-ffe7-474d-8f32-90873c0714b8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:25:08.181311 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-cf1563ad-ffe7-474d-8f32-90873c0714b8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:25:08.181718 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-cf1563ad-ffe7-474d-8f32-90873c0714b8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:25:08.182128 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-cf1563ad-ffe7-474d-8f32-90873c0714b8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:25:08.190865 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cf1563ad-ffe7-474d-8f32-90873c0714b8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:08.191318 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cf1563ad-ffe7-474d-8f32-90873c0714b8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:08.192153 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cf1563ad-ffe7-474d-8f32-90873c0714b8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:08.192587 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cf1563ad-ffe7-474d-8f32-90873c0714b8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:08.208955 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-cf1563ad-ffe7-474d-8f32-90873c0714b8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for project 5241947581244d30ba1528e6d5fad743. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:25:08.213546 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-cf1563ad-ffe7-474d-8f32-90873c0714b8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for user 27beb829232e464092b06d904b9d6ec0 and project 5241947581244d30ba1528e6d5fad743. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:25:08.226335 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-cf1563ad-ffe7-474d-8f32-90873c0714b8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:25:08.228697 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-cf1563ad-ffe7-474d-8f32-90873c0714b8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 8719f86c-4f4f-4c65-b580-c5d526d05175] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:25:08.266256 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-545cfd04-c831-4259-aa00-46891a7b0b58 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:08.273689 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-cf1563ad-ffe7-474d-8f32-90873c0714b8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529820 Jun 05 08:25:08.274346 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 334/663] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:25:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:25:08.279594 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-545cfd04-c831-4259-aa00-46891a7b0b58 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:08.279900 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2790490f-e487-4d7c-9e5a-76c3ad9e598c tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:08.280718 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2790490f-e487-4d7c-9e5a-76c3ad9e598c tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] [instance: 34e2fe19-835a-4a68-a5ed-6570a7edcd2e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:08.281309 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-545cfd04-c831-4259-aa00-46891a7b0b58 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:08.282653 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-545cfd04-c831-4259-aa00-46891a7b0b58 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 1568 microversion: 2.25 time: 0.180219 Jun 05 08:25:08.283770 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 330/664] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:08 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:08.288628 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2790490f-e487-4d7c-9e5a-76c3ad9e598c tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:08.289294 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2790490f-e487-4d7c-9e5a-76c3ad9e598c tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:08.290230 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2790490f-e487-4d7c-9e5a-76c3ad9e598c tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:08.290846 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2790490f-e487-4d7c-9e5a-76c3ad9e598c tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:08.298102 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-45e435fb-874d-4361-b409-5286e59677d4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:08.299335 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-45e435fb-874d-4361-b409-5286e59677d4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 8719f86c-4f4f-4c65-b580-c5d526d05175] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:08.369644 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-45e435fb-874d-4361-b409-5286e59677d4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:08.376326 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-45e435fb-874d-4361-b409-5286e59677d4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175" status: 200 len: 1216 microversion: 2.1 time: 0.081879 Jun 05 08:25:08.377001 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 331/665] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:08 2022] GET /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175 => generated 1216 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:08.381492 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-dc1ef177-c42b-42f8-9e83-a27120ac7ead tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:08.382091 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-dc1ef177-c42b-42f8-9e83-a27120ac7ead tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:08.387970 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc1ef177-c42b-42f8-9e83-a27120ac7ead tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:08.389127 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc1ef177-c42b-42f8-9e83-a27120ac7ead tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:08.389343 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc1ef177-c42b-42f8-9e83-a27120ac7ead tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:08.389757 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc1ef177-c42b-42f8-9e83-a27120ac7ead tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:08.506968 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2790490f-e487-4d7c-9e5a-76c3ad9e598c tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:08.515779 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2790490f-e487-4d7c-9e5a-76c3ad9e598c tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:08.518030 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2790490f-e487-4d7c-9e5a-76c3ad9e598c tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:08.519950 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2790490f-e487-4d7c-9e5a-76c3ad9e598c tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] 10.222.0.33 "GET /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e" status: 200 len: 1557 microversion: 2.21 time: 0.244216 Jun 05 08:25:08.521362 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 335/666] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:08 2022] GET /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e => generated 1557 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:08.526134 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f8a2a62d-f511-4942-a51f-a8aaf714d807 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:08.526993 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f8a2a62d-f511-4942-a51f-a8aaf714d807 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 66aeb103-f664-4b53-921a-79ae7685365e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:08.534198 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f8a2a62d-f511-4942-a51f-a8aaf714d807 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:08.534931 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f8a2a62d-f511-4942-a51f-a8aaf714d807 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:08.535878 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f8a2a62d-f511-4942-a51f-a8aaf714d807 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:08.536535 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f8a2a62d-f511-4942-a51f-a8aaf714d807 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:08.558710 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-dc1ef177-c42b-42f8-9e83-a27120ac7ead tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:08.567796 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-dc1ef177-c42b-42f8-9e83-a27120ac7ead tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21" status: 200 len: 1504 microversion: 2.1 time: 0.189773 Jun 05 08:25:08.568418 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 332/667] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:08 2022] GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21 => generated 1504 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:08.582964 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0d89adbb-7a99-43db-ae38-a3b2b76e415e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:08.583578 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0d89adbb-7a99-43db-ae38-a3b2b76e415e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:08.589729 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0d89adbb-7a99-43db-ae38-a3b2b76e415e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:08.590248 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0d89adbb-7a99-43db-ae38-a3b2b76e415e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:08.591085 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0d89adbb-7a99-43db-ae38-a3b2b76e415e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:08.591743 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0d89adbb-7a99-43db-ae38-a3b2b76e415e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:08.633563 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0d89adbb-7a99-43db-ae38-a3b2b76e415e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:08.634017 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0d89adbb-7a99-43db-ae38-a3b2b76e415e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:08.634476 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-0d89adbb-7a99-43db-ae38-a3b2b76e415e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:08.683852 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0d89adbb-7a99-43db-ae38-a3b2b76e415e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:08.686198 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:08.696419 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0d89adbb-7a99-43db-ae38-a3b2b76e415e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.117919 Jun 05 08:25:08.705856 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 333/668] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:08 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:08.712716 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f8a2a62d-f511-4942-a51f-a8aaf714d807 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704cd9e8b0984139b58ec6abe3579576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8b37e66d354ce09c4bef01d28ef7a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:08.721319 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f8a2a62d-f511-4942-a51f-a8aaf714d807 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e" status: 200 len: 1321 microversion: 2.1 time: 0.198034 Jun 05 08:25:08.721945 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 336/669] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:08 2022] GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:09.117727 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e826d1bd-26e3-4f57-ab59-355b3b2caf90 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:09.118287 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e826d1bd-26e3-4f57-ab59-355b3b2caf90 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] [instance: 5c84911f-3880-4b7c-a589-fc39d158a22b] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:09.125731 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e826d1bd-26e3-4f57-ab59-355b3b2caf90 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:09.126175 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e826d1bd-26e3-4f57-ab59-355b3b2caf90 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:09.127455 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e826d1bd-26e3-4f57-ab59-355b3b2caf90 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:09.128204 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e826d1bd-26e3-4f57-ab59-355b3b2caf90 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:09.260638 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e826d1bd-26e3-4f57-ab59-355b3b2caf90 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedf622071d04dada841a5b21a942e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcfc655897c48069119ef6b184c8d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:09.268879 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e826d1bd-26e3-4f57-ab59-355b3b2caf90 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] 10.222.0.33 "GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b" status: 200 len: 1325 microversion: 2.1 time: 0.155538 Jun 05 08:25:09.269445 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 334/670] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:09 2022] GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b => generated 1325 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:09.301536 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-219ea6b5-8b29-4a45-b83d-1fa85443e992 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:09.302292 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-219ea6b5-8b29-4a45-b83d-1fa85443e992 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:09.308924 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-219ea6b5-8b29-4a45-b83d-1fa85443e992 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:09.309619 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-219ea6b5-8b29-4a45-b83d-1fa85443e992 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:09.310567 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-219ea6b5-8b29-4a45-b83d-1fa85443e992 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:09.311167 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-219ea6b5-8b29-4a45-b83d-1fa85443e992 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:09.394214 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2c0186f4-2ced-42bd-8aeb-33156f37140c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:09.394840 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2c0186f4-2ced-42bd-8aeb-33156f37140c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 8719f86c-4f4f-4c65-b580-c5d526d05175] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:09.407829 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2c0186f4-2ced-42bd-8aeb-33156f37140c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:09.410274 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2c0186f4-2ced-42bd-8aeb-33156f37140c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:09.412252 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2c0186f4-2ced-42bd-8aeb-33156f37140c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:09.415707 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2c0186f4-2ced-42bd-8aeb-33156f37140c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:09.763876 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2c0186f4-2ced-42bd-8aeb-33156f37140c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:09.773250 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2c0186f4-2ced-42bd-8aeb-33156f37140c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175" status: 200 len: 1286 microversion: 2.1 time: 0.383774 Jun 05 08:25:09.774843 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 335/671] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:09 2022] GET /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175 => generated 1286 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:25:09.780710 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4ab2ebc3-f57f-4c37-ab19-7b0995305132 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:09.781864 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4ab2ebc3-f57f-4c37-ab19-7b0995305132 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] [instance: 34e2fe19-835a-4a68-a5ed-6570a7edcd2e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:09.794273 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4ab2ebc3-f57f-4c37-ab19-7b0995305132 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:09.795890 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4ab2ebc3-f57f-4c37-ab19-7b0995305132 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:09.797779 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4ab2ebc3-f57f-4c37-ab19-7b0995305132 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:09.799798 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4ab2ebc3-f57f-4c37-ab19-7b0995305132 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:09.935625 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-219ea6b5-8b29-4a45-b83d-1fa85443e992 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:09.945060 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-219ea6b5-8b29-4a45-b83d-1fa85443e992 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:09.947067 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-219ea6b5-8b29-4a45-b83d-1fa85443e992 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:09.948723 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-219ea6b5-8b29-4a45-b83d-1fa85443e992 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 1568 microversion: 2.25 time: 0.651541 Jun 05 08:25:09.960186 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 337/672] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:09 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 1568 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:09.966348 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-78a8c5e0-f573-4b9c-9f93-3a76d6cba867 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:09.967245 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-78a8c5e0-f573-4b9c-9f93-3a76d6cba867 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:09.975405 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-78a8c5e0-f573-4b9c-9f93-3a76d6cba867 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:09.976125 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-78a8c5e0-f573-4b9c-9f93-3a76d6cba867 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:09.977127 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-78a8c5e0-f573-4b9c-9f93-3a76d6cba867 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:09.977795 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-78a8c5e0-f573-4b9c-9f93-3a76d6cba867 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:10.073114 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=7 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:10.245869 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4ab2ebc3-f57f-4c37-ab19-7b0995305132 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:10.256147 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4ab2ebc3-f57f-4c37-ab19-7b0995305132 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:10.257980 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4ab2ebc3-f57f-4c37-ab19-7b0995305132 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:10.260662 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4ab2ebc3-f57f-4c37-ab19-7b0995305132 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] 10.222.0.33 "GET /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e" status: 200 len: 1557 microversion: 2.21 time: 0.484216 Jun 05 08:25:10.261785 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 336/673] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:09 2022] GET /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e => generated 1557 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:10.266120 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-78a8c5e0-f573-4b9c-9f93-3a76d6cba867 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:10.276660 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e4e79eb4-1f54-4762-bf6b-208e9dbacd1c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:10.277531 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e4e79eb4-1f54-4762-bf6b-208e9dbacd1c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:10.280947 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-78a8c5e0-f573-4b9c-9f93-3a76d6cba867 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21" status: 200 len: 1479 microversion: 2.1 time: 0.315497 Jun 05 08:25:10.281753 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 338/674] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:09 2022] GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21 => generated 1479 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:10.297109 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f0ebcf63-55f2-45ae-8f2c-f5a04938ca57 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:10.297734 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f0ebcf63-55f2-45ae-8f2c-f5a04938ca57 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 66aeb103-f664-4b53-921a-79ae7685365e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:10.299783 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e4e79eb4-1f54-4762-bf6b-208e9dbacd1c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:10.300277 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e4e79eb4-1f54-4762-bf6b-208e9dbacd1c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:10.301069 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e4e79eb4-1f54-4762-bf6b-208e9dbacd1c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:10.301514 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e4e79eb4-1f54-4762-bf6b-208e9dbacd1c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:10.331124 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f0ebcf63-55f2-45ae-8f2c-f5a04938ca57 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:10.334701 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f0ebcf63-55f2-45ae-8f2c-f5a04938ca57 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:10.336972 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f0ebcf63-55f2-45ae-8f2c-f5a04938ca57 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:10.337756 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f0ebcf63-55f2-45ae-8f2c-f5a04938ca57 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:10.381577 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e4e79eb4-1f54-4762-bf6b-208e9dbacd1c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:10.386084 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e4e79eb4-1f54-4762-bf6b-208e9dbacd1c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:10.387303 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-e4e79eb4-1f54-4762-bf6b-208e9dbacd1c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:10.528822 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e4e79eb4-1f54-4762-bf6b-208e9dbacd1c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:10.537974 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e4e79eb4-1f54-4762-bf6b-208e9dbacd1c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.274976 Jun 05 08:25:10.539553 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 337/675] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:10 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:10.544768 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-db6184ce-cdc6-406b-836a-dbb81fa20275 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:10.550550 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-db6184ce-cdc6-406b-836a-dbb81fa20275 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] [instance: 5c84911f-3880-4b7c-a589-fc39d158a22b] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:10.573089 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-db6184ce-cdc6-406b-836a-dbb81fa20275 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:10.574129 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-db6184ce-cdc6-406b-836a-dbb81fa20275 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:10.575248 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-db6184ce-cdc6-406b-836a-dbb81fa20275 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:10.575904 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-db6184ce-cdc6-406b-836a-dbb81fa20275 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:10.829225 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f0ebcf63-55f2-45ae-8f2c-f5a04938ca57 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704cd9e8b0984139b58ec6abe3579576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8b37e66d354ce09c4bef01d28ef7a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:10.835529 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=100 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:10.837986 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f0ebcf63-55f2-45ae-8f2c-f5a04938ca57 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e" status: 200 len: 1321 microversion: 2.1 time: 0.554967 Jun 05 08:25:10.845304 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 339/676] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:10 2022] GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e => generated 1321 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:10.850729 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-10a3c533-4e85-4059-8fb3-fcbd487c43fc tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Calling method '.version_select at 0x7f2433d20670>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:10.859177 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10a3c533-4e85-4059-8fb3-fcbd487c43fc tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:10.863252 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10a3c533-4e85-4059-8fb3-fcbd487c43fc tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:10.900380 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-10a3c533-4e85-4059-8fb3-fcbd487c43fc tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 1165 microversion: 2.1 time: 0.051747 Jun 05 08:25:10.906010 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 340/677] 10.222.0.33 () {58 vars in 1142 bytes} [Sun Jun 5 08:25:10 2022] GET /compute/v2.1/os-migrations => generated 1165 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:10.918995 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1198cb52-5530-44ce-bf2c-15a03ef4366c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:10.920502 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1198cb52-5530-44ce-bf2c-15a03ef4366c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 8719f86c-4f4f-4c65-b580-c5d526d05175] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:10.938129 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1198cb52-5530-44ce-bf2c-15a03ef4366c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:10.940548 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1198cb52-5530-44ce-bf2c-15a03ef4366c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:10.941524 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1198cb52-5530-44ce-bf2c-15a03ef4366c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:10.942107 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1198cb52-5530-44ce-bf2c-15a03ef4366c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:10.961097 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-db6184ce-cdc6-406b-836a-dbb81fa20275 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedf622071d04dada841a5b21a942e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcfc655897c48069119ef6b184c8d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:10.970454 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-db6184ce-cdc6-406b-836a-dbb81fa20275 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] 10.222.0.33 "GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b" status: 200 len: 1521 microversion: 2.1 time: 0.429282 Jun 05 08:25:10.971358 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 338/678] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:10 2022] GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b => generated 1521 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:10.997865 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-6adb5326-3238-4f76-bf8f-70eb0a3a458d req-464e6bec-a08e-4c68-8820-c079a61a9fbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34e2fe19-835a-4a68-a5ed-6570a7edcd2e", "name": "network-vif-deleted", "tag": "f473c9c3-61a3-448f-b7f2-edc957d4d62a"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:11.021233 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-6adb5326-3238-4f76-bf8f-70eb0a3a458d req-464e6bec-a08e-4c68-8820-c079a61a9fbc service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:11.021680 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-6adb5326-3238-4f76-bf8f-70eb0a3a458d req-464e6bec-a08e-4c68-8820-c079a61a9fbc service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:11.042044 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-6adb5326-3238-4f76-bf8f-70eb0a3a458d req-464e6bec-a08e-4c68-8820-c079a61a9fbc service nova] Creating event network-vif-deleted:f473c9c3-61a3-448f-b7f2-edc957d4d62a for instance 34e2fe19-835a-4a68-a5ed-6570a7edcd2e on n-h2-844739-1 Jun 05 08:25:11.049463 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-6adb5326-3238-4f76-bf8f-70eb0a3a458d req-464e6bec-a08e-4c68-8820-c079a61a9fbc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059218 Jun 05 08:25:11.050369 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 339/679] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:11.055669 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3d53d49c-561b-432b-90b7-1d3fbe4ff0f9 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:11.056401 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3d53d49c-561b-432b-90b7-1d3fbe4ff0f9 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:11.065396 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3d53d49c-561b-432b-90b7-1d3fbe4ff0f9 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:11.065859 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3d53d49c-561b-432b-90b7-1d3fbe4ff0f9 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:11.066655 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3d53d49c-561b-432b-90b7-1d3fbe4ff0f9 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:11.067101 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3d53d49c-561b-432b-90b7-1d3fbe4ff0f9 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:11.287092 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1198cb52-5530-44ce-bf2c-15a03ef4366c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:11.300373 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1198cb52-5530-44ce-bf2c-15a03ef4366c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175" status: 200 len: 1316 microversion: 2.1 time: 0.392808 Jun 05 08:25:11.301405 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 341/680] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:10 2022] GET /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175 => generated 1316 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:11.306704 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-317222c1-c457-4ecb-a153-31f8d109247c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:11.307492 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-317222c1-c457-4ecb-a153-31f8d109247c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:11.315335 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-317222c1-c457-4ecb-a153-31f8d109247c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:11.316053 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-317222c1-c457-4ecb-a153-31f8d109247c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:11.317086 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-317222c1-c457-4ecb-a153-31f8d109247c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:11.317748 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-317222c1-c457-4ecb-a153-31f8d109247c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:11.333799 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3d53d49c-561b-432b-90b7-1d3fbe4ff0f9 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21" status: 200 len: 1630 microversion: 2.1 time: 0.280939 Jun 05 08:25:11.334784 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 340/681] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:11 2022] GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21 => generated 1630 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:11.339992 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2b0b218f-47a5-4fae-b062-d202a60acc13 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:11.340824 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2b0b218f-47a5-4fae-b062-d202a60acc13 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] [instance: 5c84911f-3880-4b7c-a589-fc39d158a22b] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:11.358961 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2b0b218f-47a5-4fae-b062-d202a60acc13 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:11.359476 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2b0b218f-47a5-4fae-b062-d202a60acc13 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:11.368221 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2b0b218f-47a5-4fae-b062-d202a60acc13 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:11.371239 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2b0b218f-47a5-4fae-b062-d202a60acc13 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:11.452595 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-2b0b218f-47a5-4fae-b062-d202a60acc13 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] HTTP exception thrown: Action 999 not found Jun 05 08:25:11.456170 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2b0b218f-47a5-4fae-b062-d202a60acc13 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Request method failure captured: Jun 05 08:25:11.456170 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b/os-instance-actions/999 HTTP/1.1 Jun 05 08:25:11.456170 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:25:11.456170 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:25:11.456170 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:25:11.456170 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:25:11.456170 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:25:11.456170 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:25:11.456170 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:25:11.456170 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:25:11.456170 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGhW1N4wB3NEaoPKS6K0rjNYYxGL8A_8QBU6CTBjMPa6hVTqnPTGldpZ4Z2OXj0tBNROa7cyxLdjMWuPGMUSeNYLQqLUu5jl3AXtSEVx4JMSFSZxH_EOW7abdpLQo_8bcURDO-880P1pn87cWcIrhUVujBIZYOtGMDXCBqZaF4bcXa4 Jun 05 08:25:11.456170 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:25:11.456170 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:25:11.456170 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:25:11.456170 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:25:11.456170 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:25:11.456170 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:25:11.456170 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 0bcfc655897c48069119ef6b184c8d2f Jun 05 08:25:11.456170 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-305747094 Jun 05 08:25:11.456170 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:25:11.456170 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:25:11.457704 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0bcfc655897c48069119ef6b184c8d2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0bcfc655897c48069119ef6b184c8d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0bcfc655897c48069119ef6b184c8d2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0bcfc655897c48069119ef6b184c8d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:25:11.457704 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-305747094 Jun 05 08:25:11.457704 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 0bcfc655897c48069119ef6b184c8d2f Jun 05 08:25:11.457704 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-305747094 Jun 05 08:25:11.457704 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-InstanceActionsNegativeTestJSON-305747094-project Jun 05 08:25:11.457704 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:25:11.457704 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:25:11.457704 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: aedf622071d04dada841a5b21a942e51 Jun 05 08:25:11.457704 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-305747094-project Jun 05 08:25:11.457704 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:25:11.457704 n-d-844739-1 devstack@n-api.service[119049]: exception: Action 999 not found Jun 05 08:25:11.457704 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'server_id': '5c84911f-3880-4b7c-a589-fc39d158a22b', 'id': '999'} Jun 05 08:25:11.458594 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:25:11.458594 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:25:11.458594 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:25:11.458594 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:25:11.458594 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:25:11.458594 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:25:11.458594 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:25:11.458594 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:25:11.458594 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jun 05 08:25:11.458594 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 05 08:25:11.458594 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jun 05 08:25:11.458594 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:25:11.458594 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:25:11.458594 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:25:11.458594 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:25:11.458594 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:25:11.458594 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:25:11.458594 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:25:11.458594 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:25:11.458594 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jun 05 08:25:11.458594 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:25:11.465881 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2b0b218f-47a5-4fae-b062-d202a60acc13 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Returning 404 to user: Action 999 not found {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:25:11.466716 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2b0b218f-47a5-4fae-b062-d202a60acc13 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] 10.222.0.33 "GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.130737 Jun 05 08:25:11.467884 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 341/682] 10.222.0.33 () {58 vars in 1307 bytes} [Sun Jun 5 08:25:11 2022] GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b/os-instance-actions/999 => generated 66 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:25:11.473540 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-2a6dbd42-94e9-44c9-8be3-33f60e7cc6ef req-0e5f9ff2-29ce-4c4f-afcd-67c111e67f84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66aeb103-f664-4b53-921a-79ae7685365e", "name": "network-vif-plugged", "status": "completed", "tag": "69e0434d-65a6-4b9f-849b-02a37c0de9ac"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:11.483538 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-2a6dbd42-94e9-44c9-8be3-33f60e7cc6ef req-0e5f9ff2-29ce-4c4f-afcd-67c111e67f84 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:11.484144 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-2a6dbd42-94e9-44c9-8be3-33f60e7cc6ef req-0e5f9ff2-29ce-4c4f-afcd-67c111e67f84 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:11.499988 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-2a6dbd42-94e9-44c9-8be3-33f60e7cc6ef req-0e5f9ff2-29ce-4c4f-afcd-67c111e67f84 service nova] Creating event network-vif-plugged:69e0434d-65a6-4b9f-849b-02a37c0de9ac for instance 66aeb103-f664-4b53-921a-79ae7685365e on n-h1-844739-1 Jun 05 08:25:11.506973 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-2a6dbd42-94e9-44c9-8be3-33f60e7cc6ef req-0e5f9ff2-29ce-4c4f-afcd-67c111e67f84 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037532 Jun 05 08:25:11.508266 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 342/683] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:11.514586 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-dd12bb88-4388-485a-90d5-711229b28750 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:11.516308 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-dd12bb88-4388-485a-90d5-711229b28750 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] [instance: 34e2fe19-835a-4a68-a5ed-6570a7edcd2e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:11.535727 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dd12bb88-4388-485a-90d5-711229b28750 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:11.537798 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dd12bb88-4388-485a-90d5-711229b28750 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:11.541876 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dd12bb88-4388-485a-90d5-711229b28750 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:11.542785 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dd12bb88-4388-485a-90d5-711229b28750 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:11.602105 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dd12bb88-4388-485a-90d5-711229b28750 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:11.602772 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dd12bb88-4388-485a-90d5-711229b28750 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:11.603412 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-dd12bb88-4388-485a-90d5-711229b28750 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lazy-loading 'fault' on Instance uuid 34e2fe19-835a-4a68-a5ed-6570a7edcd2e {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:11.690039 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-dd12bb88-4388-485a-90d5-711229b28750 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:11.708636 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-dd12bb88-4388-485a-90d5-711229b28750 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:11.710288 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-dd12bb88-4388-485a-90d5-711229b28750 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:11.711472 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-dd12bb88-4388-485a-90d5-711229b28750 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] 10.222.0.33 "GET /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e" status: 200 len: 1403 microversion: 2.21 time: 0.201913 Jun 05 08:25:11.712703 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 343/684] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:11 2022] GET /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e => generated 1403 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:11.718080 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-87fa3388-7eee-41bb-90b0-0f33d51ed2f6 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Calling method '.version_select at 0x7f2433c035e0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:11.718644 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-87fa3388-7eee-41bb-90b0-0f33d51ed2f6 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] [instance: 94a931ad-787f-43cb-9fcf-dea647c7684b] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:11.729093 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-87fa3388-7eee-41bb-90b0-0f33d51ed2f6 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] HTTP exception thrown: Instance 94a931ad-787f-43cb-9fcf-dea647c7684b could not be found. Jun 05 08:25:11.730633 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-87fa3388-7eee-41bb-90b0-0f33d51ed2f6 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Request method failure captured: Jun 05 08:25:11.730633 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/94a931ad-787f-43cb-9fcf-dea647c7684b/os-instance-actions HTTP/1.1 Jun 05 08:25:11.730633 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:25:11.730633 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:25:11.730633 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:25:11.730633 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:25:11.730633 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:25:11.730633 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:25:11.730633 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:25:11.730633 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:25:11.730633 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGhW1N4wB3NEaoPKS6K0rjNYYxGL8A_8QBU6CTBjMPa6hVTqnPTGldpZ4Z2OXj0tBNROa7cyxLdjMWuPGMUSeNYLQqLUu5jl3AXtSEVx4JMSFSZxH_EOW7abdpLQo_8bcURDO-880P1pn87cWcIrhUVujBIZYOtGMDXCBqZaF4bcXa4 Jun 05 08:25:11.730633 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:25:11.730633 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:25:11.730633 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:25:11.730633 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:25:11.730633 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:25:11.730633 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:25:11.730633 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 0bcfc655897c48069119ef6b184c8d2f Jun 05 08:25:11.730633 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-305747094 Jun 05 08:25:11.730633 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:25:11.730633 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:25:11.731831 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0bcfc655897c48069119ef6b184c8d2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0bcfc655897c48069119ef6b184c8d2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0bcfc655897c48069119ef6b184c8d2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0bcfc655897c48069119ef6b184c8d2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:25:11.731831 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-305747094 Jun 05 08:25:11.731831 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 0bcfc655897c48069119ef6b184c8d2f Jun 05 08:25:11.731831 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-305747094 Jun 05 08:25:11.731831 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-InstanceActionsNegativeTestJSON-305747094-project Jun 05 08:25:11.731831 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:25:11.731831 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:25:11.731831 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: aedf622071d04dada841a5b21a942e51 Jun 05 08:25:11.731831 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-305747094-project Jun 05 08:25:11.731831 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:25:11.731831 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 94a931ad-787f-43cb-9fcf-dea647c7684b could not be found. Jun 05 08:25:11.731831 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'server_id': '94a931ad-787f-43cb-9fcf-dea647c7684b'} Jun 05 08:25:11.732552 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:25:11.732552 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:25:11.732552 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:25:11.732552 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:25:11.732552 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:25:11.732552 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:25:11.732552 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 05 08:25:11.732552 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 05 08:25:11.732552 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94a931ad-787f-43cb-9fcf-dea647c7684b could not be found. Jun 05 08:25:11.732552 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:25:11.732552 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:25:11.732552 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:25:11.732552 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:25:11.732552 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:25:11.732552 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:25:11.732552 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:25:11.732552 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:25:11.732552 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:25:11.732552 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:25:11.732552 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:25:11.733679 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:25:11.733679 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jun 05 08:25:11.733679 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jun 05 08:25:11.733679 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:25:11.733679 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:25:11.733679 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jun 05 08:25:11.733679 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jun 05 08:25:11.733679 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:25:11.733679 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:25:11.733679 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94a931ad-787f-43cb-9fcf-dea647c7684b could not be found. Jun 05 08:25:11.733679 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:25:11.733679 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:25:11.733679 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:25:11.733679 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:25:11.733679 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:25:11.733679 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:25:11.733679 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:25:11.733679 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:25:11.733679 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94a931ad-787f-43cb-9fcf-dea647c7684b could not be found. Jun 05 08:25:11.733679 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:25:11.734812 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-87fa3388-7eee-41bb-90b0-0f33d51ed2f6 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Returning 404 to user: Instance 94a931ad-787f-43cb-9fcf-dea647c7684b could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:25:11.734812 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-87fa3388-7eee-41bb-90b0-0f33d51ed2f6 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] 10.222.0.33 "GET /compute/v2.1/servers/94a931ad-787f-43cb-9fcf-dea647c7684b/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.019096 Jun 05 08:25:11.734812 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 344/685] 10.222.0.33 () {58 vars in 1295 bytes} [Sun Jun 5 08:25:11 2022] GET /compute/v2.1/servers/94a931ad-787f-43cb-9fcf-dea647c7684b/os-instance-actions => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:25:11.741028 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-73dc82f9-276b-4667-92e2-626f6cbf7100 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:11.741028 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-73dc82f9-276b-4667-92e2-626f6cbf7100 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:11.749122 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-73dc82f9-276b-4667-92e2-626f6cbf7100 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:11.749626 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-73dc82f9-276b-4667-92e2-626f6cbf7100 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:11.750852 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-73dc82f9-276b-4667-92e2-626f6cbf7100 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:11.751308 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-73dc82f9-276b-4667-92e2-626f6cbf7100 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:11.780890 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-317222c1-c457-4ecb-a153-31f8d109247c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:11.799232 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-73dc82f9-276b-4667-92e2-626f6cbf7100 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:11.799890 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-73dc82f9-276b-4667-92e2-626f6cbf7100 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:11.800676 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-73dc82f9-276b-4667-92e2-626f6cbf7100 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:11.808282 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-317222c1-c457-4ecb-a153-31f8d109247c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:11.815373 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-317222c1-c457-4ecb-a153-31f8d109247c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:11.819628 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-317222c1-c457-4ecb-a153-31f8d109247c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 1568 microversion: 2.25 time: 0.517011 Jun 05 08:25:11.820923 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 342/686] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:11 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 1568 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:11.826657 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-be2b4ad0-ef9b-421d-b78a-ce0dedc14733 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2030720377", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "d6fc5636-9c8b-4238-8a2c-cf51a213fbbf"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:11.873017 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-73dc82f9-276b-4667-92e2-626f6cbf7100 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:11.882480 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-73dc82f9-276b-4667-92e2-626f6cbf7100 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.148277 Jun 05 08:25:11.895351 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 345/687] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:11 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:11.898635 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-be2b4ad0-ef9b-421d-b78a-ce0dedc14733 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] validate_networks() for [('d6fc5636-9c8b-4238-8a2c-cf51a213fbbf', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:25:11.906177 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-90b0ff5f-55e7-43ee-8193-3e2103b5ae7c tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:11.906935 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-90b0ff5f-55e7-43ee-8193-3e2103b5ae7c tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] [instance: 34e2fe19-835a-4a68-a5ed-6570a7edcd2e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:11.914942 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-90b0ff5f-55e7-43ee-8193-3e2103b5ae7c tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:11.915402 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-90b0ff5f-55e7-43ee-8193-3e2103b5ae7c tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:11.916290 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-90b0ff5f-55e7-43ee-8193-3e2103b5ae7c tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:11.916735 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-90b0ff5f-55e7-43ee-8193-3e2103b5ae7c tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:11.950542 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-90b0ff5f-55e7-43ee-8193-3e2103b5ae7c tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] [instance: 34e2fe19-835a-4a68-a5ed-6570a7edcd2e] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:25:12.044301 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-90b0ff5f-55e7-43ee-8193-3e2103b5ae7c tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] 10.222.0.33 "DELETE /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e" status: 204 len: 0 microversion: 2.21 time: 0.147023 Jun 05 08:25:12.049178 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 346/688] 10.222.0.33 () {60 vars in 1279 bytes} [Sun Jun 5 08:25:11 2022] DELETE /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:25:12.057963 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-34d6b06d-2a11-4933-8473-5db341c0286b tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:12.059221 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-34d6b06d-2a11-4933-8473-5db341c0286b tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] [instance: 5c84911f-3880-4b7c-a589-fc39d158a22b] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:12.062587 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:12.067423 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-34d6b06d-2a11-4933-8473-5db341c0286b tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:12.067948 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-34d6b06d-2a11-4933-8473-5db341c0286b tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:12.068842 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-34d6b06d-2a11-4933-8473-5db341c0286b tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:12.070098 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-34d6b06d-2a11-4933-8473-5db341c0286b tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:12.118702 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-34d6b06d-2a11-4933-8473-5db341c0286b tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] [instance: 5c84911f-3880-4b7c-a589-fc39d158a22b] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:25:12.244413 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-34d6b06d-2a11-4933-8473-5db341c0286b tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b" status: 204 len: 0 microversion: 2.1 time: 0.193426 Jun 05 08:25:12.245215 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 347/689] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:25:12 2022] DELETE /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:25:12.250063 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-425d56b0-f72b-4571-8011-9bc46b513185 req-77d155b9-b47a-4110-9147-e5b7a8251ddf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8719f86c-4f4f-4c65-b580-c5d526d05175", "tag": "5b4dce05-9412-45a0-ac85-62098ec0ca15"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:12.260494 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-425d56b0-f72b-4571-8011-9bc46b513185 req-77d155b9-b47a-4110-9147-e5b7a8251ddf service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:12.260945 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-425d56b0-f72b-4571-8011-9bc46b513185 req-77d155b9-b47a-4110-9147-e5b7a8251ddf service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:12.274521 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-425d56b0-f72b-4571-8011-9bc46b513185 req-77d155b9-b47a-4110-9147-e5b7a8251ddf service nova] Creating event network-changed:5b4dce05-9412-45a0-ac85-62098ec0ca15 for instance 8719f86c-4f4f-4c65-b580-c5d526d05175 on n-h1-844739-1 Jun 05 08:25:12.280546 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-425d56b0-f72b-4571-8011-9bc46b513185 req-77d155b9-b47a-4110-9147-e5b7a8251ddf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033464 Jun 05 08:25:12.283850 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 348/690] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:12.292476 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-96edc043-f469-470f-a3ac-b7d27e424c98 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:12.293183 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-96edc043-f469-470f-a3ac-b7d27e424c98 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 66aeb103-f664-4b53-921a-79ae7685365e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:12.301932 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-96edc043-f469-470f-a3ac-b7d27e424c98 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:12.302393 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-96edc043-f469-470f-a3ac-b7d27e424c98 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:12.303249 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-96edc043-f469-470f-a3ac-b7d27e424c98 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:12.304353 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-96edc043-f469-470f-a3ac-b7d27e424c98 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:12.331423 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:12.553508 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-96edc043-f469-470f-a3ac-b7d27e424c98 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704cd9e8b0984139b58ec6abe3579576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8b37e66d354ce09c4bef01d28ef7a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:12.561172 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-96edc043-f469-470f-a3ac-b7d27e424c98 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e" status: 200 len: 1321 microversion: 2.1 time: 0.278848 Jun 05 08:25:12.562059 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 349/691] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:12 2022] GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:12.567913 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0525421d-502c-402b-a07a-6bb927e77540 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:12.568549 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0525421d-502c-402b-a07a-6bb927e77540 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] [instance: 34e2fe19-835a-4a68-a5ed-6570a7edcd2e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:12.574880 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0525421d-502c-402b-a07a-6bb927e77540 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:12.575330 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0525421d-502c-402b-a07a-6bb927e77540 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:12.576126 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0525421d-502c-402b-a07a-6bb927e77540 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:12.576564 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0525421d-502c-402b-a07a-6bb927e77540 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:12.607539 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0525421d-502c-402b-a07a-6bb927e77540 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:12.607985 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0525421d-502c-402b-a07a-6bb927e77540 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:12.608463 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-0525421d-502c-402b-a07a-6bb927e77540 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lazy-loading 'fault' on Instance uuid 34e2fe19-835a-4a68-a5ed-6570a7edcd2e {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:12.614029 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-be2b4ad0-ef9b-421d-b78a-ce0dedc14733 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:25:12.615610 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-be2b4ad0-ef9b-421d-b78a-ce0dedc14733 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:25:12.616619 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-be2b4ad0-ef9b-421d-b78a-ce0dedc14733 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:25:12.619564 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-be2b4ad0-ef9b-421d-b78a-ce0dedc14733 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:25:12.620254 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-be2b4ad0-ef9b-421d-b78a-ce0dedc14733 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:25:12.630656 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-be2b4ad0-ef9b-421d-b78a-ce0dedc14733 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:12.631373 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-be2b4ad0-ef9b-421d-b78a-ce0dedc14733 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:12.632283 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-be2b4ad0-ef9b-421d-b78a-ce0dedc14733 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:12.632790 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-be2b4ad0-ef9b-421d-b78a-ce0dedc14733 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:12.650376 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-be2b4ad0-ef9b-421d-b78a-ce0dedc14733 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Getting quotas for project 4d03f2fd71b942c58157558bc37213b2. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:25:12.654487 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0525421d-502c-402b-a07a-6bb927e77540 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:12.655718 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-be2b4ad0-ef9b-421d-b78a-ce0dedc14733 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Getting quotas for user 63a93651985b4efaa4b0b2fde0f91010 and project 4d03f2fd71b942c58157558bc37213b2. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:25:12.663850 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0525421d-502c-402b-a07a-6bb927e77540 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:12.665446 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0525421d-502c-402b-a07a-6bb927e77540 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:12.666566 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0525421d-502c-402b-a07a-6bb927e77540 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] 10.222.0.33 "GET /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e" status: 200 len: 1409 microversion: 2.21 time: 0.103520 Jun 05 08:25:12.667439 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 350/692] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:12 2022] GET /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e => generated 1409 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:12.668862 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-be2b4ad0-ef9b-421d-b78a-ce0dedc14733 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:25:12.671103 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-be2b4ad0-ef9b-421d-b78a-ce0dedc14733 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:25:12.681321 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:12.685573 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4db2b5f5-cd5d-4721-bd38-efe1c36e558d tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:12.686227 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4db2b5f5-cd5d-4721-bd38-efe1c36e558d tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] [instance: 5c84911f-3880-4b7c-a589-fc39d158a22b] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:12.693321 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4db2b5f5-cd5d-4721-bd38-efe1c36e558d tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:12.693888 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4db2b5f5-cd5d-4721-bd38-efe1c36e558d tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:12.694627 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4db2b5f5-cd5d-4721-bd38-efe1c36e558d tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:12.700218 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4db2b5f5-cd5d-4721-bd38-efe1c36e558d tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:12.722150 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-be2b4ad0-ef9b-421d-b78a-ce0dedc14733 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.899570 Jun 05 08:25:12.727956 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 343/693] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:25:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:25:12.728124 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ffabe2b9-5eaf-48d6-82bc-e20f53444e0f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:12.728858 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ffabe2b9-5eaf-48d6-82bc-e20f53444e0f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 8719f86c-4f4f-4c65-b580-c5d526d05175] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:12.735721 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ffabe2b9-5eaf-48d6-82bc-e20f53444e0f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:12.736282 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ffabe2b9-5eaf-48d6-82bc-e20f53444e0f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:12.737070 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ffabe2b9-5eaf-48d6-82bc-e20f53444e0f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:12.737554 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ffabe2b9-5eaf-48d6-82bc-e20f53444e0f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:12.902217 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4db2b5f5-cd5d-4721-bd38-efe1c36e558d tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedf622071d04dada841a5b21a942e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcfc655897c48069119ef6b184c8d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:12.917234 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4db2b5f5-cd5d-4721-bd38-efe1c36e558d tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] 10.222.0.33 "GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b" status: 200 len: 1527 microversion: 2.1 time: 0.236493 Jun 05 08:25:12.918163 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 351/694] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:12 2022] GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b => generated 1527 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:12.923290 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-cc38398e-e1ab-48cc-9a66-a04b8811fd3d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:12.924780 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-cc38398e-e1ab-48cc-9a66-a04b8811fd3d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:12.943718 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ffabe2b9-5eaf-48d6-82bc-e20f53444e0f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:12.952132 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ffabe2b9-5eaf-48d6-82bc-e20f53444e0f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175" status: 200 len: 1316 microversion: 2.1 time: 0.227601 Jun 05 08:25:12.961662 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 344/695] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:12 2022] GET /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175 => generated 1316 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:12.967792 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-327d719c-2d37-479b-88a4-8451d2412d54 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:12.968451 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-327d719c-2d37-479b-88a4-8451d2412d54 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:12.979749 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-327d719c-2d37-479b-88a4-8451d2412d54 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:12.980240 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-327d719c-2d37-479b-88a4-8451d2412d54 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:12.981017 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-327d719c-2d37-479b-88a4-8451d2412d54 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:12.981454 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-327d719c-2d37-479b-88a4-8451d2412d54 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:13.020355 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-cc38398e-e1ab-48cc-9a66-a04b8811fd3d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:13.029989 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-cc38398e-e1ab-48cc-9a66-a04b8811fd3d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1211 microversion: 2.1 time: 0.110547 Jun 05 08:25:13.031484 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 352/696] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:12 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1211 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:13.052472 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a3df187d-5dba-4b5e-98d1-f05c52938ab8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:13.053355 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a3df187d-5dba-4b5e-98d1-f05c52938ab8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:13.069413 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a3df187d-5dba-4b5e-98d1-f05c52938ab8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:13.070109 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a3df187d-5dba-4b5e-98d1-f05c52938ab8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:13.071151 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a3df187d-5dba-4b5e-98d1-f05c52938ab8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:13.071808 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a3df187d-5dba-4b5e-98d1-f05c52938ab8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:13.108730 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a3df187d-5dba-4b5e-98d1-f05c52938ab8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:13.109808 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a3df187d-5dba-4b5e-98d1-f05c52938ab8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:13.110593 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-a3df187d-5dba-4b5e-98d1-f05c52938ab8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:13.165158 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a3df187d-5dba-4b5e-98d1-f05c52938ab8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:13.177425 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a3df187d-5dba-4b5e-98d1-f05c52938ab8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.144508 Jun 05 08:25:13.178406 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 353/697] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:13 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:13.185521 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-327d719c-2d37-479b-88a4-8451d2412d54 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:13.194617 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-327d719c-2d37-479b-88a4-8451d2412d54 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:13.196188 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-327d719c-2d37-479b-88a4-8451d2412d54 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:13.197378 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-327d719c-2d37-479b-88a4-8451d2412d54 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 1568 microversion: 2.25 time: 0.243114 Jun 05 08:25:13.210045 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 345/698] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:12 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 1568 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:13.578736 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2affe9d3-4ea2-4c49-89bf-e6bd7362b2c1 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:13.579395 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2affe9d3-4ea2-4c49-89bf-e6bd7362b2c1 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 66aeb103-f664-4b53-921a-79ae7685365e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:13.589274 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2affe9d3-4ea2-4c49-89bf-e6bd7362b2c1 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:13.589729 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2affe9d3-4ea2-4c49-89bf-e6bd7362b2c1 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:13.590514 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2affe9d3-4ea2-4c49-89bf-e6bd7362b2c1 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:13.590936 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2affe9d3-4ea2-4c49-89bf-e6bd7362b2c1 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:13.693978 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-34ff85dc-5056-4e56-9d2e-f94b438497f8 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:13.694612 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-34ff85dc-5056-4e56-9d2e-f94b438497f8 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] [instance: 34e2fe19-835a-4a68-a5ed-6570a7edcd2e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:13.706992 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-34ff85dc-5056-4e56-9d2e-f94b438497f8 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:13.707826 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-34ff85dc-5056-4e56-9d2e-f94b438497f8 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:13.709528 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-34ff85dc-5056-4e56-9d2e-f94b438497f8 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:13.709999 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-34ff85dc-5056-4e56-9d2e-f94b438497f8 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:13.747351 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-34ff85dc-5056-4e56-9d2e-f94b438497f8 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:13.747821 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-34ff85dc-5056-4e56-9d2e-f94b438497f8 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:13.748326 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-34ff85dc-5056-4e56-9d2e-f94b438497f8 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Lazy-loading 'fault' on Instance uuid 34e2fe19-835a-4a68-a5ed-6570a7edcd2e {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:13.826044 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-34ff85dc-5056-4e56-9d2e-f94b438497f8 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:13.837325 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-34ff85dc-5056-4e56-9d2e-f94b438497f8 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:13.839034 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-34ff85dc-5056-4e56-9d2e-f94b438497f8 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af823091e4574d3c8ad0576ed3d1fec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3690560330ef4d5985fa664d3c4773d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:13.840277 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-34ff85dc-5056-4e56-9d2e-f94b438497f8 tempest-InstanceActionsV221TestJSON-1281702188 tempest-InstanceActionsV221TestJSON-1281702188-project] 10.222.0.33 "GET /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e" status: 200 len: 1403 microversion: 2.21 time: 0.150986 Jun 05 08:25:13.841057 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 346/699] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:13 2022] GET /compute/v2.1/servers/34e2fe19-835a-4a68-a5ed-6570a7edcd2e => generated 1403 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:13.882574 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2affe9d3-4ea2-4c49-89bf-e6bd7362b2c1 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704cd9e8b0984139b58ec6abe3579576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8b37e66d354ce09c4bef01d28ef7a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:13.894568 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2affe9d3-4ea2-4c49-89bf-e6bd7362b2c1 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e" status: 200 len: 1470 microversion: 2.1 time: 0.318461 Jun 05 08:25:13.904078 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 354/700] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:13 2022] GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e => generated 1470 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:13.918125 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-09e9c0b3-26e1-409d-b0ba-2044c32fe765 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:13.919616 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-09e9c0b3-26e1-409d-b0ba-2044c32fe765 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] [instance: 66aeb103-f664-4b53-921a-79ae7685365e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:13.938405 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bdf11957-6f05-485b-a032-56f7b4f31bdb tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:13.939699 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-09e9c0b3-26e1-409d-b0ba-2044c32fe765 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:13.940414 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-bdf11957-6f05-485b-a032-56f7b4f31bdb tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] [instance: 5c84911f-3880-4b7c-a589-fc39d158a22b] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:13.943868 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-09e9c0b3-26e1-409d-b0ba-2044c32fe765 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:13.945813 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-09e9c0b3-26e1-409d-b0ba-2044c32fe765 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:13.948453 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-09e9c0b3-26e1-409d-b0ba-2044c32fe765 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:13.958159 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bdf11957-6f05-485b-a032-56f7b4f31bdb tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:13.960689 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bdf11957-6f05-485b-a032-56f7b4f31bdb tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:13.964358 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bdf11957-6f05-485b-a032-56f7b4f31bdb tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:13.965169 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bdf11957-6f05-485b-a032-56f7b4f31bdb tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:13.984160 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-09e9c0b3-26e1-409d-b0ba-2044c32fe765 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Lazy-loading 'flavor' on Instance uuid 66aeb103-f664-4b53-921a-79ae7685365e {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:14.092024 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-09e9c0b3-26e1-409d-b0ba-2044c32fe765 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e/action" status: 202 len: 0 microversion: 2.1 time: 0.179582 Jun 05 08:25:14.095715 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 347/701] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Jun 5 08:25:13 2022] POST /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:25:14.099794 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-49a3801f-621f-430d-af4d-65a8350cd872 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:14.100895 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-49a3801f-621f-430d-af4d-65a8350cd872 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 8719f86c-4f4f-4c65-b580-c5d526d05175] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:14.109970 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-49a3801f-621f-430d-af4d-65a8350cd872 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:14.111975 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-49a3801f-621f-430d-af4d-65a8350cd872 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:14.112999 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-49a3801f-621f-430d-af4d-65a8350cd872 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:14.114596 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-49a3801f-621f-430d-af4d-65a8350cd872 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:14.747088 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-bdf11957-6f05-485b-a032-56f7b4f31bdb tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedf622071d04dada841a5b21a942e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcfc655897c48069119ef6b184c8d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:14.755037 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bdf11957-6f05-485b-a032-56f7b4f31bdb tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] 10.222.0.33 "GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b" status: 200 len: 1527 microversion: 2.1 time: 0.822798 Jun 05 08:25:14.763200 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 355/702] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:13 2022] GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b => generated 1527 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:14.763200 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-31d99400-fe3f-445d-86c4-0c3d485db269 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:14.763200 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-31d99400-fe3f-445d-86c4-0c3d485db269 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:14.768576 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-31d99400-fe3f-445d-86c4-0c3d485db269 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:14.769023 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-31d99400-fe3f-445d-86c4-0c3d485db269 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:14.769817 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-31d99400-fe3f-445d-86c4-0c3d485db269 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:14.770247 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-31d99400-fe3f-445d-86c4-0c3d485db269 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:14.780499 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-49a3801f-621f-430d-af4d-65a8350cd872 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:14.792633 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-49a3801f-621f-430d-af4d-65a8350cd872 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175" status: 200 len: 1316 microversion: 2.1 time: 0.697775 Jun 05 08:25:14.793758 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 348/703] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:14 2022] GET /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175 => generated 1316 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:14.799612 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ecc8e9de-b149-4432-9d33-adbefafa99e9 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:14.800723 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ecc8e9de-b149-4432-9d33-adbefafa99e9 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] [instance: 66aeb103-f664-4b53-921a-79ae7685365e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:14.807271 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ecc8e9de-b149-4432-9d33-adbefafa99e9 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:14.807836 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ecc8e9de-b149-4432-9d33-adbefafa99e9 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:14.808880 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ecc8e9de-b149-4432-9d33-adbefafa99e9 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:14.809511 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ecc8e9de-b149-4432-9d33-adbefafa99e9 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:14.964498 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-31d99400-fe3f-445d-86c4-0c3d485db269 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:14.977720 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-31d99400-fe3f-445d-86c4-0c3d485db269 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1269 microversion: 2.1 time: 0.220872 Jun 05 08:25:14.978651 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 356/704] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:14 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1269 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:14.983787 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f5e6f922-2491-4f15-8bbc-0b0f8d999433 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:14.984464 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f5e6f922-2491-4f15-8bbc-0b0f8d999433 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:14.992406 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f5e6f922-2491-4f15-8bbc-0b0f8d999433 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:14.992875 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f5e6f922-2491-4f15-8bbc-0b0f8d999433 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:14.993847 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f5e6f922-2491-4f15-8bbc-0b0f8d999433 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:14.994295 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f5e6f922-2491-4f15-8bbc-0b0f8d999433 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:15.031425 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f5e6f922-2491-4f15-8bbc-0b0f8d999433 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:15.031922 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f5e6f922-2491-4f15-8bbc-0b0f8d999433 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:15.032436 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-f5e6f922-2491-4f15-8bbc-0b0f8d999433 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:15.115909 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f5e6f922-2491-4f15-8bbc-0b0f8d999433 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:15.124163 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f5e6f922-2491-4f15-8bbc-0b0f8d999433 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.144274 Jun 05 08:25:15.125068 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 357/705] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:14 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:15.130613 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5608f6db-2b36-4324-a3d1-6f4754350e3e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:15.131183 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5608f6db-2b36-4324-a3d1-6f4754350e3e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:15.137609 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5608f6db-2b36-4324-a3d1-6f4754350e3e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:15.138112 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5608f6db-2b36-4324-a3d1-6f4754350e3e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:15.138901 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5608f6db-2b36-4324-a3d1-6f4754350e3e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:15.139350 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5608f6db-2b36-4324-a3d1-6f4754350e3e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:15.406971 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5608f6db-2b36-4324-a3d1-6f4754350e3e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:15.416720 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5608f6db-2b36-4324-a3d1-6f4754350e3e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:15.418246 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5608f6db-2b36-4324-a3d1-6f4754350e3e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:15.419610 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5608f6db-2b36-4324-a3d1-6f4754350e3e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 1568 microversion: 2.25 time: 0.293526 Jun 05 08:25:15.420579 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 358/706] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:15 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 1568 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:15.425589 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-020f0bd3-be86-4c1c-8f46-f5b3eb179cc2 req-1951d108-b671-4d25-b8e4-bb5d81a95f79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "035abb75-eda1-447d-b034-2bbb171f704e", "name": "network-vif-unplugged", "status": "completed", "tag": "a81939c6-14ec-4dcc-99cd-55f57077719c"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:15.437290 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-020f0bd3-be86-4c1c-8f46-f5b3eb179cc2 req-1951d108-b671-4d25-b8e4-bb5d81a95f79 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:15.437766 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-020f0bd3-be86-4c1c-8f46-f5b3eb179cc2 req-1951d108-b671-4d25-b8e4-bb5d81a95f79 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:15.450316 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-020f0bd3-be86-4c1c-8f46-f5b3eb179cc2 req-1951d108-b671-4d25-b8e4-bb5d81a95f79 service nova] Creating event network-vif-unplugged:a81939c6-14ec-4dcc-99cd-55f57077719c for instance 035abb75-eda1-447d-b034-2bbb171f704e on n-h1-844739-1 Jun 05 08:25:15.457413 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-020f0bd3-be86-4c1c-8f46-f5b3eb179cc2 req-1951d108-b671-4d25-b8e4-bb5d81a95f79 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034863 Jun 05 08:25:15.458337 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 359/707] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:15.464369 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-f2ac06cf-9870-4600-be78-11ee20ffb2d6 req-44414a50-8859-4335-99ca-c528f550c51d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c84911f-3880-4b7c-a589-fc39d158a22b", "name": "network-vif-deleted", "tag": "b21e549c-cb08-4577-9af4-80b6c7cb43fb"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:15.472328 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ecc8e9de-b149-4432-9d33-adbefafa99e9 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e" status: 200 len: 1629 microversion: 2.1 time: 0.677299 Jun 05 08:25:15.472922 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 349/708] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:14 2022] GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e => generated 1629 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:15.476362 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-f2ac06cf-9870-4600-be78-11ee20ffb2d6 req-44414a50-8859-4335-99ca-c528f550c51d service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:15.476803 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-f2ac06cf-9870-4600-be78-11ee20ffb2d6 req-44414a50-8859-4335-99ca-c528f550c51d service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:15.489833 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-f2ac06cf-9870-4600-be78-11ee20ffb2d6 req-44414a50-8859-4335-99ca-c528f550c51d service nova] Creating event network-vif-deleted:b21e549c-cb08-4577-9af4-80b6c7cb43fb for instance 5c84911f-3880-4b7c-a589-fc39d158a22b on n-h2-844739-1 Jun 05 08:25:15.496659 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-f2ac06cf-9870-4600-be78-11ee20ffb2d6 req-44414a50-8859-4335-99ca-c528f550c51d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036367 Jun 05 08:25:15.497756 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 360/709] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:15.773347 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-709c5f66-b7fb-434c-aa65-3ae3589abf36 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:15.774169 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-709c5f66-b7fb-434c-aa65-3ae3589abf36 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] [instance: 5c84911f-3880-4b7c-a589-fc39d158a22b] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:15.782901 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-709c5f66-b7fb-434c-aa65-3ae3589abf36 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:15.783939 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-709c5f66-b7fb-434c-aa65-3ae3589abf36 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:15.784987 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-709c5f66-b7fb-434c-aa65-3ae3589abf36 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:15.785647 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-709c5f66-b7fb-434c-aa65-3ae3589abf36 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:15.811091 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d471ba8a-08f0-40de-990e-4727ee94dea4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:15.812814 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d471ba8a-08f0-40de-990e-4727ee94dea4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 8719f86c-4f4f-4c65-b580-c5d526d05175] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:15.832571 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d471ba8a-08f0-40de-990e-4727ee94dea4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:15.833050 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d471ba8a-08f0-40de-990e-4727ee94dea4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:15.833844 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d471ba8a-08f0-40de-990e-4727ee94dea4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:15.834274 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d471ba8a-08f0-40de-990e-4727ee94dea4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:15.855499 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-709c5f66-b7fb-434c-aa65-3ae3589abf36 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:15.859618 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-709c5f66-b7fb-434c-aa65-3ae3589abf36 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:15.860125 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-709c5f66-b7fb-434c-aa65-3ae3589abf36 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Lazy-loading 'fault' on Instance uuid 5c84911f-3880-4b7c-a589-fc39d158a22b {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:15.949167 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-709c5f66-b7fb-434c-aa65-3ae3589abf36 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aedf622071d04dada841a5b21a942e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcfc655897c48069119ef6b184c8d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:15.961023 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-709c5f66-b7fb-434c-aa65-3ae3589abf36 tempest-InstanceActionsNegativeTestJSON-305747094 tempest-InstanceActionsNegativeTestJSON-305747094-project] 10.222.0.33 "GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b" status: 200 len: 1370 microversion: 2.1 time: 0.192098 Jun 05 08:25:15.962012 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 350/710] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:15 2022] GET /compute/v2.1/servers/5c84911f-3880-4b7c-a589-fc39d158a22b => generated 1370 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:15.998044 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-99963db4-0139-43d5-a3ed-7363cffeebbd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:16.000827 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-99963db4-0139-43d5-a3ed-7363cffeebbd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:16.010664 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-99963db4-0139-43d5-a3ed-7363cffeebbd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:16.012148 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-99963db4-0139-43d5-a3ed-7363cffeebbd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:16.013173 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-99963db4-0139-43d5-a3ed-7363cffeebbd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:16.014497 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-99963db4-0139-43d5-a3ed-7363cffeebbd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:16.116151 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d471ba8a-08f0-40de-990e-4727ee94dea4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:16.136788 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d471ba8a-08f0-40de-990e-4727ee94dea4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175" status: 200 len: 1316 microversion: 2.1 time: 0.330416 Jun 05 08:25:16.147608 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 361/711] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:15 2022] GET /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175 => generated 1316 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:16.154330 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ab05cb45-158b-477f-aa21-68a9c088f19e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:16.155357 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ab05cb45-158b-477f-aa21-68a9c088f19e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:16.164638 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ab05cb45-158b-477f-aa21-68a9c088f19e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:16.165449 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ab05cb45-158b-477f-aa21-68a9c088f19e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:16.166753 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ab05cb45-158b-477f-aa21-68a9c088f19e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:16.167237 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ab05cb45-158b-477f-aa21-68a9c088f19e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:16.207841 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ab05cb45-158b-477f-aa21-68a9c088f19e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:16.209192 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ab05cb45-158b-477f-aa21-68a9c088f19e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:16.209892 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-ab05cb45-158b-477f-aa21-68a9c088f19e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:16.289689 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ab05cb45-158b-477f-aa21-68a9c088f19e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:16.300528 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ab05cb45-158b-477f-aa21-68a9c088f19e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.151196 Jun 05 08:25:16.302030 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 362/712] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:16 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:16.426107 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-99963db4-0139-43d5-a3ed-7363cffeebbd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:16.439450 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2e5e7fa5-d62b-4cea-b9e8-01fcc09159d9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:16.440421 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2e5e7fa5-d62b-4cea-b9e8-01fcc09159d9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:16.442962 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-99963db4-0139-43d5-a3ed-7363cffeebbd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1311 microversion: 2.1 time: 0.450565 Jun 05 08:25:16.444746 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 351/713] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:15 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1311 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:16.447426 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2e5e7fa5-d62b-4cea-b9e8-01fcc09159d9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:16.447954 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2e5e7fa5-d62b-4cea-b9e8-01fcc09159d9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:16.448845 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2e5e7fa5-d62b-4cea-b9e8-01fcc09159d9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:16.449369 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2e5e7fa5-d62b-4cea-b9e8-01fcc09159d9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:16.492723 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-778e8dd2-6725-40b1-852c-43529965a117 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:16.493340 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-778e8dd2-6725-40b1-852c-43529965a117 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] [instance: 66aeb103-f664-4b53-921a-79ae7685365e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:16.500618 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-778e8dd2-6725-40b1-852c-43529965a117 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:16.501284 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-778e8dd2-6725-40b1-852c-43529965a117 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:16.502807 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-778e8dd2-6725-40b1-852c-43529965a117 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:16.503449 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-778e8dd2-6725-40b1-852c-43529965a117 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:16.867135 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2e5e7fa5-d62b-4cea-b9e8-01fcc09159d9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:16.876410 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2e5e7fa5-d62b-4cea-b9e8-01fcc09159d9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:16.879035 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2e5e7fa5-d62b-4cea-b9e8-01fcc09159d9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:16.880349 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2e5e7fa5-d62b-4cea-b9e8-01fcc09159d9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 1568 microversion: 2.25 time: 0.445506 Jun 05 08:25:16.880987 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 363/714] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:16 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 1568 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:16.882316 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2e5e7fa5-d62b-4cea-b9e8-01fcc09159d9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:16.883401 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2e5e7fa5-d62b-4cea-b9e8-01fcc09159d9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001432 Jun 05 08:25:16.890066 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 364/715] 10.222.0.33 () {56 vars in 885 bytes} [Sun Jun 5 08:25:16 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 05 08:25:16.963605 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-778e8dd2-6725-40b1-852c-43529965a117 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e" status: 200 len: 1629 microversion: 2.1 time: 0.474472 Jun 05 08:25:16.974527 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 352/716] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:16 2022] GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e => generated 1629 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:17.154616 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7f9d20b8-9d8d-4f82-8990-81f20d031aac tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:17.155236 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7f9d20b8-9d8d-4f82-8990-81f20d031aac tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 8719f86c-4f4f-4c65-b580-c5d526d05175] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:17.163034 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7f9d20b8-9d8d-4f82-8990-81f20d031aac tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:17.163836 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7f9d20b8-9d8d-4f82-8990-81f20d031aac tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:17.164849 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7f9d20b8-9d8d-4f82-8990-81f20d031aac tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:17.165506 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7f9d20b8-9d8d-4f82-8990-81f20d031aac tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:17.319828 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1a91b4da-928f-4670-acf5-18db36dd834d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:17.320697 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1a91b4da-928f-4670-acf5-18db36dd834d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:17.327900 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1a91b4da-928f-4670-acf5-18db36dd834d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:17.328957 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1a91b4da-928f-4670-acf5-18db36dd834d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:17.331007 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1a91b4da-928f-4670-acf5-18db36dd834d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:17.331785 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1a91b4da-928f-4670-acf5-18db36dd834d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:17.386890 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1a91b4da-928f-4670-acf5-18db36dd834d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:17.387780 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1a91b4da-928f-4670-acf5-18db36dd834d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:17.391151 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7f9d20b8-9d8d-4f82-8990-81f20d031aac tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:17.402089 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7f9d20b8-9d8d-4f82-8990-81f20d031aac tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175" status: 200 len: 1316 microversion: 2.1 time: 0.250557 Jun 05 08:25:17.402439 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-1a91b4da-928f-4670-acf5-18db36dd834d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:17.414670 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 365/717] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:17 2022] GET /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175 => generated 1316 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:17.460161 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0fcdc71e-6602-4788-a96e-4a6a420dc9e8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:17.461099 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0fcdc71e-6602-4788-a96e-4a6a420dc9e8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:17.479695 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0fcdc71e-6602-4788-a96e-4a6a420dc9e8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:17.480512 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0fcdc71e-6602-4788-a96e-4a6a420dc9e8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:17.481282 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0fcdc71e-6602-4788-a96e-4a6a420dc9e8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:17.481727 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0fcdc71e-6602-4788-a96e-4a6a420dc9e8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:17.541264 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1a91b4da-928f-4670-acf5-18db36dd834d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:17.553726 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1a91b4da-928f-4670-acf5-18db36dd834d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.239731 Jun 05 08:25:17.554694 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 353/718] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:17 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:17.560396 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-18d8566d-280b-4406-bf25-7890c88ce7cf req-1a30505a-da0b-4bd4-a6a9-d8458bfc7b5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "035abb75-eda1-447d-b034-2bbb171f704e", "tag": "a81939c6-14ec-4dcc-99cd-55f57077719c"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:17.570901 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-18d8566d-280b-4406-bf25-7890c88ce7cf req-1a30505a-da0b-4bd4-a6a9-d8458bfc7b5e service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:17.571353 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-18d8566d-280b-4406-bf25-7890c88ce7cf req-1a30505a-da0b-4bd4-a6a9-d8458bfc7b5e service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:17.589245 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-18d8566d-280b-4406-bf25-7890c88ce7cf req-1a30505a-da0b-4bd4-a6a9-d8458bfc7b5e service nova] Creating event network-changed:a81939c6-14ec-4dcc-99cd-55f57077719c for instance 035abb75-eda1-447d-b034-2bbb171f704e on n-h1-844739-1 Jun 05 08:25:17.597710 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-18d8566d-280b-4406-bf25-7890c88ce7cf req-1a30505a-da0b-4bd4-a6a9-d8458bfc7b5e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041671 Jun 05 08:25:17.598591 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 354/719] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:17.607061 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-05345c9a-c5f8-4abd-b64d-44ab83eb38f9 req-07cf3097-d30f-470d-9eb0-c08910a6c279 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "984c9830-3956-48fd-ab9e-8aad63a9cd97", "tag": "4128ae0a-58ff-43c8-ad0a-94d8da88b8dc"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:17.638703 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-05345c9a-c5f8-4abd-b64d-44ab83eb38f9 req-07cf3097-d30f-470d-9eb0-c08910a6c279 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:17.639698 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-05345c9a-c5f8-4abd-b64d-44ab83eb38f9 req-07cf3097-d30f-470d-9eb0-c08910a6c279 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:17.668471 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-05345c9a-c5f8-4abd-b64d-44ab83eb38f9 req-07cf3097-d30f-470d-9eb0-c08910a6c279 service nova] Creating event network-changed:4128ae0a-58ff-43c8-ad0a-94d8da88b8dc for instance 984c9830-3956-48fd-ab9e-8aad63a9cd97 on n-h2-844739-1 Jun 05 08:25:17.677842 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-05345c9a-c5f8-4abd-b64d-44ab83eb38f9 req-07cf3097-d30f-470d-9eb0-c08910a6c279 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076616 Jun 05 08:25:17.679292 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 355/720] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:17.770613 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0fcdc71e-6602-4788-a96e-4a6a420dc9e8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:17.783888 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0fcdc71e-6602-4788-a96e-4a6a420dc9e8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1311 microversion: 2.1 time: 0.326934 Jun 05 08:25:17.785508 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 366/721] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:17 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1311 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:25:17.900555 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2ef5dc1e-6086-495d-9d77-c6b98017e395 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:17.902352 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2ef5dc1e-6086-495d-9d77-c6b98017e395 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:17.912542 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2ef5dc1e-6086-495d-9d77-c6b98017e395 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:17.913163 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2ef5dc1e-6086-495d-9d77-c6b98017e395 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:17.914679 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2ef5dc1e-6086-495d-9d77-c6b98017e395 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:17.915284 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2ef5dc1e-6086-495d-9d77-c6b98017e395 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:17.939640 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:17.982033 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bdeebd39-e08e-4fb6-86d5-7d6dae855a27 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:17.983972 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-bdeebd39-e08e-4fb6-86d5-7d6dae855a27 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] [instance: 66aeb103-f664-4b53-921a-79ae7685365e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:17.993278 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bdeebd39-e08e-4fb6-86d5-7d6dae855a27 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:17.994221 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bdeebd39-e08e-4fb6-86d5-7d6dae855a27 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:17.995158 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bdeebd39-e08e-4fb6-86d5-7d6dae855a27 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:17.995739 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bdeebd39-e08e-4fb6-86d5-7d6dae855a27 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:18.109629 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2ef5dc1e-6086-495d-9d77-c6b98017e395 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:18.121234 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2ef5dc1e-6086-495d-9d77-c6b98017e395 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:18.123114 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2ef5dc1e-6086-495d-9d77-c6b98017e395 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:18.124788 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2ef5dc1e-6086-495d-9d77-c6b98017e395 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 1568 microversion: 2.25 time: 0.228905 Jun 05 08:25:18.144725 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 356/722] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:17 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:18.243559 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=100 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:18.254137 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bdeebd39-e08e-4fb6-86d5-7d6dae855a27 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e" status: 200 len: 1612 microversion: 2.1 time: 0.276291 Jun 05 08:25:18.255002 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 367/723] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:17 2022] GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e => generated 1612 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:18.271391 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0e0f02ad-578d-485f-843d-92b53c2539a7 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:18.272282 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0e0f02ad-578d-485f-843d-92b53c2539a7 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] [instance: 66aeb103-f664-4b53-921a-79ae7685365e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:18.278941 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0e0f02ad-578d-485f-843d-92b53c2539a7 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:18.279637 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0e0f02ad-578d-485f-843d-92b53c2539a7 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:18.280638 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0e0f02ad-578d-485f-843d-92b53c2539a7 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:18.281259 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0e0f02ad-578d-485f-843d-92b53c2539a7 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:18.368147 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-0e0f02ad-578d-485f-843d-92b53c2539a7 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] HTTP exception thrown: Cannot 'migrate' instance 66aeb103-f664-4b53-921a-79ae7685365e while it is in vm_state suspended Jun 05 08:25:18.369892 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0e0f02ad-578d-485f-843d-92b53c2539a7 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Request method failure captured: Jun 05 08:25:18.369892 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e/action HTTP/1.1 Jun 05 08:25:18.369892 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:25:18.369892 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:25:18.369892 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:25:18.369892 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 15 Jun 05 08:25:18.369892 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:25:18.369892 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:25:18.369892 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:25:18.369892 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:25:18.369892 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGhH2PotCnO8-KI1vbAL7yHvxYW1RfsAKSSDjvWVKJI_2zZgpgQxHtJ66D581i94QEDoiDNhIeebXM6v2x49P-1olCQjkByKpMUMKfA8SZQnfEYu9LhMDYOCMzzVw7CN72_pXlmMkPoggQij99AWRVGH7A2sHPFyV2cxT3Q9N5K1AWw Jun 05 08:25:18.369892 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:25:18.369892 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:25:18.369892 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:25:18.369892 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:25:18.369892 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:25:18.369892 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:25:18.369892 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 81a08ddb66314b5ea740cf83434d8a9e Jun 05 08:25:18.369892 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1425902367 Jun 05 08:25:18.369892 n-d-844739-1 devstack@n-api.service[119050]: X-Role: admin,reader,member Jun 05 08:25:18.369892 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: admin,reader,member Jun 05 08:25:18.371405 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/81a08ddb66314b5ea740cf83434d8a9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/81a08ddb66314b5ea740cf83434d8a9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_81a08ddb66314b5ea740cf83434d8a9e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/81a08ddb66314b5ea740cf83434d8a9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:25:18.371405 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1425902367 Jun 05 08:25:18.371405 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 81a08ddb66314b5ea740cf83434d8a9e Jun 05 08:25:18.371405 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1425902367 Jun 05 08:25:18.371405 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ServersAdminNegativeTestJSON-1425902367-project-admin Jun 05 08:25:18.371405 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:25:18.371405 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:25:18.371405 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: b1d4e395484a46b791636b8b76c09fd9 Jun 05 08:25:18.371405 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1425902367-project-admin Jun 05 08:25:18.371405 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:25:18.371405 n-d-844739-1 devstack@n-api.service[119050]: {"migrate": {}} Jun 05 08:25:18.371405 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:25:18.371405 n-d-844739-1 devstack@n-api.service[119050]: exception: Cannot 'migrate' instance 66aeb103-f664-4b53-921a-79ae7685365e while it is in vm_state suspended Jun 05 08:25:18.372283 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '66aeb103-f664-4b53-921a-79ae7685365e', 'body': {'migrate': {}}} Jun 05 08:25:18.372283 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:25:18.372283 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:25:18.372283 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jun 05 08:25:18.372283 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jun 05 08:25:18.372283 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 05 08:25:18.372283 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 05 08:25:18.372283 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 05 08:25:18.372283 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 05 08:25:18.372283 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 05 08:25:18.372283 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 05 08:25:18.372283 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 05 08:25:18.372283 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 05 08:25:18.372283 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 05 08:25:18.372283 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 05 08:25:18.372283 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 05 08:25:18.372283 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 05 08:25:18.372283 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 66aeb103-f664-4b53-921a-79ae7685365e in vm_state suspended. Cannot resize while the instance is in this state. Jun 05 08:25:18.372283 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:25:18.373499 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:25:18.373499 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:25:18.373499 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:25:18.373499 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:25:18.373499 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:25:18.373499 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:25:18.373499 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:25:18.373499 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:25:18.373499 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:25:18.373499 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:25:18.373499 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:25:18.373499 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jun 05 08:25:18.373499 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 05 08:25:18.373499 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 05 08:25:18.373499 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 05 08:25:18.373499 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 66aeb103-f664-4b53-921a-79ae7685365e while it is in vm_state suspended Jun 05 08:25:18.373499 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:25:18.373499 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:25:18.373499 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:25:18.373499 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:25:18.374853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:25:18.374853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:25:18.374853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:25:18.374853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:25:18.374853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 66aeb103-f664-4b53-921a-79ae7685365e while it is in vm_state suspended Jun 05 08:25:18.374853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:25:18.374853 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0e0f02ad-578d-485f-843d-92b53c2539a7 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Returning 409 to user: Cannot 'migrate' instance 66aeb103-f664-4b53-921a-79ae7685365e while it is in vm_state suspended {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:25:18.374853 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0e0f02ad-578d-485f-843d-92b53c2539a7 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e/action" status: 409 len: 148 microversion: 2.1 time: 0.104594 Jun 05 08:25:18.374853 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 357/724] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Jun 5 08:25:18 2022] POST /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e/action => generated 148 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 05 08:25:18.383765 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a551b048-d1fe-4c3e-9474-3ea5ceb769d0 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:18.386459 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a551b048-d1fe-4c3e-9474-3ea5ceb769d0 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Request method failure captured: Jun 05 08:25:18.386459 n-d-844739-1 devstack@n-api.service[119049]: request: POST /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88/action HTTP/1.1 Jun 05 08:25:18.386459 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:25:18.386459 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:25:18.386459 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:25:18.386459 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 39 Jun 05 08:25:18.386459 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:25:18.386459 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:25:18.386459 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:25:18.386459 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:25:18.386459 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGhH2PotCnO8-KI1vbAL7yHvxYW1RfsAKSSDjvWVKJI_2zZgpgQxHtJ66D581i94QEDoiDNhIeebXM6v2x49P-1olCQjkByKpMUMKfA8SZQnfEYu9LhMDYOCMzzVw7CN72_pXlmMkPoggQij99AWRVGH7A2sHPFyV2cxT3Q9N5K1AWw Jun 05 08:25:18.386459 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:25:18.386459 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:25:18.386459 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:25:18.386459 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:25:18.386459 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:25:18.386459 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:25:18.386459 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 81a08ddb66314b5ea740cf83434d8a9e Jun 05 08:25:18.386459 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1425902367 Jun 05 08:25:18.386459 n-d-844739-1 devstack@n-api.service[119049]: X-Role: admin,reader,member Jun 05 08:25:18.386459 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: admin,reader,member Jun 05 08:25:18.387699 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/81a08ddb66314b5ea740cf83434d8a9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/81a08ddb66314b5ea740cf83434d8a9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_81a08ddb66314b5ea740cf83434d8a9e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/81a08ddb66314b5ea740cf83434d8a9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:25:18.387699 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1425902367 Jun 05 08:25:18.387699 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 81a08ddb66314b5ea740cf83434d8a9e Jun 05 08:25:18.387699 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1425902367 Jun 05 08:25:18.387699 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ServersAdminNegativeTestJSON-1425902367-project-admin Jun 05 08:25:18.387699 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:25:18.387699 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:25:18.387699 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: b1d4e395484a46b791636b8b76c09fd9 Jun 05 08:25:18.387699 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1425902367-project-admin Jun 05 08:25:18.387699 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:25:18.387699 n-d-844739-1 devstack@n-api.service[119049]: {"os-resetState": {"state": "invalid"}} Jun 05 08:25:18.387699 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:25:18.392758 n-d-844739-1 devstack@n-api.service[119049]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jun 05 08:25:18.392758 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '828624fb-b333-41c7-81a2-28d9bb4e1d88', 'body': {'os-resetState': {'state': 'invalid'}}} Jun 05 08:25:18.392758 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:25:18.392758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:25:18.392758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 05 08:25:18.392758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 05 08:25:18.392758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 05 08:25:18.392758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise error Jun 05 08:25:18.392758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jun 05 08:25:18.392758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:25:18.392758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jun 05 08:25:18.392758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jun 05 08:25:18.392758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:25:18.392758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jun 05 08:25:18.392758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi 'invalid' Jun 05 08:25:18.392758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:25:18.392758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:25:18.392758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:25:18.392758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:25:18.392758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:25:18.392758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:25:18.392758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:25:18.394522 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:25:18.394522 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:25:18.394522 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:25:18.394522 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 05 08:25:18.394522 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 05 08:25:18.394522 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 05 08:25:18.394522 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 05 08:25:18.394522 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 05 08:25:18.394522 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 05 08:25:18.394522 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jun 05 08:25:18.394522 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:25:18.394522 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:25:18.394522 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:25:18.394522 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:25:18.394522 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:25:18.394522 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:25:18.394522 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 05 08:25:18.394522 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 05 08:25:18.394522 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jun 05 08:25:18.395624 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:25:18.395624 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a551b048-d1fe-4c3e-9474-3ea5ceb769d0 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:25:18.395624 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a551b048-d1fe-4c3e-9474-3ea5ceb769d0 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88/action" status: 400 len: 144 microversion: 2.1 time: 0.008595 Jun 05 08:25:18.395624 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 368/725] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Jun 5 08:25:18 2022] POST /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88/action => generated 144 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 05 08:25:18.408985 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b521ccde-cb63-4be9-9b21-54e4f2c00bad tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:18.412400 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b521ccde-cb63-4be9-9b21-54e4f2c00bad tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Request method failure captured: Jun 05 08:25:18.412400 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88/action HTTP/1.1 Jun 05 08:25:18.412400 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:25:18.412400 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:25:18.412400 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:25:18.412400 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 31 Jun 05 08:25:18.412400 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:25:18.412400 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:25:18.412400 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:25:18.412400 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:25:18.412400 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGhH2PotCnO8-KI1vbAL7yHvxYW1RfsAKSSDjvWVKJI_2zZgpgQxHtJ66D581i94QEDoiDNhIeebXM6v2x49P-1olCQjkByKpMUMKfA8SZQnfEYu9LhMDYOCMzzVw7CN72_pXlmMkPoggQij99AWRVGH7A2sHPFyV2cxT3Q9N5K1AWw Jun 05 08:25:18.412400 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:25:18.412400 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:25:18.412400 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:25:18.412400 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:25:18.412400 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:25:18.412400 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:25:18.412400 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 81a08ddb66314b5ea740cf83434d8a9e Jun 05 08:25:18.412400 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1425902367 Jun 05 08:25:18.412400 n-d-844739-1 devstack@n-api.service[119050]: X-Role: admin,reader,member Jun 05 08:25:18.412400 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: admin,reader,member Jun 05 08:25:18.414368 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/81a08ddb66314b5ea740cf83434d8a9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/81a08ddb66314b5ea740cf83434d8a9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_81a08ddb66314b5ea740cf83434d8a9e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/81a08ddb66314b5ea740cf83434d8a9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:25:18.414368 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1425902367 Jun 05 08:25:18.414368 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 81a08ddb66314b5ea740cf83434d8a9e Jun 05 08:25:18.414368 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1425902367 Jun 05 08:25:18.414368 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ServersAdminNegativeTestJSON-1425902367-project-admin Jun 05 08:25:18.414368 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:25:18.414368 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:25:18.414368 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: b1d4e395484a46b791636b8b76c09fd9 Jun 05 08:25:18.414368 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1425902367-project-admin Jun 05 08:25:18.414368 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:25:18.414368 n-d-844739-1 devstack@n-api.service[119050]: {"os-resetState": {"state": 1}} Jun 05 08:25:18.414368 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:25:18.414368 n-d-844739-1 devstack@n-api.service[119050]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jun 05 08:25:18.421525 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '828624fb-b333-41c7-81a2-28d9bb4e1d88', 'body': {'os-resetState': {'state': 1}}} Jun 05 08:25:18.421525 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:25:18.421525 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:25:18.421525 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 05 08:25:18.421525 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 05 08:25:18.421525 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 05 08:25:18.421525 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise error Jun 05 08:25:18.421525 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jun 05 08:25:18.421525 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:25:18.421525 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jun 05 08:25:18.421525 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jun 05 08:25:18.421525 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:25:18.421525 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jun 05 08:25:18.421525 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi 1 Jun 05 08:25:18.421525 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:25:18.421525 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:25:18.421525 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:25:18.421525 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:25:18.421525 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:25:18.421525 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:25:18.421525 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:25:18.421525 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:25:18.424787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:25:18.424787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:25:18.424787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 05 08:25:18.424787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 05 08:25:18.424787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 05 08:25:18.424787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 05 08:25:18.424787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 05 08:25:18.424787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 05 08:25:18.424787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jun 05 08:25:18.424787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:25:18.424787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:25:18.424787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:25:18.424787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:25:18.424787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:25:18.424787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:25:18.424787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 05 08:25:18.424787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 05 08:25:18.424787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jun 05 08:25:18.424787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:25:18.426802 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b521ccde-cb63-4be9-9b21-54e4f2c00bad tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:25:18.426802 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b521ccde-cb63-4be9-9b21-54e4f2c00bad tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88/action" status: 400 len: 120 microversion: 2.1 time: 0.009259 Jun 05 08:25:18.426802 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 358/726] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Jun 5 08:25:18 2022] POST /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88/action => generated 120 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 05 08:25:18.427081 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-529abda1-f224-4e8b-9565-a9267c98fc84 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:18.427081 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-529abda1-f224-4e8b-9565-a9267c98fc84 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 8719f86c-4f4f-4c65-b580-c5d526d05175] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:18.437928 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-529abda1-f224-4e8b-9565-a9267c98fc84 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:18.438377 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-529abda1-f224-4e8b-9565-a9267c98fc84 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:18.439742 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-529abda1-f224-4e8b-9565-a9267c98fc84 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:18.442172 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-469e4339-4e8d-4dd5-8ab3-a3ca2ad705d1 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:18.443054 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-469e4339-4e8d-4dd5-8ab3-a3ca2ad705d1 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Failed to fetch instance by id 999 {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 05 08:25:18.443644 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-469e4339-4e8d-4dd5-8ab3-a3ca2ad705d1 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] HTTP exception thrown: Instance 999 could not be found. Jun 05 08:25:18.444393 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-529abda1-f224-4e8b-9565-a9267c98fc84 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:18.449828 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-469e4339-4e8d-4dd5-8ab3-a3ca2ad705d1 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Request method failure captured: Jun 05 08:25:18.449828 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jun 05 08:25:18.449828 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:25:18.449828 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:25:18.449828 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:25:18.449828 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 37 Jun 05 08:25:18.449828 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:25:18.449828 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:25:18.449828 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:25:18.449828 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:25:18.449828 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGhH2PotCnO8-KI1vbAL7yHvxYW1RfsAKSSDjvWVKJI_2zZgpgQxHtJ66D581i94QEDoiDNhIeebXM6v2x49P-1olCQjkByKpMUMKfA8SZQnfEYu9LhMDYOCMzzVw7CN72_pXlmMkPoggQij99AWRVGH7A2sHPFyV2cxT3Q9N5K1AWw Jun 05 08:25:18.449828 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:25:18.449828 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:25:18.449828 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:25:18.449828 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:25:18.449828 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:25:18.449828 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:25:18.449828 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 81a08ddb66314b5ea740cf83434d8a9e Jun 05 08:25:18.449828 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1425902367 Jun 05 08:25:18.449828 n-d-844739-1 devstack@n-api.service[119050]: X-Role: admin,reader,member Jun 05 08:25:18.449828 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: admin,reader,member Jun 05 08:25:18.451356 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/81a08ddb66314b5ea740cf83434d8a9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/81a08ddb66314b5ea740cf83434d8a9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_81a08ddb66314b5ea740cf83434d8a9e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/81a08ddb66314b5ea740cf83434d8a9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:25:18.451356 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1425902367 Jun 05 08:25:18.451356 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 81a08ddb66314b5ea740cf83434d8a9e Jun 05 08:25:18.451356 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1425902367 Jun 05 08:25:18.451356 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ServersAdminNegativeTestJSON-1425902367-project-admin Jun 05 08:25:18.451356 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:25:18.451356 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:25:18.451356 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: b1d4e395484a46b791636b8b76c09fd9 Jun 05 08:25:18.451356 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1425902367-project-admin Jun 05 08:25:18.451356 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:25:18.451356 n-d-844739-1 devstack@n-api.service[119050]: {"os-resetState": {"state": "error"}} Jun 05 08:25:18.451356 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:25:18.451356 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 999 could not be found. Jun 05 08:25:18.452293 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jun 05 08:25:18.452293 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:25:18.452293 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:25:18.452293 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:25:18.452293 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:25:18.452293 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 05 08:25:18.452293 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 05 08:25:18.452293 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jun 05 08:25:18.452293 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:25:18.452293 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:25:18.452293 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:25:18.452293 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:25:18.452293 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:25:18.452293 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:25:18.452293 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:25:18.452293 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:25:18.452293 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:25:18.452293 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:25:18.452293 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:25:18.452293 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:25:18.452293 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jun 05 08:25:18.453685 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 05 08:25:18.453685 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:25:18.453685 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:25:18.453685 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jun 05 08:25:18.453685 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:25:18.453685 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:25:18.453685 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:25:18.453685 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:25:18.453685 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:25:18.453685 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:25:18.453685 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:25:18.453685 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:25:18.453685 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jun 05 08:25:18.453685 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:25:18.453685 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-469e4339-4e8d-4dd5-8ab3-a3ca2ad705d1 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:25:18.453685 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-469e4339-4e8d-4dd5-8ab3-a3ca2ad705d1 tempest-ServersAdminNegativeTestJSON-1425902367 tempest-ServersAdminNegativeTestJSON-1425902367-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.018061 Jun 05 08:25:18.455094 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 359/727] 10.222.0.33 () {60 vars in 1178 bytes} [Sun Jun 5 08:25:18 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:25:18.479730 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-60e8de24-3bb9-4bf3-b5c7-bf265c8f797e tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:18.481514 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-60e8de24-3bb9-4bf3-b5c7-bf265c8f797e tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 66aeb103-f664-4b53-921a-79ae7685365e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:18.491339 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-60e8de24-3bb9-4bf3-b5c7-bf265c8f797e tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:18.491806 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-60e8de24-3bb9-4bf3-b5c7-bf265c8f797e tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:18.492721 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-60e8de24-3bb9-4bf3-b5c7-bf265c8f797e tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:18.493302 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-60e8de24-3bb9-4bf3-b5c7-bf265c8f797e tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:18.520731 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-60e8de24-3bb9-4bf3-b5c7-bf265c8f797e tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 66aeb103-f664-4b53-921a-79ae7685365e] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:25:18.621096 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-529abda1-f224-4e8b-9565-a9267c98fc84 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:18.631957 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-529abda1-f224-4e8b-9565-a9267c98fc84 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175" status: 200 len: 1316 microversion: 2.1 time: 0.212243 Jun 05 08:25:18.633223 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 369/728] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:18 2022] GET /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175 => generated 1316 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:18.638306 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fad8e4c1-1a7e-475b-89b1-c17ba947e42a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:18.638917 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-fad8e4c1-1a7e-475b-89b1-c17ba947e42a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:18.657333 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-60e8de24-3bb9-4bf3-b5c7-bf265c8f797e tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "DELETE /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e" status: 204 len: 0 microversion: 2.1 time: 0.192460 Jun 05 08:25:18.660152 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fad8e4c1-1a7e-475b-89b1-c17ba947e42a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:18.661094 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fad8e4c1-1a7e-475b-89b1-c17ba947e42a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:18.661396 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fad8e4c1-1a7e-475b-89b1-c17ba947e42a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:18.662458 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fad8e4c1-1a7e-475b-89b1-c17ba947e42a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:18.663282 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 360/729] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:25:18 2022] DELETE /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:25:18.687498 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5367dfbd-2887-4a8d-8a6b-af4782db2278 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:18.688762 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5367dfbd-2887-4a8d-8a6b-af4782db2278 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 66aeb103-f664-4b53-921a-79ae7685365e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:18.698591 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5367dfbd-2887-4a8d-8a6b-af4782db2278 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:18.699370 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5367dfbd-2887-4a8d-8a6b-af4782db2278 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:18.700391 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5367dfbd-2887-4a8d-8a6b-af4782db2278 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:18.701526 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5367dfbd-2887-4a8d-8a6b-af4782db2278 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:18.720751 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fad8e4c1-1a7e-475b-89b1-c17ba947e42a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:18.721553 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fad8e4c1-1a7e-475b-89b1-c17ba947e42a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:18.722638 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-fad8e4c1-1a7e-475b-89b1-c17ba947e42a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:18.776120 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-fad8e4c1-1a7e-475b-89b1-c17ba947e42a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:18.791857 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fad8e4c1-1a7e-475b-89b1-c17ba947e42a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.157143 Jun 05 08:25:18.801753 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 370/730] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:18 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:18.807141 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-cf463abc-371c-4a1c-becb-56433adbc839 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:18.807963 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-cf463abc-371c-4a1c-becb-56433adbc839 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:18.814558 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cf463abc-371c-4a1c-becb-56433adbc839 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:18.815218 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cf463abc-371c-4a1c-becb-56433adbc839 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:18.816229 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cf463abc-371c-4a1c-becb-56433adbc839 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:18.817023 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cf463abc-371c-4a1c-becb-56433adbc839 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:19.026595 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5367dfbd-2887-4a8d-8a6b-af4782db2278 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704cd9e8b0984139b58ec6abe3579576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8b37e66d354ce09c4bef01d28ef7a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:19.048558 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5367dfbd-2887-4a8d-8a6b-af4782db2278 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e" status: 200 len: 1467 microversion: 2.1 time: 0.380844 Jun 05 08:25:19.050346 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 361/731] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:18 2022] GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e => generated 1467 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:25:19.056153 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-cf463abc-371c-4a1c-becb-56433adbc839 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:19.065052 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-816dd15d-7386-40f1-ad4d-6e9d8a03f5f0 req-fbe12c7b-f7b2-4ca6-98ab-202f70e4d17a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8719f86c-4f4f-4c65-b580-c5d526d05175", "name": "network-vif-plugged", "status": "completed", "tag": "5b4dce05-9412-45a0-ac85-62098ec0ca15"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:19.067319 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-cf463abc-371c-4a1c-becb-56433adbc839 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1311 microversion: 2.1 time: 0.264061 Jun 05 08:25:19.077177 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 371/732] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:18 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1311 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:19.085330 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-816dd15d-7386-40f1-ad4d-6e9d8a03f5f0 req-fbe12c7b-f7b2-4ca6-98ab-202f70e4d17a service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:19.086025 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-816dd15d-7386-40f1-ad4d-6e9d8a03f5f0 req-fbe12c7b-f7b2-4ca6-98ab-202f70e4d17a service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:19.107037 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-816dd15d-7386-40f1-ad4d-6e9d8a03f5f0 req-fbe12c7b-f7b2-4ca6-98ab-202f70e4d17a service nova] Creating event network-vif-plugged:5b4dce05-9412-45a0-ac85-62098ec0ca15 for instance 8719f86c-4f4f-4c65-b580-c5d526d05175 on n-h1-844739-1 Jun 05 08:25:19.115766 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-816dd15d-7386-40f1-ad4d-6e9d8a03f5f0 req-fbe12c7b-f7b2-4ca6-98ab-202f70e4d17a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063509 Jun 05 08:25:19.117182 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 362/733] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:19.147271 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-84e2a052-3b67-49cd-b488-dd462216b327 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:19.148131 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-84e2a052-3b67-49cd-b488-dd462216b327 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:19.154430 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-84e2a052-3b67-49cd-b488-dd462216b327 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:19.154880 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-84e2a052-3b67-49cd-b488-dd462216b327 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:19.155711 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-84e2a052-3b67-49cd-b488-dd462216b327 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:19.156226 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-84e2a052-3b67-49cd-b488-dd462216b327 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:19.310311 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-84e2a052-3b67-49cd-b488-dd462216b327 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:19.319621 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-84e2a052-3b67-49cd-b488-dd462216b327 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:19.321275 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-84e2a052-3b67-49cd-b488-dd462216b327 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:19.322576 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-84e2a052-3b67-49cd-b488-dd462216b327 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 1568 microversion: 2.25 time: 0.179206 Jun 05 08:25:19.323116 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 372/734] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:19 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:19.500350 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5bbff4bb-441c-4c2f-bf10-33c8292ca044 tempest-ExtensionsTest-1936122975 tempest-ExtensionsTest-1936122975-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:19.504120 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5bbff4bb-441c-4c2f-bf10-33c8292ca044 tempest-ExtensionsTest-1936122975 tempest-ExtensionsTest-1936122975-project] 10.222.0.33 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.187018 Jun 05 08:25:19.504718 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 363/735] 10.222.0.33 () {58 vars in 1169 bytes} [Sun Jun 5 08:25:19 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:19.515003 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e162c896-8b68-4e51-a5bd-28f46675c0bb tempest-ExtensionsTest-1936122975 tempest-ExtensionsTest-1936122975-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:19.517625 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e162c896-8b68-4e51-a5bd-28f46675c0bb tempest-ExtensionsTest-1936122975 tempest-ExtensionsTest-1936122975-project] 10.222.0.33 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006182 Jun 05 08:25:19.518630 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 373/736] 10.222.0.33 () {58 vars in 1133 bytes} [Sun Jun 5 08:25:19 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:25:19.650258 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-37f1e8be-5747-4585-885f-21cf8876058d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:19.651272 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-37f1e8be-5747-4585-885f-21cf8876058d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 8719f86c-4f4f-4c65-b580-c5d526d05175] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:19.666790 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-37f1e8be-5747-4585-885f-21cf8876058d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:19.667489 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-37f1e8be-5747-4585-885f-21cf8876058d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:19.668598 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-37f1e8be-5747-4585-885f-21cf8876058d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:19.669157 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-37f1e8be-5747-4585-885f-21cf8876058d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:19.753696 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fce0c54c-13a8-43f9-8812-7620b3bbb39e tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:19.754210 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-fce0c54c-13a8-43f9-8812-7620b3bbb39e tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: e4c09fb3-f67f-4b07-a992-2e70683932bd] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:19.762078 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fce0c54c-13a8-43f9-8812-7620b3bbb39e tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:19.762703 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fce0c54c-13a8-43f9-8812-7620b3bbb39e tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:19.763768 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fce0c54c-13a8-43f9-8812-7620b3bbb39e tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:19.764412 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fce0c54c-13a8-43f9-8812-7620b3bbb39e tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:19.809852 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-fce0c54c-13a8-43f9-8812-7620b3bbb39e tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: e4c09fb3-f67f-4b07-a992-2e70683932bd] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:25:19.933116 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fce0c54c-13a8-43f9-8812-7620b3bbb39e tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd" status: 204 len: 0 microversion: 2.1 time: 0.183574 Jun 05 08:25:19.934159 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 374/737] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:25:19 2022] DELETE /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:25:19.945430 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-42679e6a-07a5-4d6c-829f-6d979436ced9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:19.947131 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-42679e6a-07a5-4d6c-829f-6d979436ced9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:19.959918 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42679e6a-07a5-4d6c-829f-6d979436ced9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:19.960403 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42679e6a-07a5-4d6c-829f-6d979436ced9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:19.963463 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42679e6a-07a5-4d6c-829f-6d979436ced9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:19.964139 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42679e6a-07a5-4d6c-829f-6d979436ced9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:19.996490 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-37f1e8be-5747-4585-885f-21cf8876058d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:20.012116 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-37f1e8be-5747-4585-885f-21cf8876058d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175" status: 200 len: 1316 microversion: 2.1 time: 0.366592 Jun 05 08:25:20.013364 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 364/738] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:19 2022] GET /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175 => generated 1316 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:20.027357 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42679e6a-07a5-4d6c-829f-6d979436ced9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:20.031444 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42679e6a-07a5-4d6c-829f-6d979436ced9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:20.032617 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-42679e6a-07a5-4d6c-829f-6d979436ced9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:20.071290 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-92a4058e-ea42-4f23-b871-f923e31ddd11 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:20.072140 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-92a4058e-ea42-4f23-b871-f923e31ddd11 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 66aeb103-f664-4b53-921a-79ae7685365e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:20.093147 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-92a4058e-ea42-4f23-b871-f923e31ddd11 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:20.093732 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-92a4058e-ea42-4f23-b871-f923e31ddd11 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:20.094618 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-92a4058e-ea42-4f23-b871-f923e31ddd11 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:20.097012 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-92a4058e-ea42-4f23-b871-f923e31ddd11 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:20.110906 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-42679e6a-07a5-4d6c-829f-6d979436ced9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:20.119897 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-42679e6a-07a5-4d6c-829f-6d979436ced9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.184392 Jun 05 08:25:20.129596 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 375/739] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:19 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:20.129596 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9737320e-6583-4f28-86a7-e1c99fd057f8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:20.129596 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9737320e-6583-4f28-86a7-e1c99fd057f8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:20.136001 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9737320e-6583-4f28-86a7-e1c99fd057f8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:20.136412 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9737320e-6583-4f28-86a7-e1c99fd057f8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:20.137386 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9737320e-6583-4f28-86a7-e1c99fd057f8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:20.137996 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9737320e-6583-4f28-86a7-e1c99fd057f8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:20.576373 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-92a4058e-ea42-4f23-b871-f923e31ddd11 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704cd9e8b0984139b58ec6abe3579576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8b37e66d354ce09c4bef01d28ef7a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:20.583623 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9737320e-6583-4f28-86a7-e1c99fd057f8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:20.585638 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-92a4058e-ea42-4f23-b871-f923e31ddd11 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e" status: 200 len: 1467 microversion: 2.1 time: 0.521519 Jun 05 08:25:20.586223 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 365/740] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:20 2022] GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e => generated 1467 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:25:20.591231 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9737320e-6583-4f28-86a7-e1c99fd057f8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1311 microversion: 2.1 time: 0.469083 Jun 05 08:25:20.591788 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 376/741] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:20 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1311 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:20.596163 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fea3eee8-9920-4dea-bf66-e5159d4ef466 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-964432649", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "1541174189", "adminPass": "***", "networks": [{"uuid": "c20801c1-6ea9-471f-94e8-06f626292b48"}], "security_groups": [{"name": "tempest-securitygroup--2089244299"}], "key_name": "tempest-keypair-1041185333", "user_data": "}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:20.745446 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-fea3eee8-9920-4dea-bf66-e5159d4ef466 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] validate_networks() for [('c20801c1-6ea9-471f-94e8-06f626292b48', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:25:20.956308 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-66c6b6be-d39a-4283-972b-a78a29197788 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-2133608484", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "31d802ef-f16b-4f76-a576-58c64ba0a0cf"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:21.013745 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-66c6b6be-d39a-4283-972b-a78a29197788 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] validate_networks() for [('31d802ef-f16b-4f76-a576-58c64ba0a0cf', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:25:21.338987 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-fea3eee8-9920-4dea-bf66-e5159d4ef466 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:25:21.339423 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-fea3eee8-9920-4dea-bf66-e5159d4ef466 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:25:21.339908 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-fea3eee8-9920-4dea-bf66-e5159d4ef466 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:25:21.340513 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-fea3eee8-9920-4dea-bf66-e5159d4ef466 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:25:21.340931 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-fea3eee8-9920-4dea-bf66-e5159d4ef466 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:25:21.354807 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fea3eee8-9920-4dea-bf66-e5159d4ef466 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:21.355477 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fea3eee8-9920-4dea-bf66-e5159d4ef466 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:21.356494 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fea3eee8-9920-4dea-bf66-e5159d4ef466 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:21.357122 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fea3eee8-9920-4dea-bf66-e5159d4ef466 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:21.375611 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-fea3eee8-9920-4dea-bf66-e5159d4ef466 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Getting quotas for project 0348d3b9a38d437c8e82a24be537c848. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:25:21.381324 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-fea3eee8-9920-4dea-bf66-e5159d4ef466 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Getting quotas for user da4cc519c13c4b88bfff58f418bcdb4f and project 0348d3b9a38d437c8e82a24be537c848. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:25:21.397453 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-fea3eee8-9920-4dea-bf66-e5159d4ef466 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:25:21.400234 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-fea3eee8-9920-4dea-bf66-e5159d4ef466 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: 9b80f5d2-a282-4ccc-8db3-c97fa829aefe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:25:21.454150 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fea3eee8-9920-4dea-bf66-e5159d4ef466 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.865846 Jun 05 08:25:21.456203 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 366/742] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:25:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:25:21.464556 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f9c2c207-b110-46eb-98e9-c57759eea189 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:21.465441 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f9c2c207-b110-46eb-98e9-c57759eea189 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:21.493290 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f9c2c207-b110-46eb-98e9-c57759eea189 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:21.494612 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f9c2c207-b110-46eb-98e9-c57759eea189 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:21.495639 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f9c2c207-b110-46eb-98e9-c57759eea189 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:21.496302 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f9c2c207-b110-46eb-98e9-c57759eea189 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:21.745878 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-66c6b6be-d39a-4283-972b-a78a29197788 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:25:21.746464 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-66c6b6be-d39a-4283-972b-a78a29197788 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:25:21.746767 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-66c6b6be-d39a-4283-972b-a78a29197788 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:25:21.747178 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-66c6b6be-d39a-4283-972b-a78a29197788 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:25:21.747591 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-66c6b6be-d39a-4283-972b-a78a29197788 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:25:21.764565 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=28 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:21.768099 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-66c6b6be-d39a-4283-972b-a78a29197788 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:21.768516 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-66c6b6be-d39a-4283-972b-a78a29197788 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:21.769502 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-66c6b6be-d39a-4283-972b-a78a29197788 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:21.769958 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-66c6b6be-d39a-4283-972b-a78a29197788 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:21.804653 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-66c6b6be-d39a-4283-972b-a78a29197788 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Getting quotas for project ad02ddb51f51433a82e0c6361e6ed6eb. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:25:21.810060 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-66c6b6be-d39a-4283-972b-a78a29197788 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Getting quotas for user 1248e0d123924c06bb36aeab9c2fa720 and project ad02ddb51f51433a82e0c6361e6ed6eb. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:25:21.827930 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-66c6b6be-d39a-4283-972b-a78a29197788 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Going to run 3 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:25:21.833351 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-66c6b6be-d39a-4283-972b-a78a29197788 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 32ee0b81-4a5b-4181-b43c-ad4cdecd0a70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:25:21.856454 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f9c2c207-b110-46eb-98e9-c57759eea189 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:21.868073 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f9c2c207-b110-46eb-98e9-c57759eea189 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:21.870253 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f9c2c207-b110-46eb-98e9-c57759eea189 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:21.875622 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f9c2c207-b110-46eb-98e9-c57759eea189 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 1568 microversion: 2.25 time: 0.418041 Jun 05 08:25:21.880401 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 367/743] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:21 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 1568 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:21.885548 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-235540c0-4b06-49a6-8207-7f16ececcfe7 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:21.886381 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-235540c0-4b06-49a6-8207-7f16ececcfe7 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 8719f86c-4f4f-4c65-b580-c5d526d05175] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:21.894181 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-235540c0-4b06-49a6-8207-7f16ececcfe7 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:21.894864 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-235540c0-4b06-49a6-8207-7f16ececcfe7 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:21.896032 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-235540c0-4b06-49a6-8207-7f16ececcfe7 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:21.896828 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-235540c0-4b06-49a6-8207-7f16ececcfe7 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:21.897614 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-66c6b6be-d39a-4283-972b-a78a29197788 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: a1b50f75-ca7f-4320-bbd6-363b4d656cd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=32ee0b81-4a5b-4181-b43c-ad4cdecd0a70,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:25:21.954933 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-66c6b6be-d39a-4283-972b-a78a29197788 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 5ad92c72-624d-411d-b083-8eb7097ffbfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=a1b50f75-ca7f-4320-bbd6-363b4d656cd8,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:25:21.970046 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:22.037756 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-66c6b6be-d39a-4283-972b-a78a29197788 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.440112 Jun 05 08:25:22.038412 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 377/744] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:25:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:25:22.043729 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0157b4b6-04a0-43e9-8b29-f193273e2e60 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:22.044379 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0157b4b6-04a0-43e9-8b29-f193273e2e60 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:22.053219 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0157b4b6-04a0-43e9-8b29-f193273e2e60 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:22.053734 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0157b4b6-04a0-43e9-8b29-f193273e2e60 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:22.054573 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0157b4b6-04a0-43e9-8b29-f193273e2e60 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:22.055122 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0157b4b6-04a0-43e9-8b29-f193273e2e60 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:22.096877 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0157b4b6-04a0-43e9-8b29-f193273e2e60 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:22.097637 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0157b4b6-04a0-43e9-8b29-f193273e2e60 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:22.098184 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-0157b4b6-04a0-43e9-8b29-f193273e2e60 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:22.157992 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-235540c0-4b06-49a6-8207-7f16ececcfe7 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:22.167651 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-235540c0-4b06-49a6-8207-7f16ececcfe7 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175" status: 200 len: 1316 microversion: 2.1 time: 0.285370 Jun 05 08:25:22.169766 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 368/745] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:21 2022] GET /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175 => generated 1316 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:22.180342 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-dc4a2ec6-9fed-4485-81c2-74930dc59d71 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:22.181058 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-dc4a2ec6-9fed-4485-81c2-74930dc59d71 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: 9b80f5d2-a282-4ccc-8db3-c97fa829aefe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:22.190500 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0157b4b6-04a0-43e9-8b29-f193273e2e60 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:22.202172 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dc4a2ec6-9fed-4485-81c2-74930dc59d71 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:22.202823 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0157b4b6-04a0-43e9-8b29-f193273e2e60 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.160794 Jun 05 08:25:22.213969 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 378/746] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:22 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:22.216098 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dc4a2ec6-9fed-4485-81c2-74930dc59d71 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:22.217245 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dc4a2ec6-9fed-4485-81c2-74930dc59d71 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:22.220534 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dc4a2ec6-9fed-4485-81c2-74930dc59d71 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:22.229145 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-af9f3d2a-b0e9-46ce-9e58-9627cd77eaae tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:22.229741 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-af9f3d2a-b0e9-46ce-9e58-9627cd77eaae tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 66aeb103-f664-4b53-921a-79ae7685365e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:22.239558 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-af9f3d2a-b0e9-46ce-9e58-9627cd77eaae tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:22.248704 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-af9f3d2a-b0e9-46ce-9e58-9627cd77eaae tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:22.249788 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-af9f3d2a-b0e9-46ce-9e58-9627cd77eaae tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:22.250388 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-af9f3d2a-b0e9-46ce-9e58-9627cd77eaae tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:22.333832 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-dc4a2ec6-9fed-4485-81c2-74930dc59d71 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:22.348465 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-dc4a2ec6-9fed-4485-81c2-74930dc59d71 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe" status: 200 len: 1260 microversion: 2.1 time: 0.176180 Jun 05 08:25:22.352022 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 369/747] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:22 2022] GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:22.357861 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e56b8b84-c1cb-4df8-ae9c-688f2624f036 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:22.358903 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e56b8b84-c1cb-4df8-ae9c-688f2624f036 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:22.367477 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e56b8b84-c1cb-4df8-ae9c-688f2624f036 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:22.368365 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e56b8b84-c1cb-4df8-ae9c-688f2624f036 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:22.369386 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e56b8b84-c1cb-4df8-ae9c-688f2624f036 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:22.370524 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e56b8b84-c1cb-4df8-ae9c-688f2624f036 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:22.402961 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-af9f3d2a-b0e9-46ce-9e58-9627cd77eaae tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704cd9e8b0984139b58ec6abe3579576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8b37e66d354ce09c4bef01d28ef7a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:22.416985 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-af9f3d2a-b0e9-46ce-9e58-9627cd77eaae tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e" status: 200 len: 1425 microversion: 2.1 time: 0.200183 Jun 05 08:25:22.423853 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 379/748] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:22 2022] GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e => generated 1425 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:22.436315 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7de28098-9835-4f2a-8160-988b5b5f6a54 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:22.455270 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7de28098-9835-4f2a-8160-988b5b5f6a54 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1248e0d123924c06bb36aeab9c2fa720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad02ddb51f51433a82e0c6361e6ed6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:22.456548 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7de28098-9835-4f2a-8160-988b5b5f6a54 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Searching by: {'deleted': False, 'project_id': 'ad02ddb51f51433a82e0c6361e6ed6eb'} {{(pid=119049) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 05 08:25:22.519720 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7de28098-9835-4f2a-8160-988b5b5f6a54 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:22.523281 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7de28098-9835-4f2a-8160-988b5b5f6a54 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:22.524182 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7de28098-9835-4f2a-8160-988b5b5f6a54 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:22.524623 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7de28098-9835-4f2a-8160-988b5b5f6a54 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:22.706407 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7de28098-9835-4f2a-8160-988b5b5f6a54 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.279735 Jun 05 08:25:22.707372 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 380/749] 10.222.0.33 () {58 vars in 1124 bytes} [Sun Jun 5 08:25:22 2022] GET /compute/v2.1/servers => generated 1018 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:22.713057 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-e5fbff29-e3df-469b-a358-7f2b0cf741ac req-3db29679-8504-4f11-b95d-a7ab9b0a5724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66aeb103-f664-4b53-921a-79ae7685365e", "name": "network-vif-deleted", "tag": "69e0434d-65a6-4b9f-849b-02a37c0de9ac"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:22.723260 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-e5fbff29-e3df-469b-a358-7f2b0cf741ac req-3db29679-8504-4f11-b95d-a7ab9b0a5724 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:22.723989 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-e5fbff29-e3df-469b-a358-7f2b0cf741ac req-3db29679-8504-4f11-b95d-a7ab9b0a5724 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:22.739429 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-e5fbff29-e3df-469b-a358-7f2b0cf741ac req-3db29679-8504-4f11-b95d-a7ab9b0a5724 service nova] Creating event network-vif-deleted:69e0434d-65a6-4b9f-849b-02a37c0de9ac for instance 66aeb103-f664-4b53-921a-79ae7685365e on n-h1-844739-1 Jun 05 08:25:22.746033 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-e5fbff29-e3df-469b-a358-7f2b0cf741ac req-3db29679-8504-4f11-b95d-a7ab9b0a5724 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037211 Jun 05 08:25:22.747846 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 381/750] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:22.756184 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7a672771-ffd9-41f4-8ff7-ebcff69aead0 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:22.757115 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7a672771-ffd9-41f4-8ff7-ebcff69aead0 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 5ad92c72-624d-411d-b083-8eb7097ffbfe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:22.864028 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7a672771-ffd9-41f4-8ff7-ebcff69aead0 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e0d123924c06bb36aeab9c2fa720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad02ddb51f51433a82e0c6361e6ed6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:22.873115 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e56b8b84-c1cb-4df8-ae9c-688f2624f036 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:22.880408 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7a672771-ffd9-41f4-8ff7-ebcff69aead0 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe" status: 200 len: 1223 microversion: 2.1 time: 0.131054 Jun 05 08:25:22.881554 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 382/751] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:22 2022] GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe => generated 1223 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:22.894812 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e56b8b84-c1cb-4df8-ae9c-688f2624f036 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1311 microversion: 2.1 time: 0.541543 Jun 05 08:25:22.895906 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 370/752] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:22 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1311 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:22.910403 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e219a003-e874-483f-b7ad-502195e5b9d2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:22.911789 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e219a003-e874-483f-b7ad-502195e5b9d2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:22.929454 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e219a003-e874-483f-b7ad-502195e5b9d2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:22.932952 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e219a003-e874-483f-b7ad-502195e5b9d2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:22.938649 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e219a003-e874-483f-b7ad-502195e5b9d2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:22.940648 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e219a003-e874-483f-b7ad-502195e5b9d2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:23.179245 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-40ebebd8-ef28-49ca-b30a-2e399f721e8d req-570aa9fd-c00d-4f9f-929b-7c62630da18f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "984c9830-3956-48fd-ab9e-8aad63a9cd97", "name": "network-vif-plugged", "status": "completed", "tag": "4128ae0a-58ff-43c8-ad0a-94d8da88b8dc"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:23.200883 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-40ebebd8-ef28-49ca-b30a-2e399f721e8d req-570aa9fd-c00d-4f9f-929b-7c62630da18f service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:23.206085 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-40ebebd8-ef28-49ca-b30a-2e399f721e8d req-570aa9fd-c00d-4f9f-929b-7c62630da18f service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:23.232369 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-40ebebd8-ef28-49ca-b30a-2e399f721e8d req-570aa9fd-c00d-4f9f-929b-7c62630da18f service nova] Creating event network-vif-plugged:4128ae0a-58ff-43c8-ad0a-94d8da88b8dc for instance 984c9830-3956-48fd-ab9e-8aad63a9cd97 on n-h2-844739-1 Jun 05 08:25:23.239464 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-40ebebd8-ef28-49ca-b30a-2e399f721e8d req-570aa9fd-c00d-4f9f-929b-7c62630da18f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063903 Jun 05 08:25:23.246806 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 371/753] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:25:23.253666 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5086b166-5253-4a2a-b65f-743a6885b9df tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:23.254374 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5086b166-5253-4a2a-b65f-743a6885b9df tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 8719f86c-4f4f-4c65-b580-c5d526d05175] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:23.279601 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5086b166-5253-4a2a-b65f-743a6885b9df tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:23.280741 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5086b166-5253-4a2a-b65f-743a6885b9df tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:23.281812 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5086b166-5253-4a2a-b65f-743a6885b9df tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:23.282476 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5086b166-5253-4a2a-b65f-743a6885b9df tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:23.660251 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e219a003-e874-483f-b7ad-502195e5b9d2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:23.669890 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e219a003-e874-483f-b7ad-502195e5b9d2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:23.675879 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e219a003-e874-483f-b7ad-502195e5b9d2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:23.685685 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e219a003-e874-483f-b7ad-502195e5b9d2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 1568 microversion: 2.25 time: 0.790559 Jun 05 08:25:23.686980 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 383/754] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:22 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 1568 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:25:23.701997 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-dc7eca6a-3bc0-482a-b53d-03fd41f50f02 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:23.707829 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-dc7eca6a-3bc0-482a-b53d-03fd41f50f02 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:23.718502 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc7eca6a-3bc0-482a-b53d-03fd41f50f02 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:23.720274 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc7eca6a-3bc0-482a-b53d-03fd41f50f02 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:23.723733 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc7eca6a-3bc0-482a-b53d-03fd41f50f02 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:23.729375 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc7eca6a-3bc0-482a-b53d-03fd41f50f02 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:23.822977 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5086b166-5253-4a2a-b65f-743a6885b9df tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:23.835408 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5086b166-5253-4a2a-b65f-743a6885b9df tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175" status: 200 len: 1465 microversion: 2.1 time: 0.587246 Jun 05 08:25:23.839759 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 372/755] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:23 2022] GET /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175 => generated 1465 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:23.854125 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc7eca6a-3bc0-482a-b53d-03fd41f50f02 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:23.855200 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc7eca6a-3bc0-482a-b53d-03fd41f50f02 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:23.856181 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-dc7eca6a-3bc0-482a-b53d-03fd41f50f02 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:23.980185 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-dc7eca6a-3bc0-482a-b53d-03fd41f50f02 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:23.991097 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-dc7eca6a-3bc0-482a-b53d-03fd41f50f02 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.302560 Jun 05 08:25:23.993301 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 384/756] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:23 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:23.998562 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-aed7a183-220d-4509-af04-92236ccb944b tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:23.999239 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-aed7a183-220d-4509-af04-92236ccb944b tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: 9b80f5d2-a282-4ccc-8db3-c97fa829aefe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:24.018232 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aed7a183-220d-4509-af04-92236ccb944b tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:24.023950 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aed7a183-220d-4509-af04-92236ccb944b tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:24.025171 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aed7a183-220d-4509-af04-92236ccb944b tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:24.030712 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aed7a183-220d-4509-af04-92236ccb944b tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:24.053250 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5631217b-0774-4e94-b12b-1116cf695c10 tempest-ComputeTenantNetworksTest-2105402657 tempest-ComputeTenantNetworksTest-2105402657-project] Calling method '.version_select at 0x7f2440569040>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:24.222239 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-aed7a183-220d-4509-af04-92236ccb944b tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:24.236071 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-aed7a183-220d-4509-af04-92236ccb944b tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe" status: 200 len: 1322 microversion: 2.1 time: 0.237664 Jun 05 08:25:24.239411 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 385/757] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:23 2022] GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:24.252238 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e142aa26-4411-4d94-8949-b5089a261a2a tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:24.252883 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e142aa26-4411-4d94-8949-b5089a261a2a tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 66aeb103-f664-4b53-921a-79ae7685365e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:24.279423 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e142aa26-4411-4d94-8949-b5089a261a2a tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:24.284305 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e142aa26-4411-4d94-8949-b5089a261a2a tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:24.287234 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e142aa26-4411-4d94-8949-b5089a261a2a tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:24.290070 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e142aa26-4411-4d94-8949-b5089a261a2a tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:24.330743 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:24.357450 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e142aa26-4411-4d94-8949-b5089a261a2a tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:24.357953 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e142aa26-4411-4d94-8949-b5089a261a2a tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:24.358415 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-e142aa26-4411-4d94-8949-b5089a261a2a tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lazy-loading 'fault' on Instance uuid 66aeb103-f664-4b53-921a-79ae7685365e {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:24.402688 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5631217b-0774-4e94-b12b-1116cf695c10 tempest-ComputeTenantNetworksTest-2105402657 tempest-ComputeTenantNetworksTest-2105402657-project] 10.222.0.33 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.560529 Jun 05 08:25:24.409572 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 373/758] 10.222.0.33 () {58 vars in 1157 bytes} [Sun Jun 5 08:25:23 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:24.440636 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e142aa26-4411-4d94-8949-b5089a261a2a tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704cd9e8b0984139b58ec6abe3579576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8b37e66d354ce09c4bef01d28ef7a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:24.453425 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e142aa26-4411-4d94-8949-b5089a261a2a tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e" status: 200 len: 1366 microversion: 2.1 time: 0.212814 Jun 05 08:25:24.453975 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 386/759] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:24 2022] GET /compute/v2.1/servers/66aeb103-f664-4b53-921a-79ae7685365e => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:24.466790 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-94b9abc3-0e98-4f05-9a92-beb105a2482c tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:24.466790 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-94b9abc3-0e98-4f05-9a92-beb105a2482c tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 5ad92c72-624d-411d-b083-8eb7097ffbfe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:24.474229 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-94b9abc3-0e98-4f05-9a92-beb105a2482c tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:24.474915 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-94b9abc3-0e98-4f05-9a92-beb105a2482c tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:24.477119 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-94b9abc3-0e98-4f05-9a92-beb105a2482c tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:24.477867 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-94b9abc3-0e98-4f05-9a92-beb105a2482c tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:24.713469 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3693a4f5-bc73-4ee7-9534-e6cc932c40ac tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:24.714393 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3693a4f5-bc73-4ee7-9534-e6cc932c40ac tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] [instance: 8719f86c-4f4f-4c65-b580-c5d526d05175] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:24.724900 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3693a4f5-bc73-4ee7-9534-e6cc932c40ac tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:24.725925 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3693a4f5-bc73-4ee7-9534-e6cc932c40ac tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:24.727100 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3693a4f5-bc73-4ee7-9534-e6cc932c40ac tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:24.728980 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3693a4f5-bc73-4ee7-9534-e6cc932c40ac tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:24.767789 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-94b9abc3-0e98-4f05-9a92-beb105a2482c tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e0d123924c06bb36aeab9c2fa720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad02ddb51f51433a82e0c6361e6ed6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:24.809217 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-94b9abc3-0e98-4f05-9a92-beb105a2482c tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe" status: 200 len: 1275 microversion: 2.1 time: 0.347898 Jun 05 08:25:24.816758 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 387/760] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:24 2022] GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe => generated 1275 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:24.838123 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-92c82081-ba16-4076-9389-a54f64830d36 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:24.839026 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-92c82081-ba16-4076-9389-a54f64830d36 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:24.871445 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-92c82081-ba16-4076-9389-a54f64830d36 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:24.877686 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-92c82081-ba16-4076-9389-a54f64830d36 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:24.878906 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-92c82081-ba16-4076-9389-a54f64830d36 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:24.881898 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-92c82081-ba16-4076-9389-a54f64830d36 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:25.953592 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-92c82081-ba16-4076-9389-a54f64830d36 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:25.962049 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-92c82081-ba16-4076-9389-a54f64830d36 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1311 microversion: 2.1 time: 1.142821 Jun 05 08:25:25.973957 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 388/761] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:24 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1311 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:25.979412 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5dcf41b0-6348-402c-a0e8-b4fe9a2af49a tempest-ComputeTenantNetworksTest-2105402657 tempest-ComputeTenantNetworksTest-2105402657-project] Calling method '.version_select at 0x7f2433d73790>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:26.320815 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5dcf41b0-6348-402c-a0e8-b4fe9a2af49a tempest-ComputeTenantNetworksTest-2105402657 tempest-ComputeTenantNetworksTest-2105402657-project] 10.222.0.33 "GET /compute/v2.1/os-tenant-networks/a9136a0e-3ea3-47a3-9cef-2001c0ae58ff" status: 200 len: 140 microversion: 2.1 time: 0.345467 Jun 05 08:25:26.321839 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 389/762] 10.222.0.33 () {58 vars in 1268 bytes} [Sun Jun 5 08:25:25 2022] GET /compute/v2.1/os-tenant-networks/a9136a0e-3ea3-47a3-9cef-2001c0ae58ff => generated 140 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:26.328225 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c4dd6e6f-026d-4438-97c4-c1a9350c0fe9 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:26.330168 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c4dd6e6f-026d-4438-97c4-c1a9350c0fe9 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 828624fb-b333-41c7-81a2-28d9bb4e1d88] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:26.346072 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c4dd6e6f-026d-4438-97c4-c1a9350c0fe9 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:26.347286 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c4dd6e6f-026d-4438-97c4-c1a9350c0fe9 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:26.348254 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c4dd6e6f-026d-4438-97c4-c1a9350c0fe9 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:26.351640 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c4dd6e6f-026d-4438-97c4-c1a9350c0fe9 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:26.407461 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c4dd6e6f-026d-4438-97c4-c1a9350c0fe9 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 828624fb-b333-41c7-81a2-28d9bb4e1d88] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:25:26.575510 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c4dd6e6f-026d-4438-97c4-c1a9350c0fe9 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "DELETE /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88" status: 204 len: 0 microversion: 2.1 time: 0.251664 Jun 05 08:25:26.576427 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 390/763] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:25:26 2022] DELETE /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:25:26.585821 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-91a1215f-4fca-4610-8b5c-3b4ea9920cd2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:26.586788 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-91a1215f-4fca-4610-8b5c-3b4ea9920cd2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:26.595956 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-91a1215f-4fca-4610-8b5c-3b4ea9920cd2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:26.596792 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-91a1215f-4fca-4610-8b5c-3b4ea9920cd2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:26.598373 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-91a1215f-4fca-4610-8b5c-3b4ea9920cd2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:26.598976 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-91a1215f-4fca-4610-8b5c-3b4ea9920cd2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:26.696645 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3693a4f5-bc73-4ee7-9534-e6cc932c40ac tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175" status: 200 len: 1616 microversion: 2.1 time: 2.281650 Jun 05 08:25:26.700968 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 374/764] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:24 2022] GET /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175 => generated 1616 bytes in 2290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:26.714879 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-acf1a35e-6063-48b3-b7aa-71fd426d9476 req-17f11a50-91d5-4646-b843-670f2f6ba100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c09fb3-f67f-4b07-a992-2e70683932bd", "name": "network-vif-deleted", "tag": "0d4a6d59-7631-4ce9-ba50-a33984101036"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:26.761450 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-acf1a35e-6063-48b3-b7aa-71fd426d9476 req-17f11a50-91d5-4646-b843-670f2f6ba100 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:26.762360 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-acf1a35e-6063-48b3-b7aa-71fd426d9476 req-17f11a50-91d5-4646-b843-670f2f6ba100 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:26.781734 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-acf1a35e-6063-48b3-b7aa-71fd426d9476 req-17f11a50-91d5-4646-b843-670f2f6ba100 service nova] Creating event network-vif-deleted:0d4a6d59-7631-4ce9-ba50-a33984101036 for instance e4c09fb3-f67f-4b07-a992-2e70683932bd on n-h1-844739-1 Jun 05 08:25:26.789860 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-acf1a35e-6063-48b3-b7aa-71fd426d9476 req-17f11a50-91d5-4646-b843-670f2f6ba100 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085554 Jun 05 08:25:26.791317 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 375/765] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:26.802117 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d8372e41-44b5-471f-b390-86f1c3f04bfe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:26.803724 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d8372e41-44b5-471f-b390-86f1c3f04bfe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:26.813730 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d8372e41-44b5-471f-b390-86f1c3f04bfe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:26.823103 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d8372e41-44b5-471f-b390-86f1c3f04bfe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:26.824178 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d8372e41-44b5-471f-b390-86f1c3f04bfe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:26.824920 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d8372e41-44b5-471f-b390-86f1c3f04bfe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:26.880161 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d8372e41-44b5-471f-b390-86f1c3f04bfe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:26.881179 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d8372e41-44b5-471f-b390-86f1c3f04bfe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:26.882045 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-d8372e41-44b5-471f-b390-86f1c3f04bfe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:27.053661 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d8372e41-44b5-471f-b390-86f1c3f04bfe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:27.080852 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d8372e41-44b5-471f-b390-86f1c3f04bfe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.285518 Jun 05 08:25:27.081691 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 376/766] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:26 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:27.092757 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-be273534-9285-434d-b4b9-1cdfd075ac54 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:27.100230 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-be273534-9285-434d-b4b9-1cdfd075ac54 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: 9b80f5d2-a282-4ccc-8db3-c97fa829aefe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:27.119497 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-be273534-9285-434d-b4b9-1cdfd075ac54 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:27.120676 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-be273534-9285-434d-b4b9-1cdfd075ac54 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:27.122159 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-be273534-9285-434d-b4b9-1cdfd075ac54 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:27.129327 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-be273534-9285-434d-b4b9-1cdfd075ac54 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:27.130813 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-91a1215f-4fca-4610-8b5c-3b4ea9920cd2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:27.143131 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-91a1215f-4fca-4610-8b5c-3b4ea9920cd2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:27.147034 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-91a1215f-4fca-4610-8b5c-3b4ea9920cd2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:27.155714 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-91a1215f-4fca-4610-8b5c-3b4ea9920cd2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 1568 microversion: 2.25 time: 0.577827 Jun 05 08:25:27.156639 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 391/767] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:26 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 1568 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:27.161619 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ba4a347c-52ad-46d3-862d-2d871fb8191c tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:27.172242 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ba4a347c-52ad-46d3-862d-2d871fb8191c tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 5ad92c72-624d-411d-b083-8eb7097ffbfe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:27.179047 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ba4a347c-52ad-46d3-862d-2d871fb8191c tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:27.179638 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ba4a347c-52ad-46d3-862d-2d871fb8191c tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:27.180556 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ba4a347c-52ad-46d3-862d-2d871fb8191c tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:27.183705 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ba4a347c-52ad-46d3-862d-2d871fb8191c tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:27.432096 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ba4a347c-52ad-46d3-862d-2d871fb8191c tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e0d123924c06bb36aeab9c2fa720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad02ddb51f51433a82e0c6361e6ed6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:27.441629 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ba4a347c-52ad-46d3-862d-2d871fb8191c tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe" status: 200 len: 1281 microversion: 2.1 time: 0.283658 Jun 05 08:25:27.442582 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 392/768] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:27 2022] GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe => generated 1281 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:27.457504 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-11ff8364-f9ae-4b3c-90f1-aac303e6d3d7 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:27.458503 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-11ff8364-f9ae-4b3c-90f1-aac303e6d3d7 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 828624fb-b333-41c7-81a2-28d9bb4e1d88] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:27.468818 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-11ff8364-f9ae-4b3c-90f1-aac303e6d3d7 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:27.469743 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-11ff8364-f9ae-4b3c-90f1-aac303e6d3d7 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:27.470911 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-11ff8364-f9ae-4b3c-90f1-aac303e6d3d7 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:27.471694 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-11ff8364-f9ae-4b3c-90f1-aac303e6d3d7 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:27.887618 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-be273534-9285-434d-b4b9-1cdfd075ac54 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:27.895994 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-be273534-9285-434d-b4b9-1cdfd075ac54 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe" status: 200 len: 1390 microversion: 2.1 time: 0.810899 Jun 05 08:25:27.896606 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 377/769] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:27 2022] GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe => generated 1390 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:27.917095 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-df8bde0e-fb22-4530-8054-f82f0fefc410 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Action: 'create', calling method: .version_select at 0x7f2433a954c0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-609309036", "policies": ["affinity"]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:27.937056 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-df8bde0e-fb22-4530-8054-f82f0fefc410 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for project 5241947581244d30ba1528e6d5fad743. Resources: {'server_groups'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:25:27.940012 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:27.943763 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-df8bde0e-fb22-4530-8054-f82f0fefc410 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for user 27beb829232e464092b06d904b9d6ec0 and project 5241947581244d30ba1528e6d5fad743. Resources: {'server_groups'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:25:28.007365 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-df8bde0e-fb22-4530-8054-f82f0fefc410 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for project 5241947581244d30ba1528e6d5fad743. Resources: {'server_groups'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:25:28.013626 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-df8bde0e-fb22-4530-8054-f82f0fefc410 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for user 27beb829232e464092b06d904b9d6ec0 and project 5241947581244d30ba1528e6d5fad743. Resources: {'server_groups'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:25:28.029936 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-df8bde0e-fb22-4530-8054-f82f0fefc410 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.128833 Jun 05 08:25:28.030546 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 378/770] 10.222.0.33 () {60 vars in 1173 bytes} [Sun Jun 5 08:25:27 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:28.033856 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-11ff8364-f9ae-4b3c-90f1-aac303e6d3d7 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704cd9e8b0984139b58ec6abe3579576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8b37e66d354ce09c4bef01d28ef7a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:28.046640 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-18969006-d4eb-4d32-8e02-786cfe0895e2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:28.047376 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-18969006-d4eb-4d32-8e02-786cfe0895e2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:28.048451 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-11ff8364-f9ae-4b3c-90f1-aac303e6d3d7 tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "GET /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88" status: 200 len: 1478 microversion: 2.1 time: 0.592199 Jun 05 08:25:28.049193 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 393/771] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:27 2022] GET /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88 => generated 1478 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:28.059913 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-18969006-d4eb-4d32-8e02-786cfe0895e2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:28.062249 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-18969006-d4eb-4d32-8e02-786cfe0895e2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:28.065005 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-18969006-d4eb-4d32-8e02-786cfe0895e2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:28.065191 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-18969006-d4eb-4d32-8e02-786cfe0895e2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:28.070517 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:28.098746 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c53ce674-35ff-41c5-aac3-87cc47e9ab91 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:28.099395 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c53ce674-35ff-41c5-aac3-87cc47e9ab91 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:28.112869 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c53ce674-35ff-41c5-aac3-87cc47e9ab91 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:28.113328 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c53ce674-35ff-41c5-aac3-87cc47e9ab91 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:28.115158 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c53ce674-35ff-41c5-aac3-87cc47e9ab91 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:28.118059 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c53ce674-35ff-41c5-aac3-87cc47e9ab91 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:28.159470 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c53ce674-35ff-41c5-aac3-87cc47e9ab91 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:28.162719 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c53ce674-35ff-41c5-aac3-87cc47e9ab91 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:28.162873 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-c53ce674-35ff-41c5-aac3-87cc47e9ab91 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:28.305768 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c53ce674-35ff-41c5-aac3-87cc47e9ab91 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:28.313358 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c53ce674-35ff-41c5-aac3-87cc47e9ab91 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.219293 Jun 05 08:25:28.314312 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 394/772] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:28 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:28.327861 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b3947a9b-374d-4b01-bb6d-59fc819c412c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:28.328754 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b3947a9b-374d-4b01-bb6d-59fc819c412c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:28.337078 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b3947a9b-374d-4b01-bb6d-59fc819c412c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:28.337554 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b3947a9b-374d-4b01-bb6d-59fc819c412c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:28.338540 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b3947a9b-374d-4b01-bb6d-59fc819c412c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:28.339359 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b3947a9b-374d-4b01-bb6d-59fc819c412c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:28.599243 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-18969006-d4eb-4d32-8e02-786cfe0895e2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:28.608867 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-18969006-d4eb-4d32-8e02-786cfe0895e2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1494 microversion: 2.1 time: 0.577271 Jun 05 08:25:28.610152 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 379/773] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:28 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1494 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:28.616417 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2b3aaf62-b7e3-44a8-b43a-0e7230be0678 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1493564933", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "68b27b6f-877f-4ac6-be8b-cf2d0ed80d2a"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:28.681316 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-2b3aaf62-b7e3-44a8-b43a-0e7230be0678 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] validate_networks() for None {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:25:28.881889 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b3947a9b-374d-4b01-bb6d-59fc819c412c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:28.896116 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b3947a9b-374d-4b01-bb6d-59fc819c412c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:28.897687 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b3947a9b-374d-4b01-bb6d-59fc819c412c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:28.899243 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b3947a9b-374d-4b01-bb6d-59fc819c412c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 1558 microversion: 2.25 time: 0.574950 Jun 05 08:25:28.903541 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 395/774] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:28 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 1558 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:28.910389 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f9835fc1-fee8-4faa-8b6f-6f1e50bf0be3 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:28.911277 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f9835fc1-fee8-4faa-8b6f-6f1e50bf0be3 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 5ad92c72-624d-411d-b083-8eb7097ffbfe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:28.937766 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f9835fc1-fee8-4faa-8b6f-6f1e50bf0be3 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:28.938003 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f9835fc1-fee8-4faa-8b6f-6f1e50bf0be3 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:28.939254 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f9835fc1-fee8-4faa-8b6f-6f1e50bf0be3 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:28.939713 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f9835fc1-fee8-4faa-8b6f-6f1e50bf0be3 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:29.777968 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f9835fc1-fee8-4faa-8b6f-6f1e50bf0be3 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e0d123924c06bb36aeab9c2fa720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad02ddb51f51433a82e0c6361e6ed6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:29.789596 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f9835fc1-fee8-4faa-8b6f-6f1e50bf0be3 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe" status: 200 len: 1323 microversion: 2.1 time: 0.883822 Jun 05 08:25:29.790852 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 396/775] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:28 2022] GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe => generated 1323 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:29.806042 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a2c5c71b-24a6-48a7-90ff-d77205e55616 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:29.806979 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a2c5c71b-24a6-48a7-90ff-d77205e55616 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:29.813830 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a2c5c71b-24a6-48a7-90ff-d77205e55616 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:29.814278 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a2c5c71b-24a6-48a7-90ff-d77205e55616 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:29.815486 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a2c5c71b-24a6-48a7-90ff-d77205e55616 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:29.815989 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a2c5c71b-24a6-48a7-90ff-d77205e55616 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:29.858274 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-2b3aaf62-b7e3-44a8-b43a-0e7230be0678 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:25:29.859566 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-2b3aaf62-b7e3-44a8-b43a-0e7230be0678 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:25:29.860475 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-2b3aaf62-b7e3-44a8-b43a-0e7230be0678 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:25:29.861593 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-2b3aaf62-b7e3-44a8-b43a-0e7230be0678 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:25:29.862164 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-2b3aaf62-b7e3-44a8-b43a-0e7230be0678 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:25:29.891338 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=27 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:29.895217 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2b3aaf62-b7e3-44a8-b43a-0e7230be0678 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:29.895839 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2b3aaf62-b7e3-44a8-b43a-0e7230be0678 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:29.896839 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2b3aaf62-b7e3-44a8-b43a-0e7230be0678 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:29.897377 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2b3aaf62-b7e3-44a8-b43a-0e7230be0678 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:29.921289 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-2b3aaf62-b7e3-44a8-b43a-0e7230be0678 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for project 5241947581244d30ba1528e6d5fad743. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:25:29.927652 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-2b3aaf62-b7e3-44a8-b43a-0e7230be0678 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for user 27beb829232e464092b06d904b9d6ec0 and project 5241947581244d30ba1528e6d5fad743. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:25:29.942130 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2b3aaf62-b7e3-44a8-b43a-0e7230be0678 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Going to run 2 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:25:29.944982 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2b3aaf62-b7e3-44a8-b43a-0e7230be0678 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 15fff300-f7b6-4336-a143-1e5687af979b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:25:29.994766 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-2b3aaf62-b7e3-44a8-b43a-0e7230be0678 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119050) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jun 05 08:25:30.026953 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-2b3aaf62-b7e3-44a8-b43a-0e7230be0678 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for project 5241947581244d30ba1528e6d5fad743. Resources: {'server_group_members'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:25:30.033343 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-2b3aaf62-b7e3-44a8-b43a-0e7230be0678 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for user 27beb829232e464092b06d904b9d6ec0 and project 5241947581244d30ba1528e6d5fad743. Resources: {'server_group_members'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:25:30.095770 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-2b3aaf62-b7e3-44a8-b43a-0e7230be0678 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for project 5241947581244d30ba1528e6d5fad743. Resources: {'server_group_members'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:25:30.102485 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-2b3aaf62-b7e3-44a8-b43a-0e7230be0678 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for user 27beb829232e464092b06d904b9d6ec0 and project 5241947581244d30ba1528e6d5fad743. Resources: {'server_group_members'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:25:30.125103 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2b3aaf62-b7e3-44a8-b43a-0e7230be0678 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 35db623e-15e3-4238-8c0f-ce05bc679787] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=15fff300-f7b6-4336-a143-1e5687af979b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:25:30.191631 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-2b3aaf62-b7e3-44a8-b43a-0e7230be0678 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for project 5241947581244d30ba1528e6d5fad743. Resources: {'server_group_members'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:25:30.198520 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-2b3aaf62-b7e3-44a8-b43a-0e7230be0678 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for user 27beb829232e464092b06d904b9d6ec0 and project 5241947581244d30ba1528e6d5fad743. Resources: {'server_group_members'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:25:30.249605 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-2b3aaf62-b7e3-44a8-b43a-0e7230be0678 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for project 5241947581244d30ba1528e6d5fad743. Resources: {'server_group_members'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:25:30.256348 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-2b3aaf62-b7e3-44a8-b43a-0e7230be0678 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for user 27beb829232e464092b06d904b9d6ec0 and project 5241947581244d30ba1528e6d5fad743. Resources: {'server_group_members'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:25:30.302337 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2b3aaf62-b7e3-44a8-b43a-0e7230be0678 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.689961 Jun 05 08:25:30.303037 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 380/776] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:25:28 2022] POST /compute/v2.1/servers => generated 32 bytes in 1691 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jun 05 08:25:30.308600 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4157cbed-28a6-48eb-9997-acc7e564c1c5 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:30.309290 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4157cbed-28a6-48eb-9997-acc7e564c1c5 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: 9b80f5d2-a282-4ccc-8db3-c97fa829aefe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:30.317748 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4157cbed-28a6-48eb-9997-acc7e564c1c5 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:30.318509 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4157cbed-28a6-48eb-9997-acc7e564c1c5 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:30.319341 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4157cbed-28a6-48eb-9997-acc7e564c1c5 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:30.319816 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4157cbed-28a6-48eb-9997-acc7e564c1c5 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:30.400359 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a2c5c71b-24a6-48a7-90ff-d77205e55616 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1645 microversion: 2.1 time: 0.607240 Jun 05 08:25:30.401388 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 397/777] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:29 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1645 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:30.409943 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c13bad9b-2c14-4252-a5d8-ef8cb32e8479 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Calling method '.version_select at 0x7f24401ea790>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:30.413111 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c13bad9b-2c14-4252-a5d8-ef8cb32e8479 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:30.413778 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c13bad9b-2c14-4252-a5d8-ef8cb32e8479 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:30.427449 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c13bad9b-2c14-4252-a5d8-ef8cb32e8479 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 1276 microversion: 2.25 time: 0.022274 Jun 05 08:25:30.428949 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 398/778] 10.222.0.33 () {60 vars in 1183 bytes} [Sun Jun 5 08:25:30 2022] GET /compute/v2.1/os-migrations => generated 1276 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:30.437147 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d5038b69-3480-4c04-a3f8-03990d9ff1ce tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:30.438092 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d5038b69-3480-4c04-a3f8-03990d9ff1ce tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] [instance: 828624fb-b333-41c7-81a2-28d9bb4e1d88] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:30.447697 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d5038b69-3480-4c04-a3f8-03990d9ff1ce tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:30.448579 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d5038b69-3480-4c04-a3f8-03990d9ff1ce tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:30.451047 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d5038b69-3480-4c04-a3f8-03990d9ff1ce tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:30.451897 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d5038b69-3480-4c04-a3f8-03990d9ff1ce tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:30.496442 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d5038b69-3480-4c04-a3f8-03990d9ff1ce tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:30.497232 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d5038b69-3480-4c04-a3f8-03990d9ff1ce tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:30.497901 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-d5038b69-3480-4c04-a3f8-03990d9ff1ce tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Lazy-loading 'fault' on Instance uuid 828624fb-b333-41c7-81a2-28d9bb4e1d88 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:30.656197 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d5038b69-3480-4c04-a3f8-03990d9ff1ce tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704cd9e8b0984139b58ec6abe3579576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8b37e66d354ce09c4bef01d28ef7a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:30.672174 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d5038b69-3480-4c04-a3f8-03990d9ff1ce tempest-ServersAdminNegativeTestJSON-898155861 tempest-ServersAdminNegativeTestJSON-898155861-project] 10.222.0.33 "GET /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88" status: 200 len: 1367 microversion: 2.1 time: 0.240936 Jun 05 08:25:30.673416 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 399/779] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:30 2022] GET /compute/v2.1/servers/828624fb-b333-41c7-81a2-28d9bb4e1d88 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:30.680782 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-6b889f5a-c647-45bd-a5be-692cc0a8f947 req-207bba70-dfdf-4856-80cb-38129606c9ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "828624fb-b333-41c7-81a2-28d9bb4e1d88", "name": "network-vif-deleted", "tag": "df9bf56e-171a-4e64-a006-203773f700a6"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:30.703122 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-6b889f5a-c647-45bd-a5be-692cc0a8f947 req-207bba70-dfdf-4856-80cb-38129606c9ef service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:30.703564 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-6b889f5a-c647-45bd-a5be-692cc0a8f947 req-207bba70-dfdf-4856-80cb-38129606c9ef service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:30.722470 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-6b889f5a-c647-45bd-a5be-692cc0a8f947 req-207bba70-dfdf-4856-80cb-38129606c9ef service nova] Creating event network-vif-deleted:df9bf56e-171a-4e64-a006-203773f700a6 for instance 828624fb-b333-41c7-81a2-28d9bb4e1d88 on n-h1-844739-1 Jun 05 08:25:30.727656 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-6b889f5a-c647-45bd-a5be-692cc0a8f947 req-207bba70-dfdf-4856-80cb-38129606c9ef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050434 Jun 05 08:25:30.728822 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 400/780] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:30.734159 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-dc5a5bd4-07e9-4aaa-adaf-fd8f88d2e677 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:30.734965 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-dc5a5bd4-07e9-4aaa-adaf-fd8f88d2e677 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:30.742239 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc5a5bd4-07e9-4aaa-adaf-fd8f88d2e677 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:30.743155 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc5a5bd4-07e9-4aaa-adaf-fd8f88d2e677 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:30.744215 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc5a5bd4-07e9-4aaa-adaf-fd8f88d2e677 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:30.744775 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc5a5bd4-07e9-4aaa-adaf-fd8f88d2e677 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:30.788303 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc5a5bd4-07e9-4aaa-adaf-fd8f88d2e677 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:30.789028 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc5a5bd4-07e9-4aaa-adaf-fd8f88d2e677 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:30.789672 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-dc5a5bd4-07e9-4aaa-adaf-fd8f88d2e677 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:30.914064 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-dc5a5bd4-07e9-4aaa-adaf-fd8f88d2e677 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:30.924199 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-dc5a5bd4-07e9-4aaa-adaf-fd8f88d2e677 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.193763 Jun 05 08:25:30.928987 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 401/781] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:30 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:30.936889 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-09982dd6-ba3d-466a-9095-2cd963672d0a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:30.944288 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-09982dd6-ba3d-466a-9095-2cd963672d0a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:30.945264 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-09982dd6-ba3d-466a-9095-2cd963672d0a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Searching by: {'deleted': False, 'project_id': '5241947581244d30ba1528e6d5fad743'} {{(pid=119049) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 05 08:25:30.984865 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-09982dd6-ba3d-466a-9095-2cd963672d0a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:30.985347 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-09982dd6-ba3d-466a-9095-2cd963672d0a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:30.986175 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-09982dd6-ba3d-466a-9095-2cd963672d0a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:30.986610 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-09982dd6-ba3d-466a-9095-2cd963672d0a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:30.990269 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4157cbed-28a6-48eb-9997-acc7e564c1c5 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:31.007283 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4157cbed-28a6-48eb-9997-acc7e564c1c5 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe" status: 200 len: 1390 microversion: 2.1 time: 0.701721 Jun 05 08:25:31.008134 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 381/782] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:30 2022] GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe => generated 1390 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:31.013007 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-b4cd01e1-95c1-4ef1-8b7c-6501b90d7d1c req-41884f2e-517f-49bf-b55e-efcd06a5bedb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b80f5d2-a282-4ccc-8db3-c97fa829aefe", "tag": "dd1eaf3c-4246-487f-b193-efb1262f0dba"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:31.020383 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:31.025303 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.multi_cell_list [None req-09982dd6-ba3d-466a-9095-2cd963672d0a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=119049) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 05 08:25:31.032442 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-b4cd01e1-95c1-4ef1-8b7c-6501b90d7d1c req-41884f2e-517f-49bf-b55e-efcd06a5bedb service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:31.036291 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-b4cd01e1-95c1-4ef1-8b7c-6501b90d7d1c req-41884f2e-517f-49bf-b55e-efcd06a5bedb service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:31.058487 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-b4cd01e1-95c1-4ef1-8b7c-6501b90d7d1c req-41884f2e-517f-49bf-b55e-efcd06a5bedb service nova] Creating event network-changed:dd1eaf3c-4246-487f-b193-efb1262f0dba for instance 9b80f5d2-a282-4ccc-8db3-c97fa829aefe on n-h2-844739-1 Jun 05 08:25:31.080067 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-b4cd01e1-95c1-4ef1-8b7c-6501b90d7d1c req-41884f2e-517f-49bf-b55e-efcd06a5bedb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070379 Jun 05 08:25:31.081303 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 382/783] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:31.086470 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2b5cd21c-8708-4e0c-b651-f0910af9614a tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:31.092280 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:25:31.092280 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:25:31.094046 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2b5cd21c-8708-4e0c-b651-f0910af9614a tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:31.099832 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2b5cd21c-8708-4e0c-b651-f0910af9614a tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:31.101200 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2b5cd21c-8708-4e0c-b651-f0910af9614a tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:31.101871 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2b5cd21c-8708-4e0c-b651-f0910af9614a tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:31.136829 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:31.167615 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-09982dd6-ba3d-466a-9095-2cd963672d0a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.236026 Jun 05 08:25:31.170752 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2b5cd21c-8708-4e0c-b651-f0910af9614a tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.087926 Jun 05 08:25:31.171997 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 383/784] 10.222.0.33 () {58 vars in 1175 bytes} [Sun Jun 5 08:25:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:31.179428 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 402/785] 10.222.0.33 () {58 vars in 1124 bytes} [Sun Jun 5 08:25:30 2022] GET /compute/v2.1/servers => generated 1003 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:31.187035 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f4d1c3e2-de7f-465e-968f-ce6dfeca7e7a tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:31.187729 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f4d1c3e2-de7f-465e-968f-ce6dfeca7e7a tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 5ad92c72-624d-411d-b083-8eb7097ffbfe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:31.191302 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-af91653b-5653-4361-93ba-410142a8e101 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:31.193820 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-af91653b-5653-4361-93ba-410142a8e101 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:31.196802 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f4d1c3e2-de7f-465e-968f-ce6dfeca7e7a tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:31.197397 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f4d1c3e2-de7f-465e-968f-ce6dfeca7e7a tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:31.198207 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f4d1c3e2-de7f-465e-968f-ce6dfeca7e7a tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:31.198730 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f4d1c3e2-de7f-465e-968f-ce6dfeca7e7a tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:31.204710 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-af91653b-5653-4361-93ba-410142a8e101 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:31.205462 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-af91653b-5653-4361-93ba-410142a8e101 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:31.206851 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-af91653b-5653-4361-93ba-410142a8e101 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:31.207473 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-af91653b-5653-4361-93ba-410142a8e101 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:31.742604 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f4d1c3e2-de7f-465e-968f-ce6dfeca7e7a tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e0d123924c06bb36aeab9c2fa720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad02ddb51f51433a82e0c6361e6ed6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:31.754527 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f4d1c3e2-de7f-465e-968f-ce6dfeca7e7a tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe" status: 200 len: 1323 microversion: 2.1 time: 0.571610 Jun 05 08:25:31.754926 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-af91653b-5653-4361-93ba-410142a8e101 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lazy-loading 'services' on Instance uuid 035abb75-eda1-447d-b034-2bbb171f704e {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:31.755732 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 403/786] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:31 2022] GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe => generated 1323 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:31.769883 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-30764fbd-8833-46dc-abd1-b37f2d4c7ddf tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:31.771305 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-30764fbd-8833-46dc-abd1-b37f2d4c7ddf tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 35db623e-15e3-4238-8c0f-ce05bc679787] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:31.786880 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-30764fbd-8833-46dc-abd1-b37f2d4c7ddf tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:31.789893 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-30764fbd-8833-46dc-abd1-b37f2d4c7ddf tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:31.791568 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-30764fbd-8833-46dc-abd1-b37f2d4c7ddf tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:31.794131 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-30764fbd-8833-46dc-abd1-b37f2d4c7ddf tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:31.796579 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-af91653b-5653-4361-93ba-410142a8e101 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 2050 microversion: 2.25 time: 0.618590 Jun 05 08:25:31.798875 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 384/787] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:31 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 2050 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:31.941456 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-79aa1f2e-2590-43ef-8801-7670850bcb9d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:31.942269 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-79aa1f2e-2590-43ef-8801-7670850bcb9d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:31.951578 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-79aa1f2e-2590-43ef-8801-7670850bcb9d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:31.957027 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-79aa1f2e-2590-43ef-8801-7670850bcb9d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:31.961604 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-79aa1f2e-2590-43ef-8801-7670850bcb9d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:31.963456 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-79aa1f2e-2590-43ef-8801-7670850bcb9d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:31.975166 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-30764fbd-8833-46dc-abd1-b37f2d4c7ddf tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:31.989371 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-30764fbd-8833-46dc-abd1-b37f2d4c7ddf tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787" status: 200 len: 1223 microversion: 2.1 time: 0.232256 Jun 05 08:25:32.002290 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 404/788] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:31 2022] GET /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787 => generated 1223 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:32.030037 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-61224a0c-e2ae-44c4-a1ea-cbd0ebf57c3f tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:32.030664 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-61224a0c-e2ae-44c4-a1ea-cbd0ebf57c3f tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: 9b80f5d2-a282-4ccc-8db3-c97fa829aefe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:32.049465 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-61224a0c-e2ae-44c4-a1ea-cbd0ebf57c3f tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:32.050194 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-61224a0c-e2ae-44c4-a1ea-cbd0ebf57c3f tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:32.051365 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-61224a0c-e2ae-44c4-a1ea-cbd0ebf57c3f tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:32.052069 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-61224a0c-e2ae-44c4-a1ea-cbd0ebf57c3f tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:32.073058 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-79aa1f2e-2590-43ef-8801-7670850bcb9d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:32.077776 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-79aa1f2e-2590-43ef-8801-7670850bcb9d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:32.078276 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-79aa1f2e-2590-43ef-8801-7670850bcb9d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:32.443775 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-79aa1f2e-2590-43ef-8801-7670850bcb9d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:32.453271 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-79aa1f2e-2590-43ef-8801-7670850bcb9d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.515677 Jun 05 08:25:32.462688 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 385/789] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:31 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:25:32.483002 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6c19d2e1-a09b-4af5-affe-30eb43e7e528 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2041360605", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "a7010e4a-eda5-41d8-af56-68a4d3196193"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:32.571098 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-6c19d2e1-a09b-4af5-affe-30eb43e7e528 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] validate_networks() for [('a7010e4a-eda5-41d8-af56-68a4d3196193', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:25:32.870419 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=7 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:33.301509 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-61224a0c-e2ae-44c4-a1ea-cbd0ebf57c3f tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:33.358813 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-61224a0c-e2ae-44c4-a1ea-cbd0ebf57c3f tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe" status: 200 len: 1390 microversion: 2.1 time: 1.335629 Jun 05 08:25:33.368371 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 405/790] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:32 2022] GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe => generated 1390 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:33.382665 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0a59ace2-efe3-44f9-a5da-2e53f2a56652 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:33.387635 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0a59ace2-efe3-44f9-a5da-2e53f2a56652 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 5ad92c72-624d-411d-b083-8eb7097ffbfe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:33.403896 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0a59ace2-efe3-44f9-a5da-2e53f2a56652 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:33.404981 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0a59ace2-efe3-44f9-a5da-2e53f2a56652 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:33.406194 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0a59ace2-efe3-44f9-a5da-2e53f2a56652 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:33.407688 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0a59ace2-efe3-44f9-a5da-2e53f2a56652 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:33.928880 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0a59ace2-efe3-44f9-a5da-2e53f2a56652 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e0d123924c06bb36aeab9c2fa720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad02ddb51f51433a82e0c6361e6ed6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:33.938056 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0a59ace2-efe3-44f9-a5da-2e53f2a56652 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe" status: 200 len: 1323 microversion: 2.1 time: 0.568328 Jun 05 08:25:33.940839 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 406/791] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:33 2022] GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe => generated 1323 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:33.950216 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-096da0cb-0a6b-4ac6-b61f-96ab6884797d req-9e2e1e85-35b9-4f28-ac61-4f9552a1d0e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1b50f75-ca7f-4320-bbd6-363b4d656cd8", "tag": "979ddd25-4bd3-4566-91d5-2e2a41a40011"}, {"name": "network-changed", "server_uuid": "32ee0b81-4a5b-4181-b43c-ad4cdecd0a70", "tag": "b0c5ff73-aaad-4c1b-9548-e2c279aa4681"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:33.972673 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-096da0cb-0a6b-4ac6-b61f-96ab6884797d req-9e2e1e85-35b9-4f28-ac61-4f9552a1d0e2 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:33.975513 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-096da0cb-0a6b-4ac6-b61f-96ab6884797d req-9e2e1e85-35b9-4f28-ac61-4f9552a1d0e2 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:34.014770 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-096da0cb-0a6b-4ac6-b61f-96ab6884797d req-9e2e1e85-35b9-4f28-ac61-4f9552a1d0e2 service nova] Creating event network-changed:979ddd25-4bd3-4566-91d5-2e2a41a40011 for instance a1b50f75-ca7f-4320-bbd6-363b4d656cd8 on n-h1-844739-1 Jun 05 08:25:34.019023 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-096da0cb-0a6b-4ac6-b61f-96ab6884797d req-9e2e1e85-35b9-4f28-ac61-4f9552a1d0e2 service nova] Creating event network-changed:b0c5ff73-aaad-4c1b-9548-e2c279aa4681 for instance 32ee0b81-4a5b-4181-b43c-ad4cdecd0a70 on n-h2-844739-1 Jun 05 08:25:34.038711 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-096da0cb-0a6b-4ac6-b61f-96ab6884797d req-9e2e1e85-35b9-4f28-ac61-4f9552a1d0e2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.091920 Jun 05 08:25:34.043724 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 407/792] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:34.051919 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e8025c9d-192c-4157-894e-cc1783360a5d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:34.053002 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e8025c9d-192c-4157-894e-cc1783360a5d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 35db623e-15e3-4238-8c0f-ce05bc679787] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:34.060402 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e8025c9d-192c-4157-894e-cc1783360a5d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:34.061039 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e8025c9d-192c-4157-894e-cc1783360a5d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:34.062143 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e8025c9d-192c-4157-894e-cc1783360a5d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:34.062753 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e8025c9d-192c-4157-894e-cc1783360a5d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:34.135253 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-6c19d2e1-a09b-4af5-affe-30eb43e7e528 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:25:34.135716 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-6c19d2e1-a09b-4af5-affe-30eb43e7e528 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:25:34.136302 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-6c19d2e1-a09b-4af5-affe-30eb43e7e528 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:25:34.136877 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-6c19d2e1-a09b-4af5-affe-30eb43e7e528 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:25:34.137462 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-6c19d2e1-a09b-4af5-affe-30eb43e7e528 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:25:34.154052 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6c19d2e1-a09b-4af5-affe-30eb43e7e528 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:34.158288 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6c19d2e1-a09b-4af5-affe-30eb43e7e528 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:34.159507 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6c19d2e1-a09b-4af5-affe-30eb43e7e528 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:34.162873 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6c19d2e1-a09b-4af5-affe-30eb43e7e528 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:34.182756 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=11 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:34.242074 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-6c19d2e1-a09b-4af5-affe-30eb43e7e528 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Getting quotas for project fb5c1766af9c4e079f74b67177db0246. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:25:34.259069 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-6c19d2e1-a09b-4af5-affe-30eb43e7e528 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Getting quotas for user 03720c07cc1e4ae6a2c621b1d3feed9a and project fb5c1766af9c4e079f74b67177db0246. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:25:34.263985 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e8025c9d-192c-4157-894e-cc1783360a5d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:34.273616 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e8025c9d-192c-4157-894e-cc1783360a5d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787" status: 200 len: 1289 microversion: 2.1 time: 0.228451 Jun 05 08:25:34.280375 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 408/793] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:34 2022] GET /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787 => generated 1289 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:34.289659 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-03174a11-6542-43cb-b1cc-58274264fdf8 req-8e49da9f-51d3-4237-a33a-58a8250e6a6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ad92c72-624d-411d-b083-8eb7097ffbfe", "tag": "0a210eba-2292-4ffe-838d-feb9e31e4828"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:34.290604 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6c19d2e1-a09b-4af5-affe-30eb43e7e528 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:25:34.294187 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6c19d2e1-a09b-4af5-affe-30eb43e7e528 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:25:34.317310 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-03174a11-6542-43cb-b1cc-58274264fdf8 req-8e49da9f-51d3-4237-a33a-58a8250e6a6e service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:34.318151 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-03174a11-6542-43cb-b1cc-58274264fdf8 req-8e49da9f-51d3-4237-a33a-58a8250e6a6e service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:34.345569 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-03174a11-6542-43cb-b1cc-58274264fdf8 req-8e49da9f-51d3-4237-a33a-58a8250e6a6e service nova] Creating event network-changed:0a210eba-2292-4ffe-838d-feb9e31e4828 for instance 5ad92c72-624d-411d-b083-8eb7097ffbfe on n-h1-844739-1 Jun 05 08:25:34.362587 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6c19d2e1-a09b-4af5-affe-30eb43e7e528 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.898626 Jun 05 08:25:34.364682 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 386/794] 10.222.0.33 () {62 vars in 1187 bytes} [Sun Jun 5 08:25:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1900 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 05 08:25:34.370563 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-03174a11-6542-43cb-b1cc-58274264fdf8 req-8e49da9f-51d3-4237-a33a-58a8250e6a6e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084254 Jun 05 08:25:34.372443 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6033ea54-2ee5-4d9b-b07e-b0e6e4144a7e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:34.373444 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 409/795] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:34.375086 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6033ea54-2ee5-4d9b-b07e-b0e6e4144a7e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:34.385389 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6033ea54-2ee5-4d9b-b07e-b0e6e4144a7e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:34.385858 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6033ea54-2ee5-4d9b-b07e-b0e6e4144a7e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:34.386659 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6033ea54-2ee5-4d9b-b07e-b0e6e4144a7e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:34.387105 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6033ea54-2ee5-4d9b-b07e-b0e6e4144a7e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:34.389624 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-98f985fd-2521-4292-b0e8-63fcffeff89c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:34.390799 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-98f985fd-2521-4292-b0e8-63fcffeff89c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:34.451010 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6033ea54-2ee5-4d9b-b07e-b0e6e4144a7e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:34.452322 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6033ea54-2ee5-4d9b-b07e-b0e6e4144a7e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:34.453126 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-6033ea54-2ee5-4d9b-b07e-b0e6e4144a7e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:34.513990 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-98f985fd-2521-4292-b0e8-63fcffeff89c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:34.531324 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-98f985fd-2521-4292-b0e8-63fcffeff89c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:34.533902 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-98f985fd-2521-4292-b0e8-63fcffeff89c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:34.535070 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-98f985fd-2521-4292-b0e8-63fcffeff89c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 1262 microversion: 2.25 time: 0.155972 Jun 05 08:25:34.535893 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 410/796] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:34 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 1262 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:34.563873 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c6d5f034-78a5-4c29-9435-81dc09ed6bfe tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:34.564539 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c6d5f034-78a5-4c29-9435-81dc09ed6bfe tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: 9b80f5d2-a282-4ccc-8db3-c97fa829aefe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:34.582590 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c6d5f034-78a5-4c29-9435-81dc09ed6bfe tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:34.583063 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c6d5f034-78a5-4c29-9435-81dc09ed6bfe tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:34.584132 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c6d5f034-78a5-4c29-9435-81dc09ed6bfe tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:34.584555 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c6d5f034-78a5-4c29-9435-81dc09ed6bfe tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:34.621343 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6033ea54-2ee5-4d9b-b07e-b0e6e4144a7e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:34.637567 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6033ea54-2ee5-4d9b-b07e-b0e6e4144a7e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.271387 Jun 05 08:25:34.639147 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 387/797] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:34 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:34.959203 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f04ea333-d0c6-4a33-be28-8e2ec2374997 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:34.959796 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f04ea333-d0c6-4a33-be28-8e2ec2374997 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 5ad92c72-624d-411d-b083-8eb7097ffbfe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:35.004685 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f04ea333-d0c6-4a33-be28-8e2ec2374997 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:35.019928 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f04ea333-d0c6-4a33-be28-8e2ec2374997 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:35.021027 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f04ea333-d0c6-4a33-be28-8e2ec2374997 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:35.021489 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f04ea333-d0c6-4a33-be28-8e2ec2374997 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:35.663417 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c6d5f034-78a5-4c29-9435-81dc09ed6bfe tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:35.674182 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c6d5f034-78a5-4c29-9435-81dc09ed6bfe tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe" status: 200 len: 1390 microversion: 2.1 time: 1.120610 Jun 05 08:25:35.692467 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 411/798] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:34 2022] GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe => generated 1390 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:35.729999 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4d14f4d7-f97a-4c61-bf66-645c2faa14d4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:35.734591 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4d14f4d7-f97a-4c61-bf66-645c2faa14d4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 35db623e-15e3-4238-8c0f-ce05bc679787] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:35.765834 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4d14f4d7-f97a-4c61-bf66-645c2faa14d4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:35.766470 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4d14f4d7-f97a-4c61-bf66-645c2faa14d4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:35.767969 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4d14f4d7-f97a-4c61-bf66-645c2faa14d4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:35.772730 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4d14f4d7-f97a-4c61-bf66-645c2faa14d4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:35.956794 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4d14f4d7-f97a-4c61-bf66-645c2faa14d4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:35.967048 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4d14f4d7-f97a-4c61-bf66-645c2faa14d4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787" status: 200 len: 1277 microversion: 2.1 time: 0.271556 Jun 05 08:25:35.971855 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 412/799] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:35 2022] GET /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787 => generated 1277 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:35.984314 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4e4875a4-c5d6-41eb-9698-77fe6fbc3ba9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:35.986384 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4e4875a4-c5d6-41eb-9698-77fe6fbc3ba9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:35.999988 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f04ea333-d0c6-4a33-be28-8e2ec2374997 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e0d123924c06bb36aeab9c2fa720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad02ddb51f51433a82e0c6361e6ed6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:36.005198 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4e4875a4-c5d6-41eb-9698-77fe6fbc3ba9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:36.005858 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4e4875a4-c5d6-41eb-9698-77fe6fbc3ba9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:36.007026 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4e4875a4-c5d6-41eb-9698-77fe6fbc3ba9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:36.007962 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f04ea333-d0c6-4a33-be28-8e2ec2374997 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe" status: 200 len: 1323 microversion: 2.1 time: 1.052930 Jun 05 08:25:36.011513 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 388/800] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:34 2022] GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe => generated 1323 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:36.012358 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4e4875a4-c5d6-41eb-9698-77fe6fbc3ba9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:36.022107 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8ed761d8-f2eb-407d-9f3f-1f38108ebdbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:36.022732 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8ed761d8-f2eb-407d-9f3f-1f38108ebdbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:36.033899 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8ed761d8-f2eb-407d-9f3f-1f38108ebdbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:36.034354 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8ed761d8-f2eb-407d-9f3f-1f38108ebdbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:36.035142 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8ed761d8-f2eb-407d-9f3f-1f38108ebdbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:36.035583 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8ed761d8-f2eb-407d-9f3f-1f38108ebdbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:36.091031 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8ed761d8-f2eb-407d-9f3f-1f38108ebdbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:36.091541 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8ed761d8-f2eb-407d-9f3f-1f38108ebdbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:36.092012 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-8ed761d8-f2eb-407d-9f3f-1f38108ebdbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:36.169878 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4e4875a4-c5d6-41eb-9698-77fe6fbc3ba9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:36.184788 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4e4875a4-c5d6-41eb-9698-77fe6fbc3ba9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:36.186716 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4e4875a4-c5d6-41eb-9698-77fe6fbc3ba9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:36.190133 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4e4875a4-c5d6-41eb-9698-77fe6fbc3ba9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 1314 microversion: 2.25 time: 0.217036 Jun 05 08:25:36.195497 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 413/801] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:35 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:36.203522 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8ed761d8-f2eb-407d-9f3f-1f38108ebdbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:36.213994 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8ed761d8-f2eb-407d-9f3f-1f38108ebdbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.201339 Jun 05 08:25:36.221911 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 389/802] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:36 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:36.515843 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e3ba6d8b-e1fe-4fd4-b103-09d78530dc12 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f41593c-9364-47bc-b99a-e4d9b91e8afa", "device": "/dev/xvdb"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:36.518642 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e3ba6d8b-e1fe-4fd4-b103-09d78530dc12 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:36.532852 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e3ba6d8b-e1fe-4fd4-b103-09d78530dc12 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:36.533405 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e3ba6d8b-e1fe-4fd4-b103-09d78530dc12 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:36.535844 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e3ba6d8b-e1fe-4fd4-b103-09d78530dc12 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:36.537138 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e3ba6d8b-e1fe-4fd4-b103-09d78530dc12 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:36.811451 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-97dcf873-94d5-423e-8dcb-ec12b2590cba tempest-ServicesAdminTestJSON-939368371 tempest-ServicesAdminTestJSON-939368371-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:36.813606 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:25:36.813606 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:25:36.815569 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-97dcf873-94d5-423e-8dcb-ec12b2590cba tempest-ServicesAdminTestJSON-939368371 tempest-ServicesAdminTestJSON-939368371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:36.817465 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-97dcf873-94d5-423e-8dcb-ec12b2590cba tempest-ServicesAdminTestJSON-939368371 tempest-ServicesAdminTestJSON-939368371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:36.829049 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-97dcf873-94d5-423e-8dcb-ec12b2590cba tempest-ServicesAdminTestJSON-939368371 tempest-ServicesAdminTestJSON-939368371-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:36.829800 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-97dcf873-94d5-423e-8dcb-ec12b2590cba tempest-ServicesAdminTestJSON-939368371 tempest-ServicesAdminTestJSON-939368371-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:36.857640 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-97dcf873-94d5-423e-8dcb-ec12b2590cba tempest-ServicesAdminTestJSON-939368371 tempest-ServicesAdminTestJSON-939368371-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.331312 Jun 05 08:25:36.858225 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 390/803] 10.222.0.33 () {58 vars in 1136 bytes} [Sun Jun 5 08:25:36 2022] GET /compute/v2.1/os-services => generated 944 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:25:36.877833 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cfa860d1-a8c5-4827-8bd9-8f48b9d18bd4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:36.878607 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-cfa860d1-a8c5-4827-8bd9-8f48b9d18bd4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: 9b80f5d2-a282-4ccc-8db3-c97fa829aefe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:36.893007 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cfa860d1-a8c5-4827-8bd9-8f48b9d18bd4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:36.894042 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cfa860d1-a8c5-4827-8bd9-8f48b9d18bd4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:36.901854 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cfa860d1-a8c5-4827-8bd9-8f48b9d18bd4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:36.902314 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cfa860d1-a8c5-4827-8bd9-8f48b9d18bd4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:37.058036 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e3ba6d8b-e1fe-4fd4-b103-09d78530dc12 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "POST /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.547653 Jun 05 08:25:37.064125 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 414/804] 10.222.0.33 () {60 vars in 1322 bytes} [Sun Jun 5 08:25:36 2022] POST /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments => generated 194 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:37.069672 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e3f75897-fff6-48d5-bcda-d221f0056f4e tempest-ServicesAdminTestJSON-939368371 tempest-ServicesAdminTestJSON-939368371-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:37.071070 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:25:37.071070 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:25:37.072386 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e3f75897-fff6-48d5-bcda-d221f0056f4e tempest-ServicesAdminTestJSON-939368371 tempest-ServicesAdminTestJSON-939368371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:37.072842 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e3f75897-fff6-48d5-bcda-d221f0056f4e tempest-ServicesAdminTestJSON-939368371 tempest-ServicesAdminTestJSON-939368371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:37.073719 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e3f75897-fff6-48d5-bcda-d221f0056f4e tempest-ServicesAdminTestJSON-939368371 tempest-ServicesAdminTestJSON-939368371-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:37.074243 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e3f75897-fff6-48d5-bcda-d221f0056f4e tempest-ServicesAdminTestJSON-939368371 tempest-ServicesAdminTestJSON-939368371-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:37.108870 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e3f75897-fff6-48d5-bcda-d221f0056f4e tempest-ServicesAdminTestJSON-939368371 tempest-ServicesAdminTestJSON-939368371-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=n-d-844739-1" status: 200 len: 578 microversion: 2.1 time: 0.043124 Jun 05 08:25:37.111058 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 415/805] 10.222.0.33 () {58 vars in 1171 bytes} [Sun Jun 5 08:25:37 2022] GET /compute/v2.1/os-services?host=n-d-844739-1 => generated 578 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:37.116834 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a5eea483-0251-4793-ab57-50af76131e9d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:37.117780 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a5eea483-0251-4793-ab57-50af76131e9d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 35db623e-15e3-4238-8c0f-ce05bc679787] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:37.123941 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:37.126195 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a5eea483-0251-4793-ab57-50af76131e9d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:37.126722 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a5eea483-0251-4793-ab57-50af76131e9d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:37.127618 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a5eea483-0251-4793-ab57-50af76131e9d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:37.128269 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a5eea483-0251-4793-ab57-50af76131e9d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:37.207533 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-cfa860d1-a8c5-4827-8bd9-8f48b9d18bd4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:37.218425 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-cfa860d1-a8c5-4827-8bd9-8f48b9d18bd4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe" status: 200 len: 1390 microversion: 2.1 time: 0.357979 Jun 05 08:25:37.228188 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 391/806] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:36 2022] GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe => generated 1390 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:37.228527 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a5eea483-0251-4793-ab57-50af76131e9d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:37.235796 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-630c3cdb-cf4b-4948-8d1b-51c4fbc5f289 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:37.236782 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-630c3cdb-cf4b-4948-8d1b-51c4fbc5f289 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 5ad92c72-624d-411d-b083-8eb7097ffbfe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:37.237874 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a5eea483-0251-4793-ab57-50af76131e9d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787" status: 200 len: 1277 microversion: 2.1 time: 0.125128 Jun 05 08:25:37.247129 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 416/807] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:37 2022] GET /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787 => generated 1277 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:37.247129 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-03ebd3b0-4395-498b-89fe-2b2ca3b5663f tempest-ServicesAdminTestJSON-939368371 tempest-ServicesAdminTestJSON-939368371-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:37.247129 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:25:37.247129 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:25:37.247129 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-03ebd3b0-4395-498b-89fe-2b2ca3b5663f tempest-ServicesAdminTestJSON-939368371 tempest-ServicesAdminTestJSON-939368371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:37.247619 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-03ebd3b0-4395-498b-89fe-2b2ca3b5663f tempest-ServicesAdminTestJSON-939368371 tempest-ServicesAdminTestJSON-939368371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:37.248357 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-03ebd3b0-4395-498b-89fe-2b2ca3b5663f tempest-ServicesAdminTestJSON-939368371 tempest-ServicesAdminTestJSON-939368371-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:37.248742 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-03ebd3b0-4395-498b-89fe-2b2ca3b5663f tempest-ServicesAdminTestJSON-939368371 tempest-ServicesAdminTestJSON-939368371-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:37.256498 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-630c3cdb-cf4b-4948-8d1b-51c4fbc5f289 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:37.257223 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-630c3cdb-cf4b-4948-8d1b-51c4fbc5f289 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:37.258211 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-630c3cdb-cf4b-4948-8d1b-51c4fbc5f289 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:37.259305 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-630c3cdb-cf4b-4948-8d1b-51c4fbc5f289 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:37.281503 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-03ebd3b0-4395-498b-89fe-2b2ca3b5663f tempest-ServicesAdminTestJSON-939368371 tempest-ServicesAdminTestJSON-939368371-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.041545 Jun 05 08:25:37.282936 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 417/808] 10.222.0.33 () {58 vars in 1175 bytes} [Sun Jun 5 08:25:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:37.307812 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8d0dd09e-da9d-408a-bc4a-a8659a38f6dc tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:37.308461 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8d0dd09e-da9d-408a-bc4a-a8659a38f6dc tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:37.326750 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8d0dd09e-da9d-408a-bc4a-a8659a38f6dc tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:37.327206 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8d0dd09e-da9d-408a-bc4a-a8659a38f6dc tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:37.327995 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8d0dd09e-da9d-408a-bc4a-a8659a38f6dc tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:37.328451 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8d0dd09e-da9d-408a-bc4a-a8659a38f6dc tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:37.450369 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8d0dd09e-da9d-408a-bc4a-a8659a38f6dc tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:37.466588 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8d0dd09e-da9d-408a-bc4a-a8659a38f6dc tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:37.473136 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8d0dd09e-da9d-408a-bc4a-a8659a38f6dc tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:37.474744 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8d0dd09e-da9d-408a-bc4a-a8659a38f6dc tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 1322 microversion: 2.25 time: 0.190865 Jun 05 08:25:37.477946 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 418/809] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:37 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:37.490842 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-42b758e1-256e-4d1b-b524-f2b46386f974 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:37.491187 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-42b758e1-256e-4d1b-b524-f2b46386f974 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:37.507798 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42b758e1-256e-4d1b-b524-f2b46386f974 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:37.509995 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42b758e1-256e-4d1b-b524-f2b46386f974 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:37.510912 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42b758e1-256e-4d1b-b524-f2b46386f974 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:37.512816 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42b758e1-256e-4d1b-b524-f2b46386f974 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:37.530014 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-630c3cdb-cf4b-4948-8d1b-51c4fbc5f289 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e0d123924c06bb36aeab9c2fa720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad02ddb51f51433a82e0c6361e6ed6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:37.564975 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-630c3cdb-cf4b-4948-8d1b-51c4fbc5f289 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe" status: 200 len: 1323 microversion: 2.1 time: 0.341549 Jun 05 08:25:37.567194 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 392/810] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:37 2022] GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe => generated 1323 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:37.583628 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-17556e04-05df-4887-a275-b22843beb4c6 tempest-ServicesAdminTestJSON-939368371 tempest-ServicesAdminTestJSON-939368371-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:37.594008 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:25:37.594008 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:25:37.599257 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-17556e04-05df-4887-a275-b22843beb4c6 tempest-ServicesAdminTestJSON-939368371 tempest-ServicesAdminTestJSON-939368371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:37.599750 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-17556e04-05df-4887-a275-b22843beb4c6 tempest-ServicesAdminTestJSON-939368371 tempest-ServicesAdminTestJSON-939368371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:37.603800 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-17556e04-05df-4887-a275-b22843beb4c6 tempest-ServicesAdminTestJSON-939368371 tempest-ServicesAdminTestJSON-939368371-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:37.604368 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-17556e04-05df-4887-a275-b22843beb4c6 tempest-ServicesAdminTestJSON-939368371 tempest-ServicesAdminTestJSON-939368371-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:37.604494 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42b758e1-256e-4d1b-b524-f2b46386f974 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:37.605029 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42b758e1-256e-4d1b-b524-f2b46386f974 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:37.606387 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-42b758e1-256e-4d1b-b524-f2b46386f974 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:37.681490 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-17556e04-05df-4887-a275-b22843beb4c6 tempest-ServicesAdminTestJSON-939368371 tempest-ServicesAdminTestJSON-939368371-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.111959 Jun 05 08:25:37.682168 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 393/811] 10.222.0.33 () {58 vars in 1136 bytes} [Sun Jun 5 08:25:37 2022] GET /compute/v2.1/os-services => generated 944 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:37.731044 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-42b758e1-256e-4d1b-b524-f2b46386f974 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:37.739704 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-42b758e1-256e-4d1b-b524-f2b46386f974 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.260651 Jun 05 08:25:37.742441 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 419/812] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:37 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:38.236198 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-533a5176-7edf-491a-ab08-378eddff0a27 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:38.237833 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-533a5176-7edf-491a-ab08-378eddff0a27 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: 9b80f5d2-a282-4ccc-8db3-c97fa829aefe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:38.250889 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-533a5176-7edf-491a-ab08-378eddff0a27 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:38.252733 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-533a5176-7edf-491a-ab08-378eddff0a27 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:38.255695 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-533a5176-7edf-491a-ab08-378eddff0a27 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:38.258314 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c70638b3-7d02-43f3-8f02-b99379896e4e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:38.258823 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-533a5176-7edf-491a-ab08-378eddff0a27 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:38.259152 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c70638b3-7d02-43f3-8f02-b99379896e4e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 35db623e-15e3-4238-8c0f-ce05bc679787] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:38.282368 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c70638b3-7d02-43f3-8f02-b99379896e4e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:38.284635 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c70638b3-7d02-43f3-8f02-b99379896e4e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:38.311140 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c70638b3-7d02-43f3-8f02-b99379896e4e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:38.321358 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c70638b3-7d02-43f3-8f02-b99379896e4e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:38.864749 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c70638b3-7d02-43f3-8f02-b99379896e4e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:38.871357 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:38.876279 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c70638b3-7d02-43f3-8f02-b99379896e4e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787" status: 200 len: 1319 microversion: 2.1 time: 0.623396 Jun 05 08:25:38.892135 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 420/813] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:38 2022] GET /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787 => generated 1319 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:38.899979 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c27cea9c-b665-475c-b607-ac1380072328 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:38.903623 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c27cea9c-b665-475c-b607-ac1380072328 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:38.924920 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c27cea9c-b665-475c-b607-ac1380072328 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:38.925685 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c27cea9c-b665-475c-b607-ac1380072328 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:38.929508 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c27cea9c-b665-475c-b607-ac1380072328 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:38.930148 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c27cea9c-b665-475c-b607-ac1380072328 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:39.513745 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c27cea9c-b665-475c-b607-ac1380072328 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:39.526657 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c27cea9c-b665-475c-b607-ac1380072328 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:39.532799 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c27cea9c-b665-475c-b607-ac1380072328 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:39.541572 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c27cea9c-b665-475c-b607-ac1380072328 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 1320 microversion: 2.25 time: 0.647819 Jun 05 08:25:39.542268 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 421/814] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:38 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 1320 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:39.562733 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-950997eb-34d2-483d-a465-abbb553815d6 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:39.565013 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-950997eb-34d2-483d-a465-abbb553815d6 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 5ad92c72-624d-411d-b083-8eb7097ffbfe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:39.583578 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-950997eb-34d2-483d-a465-abbb553815d6 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:39.584483 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-950997eb-34d2-483d-a465-abbb553815d6 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:39.585485 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-950997eb-34d2-483d-a465-abbb553815d6 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:39.586376 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-950997eb-34d2-483d-a465-abbb553815d6 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:39.668675 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-533a5176-7edf-491a-ab08-378eddff0a27 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:39.678798 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-533a5176-7edf-491a-ab08-378eddff0a27 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe" status: 200 len: 1390 microversion: 2.1 time: 1.446943 Jun 05 08:25:39.693921 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 394/815] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:38 2022] GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe => generated 1390 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:39.710409 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e9b7dd83-e830-4cc5-b1d6-b7db498028bb tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:39.711460 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e9b7dd83-e830-4cc5-b1d6-b7db498028bb tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:39.730371 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e9b7dd83-e830-4cc5-b1d6-b7db498028bb tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:39.731958 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e9b7dd83-e830-4cc5-b1d6-b7db498028bb tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:39.733287 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e9b7dd83-e830-4cc5-b1d6-b7db498028bb tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:39.733738 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e9b7dd83-e830-4cc5-b1d6-b7db498028bb tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:39.835849 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e9b7dd83-e830-4cc5-b1d6-b7db498028bb tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:39.837685 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e9b7dd83-e830-4cc5-b1d6-b7db498028bb tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:39.838177 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-e9b7dd83-e830-4cc5-b1d6-b7db498028bb tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:40.158348 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e9b7dd83-e830-4cc5-b1d6-b7db498028bb tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:40.166336 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e9b7dd83-e830-4cc5-b1d6-b7db498028bb tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.470694 Jun 05 08:25:40.178632 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 395/816] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:39 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:40.196114 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-e1fea8bc-9602-4dd3-9b17-7c159b6171d9 req-dd9c7e76-e103-4c55-9515-b509537b9e21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32ee0b81-4a5b-4181-b43c-ad4cdecd0a70", "name": "network-vif-plugged", "status": "completed", "tag": "b0c5ff73-aaad-4c1b-9548-e2c279aa4681"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:40.225363 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-e1fea8bc-9602-4dd3-9b17-7c159b6171d9 req-dd9c7e76-e103-4c55-9515-b509537b9e21 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:40.228560 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-e1fea8bc-9602-4dd3-9b17-7c159b6171d9 req-dd9c7e76-e103-4c55-9515-b509537b9e21 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:40.249723 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-e1fea8bc-9602-4dd3-9b17-7c159b6171d9 req-dd9c7e76-e103-4c55-9515-b509537b9e21 service nova] Creating event network-vif-plugged:b0c5ff73-aaad-4c1b-9548-e2c279aa4681 for instance 32ee0b81-4a5b-4181-b43c-ad4cdecd0a70 on n-h2-844739-1 Jun 05 08:25:40.259248 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-e1fea8bc-9602-4dd3-9b17-7c159b6171d9 req-dd9c7e76-e103-4c55-9515-b509537b9e21 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078647 Jun 05 08:25:40.261026 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 396/817] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:40.271983 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-aaf24807-5205-4561-ba22-5d26d2c5a21a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:40.273164 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-aaf24807-5205-4561-ba22-5d26d2c5a21a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 35db623e-15e3-4238-8c0f-ce05bc679787] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:40.284176 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-aaf24807-5205-4561-ba22-5d26d2c5a21a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:40.285353 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-aaf24807-5205-4561-ba22-5d26d2c5a21a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:40.286366 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-aaf24807-5205-4561-ba22-5d26d2c5a21a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:40.287111 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-aaf24807-5205-4561-ba22-5d26d2c5a21a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:41.017648 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-950997eb-34d2-483d-a465-abbb553815d6 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e0d123924c06bb36aeab9c2fa720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad02ddb51f51433a82e0c6361e6ed6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:41.032715 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-950997eb-34d2-483d-a465-abbb553815d6 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe" status: 200 len: 1323 microversion: 2.1 time: 1.486027 Jun 05 08:25:41.033332 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 422/818] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:39 2022] GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe => generated 1323 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:41.043385 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2f1d0567-0e77-45c3-bc68-2ff80f58ad25 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:41.046156 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2f1d0567-0e77-45c3-bc68-2ff80f58ad25 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:41.061487 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2f1d0567-0e77-45c3-bc68-2ff80f58ad25 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:41.065127 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2f1d0567-0e77-45c3-bc68-2ff80f58ad25 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:41.069542 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2f1d0567-0e77-45c3-bc68-2ff80f58ad25 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:41.070324 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2f1d0567-0e77-45c3-bc68-2ff80f58ad25 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:42.194517 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-aaf24807-5205-4561-ba22-5d26d2c5a21a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:42.214783 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-aaf24807-5205-4561-ba22-5d26d2c5a21a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787" status: 200 len: 1319 microversion: 2.1 time: 1.952180 Jun 05 08:25:42.215388 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 397/819] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:40 2022] GET /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787 => generated 1319 bytes in 1954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:42.230133 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3654df5d-3d4e-4c22-bc9e-e69ce1edcb98 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:42.231364 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3654df5d-3d4e-4c22-bc9e-e69ce1edcb98 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: 9b80f5d2-a282-4ccc-8db3-c97fa829aefe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:42.262724 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3654df5d-3d4e-4c22-bc9e-e69ce1edcb98 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:42.263522 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3654df5d-3d4e-4c22-bc9e-e69ce1edcb98 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:42.264485 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3654df5d-3d4e-4c22-bc9e-e69ce1edcb98 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:42.265375 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3654df5d-3d4e-4c22-bc9e-e69ce1edcb98 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:42.374311 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2f1d0567-0e77-45c3-bc68-2ff80f58ad25 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:42.396833 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2f1d0567-0e77-45c3-bc68-2ff80f58ad25 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:42.414870 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2f1d0567-0e77-45c3-bc68-2ff80f58ad25 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:42.427396 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2f1d0567-0e77-45c3-bc68-2ff80f58ad25 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 1362 microversion: 2.25 time: 1.385551 Jun 05 08:25:42.430212 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 423/820] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:41 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 1362 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:42.462262 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7303adcc-e062-4f80-b6cc-bb2e6a919a9e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:42.478438 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7303adcc-e062-4f80-b6cc-bb2e6a919a9e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:42.491997 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7303adcc-e062-4f80-b6cc-bb2e6a919a9e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:42.495685 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7303adcc-e062-4f80-b6cc-bb2e6a919a9e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:42.496910 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7303adcc-e062-4f80-b6cc-bb2e6a919a9e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:42.500938 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7303adcc-e062-4f80-b6cc-bb2e6a919a9e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:42.582562 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7303adcc-e062-4f80-b6cc-bb2e6a919a9e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:42.583517 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7303adcc-e062-4f80-b6cc-bb2e6a919a9e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:42.584256 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-7303adcc-e062-4f80-b6cc-bb2e6a919a9e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:42.680260 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7303adcc-e062-4f80-b6cc-bb2e6a919a9e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:42.695971 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7303adcc-e062-4f80-b6cc-bb2e6a919a9e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.258174 Jun 05 08:25:42.708712 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 424/821] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:42 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:42.720857 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-7299e32c-d474-47e4-8452-5e191d0749a0 req-5c5673b6-c7a3-4a7c-af1d-c2e469724abd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35db623e-15e3-4238-8c0f-ce05bc679787", "tag": "dd3c5ea6-c469-401f-afb5-9474a9c0d5dc"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:42.756127 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-7299e32c-d474-47e4-8452-5e191d0749a0 req-5c5673b6-c7a3-4a7c-af1d-c2e469724abd service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:42.758034 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-7299e32c-d474-47e4-8452-5e191d0749a0 req-5c5673b6-c7a3-4a7c-af1d-c2e469724abd service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:42.804700 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-7299e32c-d474-47e4-8452-5e191d0749a0 req-5c5673b6-c7a3-4a7c-af1d-c2e469724abd service nova] Creating event network-changed:dd3c5ea6-c469-401f-afb5-9474a9c0d5dc for instance 35db623e-15e3-4238-8c0f-ce05bc679787 on n-h1-844739-1 Jun 05 08:25:42.823819 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-7299e32c-d474-47e4-8452-5e191d0749a0 req-5c5673b6-c7a3-4a7c-af1d-c2e469724abd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112823 Jun 05 08:25:42.825037 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 425/822] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:42.838045 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8cbd49da-f319-4cfd-8ef5-7e9db5e01578 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:42.844392 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8cbd49da-f319-4cfd-8ef5-7e9db5e01578 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 5ad92c72-624d-411d-b083-8eb7097ffbfe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:42.858916 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8cbd49da-f319-4cfd-8ef5-7e9db5e01578 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:42.859376 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8cbd49da-f319-4cfd-8ef5-7e9db5e01578 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:42.860244 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8cbd49da-f319-4cfd-8ef5-7e9db5e01578 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:42.860691 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8cbd49da-f319-4cfd-8ef5-7e9db5e01578 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:42.918406 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3654df5d-3d4e-4c22-bc9e-e69ce1edcb98 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:42.928072 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=100 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:42.931461 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3654df5d-3d4e-4c22-bc9e-e69ce1edcb98 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe" status: 200 len: 1390 microversion: 2.1 time: 0.714710 Jun 05 08:25:42.932394 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 398/823] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:42 2022] GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe => generated 1390 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:42.946654 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-3e5bd9a0-f0d9-4f03-91a7-f3a90b5eab44 req-369d8ced-c68c-4437-a9a0-3c500b964d68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b50f75-ca7f-4320-bbd6-363b4d656cd8", "name": "network-vif-plugged", "status": "completed", "tag": "979ddd25-4bd3-4566-91d5-2e2a41a40011"}, {"server_uuid": "9b80f5d2-a282-4ccc-8db3-c97fa829aefe", "name": "network-vif-plugged", "status": "completed", "tag": "dd1eaf3c-4246-487f-b193-efb1262f0dba"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:42.958540 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-3e5bd9a0-f0d9-4f03-91a7-f3a90b5eab44 req-369d8ced-c68c-4437-a9a0-3c500b964d68 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:42.959676 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-3e5bd9a0-f0d9-4f03-91a7-f3a90b5eab44 req-369d8ced-c68c-4437-a9a0-3c500b964d68 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:42.978615 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-3e5bd9a0-f0d9-4f03-91a7-f3a90b5eab44 req-369d8ced-c68c-4437-a9a0-3c500b964d68 service nova] Creating event network-vif-plugged:979ddd25-4bd3-4566-91d5-2e2a41a40011 for instance a1b50f75-ca7f-4320-bbd6-363b4d656cd8 on n-h1-844739-1 Jun 05 08:25:42.980516 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-3e5bd9a0-f0d9-4f03-91a7-f3a90b5eab44 req-369d8ced-c68c-4437-a9a0-3c500b964d68 service nova] Creating event network-vif-plugged:dd1eaf3c-4246-487f-b193-efb1262f0dba for instance 9b80f5d2-a282-4ccc-8db3-c97fa829aefe on n-h2-844739-1 Jun 05 08:25:43.011296 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-3e5bd9a0-f0d9-4f03-91a7-f3a90b5eab44 req-369d8ced-c68c-4437-a9a0-3c500b964d68 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.071220 Jun 05 08:25:43.014726 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 399/824] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:43.232764 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2c4fcf5a-0f51-4849-b1fd-7889ef2581d5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:43.235928 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2c4fcf5a-0f51-4849-b1fd-7889ef2581d5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 35db623e-15e3-4238-8c0f-ce05bc679787] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:43.247780 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2c4fcf5a-0f51-4849-b1fd-7889ef2581d5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:43.252803 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2c4fcf5a-0f51-4849-b1fd-7889ef2581d5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:43.255081 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2c4fcf5a-0f51-4849-b1fd-7889ef2581d5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:43.264284 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2c4fcf5a-0f51-4849-b1fd-7889ef2581d5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:43.267299 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8cbd49da-f319-4cfd-8ef5-7e9db5e01578 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e0d123924c06bb36aeab9c2fa720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad02ddb51f51433a82e0c6361e6ed6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:43.282684 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8cbd49da-f319-4cfd-8ef5-7e9db5e01578 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe" status: 200 len: 1323 microversion: 2.1 time: 0.455544 Jun 05 08:25:43.284564 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 426/825] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:42 2022] GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe => generated 1323 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:43.447918 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f763fa91-62be-47ed-9134-da77b361cda6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:43.448719 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f763fa91-62be-47ed-9134-da77b361cda6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:43.458624 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f763fa91-62be-47ed-9134-da77b361cda6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:43.461114 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f763fa91-62be-47ed-9134-da77b361cda6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:43.464475 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f763fa91-62be-47ed-9134-da77b361cda6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:43.464930 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f763fa91-62be-47ed-9134-da77b361cda6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:43.667794 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2c4fcf5a-0f51-4849-b1fd-7889ef2581d5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:43.693813 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2c4fcf5a-0f51-4849-b1fd-7889ef2581d5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787" status: 200 len: 1319 microversion: 2.1 time: 0.463272 Jun 05 08:25:43.696959 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 400/826] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:43 2022] GET /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787 => generated 1319 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:25:43.717067 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-24d38887-5a5e-40eb-a46c-61e478b9192e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:43.718023 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-24d38887-5a5e-40eb-a46c-61e478b9192e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:43.735582 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-24d38887-5a5e-40eb-a46c-61e478b9192e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:43.737577 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-24d38887-5a5e-40eb-a46c-61e478b9192e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:43.737577 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-24d38887-5a5e-40eb-a46c-61e478b9192e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:43.738014 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-24d38887-5a5e-40eb-a46c-61e478b9192e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:43.833172 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-24d38887-5a5e-40eb-a46c-61e478b9192e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:43.834639 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-24d38887-5a5e-40eb-a46c-61e478b9192e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:43.837547 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-24d38887-5a5e-40eb-a46c-61e478b9192e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:44.025461 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f763fa91-62be-47ed-9134-da77b361cda6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:44.026955 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-24d38887-5a5e-40eb-a46c-61e478b9192e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:44.036861 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f763fa91-62be-47ed-9134-da77b361cda6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:44.037961 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-24d38887-5a5e-40eb-a46c-61e478b9192e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.326809 Jun 05 08:25:44.040065 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f763fa91-62be-47ed-9134-da77b361cda6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:44.041221 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f763fa91-62be-47ed-9134-da77b361cda6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 1362 microversion: 2.25 time: 0.597204 Jun 05 08:25:44.041551 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 401/827] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:43 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:25:44.042845 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 427/828] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:43 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 1362 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:44.056563 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4a3e4cad-b67a-4db5-b770-4b9a1c456b63 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:44.057532 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4a3e4cad-b67a-4db5-b770-4b9a1c456b63 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: 9b80f5d2-a282-4ccc-8db3-c97fa829aefe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:44.064246 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4a3e4cad-b67a-4db5-b770-4b9a1c456b63 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:44.065001 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4a3e4cad-b67a-4db5-b770-4b9a1c456b63 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:44.066235 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4a3e4cad-b67a-4db5-b770-4b9a1c456b63 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:44.066898 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4a3e4cad-b67a-4db5-b770-4b9a1c456b63 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:44.211990 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e437b378-7b11-4405-bc7a-37bde893c355 tempest-FlavorsV2NegativeTest-761294198 tempest-FlavorsV2NegativeTest-761294198-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:44.221492 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e437b378-7b11-4405-bc7a-37bde893c355 tempest-FlavorsV2NegativeTest-761294198 tempest-FlavorsV2NegativeTest-761294198-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.148662 Jun 05 08:25:44.236447 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 428/829] 10.222.0.33 () {58 vars in 1136 bytes} [Sun Jun 5 08:25:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:25:44.283955 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=27 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:44.311698 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-299f2327-8883-4525-8928-a235cf8c9f57 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:44.313398 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-299f2327-8883-4525-8928-a235cf8c9f57 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 5ad92c72-624d-411d-b083-8eb7097ffbfe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:44.320336 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-299f2327-8883-4525-8928-a235cf8c9f57 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:44.321020 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-299f2327-8883-4525-8928-a235cf8c9f57 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:44.322043 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-299f2327-8883-4525-8928-a235cf8c9f57 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:44.322633 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-299f2327-8883-4525-8928-a235cf8c9f57 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:44.484686 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4a3e4cad-b67a-4db5-b770-4b9a1c456b63 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:44.495794 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4a3e4cad-b67a-4db5-b770-4b9a1c456b63 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe" status: 200 len: 1390 microversion: 2.1 time: 0.441609 Jun 05 08:25:44.498315 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 402/830] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:44 2022] GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe => generated 1390 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:44.526884 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:44.675938 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-299f2327-8883-4525-8928-a235cf8c9f57 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e0d123924c06bb36aeab9c2fa720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad02ddb51f51433a82e0c6361e6ed6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:44.690235 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-299f2327-8883-4525-8928-a235cf8c9f57 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe" status: 200 len: 1323 microversion: 2.1 time: 0.388232 Jun 05 08:25:44.700315 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 429/831] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:44 2022] GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe => generated 1323 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:44.713552 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d111e659-e1ca-4a3f-87c2-82d6ae5df45e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:44.715610 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d111e659-e1ca-4a3f-87c2-82d6ae5df45e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 35db623e-15e3-4238-8c0f-ce05bc679787] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:44.726601 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d111e659-e1ca-4a3f-87c2-82d6ae5df45e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:44.728471 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d111e659-e1ca-4a3f-87c2-82d6ae5df45e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:44.729424 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d111e659-e1ca-4a3f-87c2-82d6ae5df45e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:44.730051 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d111e659-e1ca-4a3f-87c2-82d6ae5df45e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:44.862654 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-905fd5a3-f249-43b8-aed9-3983ec8395ae req-7192ce37-2690-43d4-bf77-c7771e2b6adc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15fff300-f7b6-4336-a143-1e5687af979b", "tag": "c8ecaf2e-cdf3-4a90-bea7-af64a1c7bc7b"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:44.881331 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-905fd5a3-f249-43b8-aed9-3983ec8395ae req-7192ce37-2690-43d4-bf77-c7771e2b6adc service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:44.882196 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-905fd5a3-f249-43b8-aed9-3983ec8395ae req-7192ce37-2690-43d4-bf77-c7771e2b6adc service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:44.897225 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-905fd5a3-f249-43b8-aed9-3983ec8395ae req-7192ce37-2690-43d4-bf77-c7771e2b6adc service nova] Creating event network-changed:c8ecaf2e-cdf3-4a90-bea7-af64a1c7bc7b for instance 15fff300-f7b6-4336-a143-1e5687af979b on n-h1-844739-1 Jun 05 08:25:44.910933 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-905fd5a3-f249-43b8-aed9-3983ec8395ae req-7192ce37-2690-43d4-bf77-c7771e2b6adc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054948 Jun 05 08:25:44.915275 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 430/832] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:45.015154 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-2e099d17-0315-47a2-bd34-c14674ad4c43 req-f127f5b8-74ee-46ac-818c-08f52522b295 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "476cc23e-487d-4d15-849e-208df0e985b1", "tag": "b7264816-9730-49ab-bb1c-4148a2e5aaef"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:45.037343 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-2e099d17-0315-47a2-bd34-c14674ad4c43 req-f127f5b8-74ee-46ac-818c-08f52522b295 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:45.037759 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-2e099d17-0315-47a2-bd34-c14674ad4c43 req-f127f5b8-74ee-46ac-818c-08f52522b295 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:45.061965 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-2e099d17-0315-47a2-bd34-c14674ad4c43 req-f127f5b8-74ee-46ac-818c-08f52522b295 service nova] Creating event network-changed:b7264816-9730-49ab-bb1c-4148a2e5aaef for instance 476cc23e-487d-4d15-849e-208df0e985b1 on n-h1-844739-1 Jun 05 08:25:45.084570 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-2e099d17-0315-47a2-bd34-c14674ad4c43 req-f127f5b8-74ee-46ac-818c-08f52522b295 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069530 Jun 05 08:25:45.085299 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 431/833] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:25:45.089920 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d111e659-e1ca-4a3f-87c2-82d6ae5df45e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:45.098382 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d111e659-e1ca-4a3f-87c2-82d6ae5df45e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787" status: 200 len: 1319 microversion: 2.1 time: 0.390621 Jun 05 08:25:45.099155 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 403/834] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:44 2022] GET /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787 => generated 1319 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:25:45.109715 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-77479678-095a-4193-b9da-1ebb459d3b50 req-527e43ac-7bb9-4b24-a0a9-dbe0ace3377f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ad92c72-624d-411d-b083-8eb7097ffbfe", "name": "network-vif-plugged", "status": "completed", "tag": "0a210eba-2292-4ffe-838d-feb9e31e4828"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:45.113735 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3e6573ac-184d-440f-841a-4c424fdd68ea tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:45.116269 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3e6573ac-184d-440f-841a-4c424fdd68ea tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:45.124905 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-77479678-095a-4193-b9da-1ebb459d3b50 req-527e43ac-7bb9-4b24-a0a9-dbe0ace3377f service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:45.125892 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-77479678-095a-4193-b9da-1ebb459d3b50 req-527e43ac-7bb9-4b24-a0a9-dbe0ace3377f service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:45.130252 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3e6573ac-184d-440f-841a-4c424fdd68ea tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:45.132210 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3e6573ac-184d-440f-841a-4c424fdd68ea tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:45.134537 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3e6573ac-184d-440f-841a-4c424fdd68ea tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:45.135807 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3e6573ac-184d-440f-841a-4c424fdd68ea tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:45.155373 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-77479678-095a-4193-b9da-1ebb459d3b50 req-527e43ac-7bb9-4b24-a0a9-dbe0ace3377f service nova] Creating event network-vif-plugged:0a210eba-2292-4ffe-838d-feb9e31e4828 for instance 5ad92c72-624d-411d-b083-8eb7097ffbfe on n-h1-844739-1 Jun 05 08:25:45.172822 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-77479678-095a-4193-b9da-1ebb459d3b50 req-527e43ac-7bb9-4b24-a0a9-dbe0ace3377f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085306 Jun 05 08:25:45.175260 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 432/835] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:45.179855 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4af543fe-d11f-415d-813f-6d446f53ee84 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:45.184872 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4af543fe-d11f-415d-813f-6d446f53ee84 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:45.191176 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3e6573ac-184d-440f-841a-4c424fdd68ea tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:45.191761 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3e6573ac-184d-440f-841a-4c424fdd68ea tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:45.193082 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-3e6573ac-184d-440f-841a-4c424fdd68ea tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:45.202127 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4af543fe-d11f-415d-813f-6d446f53ee84 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:45.202593 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4af543fe-d11f-415d-813f-6d446f53ee84 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:45.203960 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4af543fe-d11f-415d-813f-6d446f53ee84 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:45.204442 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4af543fe-d11f-415d-813f-6d446f53ee84 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:45.266959 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3e6573ac-184d-440f-841a-4c424fdd68ea tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:45.277719 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3e6573ac-184d-440f-841a-4c424fdd68ea tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.177714 Jun 05 08:25:45.278594 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 404/836] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:45 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:45.285306 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a22181de-6d11-4fe1-b751-8adfab64cf22 tempest-FlavorsV2NegativeTest-761294198 tempest-FlavorsV2NegativeTest-761294198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1181563099", "imageRef": "840b05d6-3eb5-4b52-9edb-7240770c3198", "flavorRef": "452"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:45.377850 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-a22181de-6d11-4fe1-b751-8adfab64cf22 tempest-FlavorsV2NegativeTest-761294198 tempest-FlavorsV2NegativeTest-761294198-project] validate_networks() for None {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:25:45.782354 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4af543fe-d11f-415d-813f-6d446f53ee84 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:45.792885 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4af543fe-d11f-415d-813f-6d446f53ee84 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:45.794428 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4af543fe-d11f-415d-813f-6d446f53ee84 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:45.795536 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4af543fe-d11f-415d-813f-6d446f53ee84 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 1362 microversion: 2.25 time: 0.619781 Jun 05 08:25:45.796134 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 433/837] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:45 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 1362 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:45.803534 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-80270a5b-dcf4-42da-9974-43912ab2a788 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:45.804467 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-80270a5b-dcf4-42da-9974-43912ab2a788 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: 9b80f5d2-a282-4ccc-8db3-c97fa829aefe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:45.813491 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-80270a5b-dcf4-42da-9974-43912ab2a788 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:45.813940 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-80270a5b-dcf4-42da-9974-43912ab2a788 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:45.814808 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-80270a5b-dcf4-42da-9974-43912ab2a788 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:45.815382 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-80270a5b-dcf4-42da-9974-43912ab2a788 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:46.139454 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-a22181de-6d11-4fe1-b751-8adfab64cf22 tempest-FlavorsV2NegativeTest-761294198 tempest-FlavorsV2NegativeTest-761294198-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jun 05 08:25:46.143239 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a22181de-6d11-4fe1-b751-8adfab64cf22 tempest-FlavorsV2NegativeTest-761294198 tempest-FlavorsV2NegativeTest-761294198-project] Request method failure captured: Jun 05 08:25:46.143239 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 05 08:25:46.143239 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:25:46.143239 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:25:46.143239 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:25:46.143239 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 143 Jun 05 08:25:46.143239 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:25:46.143239 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:25:46.143239 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:25:46.143239 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:25:46.143239 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGiHg4kZwakyQfjWb0uKpthg-_3SpwGqdR9hPTY0sUZAwojWkgCPjF2P0qRliL6m3Yqg5unSaLpwG0yzP7NsuJBzmmBU0TgAMw0YRdIrmqOfHylujR6rWpssFWBo_KgWIFtLsjgRoG6GsUpf4KpEX2VCofw8d8RCp8SW2gV3K_jfU7w Jun 05 08:25:46.143239 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:25:46.143239 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:25:46.143239 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:25:46.143239 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:25:46.143239 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:25:46.143239 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:25:46.143239 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 1bd28958f6da41f7bd26e87d9fd6a6fd Jun 05 08:25:46.143239 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-FlavorsV2NegativeTest-761294198 Jun 05 08:25:46.143239 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:25:46.143239 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:25:46.144899 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1bd28958f6da41f7bd26e87d9fd6a6fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1bd28958f6da41f7bd26e87d9fd6a6fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1bd28958f6da41f7bd26e87d9fd6a6fd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1bd28958f6da41f7bd26e87d9fd6a6fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:25:46.144899 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-FlavorsV2NegativeTest-761294198 Jun 05 08:25:46.144899 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 1bd28958f6da41f7bd26e87d9fd6a6fd Jun 05 08:25:46.144899 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-761294198 Jun 05 08:25:46.144899 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-FlavorsV2NegativeTest-761294198-project Jun 05 08:25:46.144899 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:25:46.144899 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:25:46.144899 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: b370b2b5258140fba6c61058ec0c7759 Jun 05 08:25:46.144899 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-FlavorsV2NegativeTest-761294198-project Jun 05 08:25:46.144899 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:25:46.144899 n-d-844739-1 devstack@n-api.service[119050]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1181563099", "imageRef": "840b05d6-3eb5-4b52-9edb-7240770c3198", "flavorRef": "452"}} Jun 05 08:25:46.144899 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:25:46.144899 n-d-844739-1 devstack@n-api.service[119050]: exception: Flavor's memory is too small for requested image. Jun 05 08:25:46.145882 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1181563099', 'imageRef': '840b05d6-3eb5-4b52-9edb-7240770c3198', 'flavorRef': '452'}}} Jun 05 08:25:46.145882 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:25:46.145882 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:25:46.145882 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 05 08:25:46.145882 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 05 08:25:46.145882 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 05 08:25:46.145882 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 05 08:25:46.145882 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jun 05 08:25:46.145882 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jun 05 08:25:46.145882 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jun 05 08:25:46.145882 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jun 05 08:25:46.145882 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jun 05 08:25:46.145882 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jun 05 08:25:46.145882 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jun 05 08:25:46.145882 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jun 05 08:25:46.145882 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jun 05 08:25:46.145882 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:25:46.145882 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:25:46.145882 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:25:46.147273 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:25:46.147273 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:25:46.147273 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:25:46.147273 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:25:46.147273 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:25:46.147273 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:25:46.147273 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:25:46.147273 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:25:46.147273 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:25:46.147273 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:25:46.147273 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:25:46.147273 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:25:46.147273 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:25:46.147273 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 05 08:25:46.147273 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jun 05 08:25:46.147273 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 05 08:25:46.147273 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jun 05 08:25:46.147273 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:25:46.147273 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:25:46.147273 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:25:46.147273 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:25:46.148895 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:25:46.148895 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:25:46.148895 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:25:46.148895 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:25:46.148895 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jun 05 08:25:46.148895 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:25:46.148895 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a22181de-6d11-4fe1-b751-8adfab64cf22 tempest-FlavorsV2NegativeTest-761294198 tempest-FlavorsV2NegativeTest-761294198-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:25:46.150773 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a22181de-6d11-4fe1-b751-8adfab64cf22 tempest-FlavorsV2NegativeTest-761294198 tempest-FlavorsV2NegativeTest-761294198-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.871073 Jun 05 08:25:46.165388 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 405/838] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:25:45 2022] POST /compute/v2.1/servers => generated 93 bytes in 886 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 05 08:25:46.174130 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b707387c-37e7-462a-85bd-5a609235bdc9 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:46.175007 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b707387c-37e7-462a-85bd-5a609235bdc9 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 5ad92c72-624d-411d-b083-8eb7097ffbfe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:46.185015 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b707387c-37e7-462a-85bd-5a609235bdc9 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:46.185457 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b707387c-37e7-462a-85bd-5a609235bdc9 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:46.186275 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b707387c-37e7-462a-85bd-5a609235bdc9 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:46.186666 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b707387c-37e7-462a-85bd-5a609235bdc9 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:46.631276 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-80270a5b-dcf4-42da-9974-43912ab2a788 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:46.644549 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-80270a5b-dcf4-42da-9974-43912ab2a788 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe" status: 200 len: 1589 microversion: 2.1 time: 0.847145 Jun 05 08:25:46.646402 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 434/839] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:45 2022] GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe => generated 1589 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:46.657647 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b707387c-37e7-462a-85bd-5a609235bdc9 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e0d123924c06bb36aeab9c2fa720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad02ddb51f51433a82e0c6361e6ed6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:46.657647 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b707387c-37e7-462a-85bd-5a609235bdc9 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe" status: 200 len: 1323 microversion: 2.1 time: 0.489694 Jun 05 08:25:46.665912 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 406/840] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:46 2022] GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe => generated 1323 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:46.671554 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2899c491-ed02-4d36-b285-83941b01784a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:46.672720 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2899c491-ed02-4d36-b285-83941b01784a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:46.681237 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d53c0082-4046-4a7f-97f9-f9300fda1140 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:46.681887 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d53c0082-4046-4a7f-97f9-f9300fda1140 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 35db623e-15e3-4238-8c0f-ce05bc679787] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:46.682367 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2899c491-ed02-4d36-b285-83941b01784a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:46.683067 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2899c491-ed02-4d36-b285-83941b01784a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:46.684425 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2899c491-ed02-4d36-b285-83941b01784a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:46.685085 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2899c491-ed02-4d36-b285-83941b01784a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:46.699036 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d53c0082-4046-4a7f-97f9-f9300fda1140 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:46.699496 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d53c0082-4046-4a7f-97f9-f9300fda1140 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:46.700351 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d53c0082-4046-4a7f-97f9-f9300fda1140 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:46.700823 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d53c0082-4046-4a7f-97f9-f9300fda1140 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:46.727119 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2899c491-ed02-4d36-b285-83941b01784a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:46.727942 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2899c491-ed02-4d36-b285-83941b01784a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:46.728638 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-2899c491-ed02-4d36-b285-83941b01784a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:46.830086 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2899c491-ed02-4d36-b285-83941b01784a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:46.841423 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2899c491-ed02-4d36-b285-83941b01784a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.173634 Jun 05 08:25:46.843781 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 435/841] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:46 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:46.858122 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-eb06ba1d-14c7-4c16-880e-5eb7c59d773e tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:46.860069 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-eb06ba1d-14c7-4c16-880e-5eb7c59d773e tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: 9b80f5d2-a282-4ccc-8db3-c97fa829aefe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:46.873283 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-eb06ba1d-14c7-4c16-880e-5eb7c59d773e tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:46.876704 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-eb06ba1d-14c7-4c16-880e-5eb7c59d773e tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:46.879288 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-eb06ba1d-14c7-4c16-880e-5eb7c59d773e tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:46.880639 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-eb06ba1d-14c7-4c16-880e-5eb7c59d773e tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:47.005426 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d53c0082-4046-4a7f-97f9-f9300fda1140 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:47.017100 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d53c0082-4046-4a7f-97f9-f9300fda1140 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787" status: 200 len: 1319 microversion: 2.1 time: 0.350006 Jun 05 08:25:47.018533 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 407/842] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:46 2022] GET /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787 => generated 1319 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:47.029475 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-89ceb0ed-df36-46a3-b3c8-01f75f665f88 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:47.032326 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-89ceb0ed-df36-46a3-b3c8-01f75f665f88 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:47.045074 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-89ceb0ed-df36-46a3-b3c8-01f75f665f88 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:47.046440 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-89ceb0ed-df36-46a3-b3c8-01f75f665f88 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:47.050144 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-89ceb0ed-df36-46a3-b3c8-01f75f665f88 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:47.050785 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-89ceb0ed-df36-46a3-b3c8-01f75f665f88 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:47.056952 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-eb06ba1d-14c7-4c16-880e-5eb7c59d773e tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.209227 Jun 05 08:25:47.057967 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 436/843] 10.222.0.33 () {58 vars in 1274 bytes} [Sun Jun 5 08:25:46 2022] GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe/os-interface => generated 285 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:47.260908 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=10 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:47.344658 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c71cb05f-2758-414d-9164-ab0330102290 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Action: 'create', calling method: .version_select at 0x7f2433f4e550>, body: {"keypair": {"name": "tempest-keypair-1366342627", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSqjKGTxx+HAWMGG25+IvcdgoA6O9MQ3YZ8Wn+upXhqYviLT5vM5zHOz8OhisEXeQl7FYkFzYqbo3aN2/So24q8XoGJzXVlwzcndbWHRgOX25hMIl2XdQeJ7igRms4rGw=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:47.370174 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-c71cb05f-2758-414d-9164-ab0330102290 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Getting quotas for project 2ed0e53a23984cea813890af8c283d0f. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:25:47.386651 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-c71cb05f-2758-414d-9164-ab0330102290 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Getting quotas for user 4ffd5630f41a48a694fc306c78712796 and project 2ed0e53a23984cea813890af8c283d0f. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:25:47.434162 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c71cb05f-2758-414d-9164-ab0330102290 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.374961 Jun 05 08:25:47.436134 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 437/844] 10.222.0.33 () {62 vars in 1199 bytes} [Sun Jun 5 08:25:47 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 377 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 05 08:25:47.551800 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-89ceb0ed-df36-46a3-b3c8-01f75f665f88 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:47.562319 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-89ceb0ed-df36-46a3-b3c8-01f75f665f88 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:47.567369 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-89ceb0ed-df36-46a3-b3c8-01f75f665f88 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:47.569845 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-89ceb0ed-df36-46a3-b3c8-01f75f665f88 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 1362 microversion: 2.25 time: 0.550176 Jun 05 08:25:47.585576 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 408/845] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:47 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 1362 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:47.675173 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-85c15b53-0806-4c8c-bdde-da8417ca3413 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:47.676114 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-85c15b53-0806-4c8c-bdde-da8417ca3413 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 5ad92c72-624d-411d-b083-8eb7097ffbfe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:47.708759 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-85c15b53-0806-4c8c-bdde-da8417ca3413 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:47.709676 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-85c15b53-0806-4c8c-bdde-da8417ca3413 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:47.710763 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-85c15b53-0806-4c8c-bdde-da8417ca3413 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:47.712132 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-85c15b53-0806-4c8c-bdde-da8417ca3413 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:47.861936 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-42da4b9b-c552-482a-8cde-c789c08051cc tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:47.863506 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-42da4b9b-c552-482a-8cde-c789c08051cc tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:47.866773 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=5 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:47.883268 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-42da4b9b-c552-482a-8cde-c789c08051cc tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:47.884860 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-42da4b9b-c552-482a-8cde-c789c08051cc tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:47.885910 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-42da4b9b-c552-482a-8cde-c789c08051cc tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:47.887872 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-42da4b9b-c552-482a-8cde-c789c08051cc tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:47.961190 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-42da4b9b-c552-482a-8cde-c789c08051cc tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:47.961697 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-42da4b9b-c552-482a-8cde-c789c08051cc tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:47.967646 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-42da4b9b-c552-482a-8cde-c789c08051cc tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:48.160894 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-42da4b9b-c552-482a-8cde-c789c08051cc tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:48.174467 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-42da4b9b-c552-482a-8cde-c789c08051cc tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.314730 Jun 05 08:25:48.177995 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 409/846] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:47 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:48.191377 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-032fe265-9aaa-40c3-acf9-ca93bf797f64 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:48.192604 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-032fe265-9aaa-40c3-acf9-ca93bf797f64 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 35db623e-15e3-4238-8c0f-ce05bc679787] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:48.206211 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-032fe265-9aaa-40c3-acf9-ca93bf797f64 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:48.207071 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-032fe265-9aaa-40c3-acf9-ca93bf797f64 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:48.210509 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-032fe265-9aaa-40c3-acf9-ca93bf797f64 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:48.211257 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-032fe265-9aaa-40c3-acf9-ca93bf797f64 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:48.400069 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-85c15b53-0806-4c8c-bdde-da8417ca3413 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e0d123924c06bb36aeab9c2fa720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad02ddb51f51433a82e0c6361e6ed6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:48.420363 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-85c15b53-0806-4c8c-bdde-da8417ca3413 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe" status: 200 len: 1323 microversion: 2.1 time: 0.748364 Jun 05 08:25:48.425595 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 438/847] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:47 2022] GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe => generated 1323 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:48.593123 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-49a320b1-b6c8-4f42-b9a3-bdf2bea3230e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:48.594102 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-49a320b1-b6c8-4f42-b9a3-bdf2bea3230e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:48.605537 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-49a320b1-b6c8-4f42-b9a3-bdf2bea3230e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:48.606348 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-49a320b1-b6c8-4f42-b9a3-bdf2bea3230e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:48.608420 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-49a320b1-b6c8-4f42-b9a3-bdf2bea3230e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:48.614583 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-49a320b1-b6c8-4f42-b9a3-bdf2bea3230e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:49.391049 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-032fe265-9aaa-40c3-acf9-ca93bf797f64 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:49.408300 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-032fe265-9aaa-40c3-acf9-ca93bf797f64 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787" status: 200 len: 1319 microversion: 2.1 time: 1.225070 Jun 05 08:25:49.422455 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 410/848] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:48 2022] GET /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787 => generated 1319 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:49.439883 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-16c8174c-8bde-4c66-8d64-1d89e27f3327 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:49.443568 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-16c8174c-8bde-4c66-8d64-1d89e27f3327 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:49.467613 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-16c8174c-8bde-4c66-8d64-1d89e27f3327 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:49.471780 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-16c8174c-8bde-4c66-8d64-1d89e27f3327 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:49.478193 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-16c8174c-8bde-4c66-8d64-1d89e27f3327 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:49.479565 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-16c8174c-8bde-4c66-8d64-1d89e27f3327 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:49.586151 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-16c8174c-8bde-4c66-8d64-1d89e27f3327 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:49.590367 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-16c8174c-8bde-4c66-8d64-1d89e27f3327 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:49.591087 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-16c8174c-8bde-4c66-8d64-1d89e27f3327 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:49.992585 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-16c8174c-8bde-4c66-8d64-1d89e27f3327 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:50.034733 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-16c8174c-8bde-4c66-8d64-1d89e27f3327 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.610145 Jun 05 08:25:50.035869 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 411/849] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:49 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:50.042003 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-97055560-2dc7-463c-bde6-a64f9701e341 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:50.045083 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-97055560-2dc7-463c-bde6-a64f9701e341 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 5ad92c72-624d-411d-b083-8eb7097ffbfe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:50.074069 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-97055560-2dc7-463c-bde6-a64f9701e341 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:50.075927 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-97055560-2dc7-463c-bde6-a64f9701e341 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:50.077250 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-97055560-2dc7-463c-bde6-a64f9701e341 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:50.078484 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-97055560-2dc7-463c-bde6-a64f9701e341 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:50.305758 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-49a320b1-b6c8-4f42-b9a3-bdf2bea3230e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:50.323266 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-49a320b1-b6c8-4f42-b9a3-bdf2bea3230e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:50.333724 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-49a320b1-b6c8-4f42-b9a3-bdf2bea3230e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:50.335319 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-49a320b1-b6c8-4f42-b9a3-bdf2bea3230e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 1362 microversion: 2.25 time: 1.746225 Jun 05 08:25:50.336401 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 439/850] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:48 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 1362 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:50.399288 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-9c900493-d11f-408e-bbe4-8b32242ab3ae req-cf68eaa2-4d03-4f29-9fed-73218b20f83d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35db623e-15e3-4238-8c0f-ce05bc679787", "name": "network-vif-plugged", "status": "completed", "tag": "dd3c5ea6-c469-401f-afb5-9474a9c0d5dc"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:50.424838 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-9c900493-d11f-408e-bbe4-8b32242ab3ae req-cf68eaa2-4d03-4f29-9fed-73218b20f83d service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:50.430898 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-9c900493-d11f-408e-bbe4-8b32242ab3ae req-cf68eaa2-4d03-4f29-9fed-73218b20f83d service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:50.462342 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-9c900493-d11f-408e-bbe4-8b32242ab3ae req-cf68eaa2-4d03-4f29-9fed-73218b20f83d service nova] Creating event network-vif-plugged:dd3c5ea6-c469-401f-afb5-9474a9c0d5dc for instance 35db623e-15e3-4238-8c0f-ce05bc679787 on n-h1-844739-1 Jun 05 08:25:50.477014 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-9c900493-d11f-408e-bbe4-8b32242ab3ae req-cf68eaa2-4d03-4f29-9fed-73218b20f83d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076736 Jun 05 08:25:50.478947 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 440/851] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:25:50.491374 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2698f41f-7af7-44c0-939c-fd524706b73f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:50.500541 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2698f41f-7af7-44c0-939c-fd524706b73f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 35db623e-15e3-4238-8c0f-ce05bc679787] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:50.520697 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2698f41f-7af7-44c0-939c-fd524706b73f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:50.524273 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2698f41f-7af7-44c0-939c-fd524706b73f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:50.525059 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2698f41f-7af7-44c0-939c-fd524706b73f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:50.529805 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2698f41f-7af7-44c0-939c-fd524706b73f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:51.148584 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-97055560-2dc7-463c-bde6-a64f9701e341 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e0d123924c06bb36aeab9c2fa720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad02ddb51f51433a82e0c6361e6ed6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:51.164029 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-97055560-2dc7-463c-bde6-a64f9701e341 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe" status: 200 len: 1516 microversion: 2.1 time: 1.126827 Jun 05 08:25:51.166850 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 412/852] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:50 2022] GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe => generated 1516 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:51.185861 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3b2ee9c9-6528-4bcb-b4d9-e4daacebae6f tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:51.186769 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3b2ee9c9-6528-4bcb-b4d9-e4daacebae6f tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: 9b80f5d2-a282-4ccc-8db3-c97fa829aefe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:51.200031 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3b2ee9c9-6528-4bcb-b4d9-e4daacebae6f tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:51.201443 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3b2ee9c9-6528-4bcb-b4d9-e4daacebae6f tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:51.204691 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3b2ee9c9-6528-4bcb-b4d9-e4daacebae6f tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:51.205376 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3b2ee9c9-6528-4bcb-b4d9-e4daacebae6f tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:51.219245 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2698f41f-7af7-44c0-939c-fd524706b73f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:51.248139 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2698f41f-7af7-44c0-939c-fd524706b73f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787" status: 200 len: 1319 microversion: 2.1 time: 0.758723 Jun 05 08:25:51.251986 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 441/853] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:50 2022] GET /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787 => generated 1319 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:51.271454 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-d44d1079-b184-4d51-8466-89aa0c87cbcb req-62f9bf9e-df7e-4472-88f0-10a5748d7987 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b80f5d2-a282-4ccc-8db3-c97fa829aefe", "tag": "dd1eaf3c-4246-487f-b193-efb1262f0dba"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:51.283286 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-d44d1079-b184-4d51-8466-89aa0c87cbcb req-62f9bf9e-df7e-4472-88f0-10a5748d7987 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:51.284123 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-d44d1079-b184-4d51-8466-89aa0c87cbcb req-62f9bf9e-df7e-4472-88f0-10a5748d7987 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:51.309161 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-d44d1079-b184-4d51-8466-89aa0c87cbcb req-62f9bf9e-df7e-4472-88f0-10a5748d7987 service nova] Creating event network-changed:dd1eaf3c-4246-487f-b193-efb1262f0dba for instance 9b80f5d2-a282-4ccc-8db3-c97fa829aefe on n-h2-844739-1 Jun 05 08:25:51.319532 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-d44d1079-b184-4d51-8466-89aa0c87cbcb req-62f9bf9e-df7e-4472-88f0-10a5748d7987 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064241 Jun 05 08:25:51.321235 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 442/854] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:51.337243 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8117425b-0448-450e-bc31-e864425e6bbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:51.338289 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8117425b-0448-450e-bc31-e864425e6bbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:51.356546 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8117425b-0448-450e-bc31-e864425e6bbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:51.357869 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8117425b-0448-450e-bc31-e864425e6bbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:51.358644 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8117425b-0448-450e-bc31-e864425e6bbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:51.359088 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8117425b-0448-450e-bc31-e864425e6bbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:51.374065 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=100 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:51.424022 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8117425b-0448-450e-bc31-e864425e6bbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:51.428936 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8117425b-0448-450e-bc31-e864425e6bbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:51.429651 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-8117425b-0448-450e-bc31-e864425e6bbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:51.596330 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8117425b-0448-450e-bc31-e864425e6bbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:51.612425 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8117425b-0448-450e-bc31-e864425e6bbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.281582 Jun 05 08:25:51.622574 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 443/855] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:51 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:51.628514 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-117bc3b4-bd72-4eb5-b60b-3245a16c166a tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:51.632840 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-117bc3b4-bd72-4eb5-b60b-3245a16c166a tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: a1b50f75-ca7f-4320-bbd6-363b4d656cd8] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:51.646720 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-117bc3b4-bd72-4eb5-b60b-3245a16c166a tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:51.647215 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-117bc3b4-bd72-4eb5-b60b-3245a16c166a tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:51.648163 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-117bc3b4-bd72-4eb5-b60b-3245a16c166a tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:51.648716 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-117bc3b4-bd72-4eb5-b60b-3245a16c166a tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:51.834801 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3b2ee9c9-6528-4bcb-b4d9-e4daacebae6f tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:51.847979 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3b2ee9c9-6528-4bcb-b4d9-e4daacebae6f tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe" status: 200 len: 1589 microversion: 2.1 time: 0.678828 Jun 05 08:25:51.853014 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 413/856] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:51 2022] GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe => generated 1589 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:51.865080 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1a8d61e0-a316-4fd6-9d1c-358bcd99c1d0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:51.866039 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1a8d61e0-a316-4fd6-9d1c-358bcd99c1d0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:51.882748 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1a8d61e0-a316-4fd6-9d1c-358bcd99c1d0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:51.883934 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1a8d61e0-a316-4fd6-9d1c-358bcd99c1d0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:51.885687 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1a8d61e0-a316-4fd6-9d1c-358bcd99c1d0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:51.888023 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1a8d61e0-a316-4fd6-9d1c-358bcd99c1d0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:51.959113 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-117bc3b4-bd72-4eb5-b60b-3245a16c166a tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e0d123924c06bb36aeab9c2fa720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad02ddb51f51433a82e0c6361e6ed6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:51.970711 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-117bc3b4-bd72-4eb5-b60b-3245a16c166a tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "GET /compute/v2.1/servers/a1b50f75-ca7f-4320-bbd6-363b4d656cd8" status: 200 len: 1517 microversion: 2.1 time: 0.346965 Jun 05 08:25:51.977138 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 444/857] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:51 2022] GET /compute/v2.1/servers/a1b50f75-ca7f-4320-bbd6-363b4d656cd8 => generated 1517 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:51.995871 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3c270ff7-83ac-4fa2-9f8d-55f0fa3818ea tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:52.001541 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3c270ff7-83ac-4fa2-9f8d-55f0fa3818ea tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 32ee0b81-4a5b-4181-b43c-ad4cdecd0a70] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:52.023847 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3c270ff7-83ac-4fa2-9f8d-55f0fa3818ea tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:52.026644 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3c270ff7-83ac-4fa2-9f8d-55f0fa3818ea tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:52.029265 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3c270ff7-83ac-4fa2-9f8d-55f0fa3818ea tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:52.029918 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3c270ff7-83ac-4fa2-9f8d-55f0fa3818ea tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:52.626311 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1a8d61e0-a316-4fd6-9d1c-358bcd99c1d0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:52.640245 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1a8d61e0-a316-4fd6-9d1c-358bcd99c1d0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:52.644614 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1a8d61e0-a316-4fd6-9d1c-358bcd99c1d0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:52.649374 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1a8d61e0-a316-4fd6-9d1c-358bcd99c1d0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 1362 microversion: 2.25 time: 0.794276 Jun 05 08:25:52.651891 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 414/858] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:51 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 1362 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:52.672820 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a2398edd-2045-4ab4-84c3-fdb689eb5693 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:52.682175 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a2398edd-2045-4ab4-84c3-fdb689eb5693 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 35db623e-15e3-4238-8c0f-ce05bc679787] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:52.700726 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:52.711568 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a2398edd-2045-4ab4-84c3-fdb689eb5693 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:52.714454 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a2398edd-2045-4ab4-84c3-fdb689eb5693 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:52.717639 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a2398edd-2045-4ab4-84c3-fdb689eb5693 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:52.718384 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a2398edd-2045-4ab4-84c3-fdb689eb5693 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:52.752729 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3c270ff7-83ac-4fa2-9f8d-55f0fa3818ea tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e0d123924c06bb36aeab9c2fa720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad02ddb51f51433a82e0c6361e6ed6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:52.762580 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3c270ff7-83ac-4fa2-9f8d-55f0fa3818ea tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "GET /compute/v2.1/servers/32ee0b81-4a5b-4181-b43c-ad4cdecd0a70" status: 200 len: 1517 microversion: 2.1 time: 0.770793 Jun 05 08:25:52.768132 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 445/859] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:51 2022] GET /compute/v2.1/servers/32ee0b81-4a5b-4181-b43c-ad4cdecd0a70 => generated 1517 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:25:52.779642 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-47852998-cad7-4cc2-8869-5f754b68e609 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:52.783832 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-47852998-cad7-4cc2-8869-5f754b68e609 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:52.800239 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-47852998-cad7-4cc2-8869-5f754b68e609 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:52.801826 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-47852998-cad7-4cc2-8869-5f754b68e609 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:52.805752 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-47852998-cad7-4cc2-8869-5f754b68e609 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:52.806704 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-47852998-cad7-4cc2-8869-5f754b68e609 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:52.888461 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-47852998-cad7-4cc2-8869-5f754b68e609 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:52.894881 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-47852998-cad7-4cc2-8869-5f754b68e609 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:52.895767 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-47852998-cad7-4cc2-8869-5f754b68e609 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:52.973709 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-47852998-cad7-4cc2-8869-5f754b68e609 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:52.982859 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-47852998-cad7-4cc2-8869-5f754b68e609 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.212631 Jun 05 08:25:52.983453 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 446/860] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:52 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:53.015006 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bf64ca38-4752-4024-bee8-d36dda33b0d9 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:53.017365 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-bf64ca38-4752-4024-bee8-d36dda33b0d9 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 32ee0b81-4a5b-4181-b43c-ad4cdecd0a70] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:53.040819 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bf64ca38-4752-4024-bee8-d36dda33b0d9 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:53.041585 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bf64ca38-4752-4024-bee8-d36dda33b0d9 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:53.042616 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bf64ca38-4752-4024-bee8-d36dda33b0d9 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:53.043223 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bf64ca38-4752-4024-bee8-d36dda33b0d9 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:53.067905 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a2398edd-2045-4ab4-84c3-fdb689eb5693 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:53.073707 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=100 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:53.082878 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a2398edd-2045-4ab4-84c3-fdb689eb5693 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787" status: 200 len: 1468 microversion: 2.1 time: 0.429335 Jun 05 08:25:53.084127 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 415/861] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:52 2022] GET /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787 => generated 1468 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:53.100662 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-bf64ca38-4752-4024-bee8-d36dda33b0d9 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 32ee0b81-4a5b-4181-b43c-ad4cdecd0a70] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:25:53.103708 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d65aabf7-059e-4a8c-9630-f8b262acfe32 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:53.104446 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d65aabf7-059e-4a8c-9630-f8b262acfe32 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 15fff300-f7b6-4336-a143-1e5687af979b] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:53.115410 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d65aabf7-059e-4a8c-9630-f8b262acfe32 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:53.116281 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d65aabf7-059e-4a8c-9630-f8b262acfe32 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:53.117417 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d65aabf7-059e-4a8c-9630-f8b262acfe32 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:53.118980 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d65aabf7-059e-4a8c-9630-f8b262acfe32 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:53.332637 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bf64ca38-4752-4024-bee8-d36dda33b0d9 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "DELETE /compute/v2.1/servers/32ee0b81-4a5b-4181-b43c-ad4cdecd0a70" status: 204 len: 0 microversion: 2.1 time: 0.326252 Jun 05 08:25:53.333480 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 447/862] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:25:52 2022] DELETE /compute/v2.1/servers/32ee0b81-4a5b-4181-b43c-ad4cdecd0a70 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:25:53.352486 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-27f4b387-5faf-4197-90c7-024164d2eac9 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:53.353530 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-27f4b387-5faf-4197-90c7-024164d2eac9 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 32ee0b81-4a5b-4181-b43c-ad4cdecd0a70] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:53.367779 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-27f4b387-5faf-4197-90c7-024164d2eac9 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:53.370059 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-27f4b387-5faf-4197-90c7-024164d2eac9 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:53.371984 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-27f4b387-5faf-4197-90c7-024164d2eac9 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:53.372854 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-27f4b387-5faf-4197-90c7-024164d2eac9 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:53.570467 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d65aabf7-059e-4a8c-9630-f8b262acfe32 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:53.578814 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d65aabf7-059e-4a8c-9630-f8b262acfe32 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/15fff300-f7b6-4336-a143-1e5687af979b" status: 200 len: 1319 microversion: 2.1 time: 0.480923 Jun 05 08:25:53.579942 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 416/863] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:53 2022] GET /compute/v2.1/servers/15fff300-f7b6-4336-a143-1e5687af979b => generated 1319 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:25:53.585795 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-737f3595-b634-4fe0-bc18-91d124f8649a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-824675710", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4de3a7e-2405-4e59-8dfd-a93eda6fe430"}], "security_groups": [{"name": "tempest-securitygroup--2002198366"}], "key_name": "tempest-keypair-1366342627", "user_data": "}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:53.647176 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-27f4b387-5faf-4197-90c7-024164d2eac9 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e0d123924c06bb36aeab9c2fa720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad02ddb51f51433a82e0c6361e6ed6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:53.655503 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-27f4b387-5faf-4197-90c7-024164d2eac9 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "GET /compute/v2.1/servers/32ee0b81-4a5b-4181-b43c-ad4cdecd0a70" status: 200 len: 1523 microversion: 2.1 time: 0.307277 Jun 05 08:25:53.656336 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 448/864] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:53 2022] GET /compute/v2.1/servers/32ee0b81-4a5b-4181-b43c-ad4cdecd0a70 => generated 1523 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:53.670253 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-610dc082-56a3-4fca-b804-b3e75dcfe3ff tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:53.672061 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-610dc082-56a3-4fca-b804-b3e75dcfe3ff tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:53.685296 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-610dc082-56a3-4fca-b804-b3e75dcfe3ff tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:53.686065 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-610dc082-56a3-4fca-b804-b3e75dcfe3ff tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:53.687060 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-610dc082-56a3-4fca-b804-b3e75dcfe3ff tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:53.688811 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-610dc082-56a3-4fca-b804-b3e75dcfe3ff tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:53.715352 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-737f3595-b634-4fe0-bc18-91d124f8649a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] validate_networks() for [('b4de3a7e-2405-4e59-8dfd-a93eda6fe430', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:25:53.908523 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-610dc082-56a3-4fca-b804-b3e75dcfe3ff tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:53.917415 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-610dc082-56a3-4fca-b804-b3e75dcfe3ff tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:53.919592 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-610dc082-56a3-4fca-b804-b3e75dcfe3ff tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:53.920948 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-610dc082-56a3-4fca-b804-b3e75dcfe3ff tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 1362 microversion: 2.25 time: 0.256007 Jun 05 08:25:53.926637 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 449/865] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:53 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:25:54.015840 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c71dee6e-70cd-4621-b9fe-4bf2f7fd1a94 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:54.018383 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c71dee6e-70cd-4621-b9fe-4bf2f7fd1a94 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:54.036052 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c71dee6e-70cd-4621-b9fe-4bf2f7fd1a94 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:54.038296 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c71dee6e-70cd-4621-b9fe-4bf2f7fd1a94 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:54.039358 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c71dee6e-70cd-4621-b9fe-4bf2f7fd1a94 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:54.040261 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c71dee6e-70cd-4621-b9fe-4bf2f7fd1a94 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:54.080492 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c71dee6e-70cd-4621-b9fe-4bf2f7fd1a94 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:54.082921 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c71dee6e-70cd-4621-b9fe-4bf2f7fd1a94 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:54.083648 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-c71dee6e-70cd-4621-b9fe-4bf2f7fd1a94 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:54.158457 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c71dee6e-70cd-4621-b9fe-4bf2f7fd1a94 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:54.168775 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c71dee6e-70cd-4621-b9fe-4bf2f7fd1a94 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.164115 Jun 05 08:25:54.180856 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 450/866] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:54 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:54.344673 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-737f3595-b634-4fe0-bc18-91d124f8649a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:25:54.346226 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-737f3595-b634-4fe0-bc18-91d124f8649a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:25:54.346992 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-737f3595-b634-4fe0-bc18-91d124f8649a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:25:54.347640 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-737f3595-b634-4fe0-bc18-91d124f8649a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:25:54.348327 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-737f3595-b634-4fe0-bc18-91d124f8649a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:25:54.360767 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-737f3595-b634-4fe0-bc18-91d124f8649a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:54.361565 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-737f3595-b634-4fe0-bc18-91d124f8649a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:54.362410 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-737f3595-b634-4fe0-bc18-91d124f8649a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:54.362861 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-737f3595-b634-4fe0-bc18-91d124f8649a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:54.387392 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-737f3595-b634-4fe0-bc18-91d124f8649a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Getting quotas for project 2ed0e53a23984cea813890af8c283d0f. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:25:54.395262 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-737f3595-b634-4fe0-bc18-91d124f8649a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Getting quotas for user 4ffd5630f41a48a694fc306c78712796 and project 2ed0e53a23984cea813890af8c283d0f. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:25:54.409318 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-737f3595-b634-4fe0-bc18-91d124f8649a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:25:54.411732 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-737f3595-b634-4fe0-bc18-91d124f8649a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:25:54.499425 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-737f3595-b634-4fe0-bc18-91d124f8649a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.918136 Jun 05 08:25:54.501661 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 417/867] 10.222.0.33 () {62 vars in 1187 bytes} [Sun Jun 5 08:25:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 05 08:25:54.512189 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b439e591-a121-4c10-8e29-560521fbc150 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:54.512805 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b439e591-a121-4c10-8e29-560521fbc150 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:54.522013 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:54.597838 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-72ec0073-be55-4921-9b17-46201d557c27 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:54.598878 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-72ec0073-be55-4921-9b17-46201d557c27 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 15fff300-f7b6-4336-a143-1e5687af979b] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:54.608250 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-72ec0073-be55-4921-9b17-46201d557c27 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:54.609592 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-72ec0073-be55-4921-9b17-46201d557c27 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:54.610797 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-72ec0073-be55-4921-9b17-46201d557c27 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:54.611462 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-72ec0073-be55-4921-9b17-46201d557c27 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:54.615035 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b439e591-a121-4c10-8e29-560521fbc150 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:54.622925 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b439e591-a121-4c10-8e29-560521fbc150 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:54.629230 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b439e591-a121-4c10-8e29-560521fbc150 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:54.634198 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b439e591-a121-4c10-8e29-560521fbc150 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1281 microversion: 2.20 time: 0.123987 Jun 05 08:25:54.646153 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 451/868] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:54 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1281 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:54.673606 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-88e07cf3-fa5d-4456-af6b-bb69a8a8ce77 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:54.674223 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-88e07cf3-fa5d-4456-af6b-bb69a8a8ce77 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 32ee0b81-4a5b-4181-b43c-ad4cdecd0a70] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:54.686969 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-88e07cf3-fa5d-4456-af6b-bb69a8a8ce77 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:54.687387 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-88e07cf3-fa5d-4456-af6b-bb69a8a8ce77 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:54.688359 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-88e07cf3-fa5d-4456-af6b-bb69a8a8ce77 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:54.688627 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-88e07cf3-fa5d-4456-af6b-bb69a8a8ce77 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:55.363022 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-72ec0073-be55-4921-9b17-46201d557c27 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:55.368476 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-88e07cf3-fa5d-4456-af6b-bb69a8a8ce77 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e0d123924c06bb36aeab9c2fa720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad02ddb51f51433a82e0c6361e6ed6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:55.372307 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-72ec0073-be55-4921-9b17-46201d557c27 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/15fff300-f7b6-4336-a143-1e5687af979b" status: 200 len: 1319 microversion: 2.1 time: 0.779513 Jun 05 08:25:55.373511 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 418/869] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:54 2022] GET /compute/v2.1/servers/15fff300-f7b6-4336-a143-1e5687af979b => generated 1319 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:25:55.377691 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-88e07cf3-fa5d-4456-af6b-bb69a8a8ce77 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "GET /compute/v2.1/servers/32ee0b81-4a5b-4181-b43c-ad4cdecd0a70" status: 200 len: 1523 microversion: 2.1 time: 0.708445 Jun 05 08:25:55.387032 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 452/870] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:54 2022] GET /compute/v2.1/servers/32ee0b81-4a5b-4181-b43c-ad4cdecd0a70 => generated 1523 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:55.387032 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c7d6f6a0-d989-4838-b9fc-259b36550d22 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:55.387032 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c7d6f6a0-d989-4838-b9fc-259b36550d22 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:55.389726 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1abdd45a-e625-4fc9-a338-8b37f01a11f2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:55.391213 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c7d6f6a0-d989-4838-b9fc-259b36550d22 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:55.391661 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c7d6f6a0-d989-4838-b9fc-259b36550d22 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:55.391966 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1abdd45a-e625-4fc9-a338-8b37f01a11f2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:55.392470 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c7d6f6a0-d989-4838-b9fc-259b36550d22 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:55.392910 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c7d6f6a0-d989-4838-b9fc-259b36550d22 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:55.401992 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1abdd45a-e625-4fc9-a338-8b37f01a11f2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:55.403502 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1abdd45a-e625-4fc9-a338-8b37f01a11f2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:55.404699 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1abdd45a-e625-4fc9-a338-8b37f01a11f2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:55.405739 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1abdd45a-e625-4fc9-a338-8b37f01a11f2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:55.429454 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c7d6f6a0-d989-4838-b9fc-259b36550d22 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:55.429910 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c7d6f6a0-d989-4838-b9fc-259b36550d22 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:55.430368 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-c7d6f6a0-d989-4838-b9fc-259b36550d22 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:55.581565 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c7d6f6a0-d989-4838-b9fc-259b36550d22 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:55.590499 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c7d6f6a0-d989-4838-b9fc-259b36550d22 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.210166 Jun 05 08:25:55.591697 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 453/871] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:55 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:55.598868 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-b425c055-e899-4411-bdc0-0f2d9ee7aeb6 req-a7058c38-dfa3-4f01-bb95-d60820ccd65c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15fff300-f7b6-4336-a143-1e5687af979b", "name": "network-vif-plugged", "status": "completed", "tag": "c8ecaf2e-cdf3-4a90-bea7-af64a1c7bc7b"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:55.608374 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-b425c055-e899-4411-bdc0-0f2d9ee7aeb6 req-a7058c38-dfa3-4f01-bb95-d60820ccd65c service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:55.609088 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-b425c055-e899-4411-bdc0-0f2d9ee7aeb6 req-a7058c38-dfa3-4f01-bb95-d60820ccd65c service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:55.622487 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-b425c055-e899-4411-bdc0-0f2d9ee7aeb6 req-a7058c38-dfa3-4f01-bb95-d60820ccd65c service nova] Creating event network-vif-plugged:c8ecaf2e-cdf3-4a90-bea7-af64a1c7bc7b for instance 15fff300-f7b6-4336-a143-1e5687af979b on n-h1-844739-1 Jun 05 08:25:55.630166 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-b425c055-e899-4411-bdc0-0f2d9ee7aeb6 req-a7058c38-dfa3-4f01-bb95-d60820ccd65c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036779 Jun 05 08:25:55.632093 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 454/872] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:55.657433 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-837a4f26-72c6-417f-a039-f54fbe25cd39 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:55.658199 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-837a4f26-72c6-417f-a039-f54fbe25cd39 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:55.670593 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1abdd45a-e625-4fc9-a338-8b37f01a11f2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:55.691537 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-837a4f26-72c6-417f-a039-f54fbe25cd39 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:55.691684 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1abdd45a-e625-4fc9-a338-8b37f01a11f2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:55.692020 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-837a4f26-72c6-417f-a039-f54fbe25cd39 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:55.692863 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-837a4f26-72c6-417f-a039-f54fbe25cd39 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:55.693311 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-837a4f26-72c6-417f-a039-f54fbe25cd39 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:55.695696 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1abdd45a-e625-4fc9-a338-8b37f01a11f2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:55.697423 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1abdd45a-e625-4fc9-a338-8b37f01a11f2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 1362 microversion: 2.25 time: 0.321932 Jun 05 08:25:55.698372 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 419/873] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:55 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 1362 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:55.789819 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-837a4f26-72c6-417f-a039-f54fbe25cd39 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:55.799995 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-837a4f26-72c6-417f-a039-f54fbe25cd39 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:55.801556 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-837a4f26-72c6-417f-a039-f54fbe25cd39 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:55.802697 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-837a4f26-72c6-417f-a039-f54fbe25cd39 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1285 microversion: 2.20 time: 0.153594 Jun 05 08:25:55.803728 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 455/874] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:55 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1285 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:56.394658 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-63f8749b-62ec-4b7e-94a0-b9af86dbdee2 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:56.395520 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-63f8749b-62ec-4b7e-94a0-b9af86dbdee2 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 32ee0b81-4a5b-4181-b43c-ad4cdecd0a70] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:56.402082 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-63f8749b-62ec-4b7e-94a0-b9af86dbdee2 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:56.402538 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-63f8749b-62ec-4b7e-94a0-b9af86dbdee2 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:56.403574 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-63f8749b-62ec-4b7e-94a0-b9af86dbdee2 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:56.404078 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-63f8749b-62ec-4b7e-94a0-b9af86dbdee2 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:56.463747 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-80d69816-06f8-43a0-97eb-c908e4e72e21 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:56.465176 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-80d69816-06f8-43a0-97eb-c908e4e72e21 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 15fff300-f7b6-4336-a143-1e5687af979b] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:56.475352 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-80d69816-06f8-43a0-97eb-c908e4e72e21 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:56.476266 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-80d69816-06f8-43a0-97eb-c908e4e72e21 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:56.479011 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-80d69816-06f8-43a0-97eb-c908e4e72e21 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:56.479686 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-80d69816-06f8-43a0-97eb-c908e4e72e21 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:56.656732 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-63f8749b-62ec-4b7e-94a0-b9af86dbdee2 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e0d123924c06bb36aeab9c2fa720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad02ddb51f51433a82e0c6361e6ed6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:56.702195 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-63f8749b-62ec-4b7e-94a0-b9af86dbdee2 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "GET /compute/v2.1/servers/32ee0b81-4a5b-4181-b43c-ad4cdecd0a70" status: 200 len: 1523 microversion: 2.1 time: 0.289318 Jun 05 08:25:56.714156 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 420/875] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:56 2022] GET /compute/v2.1/servers/32ee0b81-4a5b-4181-b43c-ad4cdecd0a70 => generated 1523 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:56.727310 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-eebac464-f6ed-4ccf-9ce3-c1b4d0942efe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:56.728259 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-eebac464-f6ed-4ccf-9ce3-c1b4d0942efe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:56.747771 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-eebac464-f6ed-4ccf-9ce3-c1b4d0942efe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:56.748567 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-eebac464-f6ed-4ccf-9ce3-c1b4d0942efe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:56.749664 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-eebac464-f6ed-4ccf-9ce3-c1b4d0942efe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:56.751173 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-eebac464-f6ed-4ccf-9ce3-c1b4d0942efe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:56.842248 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-eebac464-f6ed-4ccf-9ce3-c1b4d0942efe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:56.857426 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-eebac464-f6ed-4ccf-9ce3-c1b4d0942efe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:56.857971 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-eebac464-f6ed-4ccf-9ce3-c1b4d0942efe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:57.035944 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-eebac464-f6ed-4ccf-9ce3-c1b4d0942efe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:57.048321 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-eebac464-f6ed-4ccf-9ce3-c1b4d0942efe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.332720 Jun 05 08:25:57.052255 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 421/876] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:56 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:57.065260 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fc497c61-3f03-4a74-a50f-7ca31ed58d40 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:57.073523 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-fc497c61-3f03-4a74-a50f-7ca31ed58d40 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:57.090931 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fc497c61-3f03-4a74-a50f-7ca31ed58d40 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:57.091627 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fc497c61-3f03-4a74-a50f-7ca31ed58d40 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:57.092987 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fc497c61-3f03-4a74-a50f-7ca31ed58d40 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:57.094096 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fc497c61-3f03-4a74-a50f-7ca31ed58d40 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:57.111549 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-80d69816-06f8-43a0-97eb-c908e4e72e21 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:57.120029 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-80d69816-06f8-43a0-97eb-c908e4e72e21 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/15fff300-f7b6-4336-a143-1e5687af979b" status: 200 len: 1319 microversion: 2.1 time: 0.660434 Jun 05 08:25:57.122452 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 456/877] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:56 2022] GET /compute/v2.1/servers/15fff300-f7b6-4336-a143-1e5687af979b => generated 1319 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:57.134792 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6acc243e-3cdd-4d5a-ae31-73ac0162370f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:57.136751 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6acc243e-3cdd-4d5a-ae31-73ac0162370f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:57.155068 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6acc243e-3cdd-4d5a-ae31-73ac0162370f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:57.156464 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6acc243e-3cdd-4d5a-ae31-73ac0162370f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:57.157668 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6acc243e-3cdd-4d5a-ae31-73ac0162370f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:57.162182 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6acc243e-3cdd-4d5a-ae31-73ac0162370f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:57.376613 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6acc243e-3cdd-4d5a-ae31-73ac0162370f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:57.389722 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6acc243e-3cdd-4d5a-ae31-73ac0162370f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:57.392271 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6acc243e-3cdd-4d5a-ae31-73ac0162370f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:57.393501 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6acc243e-3cdd-4d5a-ae31-73ac0162370f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1333 microversion: 2.20 time: 0.269897 Jun 05 08:25:57.400104 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 457/878] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:57 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1333 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:57.425599 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-53541669-1c5f-417c-8618-75eda98c947b tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:57.431269 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-53541669-1c5f-417c-8618-75eda98c947b tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:57.442520 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-53541669-1c5f-417c-8618-75eda98c947b tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:57.443009 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-53541669-1c5f-417c-8618-75eda98c947b tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:57.443942 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-53541669-1c5f-417c-8618-75eda98c947b tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:57.444284 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-53541669-1c5f-417c-8618-75eda98c947b tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:57.471904 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:25:57.867668 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-fc497c61-3f03-4a74-a50f-7ca31ed58d40 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:57.895278 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-fc497c61-3f03-4a74-a50f-7ca31ed58d40 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:57.904842 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-fc497c61-3f03-4a74-a50f-7ca31ed58d40 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:57.906695 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fc497c61-3f03-4a74-a50f-7ca31ed58d40 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 1362 microversion: 2.25 time: 0.852891 Jun 05 08:25:57.917617 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 422/879] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:57 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 1362 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:57.923439 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b1cdd81c-be66-429f-b0c2-853cedc45c54 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:57.925052 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b1cdd81c-be66-429f-b0c2-853cedc45c54 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 32ee0b81-4a5b-4181-b43c-ad4cdecd0a70] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:57.935719 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b1cdd81c-be66-429f-b0c2-853cedc45c54 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:57.936230 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b1cdd81c-be66-429f-b0c2-853cedc45c54 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:57.938388 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b1cdd81c-be66-429f-b0c2-853cedc45c54 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:57.939438 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b1cdd81c-be66-429f-b0c2-853cedc45c54 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:57.985975 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-53541669-1c5f-417c-8618-75eda98c947b tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1691 microversion: 2.1 time: 0.589892 Jun 05 08:25:57.989201 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 458/880] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:57 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1691 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:58.007987 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1ee9fea8-82df-4801-be0e-017fab6f2769 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-844739-1", "block_migration": true, "disk_over_commit": false}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:58.009232 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1ee9fea8-82df-4801-be0e-017fab6f2769 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:58.022656 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ee9fea8-82df-4801-be0e-017fab6f2769 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:58.023124 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ee9fea8-82df-4801-be0e-017fab6f2769 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:58.024025 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ee9fea8-82df-4801-be0e-017fab6f2769 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:58.025433 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ee9fea8-82df-4801-be0e-017fab6f2769 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:58.083404 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-1ee9fea8-82df-4801-be0e-017fab6f2769 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lazy-loading 'flavor' on Instance uuid 984c9830-3956-48fd-ab9e-8aad63a9cd97 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:58.103981 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b1cdd81c-be66-429f-b0c2-853cedc45c54 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e0d123924c06bb36aeab9c2fa720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad02ddb51f51433a82e0c6361e6ed6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:58.124007 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1ee9fea8-82df-4801-be0e-017fab6f2769 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Going to try to live migrate instance to n-h1-844739-1 {{(pid=119049) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 05 08:25:58.131965 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b1cdd81c-be66-429f-b0c2-853cedc45c54 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "GET /compute/v2.1/servers/32ee0b81-4a5b-4181-b43c-ad4cdecd0a70" status: 200 len: 1481 microversion: 2.1 time: 0.209950 Jun 05 08:25:58.136866 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 423/881] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:57 2022] GET /compute/v2.1/servers/32ee0b81-4a5b-4181-b43c-ad4cdecd0a70 => generated 1481 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:58.151181 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-38fdf78a-fb04-4cf6-af85-973c9aede3c6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:58.152304 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-38fdf78a-fb04-4cf6-af85-973c9aede3c6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:58.162755 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-38fdf78a-fb04-4cf6-af85-973c9aede3c6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:58.165416 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-38fdf78a-fb04-4cf6-af85-973c9aede3c6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:58.166447 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-38fdf78a-fb04-4cf6-af85-973c9aede3c6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:58.169336 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-38fdf78a-fb04-4cf6-af85-973c9aede3c6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:58.258639 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-38fdf78a-fb04-4cf6-af85-973c9aede3c6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:58.259710 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-38fdf78a-fb04-4cf6-af85-973c9aede3c6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:58.260585 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-38fdf78a-fb04-4cf6-af85-973c9aede3c6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:25:58.395448 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-38fdf78a-fb04-4cf6-af85-973c9aede3c6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:58.404714 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-38fdf78a-fb04-4cf6-af85-973c9aede3c6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.264941 Jun 05 08:25:58.412629 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 424/882] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:58 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:58.429100 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-38cb214c-970a-4437-b008-298d4c778504 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:58.429723 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-38cb214c-970a-4437-b008-298d4c778504 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 15fff300-f7b6-4336-a143-1e5687af979b] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:58.440092 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-38cb214c-970a-4437-b008-298d4c778504 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:58.441357 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-38cb214c-970a-4437-b008-298d4c778504 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:58.442914 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-38cb214c-970a-4437-b008-298d4c778504 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:58.444215 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-38cb214c-970a-4437-b008-298d4c778504 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:58.741666 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-38cb214c-970a-4437-b008-298d4c778504 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:58.754848 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-38cb214c-970a-4437-b008-298d4c778504 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/15fff300-f7b6-4336-a143-1e5687af979b" status: 200 len: 1469 microversion: 2.1 time: 0.340633 Jun 05 08:25:58.755452 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 425/883] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:25:58 2022] GET /compute/v2.1/servers/15fff300-f7b6-4336-a143-1e5687af979b => generated 1469 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:58.780127 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-228d1fd2-6ef5-4abe-afe2-a3760812d601 req-49daecb7-eeed-493b-8f0e-04ab34ef73b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32ee0b81-4a5b-4181-b43c-ad4cdecd0a70", "name": "network-vif-deleted", "tag": "b0c5ff73-aaad-4c1b-9548-e2c279aa4681"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:25:58.809899 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-228d1fd2-6ef5-4abe-afe2-a3760812d601 req-49daecb7-eeed-493b-8f0e-04ab34ef73b8 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:58.810265 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-228d1fd2-6ef5-4abe-afe2-a3760812d601 req-49daecb7-eeed-493b-8f0e-04ab34ef73b8 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:58.857191 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-228d1fd2-6ef5-4abe-afe2-a3760812d601 req-49daecb7-eeed-493b-8f0e-04ab34ef73b8 service nova] Creating event network-vif-deleted:b0c5ff73-aaad-4c1b-9548-e2c279aa4681 for instance 32ee0b81-4a5b-4181-b43c-ad4cdecd0a70 on n-h2-844739-1 Jun 05 08:25:58.870976 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-228d1fd2-6ef5-4abe-afe2-a3760812d601 req-49daecb7-eeed-493b-8f0e-04ab34ef73b8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111499 Jun 05 08:25:58.871919 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 426/884] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:25:58.881610 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8524b7f6-5d66-47a5-8039-4992da97094a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:58.882675 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8524b7f6-5d66-47a5-8039-4992da97094a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:25:58.891227 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8524b7f6-5d66-47a5-8039-4992da97094a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:58.892698 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8524b7f6-5d66-47a5-8039-4992da97094a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:58.893985 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8524b7f6-5d66-47a5-8039-4992da97094a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:58.894738 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8524b7f6-5d66-47a5-8039-4992da97094a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:59.032111 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8524b7f6-5d66-47a5-8039-4992da97094a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:59.045504 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8524b7f6-5d66-47a5-8039-4992da97094a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:59.048347 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8524b7f6-5d66-47a5-8039-4992da97094a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:59.050491 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8524b7f6-5d66-47a5-8039-4992da97094a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1339 microversion: 2.20 time: 0.177181 Jun 05 08:25:59.051342 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 427/885] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:25:58 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1339 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:25:59.071423 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-56cb380b-b2a9-42fb-89ea-5adf903a60c7 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:25:59.077265 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-56cb380b-b2a9-42fb-89ea-5adf903a60c7 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:59.078967 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-56cb380b-b2a9-42fb-89ea-5adf903a60c7 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Searching by: {'reservation_id': 'r-3cmjg93y', 'deleted': False, 'project_id': '5241947581244d30ba1528e6d5fad743'} {{(pid=119050) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 05 08:25:59.098235 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-56cb380b-b2a9-42fb-89ea-5adf903a60c7 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:59.098696 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-56cb380b-b2a9-42fb-89ea-5adf903a60c7 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:59.099511 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-56cb380b-b2a9-42fb-89ea-5adf903a60c7 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:59.100545 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-56cb380b-b2a9-42fb-89ea-5adf903a60c7 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:59.325984 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.multi_cell_list [None req-56cb380b-b2a9-42fb-89ea-5adf903a60c7 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119050) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 05 08:25:59.507438 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-56cb380b-b2a9-42fb-89ea-5adf903a60c7 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:25:59.516394 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-56cb380b-b2a9-42fb-89ea-5adf903a60c7 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:25:59.517417 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-56cb380b-b2a9-42fb-89ea-5adf903a60c7 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:25:59.789856 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-56cb380b-b2a9-42fb-89ea-5adf903a60c7 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?reservation_id=r-3cmjg93y" status: 200 len: 2930 microversion: 2.1 time: 0.737002 Jun 05 08:25:59.803606 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 428/886] 10.222.0.33 () {58 vars in 1196 bytes} [Sun Jun 5 08:25:59 2022] GET /compute/v2.1/servers/detail?reservation_id=r-3cmjg93y => generated 2930 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:25:59.991492 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3ed1ac30-6c4b-4eab-82ed-c09fa5233b31 tempest-FloatingIPsNegativeTestJSON-108132168 tempest-FloatingIPsNegativeTestJSON-108132168-project] Calling method '.version_select at 0x7f2433c1daf0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:00.128631 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3ed1ac30-6c4b-4eab-82ed-c09fa5233b31 tempest-FloatingIPsNegativeTestJSON-108132168 tempest-FloatingIPsNegativeTestJSON-108132168-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.323703 Jun 05 08:26:00.129217 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 429/887] 10.222.0.33 () {58 vars in 1148 bytes} [Sun Jun 5 08:25:59 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:26:00.134745 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6e394559-f51d-4abe-8bf7-2f10863ea562 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:00.135673 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6e394559-f51d-4abe-8bf7-2f10863ea562 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:00.143373 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6e394559-f51d-4abe-8bf7-2f10863ea562 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:00.143830 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6e394559-f51d-4abe-8bf7-2f10863ea562 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:00.144669 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6e394559-f51d-4abe-8bf7-2f10863ea562 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:00.145112 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6e394559-f51d-4abe-8bf7-2f10863ea562 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:00.417385 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6e394559-f51d-4abe-8bf7-2f10863ea562 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:00.426530 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6e394559-f51d-4abe-8bf7-2f10863ea562 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:00.428202 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6e394559-f51d-4abe-8bf7-2f10863ea562 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:00.429520 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6e394559-f51d-4abe-8bf7-2f10863ea562 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 1362 microversion: 2.25 time: 0.299182 Jun 05 08:26:00.440556 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 430/888] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:00 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 1362 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:00.440556 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-596707fb-2ab0-4a21-88ea-52e6619c5224 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:00.440556 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-596707fb-2ab0-4a21-88ea-52e6619c5224 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 32ee0b81-4a5b-4181-b43c-ad4cdecd0a70] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:00.442547 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-596707fb-2ab0-4a21-88ea-52e6619c5224 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:00.443126 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-596707fb-2ab0-4a21-88ea-52e6619c5224 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:00.443960 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-596707fb-2ab0-4a21-88ea-52e6619c5224 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:00.444542 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-596707fb-2ab0-4a21-88ea-52e6619c5224 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:00.479819 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-596707fb-2ab0-4a21-88ea-52e6619c5224 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:00.479981 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-596707fb-2ab0-4a21-88ea-52e6619c5224 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:00.480580 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-596707fb-2ab0-4a21-88ea-52e6619c5224 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lazy-loading 'fault' on Instance uuid 32ee0b81-4a5b-4181-b43c-ad4cdecd0a70 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:00.545334 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-596707fb-2ab0-4a21-88ea-52e6619c5224 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e0d123924c06bb36aeab9c2fa720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad02ddb51f51433a82e0c6361e6ed6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:00.554671 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-596707fb-2ab0-4a21-88ea-52e6619c5224 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "GET /compute/v2.1/servers/32ee0b81-4a5b-4181-b43c-ad4cdecd0a70" status: 200 len: 1368 microversion: 2.1 time: 0.123477 Jun 05 08:26:00.564760 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 431/889] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:00 2022] GET /compute/v2.1/servers/32ee0b81-4a5b-4181-b43c-ad4cdecd0a70 => generated 1368 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:00.569769 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-905b0c0b-67b4-4a62-afc5-003ba9392759 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:00.570405 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-905b0c0b-67b4-4a62-afc5-003ba9392759 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:00.576438 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-905b0c0b-67b4-4a62-afc5-003ba9392759 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:00.576894 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-905b0c0b-67b4-4a62-afc5-003ba9392759 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:00.577956 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-905b0c0b-67b4-4a62-afc5-003ba9392759 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:00.578620 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-905b0c0b-67b4-4a62-afc5-003ba9392759 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:00.651188 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-905b0c0b-67b4-4a62-afc5-003ba9392759 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:00.653541 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-905b0c0b-67b4-4a62-afc5-003ba9392759 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:00.654168 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-905b0c0b-67b4-4a62-afc5-003ba9392759 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:00.740675 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1ee9fea8-82df-4801-be0e-017fab6f2769 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/action" status: 202 len: 0 microversion: 2.1 time: 2.737729 Jun 05 08:26:00.741292 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 459/890] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Jun 5 08:25:58 2022] POST /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/action => generated 0 bytes in 2739 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 05 08:26:00.747160 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-b03710e8-5db7-4a65-a0c7-f05ae900c19b req-e024e380-c2ae-4fa0-9269-a1ea6c14eed1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "476cc23e-487d-4d15-849e-208df0e985b1", "name": "network-vif-plugged", "status": "completed", "tag": "b7264816-9730-49ab-bb1c-4148a2e5aaef"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:00.765221 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-b03710e8-5db7-4a65-a0c7-f05ae900c19b req-e024e380-c2ae-4fa0-9269-a1ea6c14eed1 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:00.766290 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-b03710e8-5db7-4a65-a0c7-f05ae900c19b req-e024e380-c2ae-4fa0-9269-a1ea6c14eed1 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:00.797670 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-b03710e8-5db7-4a65-a0c7-f05ae900c19b req-e024e380-c2ae-4fa0-9269-a1ea6c14eed1 service nova] Creating event network-vif-plugged:b7264816-9730-49ab-bb1c-4148a2e5aaef for instance 476cc23e-487d-4d15-849e-208df0e985b1 on n-h1-844739-1 Jun 05 08:26:00.809073 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-b03710e8-5db7-4a65-a0c7-f05ae900c19b req-e024e380-c2ae-4fa0-9269-a1ea6c14eed1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065421 Jun 05 08:26:00.810319 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 460/891] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:00.820217 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a3ce69ee-0b87-44bf-a0f1-8805967e17e3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:00.824936 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-905b0c0b-67b4-4a62-afc5-003ba9392759 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:00.829532 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=100 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:00.850779 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-905b0c0b-67b4-4a62-afc5-003ba9392759 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.284844 Jun 05 08:26:00.856424 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 432/892] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:00 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:00.877697 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-48e411ee-2683-48e2-90c1-4151a8ec17cb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:00.879184 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-48e411ee-2683-48e2-90c1-4151a8ec17cb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:00.896446 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-48e411ee-2683-48e2-90c1-4151a8ec17cb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:00.898276 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.compute.server_groups [None req-a3ce69ee-0b87-44bf-a0f1-8805967e17e3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Querying cell ceb8701a-c729-4596-86e5-c56dbc5a8933(cell1) for 2 instances {{(pid=119049) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 05 08:26:00.899492 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a3ce69ee-0b87-44bf-a0f1-8805967e17e3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:00.899852 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a3ce69ee-0b87-44bf-a0f1-8805967e17e3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:00.901566 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-48e411ee-2683-48e2-90c1-4151a8ec17cb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:00.902555 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-48e411ee-2683-48e2-90c1-4151a8ec17cb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:00.908602 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-48e411ee-2683-48e2-90c1-4151a8ec17cb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:00.963985 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a3ce69ee-0b87-44bf-a0f1-8805967e17e3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/68b27b6f-877f-4ac6-be8b-cf2d0ed80d2a" status: 200 len: 265 microversion: 2.1 time: 0.151989 Jun 05 08:26:00.976843 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 461/893] 10.222.0.33 () {58 vars in 1262 bytes} [Sun Jun 5 08:26:00 2022] GET /compute/v2.1/os-server-groups/68b27b6f-877f-4ac6-be8b-cf2d0ed80d2a => generated 265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:00.986786 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1efd3487-57a6-4886-a5a3-fd10f4b5df65 tempest-FloatingIPsNegativeTestJSON-108132168 tempest-FloatingIPsNegativeTestJSON-108132168-project] Action: 'create', calling method: .version_select at 0x7f24339e28b0>, body: {"pool": "non_exist_pool"} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:01.126561 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-1efd3487-57a6-4886-a5a3-fd10f4b5df65 tempest-FloatingIPsNegativeTestJSON-108132168 tempest-FloatingIPsNegativeTestJSON-108132168-project] HTTP exception thrown: Floating IP pool not found. Jun 05 08:26:01.128679 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1efd3487-57a6-4886-a5a3-fd10f4b5df65 tempest-FloatingIPsNegativeTestJSON-108132168 tempest-FloatingIPsNegativeTestJSON-108132168-project] Request method failure captured: Jun 05 08:26:01.128679 n-d-844739-1 devstack@n-api.service[119049]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jun 05 08:26:01.128679 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:26:01.128679 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:26:01.128679 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:26:01.128679 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 26 Jun 05 08:26:01.128679 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:26:01.128679 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:26:01.128679 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:26:01.128679 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:26:01.128679 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGiWukZfozOJxqZrAivGEZz-PTPgrF9dACzt6AQEngmdULRyllvMWVgdvfFTgAXh9u6yLBiOLDEdvHoWpMQ-10HXAGGFaGPnbkheBQijaoA8zZOQyE9AlR6VGOtSnrIMck4k4Pext1Fnu6-g2f7IyuKw3p46GkWOWXegWwJhUSmkUOY Jun 05 08:26:01.128679 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:26:01.128679 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:26:01.128679 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:26:01.128679 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:26:01.128679 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:26:01.128679 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:26:01.128679 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: e159b838eb534918a92c05dc6b664e0a Jun 05 08:26:01.128679 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-108132168 Jun 05 08:26:01.128679 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:26:01.128679 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:26:01.130174 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e159b838eb534918a92c05dc6b664e0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e159b838eb534918a92c05dc6b664e0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e159b838eb534918a92c05dc6b664e0a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e159b838eb534918a92c05dc6b664e0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:26:01.130174 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-108132168 Jun 05 08:26:01.130174 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: e159b838eb534918a92c05dc6b664e0a Jun 05 08:26:01.130174 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-108132168 Jun 05 08:26:01.130174 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-FloatingIPsNegativeTestJSON-108132168-project Jun 05 08:26:01.130174 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:26:01.130174 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:26:01.130174 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 376eab92c83648f58f8db0f161ad36fc Jun 05 08:26:01.130174 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-108132168-project Jun 05 08:26:01.130174 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:26:01.130174 n-d-844739-1 devstack@n-api.service[119049]: {"pool": "non_exist_pool"} Jun 05 08:26:01.130174 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:26:01.130174 n-d-844739-1 devstack@n-api.service[119049]: exception: Floating IP pool not found. Jun 05 08:26:01.130174 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'body': {'pool': 'non_exist_pool'}} Jun 05 08:26:01.130174 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:26:01.131039 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:26:01.131039 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jun 05 08:26:01.131039 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jun 05 08:26:01.131039 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2958, in allocate_floating_ip Jun 05 08:26:01.131039 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jun 05 08:26:01.131039 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2948, in _get_floating_ip_pool_id_by_name_or_id Jun 05 08:26:01.131039 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jun 05 08:26:01.131039 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jun 05 08:26:01.131039 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:26:01.131039 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:26:01.131039 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:26:01.131039 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:26:01.131039 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:26:01.131039 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:26:01.131039 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:26:01.131039 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:26:01.131039 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:26:01.131039 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:26:01.131039 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:26:01.131039 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:26:01.132215 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jun 05 08:26:01.132215 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:26:01.132215 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jun 05 08:26:01.132215 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:26:01.132215 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:26:01.132215 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:26:01.132215 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:26:01.132215 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:26:01.132215 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:26:01.132215 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:26:01.132215 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:26:01.132215 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jun 05 08:26:01.132215 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:26:01.135476 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1efd3487-57a6-4886-a5a3-fd10f4b5df65 tempest-FloatingIPsNegativeTestJSON-108132168 tempest-FloatingIPsNegativeTestJSON-108132168-project] Returning 404 to user: Floating IP pool not found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:26:01.136369 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1efd3487-57a6-4886-a5a3-fd10f4b5df65 tempest-FloatingIPsNegativeTestJSON-108132168 tempest-FloatingIPsNegativeTestJSON-108132168-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.158213 Jun 05 08:26:01.137116 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 462/894] 10.222.0.33 () {60 vars in 1169 bytes} [Sun Jun 5 08:26:00 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:26:01.143582 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-befc9170-eda2-43d8-94e3-1d92ffc94bd1 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:01.144929 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-befc9170-eda2-43d8-94e3-1d92ffc94bd1 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 32ee0b81-4a5b-4181-b43c-ad4cdecd0a70] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:01.157811 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-befc9170-eda2-43d8-94e3-1d92ffc94bd1 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:01.158653 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-befc9170-eda2-43d8-94e3-1d92ffc94bd1 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:01.159691 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-befc9170-eda2-43d8-94e3-1d92ffc94bd1 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:01.160503 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-befc9170-eda2-43d8-94e3-1d92ffc94bd1 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:01.191816 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-befc9170-eda2-43d8-94e3-1d92ffc94bd1 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 32ee0b81-4a5b-4181-b43c-ad4cdecd0a70] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:26:01.196723 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-48e411ee-2683-48e2-90c1-4151a8ec17cb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:01.209765 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-48e411ee-2683-48e2-90c1-4151a8ec17cb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:01.211612 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-48e411ee-2683-48e2-90c1-4151a8ec17cb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:01.213141 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-48e411ee-2683-48e2-90c1-4151a8ec17cb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1407 microversion: 2.20 time: 0.344736 Jun 05 08:26:01.214229 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 433/895] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:00 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1407 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:01.219797 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-da69271f-667b-4aa6-b4d1-67007e2688e3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:01.221110 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-da69271f-667b-4aa6-b4d1-67007e2688e3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:01.230086 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-da69271f-667b-4aa6-b4d1-67007e2688e3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:01.231532 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-da69271f-667b-4aa6-b4d1-67007e2688e3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:01.232809 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-da69271f-667b-4aa6-b4d1-67007e2688e3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:01.233864 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-da69271f-667b-4aa6-b4d1-67007e2688e3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:01.311683 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-befc9170-eda2-43d8-94e3-1d92ffc94bd1 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "DELETE /compute/v2.1/servers/32ee0b81-4a5b-4181-b43c-ad4cdecd0a70" status: 204 len: 0 microversion: 2.1 time: 0.173064 Jun 05 08:26:01.319203 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 463/896] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:26:01 2022] DELETE /compute/v2.1/servers/32ee0b81-4a5b-4181-b43c-ad4cdecd0a70 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:26:01.326069 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-09eb9e8b-369e-4b7c-a00a-c6dc8d15252b tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:01.326992 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-09eb9e8b-369e-4b7c-a00a-c6dc8d15252b tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] [instance: 35db623e-15e3-4238-8c0f-ce05bc679787] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:01.334304 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-09eb9e8b-369e-4b7c-a00a-c6dc8d15252b tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:01.335134 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-09eb9e8b-369e-4b7c-a00a-c6dc8d15252b tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:01.336000 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-09eb9e8b-369e-4b7c-a00a-c6dc8d15252b tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:01.336698 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-09eb9e8b-369e-4b7c-a00a-c6dc8d15252b tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:02.122860 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-da69271f-667b-4aa6-b4d1-67007e2688e3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:02.136911 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-da69271f-667b-4aa6-b4d1-67007e2688e3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.919968 Jun 05 08:26:02.139272 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 434/897] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:01 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:02.152679 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-09eb9e8b-369e-4b7c-a00a-c6dc8d15252b tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787" status: 200 len: 1619 microversion: 2.1 time: 0.815930 Jun 05 08:26:02.154755 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e514a110-eea9-4419-84e8-d0d561f66ee8 tempest-FloatingIPsNegativeTestJSON-108132168 tempest-FloatingIPsNegativeTestJSON-108132168-project] Calling method '.version_select at 0x7f2433aeb670>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:02.161472 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 464/898] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:01 2022] GET /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787 => generated 1619 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:02.173474 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-73dc5866-2bff-438b-bee3-88b58909a8a7 req-9ca21d0e-9a43-4494-8381-e9452e0ee72a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b271002d-4613-405c-aeed-7c06b205a045", "tag": "642e2803-a706-408c-b7c4-6157cb18ee50"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:02.184152 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-73dc5866-2bff-438b-bee3-88b58909a8a7 req-9ca21d0e-9a43-4494-8381-e9452e0ee72a service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:02.184847 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-73dc5866-2bff-438b-bee3-88b58909a8a7 req-9ca21d0e-9a43-4494-8381-e9452e0ee72a service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:02.196747 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-73dc5866-2bff-438b-bee3-88b58909a8a7 req-9ca21d0e-9a43-4494-8381-e9452e0ee72a service nova] Creating event network-changed:642e2803-a706-408c-b7c4-6157cb18ee50 for instance b271002d-4613-405c-aeed-7c06b205a045 on n-h2-844739-1 Jun 05 08:26:02.202980 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-73dc5866-2bff-438b-bee3-88b58909a8a7 req-9ca21d0e-9a43-4494-8381-e9452e0ee72a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039421 Jun 05 08:26:02.203764 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 465/899] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:02.210759 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6d813cb2-cbad-47d4-b96d-a5c033b99596 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:02.211368 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6d813cb2-cbad-47d4-b96d-a5c033b99596 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: a1b50f75-ca7f-4320-bbd6-363b4d656cd8] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:02.217537 n-d-844739-1 devstack@n-api.service[119050]: DEBUG neutronclient.v2_0.client [None req-e514a110-eea9-4419-84e8-d0d561f66ee8 tempest-FloatingIPsNegativeTestJSON-108132168 tempest-FloatingIPsNegativeTestJSON-108132168-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9f863715-86c3-4888-b1ef-866834f614d0 could not be found", "detail": ""}} {{(pid=119050) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 05 08:26:02.218914 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-e514a110-eea9-4419-84e8-d0d561f66ee8 tempest-FloatingIPsNegativeTestJSON-108132168 tempest-FloatingIPsNegativeTestJSON-108132168-project] HTTP exception thrown: Floating IP not found for ID 9f863715-86c3-4888-b1ef-866834f614d0 Jun 05 08:26:02.221926 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e514a110-eea9-4419-84e8-d0d561f66ee8 tempest-FloatingIPsNegativeTestJSON-108132168 tempest-FloatingIPsNegativeTestJSON-108132168-project] Request method failure captured: Jun 05 08:26:02.221926 n-d-844739-1 devstack@n-api.service[119050]: request: DELETE /compute/v2.1/os-floating-ips/9f863715-86c3-4888-b1ef-866834f614d0 HTTP/1.1 Jun 05 08:26:02.221926 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:26:02.221926 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:26:02.221926 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:26:02.221926 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:26:02.221926 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:26:02.221926 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:26:02.221926 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:26:02.221926 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:26:02.221926 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGiWukZfozOJxqZrAivGEZz-PTPgrF9dACzt6AQEngmdULRyllvMWVgdvfFTgAXh9u6yLBiOLDEdvHoWpMQ-10HXAGGFaGPnbkheBQijaoA8zZOQyE9AlR6VGOtSnrIMck4k4Pext1Fnu6-g2f7IyuKw3p46GkWOWXegWwJhUSmkUOY Jun 05 08:26:02.221926 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:26:02.221926 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:26:02.221926 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:26:02.221926 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:26:02.221926 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:26:02.221926 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:26:02.221926 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: e159b838eb534918a92c05dc6b664e0a Jun 05 08:26:02.221926 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-108132168 Jun 05 08:26:02.221926 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:26:02.221926 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:26:02.223212 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e159b838eb534918a92c05dc6b664e0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e159b838eb534918a92c05dc6b664e0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e159b838eb534918a92c05dc6b664e0a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e159b838eb534918a92c05dc6b664e0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:26:02.223212 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-108132168 Jun 05 08:26:02.223212 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: e159b838eb534918a92c05dc6b664e0a Jun 05 08:26:02.223212 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-108132168 Jun 05 08:26:02.223212 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-FloatingIPsNegativeTestJSON-108132168-project Jun 05 08:26:02.223212 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:26:02.223212 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:26:02.223212 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 376eab92c83648f58f8db0f161ad36fc Jun 05 08:26:02.223212 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-108132168-project Jun 05 08:26:02.223212 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:26:02.223212 n-d-844739-1 devstack@n-api.service[119050]: exception: Floating IP not found for ID 9f863715-86c3-4888-b1ef-866834f614d0 Jun 05 08:26:02.223212 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '9f863715-86c3-4888-b1ef-866834f614d0'} Jun 05 08:26:02.223212 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:26:02.223963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:26:02.223963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2810, in get_floating_ip Jun 05 08:26:02.223963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 05 08:26:02.223963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:26:02.223963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:26:02.223963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 05 08:26:02.223963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 05 08:26:02.223963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:26:02.223963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:26:02.223963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 05 08:26:02.223963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 05 08:26:02.223963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:26:02.223963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:26:02.223963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 05 08:26:02.223963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 05 08:26:02.223963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:26:02.223963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:26:02.223963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 05 08:26:02.223963 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 05 08:26:02.225418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:26:02.225418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:26:02.225418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 05 08:26:02.225418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 05 08:26:02.225418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 05 08:26:02.225418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 05 08:26:02.225418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 9f863715-86c3-4888-b1ef-866834f614d0 could not be found Jun 05 08:26:02.225418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae300c36-23c9-47c0-b8a5-9203073d2863'] Jun 05 08:26:02.225418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:26:02.225418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:26:02.225418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:26:02.225418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:26:02.225418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jun 05 08:26:02.225418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 05 08:26:02.225418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2813, in get_floating_ip Jun 05 08:26:02.225418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 05 08:26:02.225418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 9f863715-86c3-4888-b1ef-866834f614d0. Jun 05 08:26:02.225418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:26:02.225418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:26:02.225418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:26:02.226603 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:26:02.226603 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:26:02.226603 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:26:02.226603 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:26:02.226603 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:26:02.226603 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:26:02.226603 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:26:02.226603 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:26:02.226603 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:26:02.226603 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jun 05 08:26:02.226603 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 05 08:26:02.226603 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 9f863715-86c3-4888-b1ef-866834f614d0 Jun 05 08:26:02.226603 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:26:02.226603 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:26:02.226603 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:26:02.226603 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:26:02.226603 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:26:02.226603 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:26:02.226603 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:26:02.226603 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:26:02.229359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 9f863715-86c3-4888-b1ef-866834f614d0 Jun 05 08:26:02.229359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:26:02.229359 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e514a110-eea9-4419-84e8-d0d561f66ee8 tempest-FloatingIPsNegativeTestJSON-108132168 tempest-FloatingIPsNegativeTestJSON-108132168-project] Returning 404 to user: Floating IP not found for ID 9f863715-86c3-4888-b1ef-866834f614d0 {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:26:02.229359 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e514a110-eea9-4419-84e8-d0d561f66ee8 tempest-FloatingIPsNegativeTestJSON-108132168 tempest-FloatingIPsNegativeTestJSON-108132168-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/9f863715-86c3-4888-b1ef-866834f614d0" status: 404 len: 111 microversion: 2.1 time: 0.082754 Jun 05 08:26:02.229359 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 435/900] 10.222.0.33 () {58 vars in 1262 bytes} [Sun Jun 5 08:26:02 2022] DELETE /compute/v2.1/os-floating-ips/9f863715-86c3-4888-b1ef-866834f614d0 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:26:02.232448 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6d813cb2-cbad-47d4-b96d-a5c033b99596 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:02.232654 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6d813cb2-cbad-47d4-b96d-a5c033b99596 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:02.233335 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6d813cb2-cbad-47d4-b96d-a5c033b99596 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:02.234494 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6d813cb2-cbad-47d4-b96d-a5c033b99596 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:02.240429 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1a982f4f-f99d-4035-a104-4af907d65445 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:02.241059 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1a982f4f-f99d-4035-a104-4af907d65445 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:02.251262 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1a982f4f-f99d-4035-a104-4af907d65445 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:02.251727 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1a982f4f-f99d-4035-a104-4af907d65445 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:02.252550 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1a982f4f-f99d-4035-a104-4af907d65445 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:02.252994 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1a982f4f-f99d-4035-a104-4af907d65445 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:02.288387 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6d813cb2-cbad-47d4-b96d-a5c033b99596 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: a1b50f75-ca7f-4320-bbd6-363b4d656cd8] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:26:02.411930 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6d813cb2-cbad-47d4-b96d-a5c033b99596 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a1b50f75-ca7f-4320-bbd6-363b4d656cd8" status: 204 len: 0 microversion: 2.1 time: 0.205803 Jun 05 08:26:02.426872 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 466/901] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:26:02 2022] DELETE /compute/v2.1/servers/a1b50f75-ca7f-4320-bbd6-363b4d656cd8 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:26:02.438952 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-667c1ace-f91c-4b3a-b25a-db4e098b2a44 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:02.441320 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-667c1ace-f91c-4b3a-b25a-db4e098b2a44 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:02.448508 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-667c1ace-f91c-4b3a-b25a-db4e098b2a44 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:02.449771 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-667c1ace-f91c-4b3a-b25a-db4e098b2a44 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:02.450769 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-667c1ace-f91c-4b3a-b25a-db4e098b2a44 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:02.451494 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-667c1ace-f91c-4b3a-b25a-db4e098b2a44 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:02.490092 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-667c1ace-f91c-4b3a-b25a-db4e098b2a44 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:02.490971 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-667c1ace-f91c-4b3a-b25a-db4e098b2a44 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:02.491675 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-667c1ace-f91c-4b3a-b25a-db4e098b2a44 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:02.575542 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-667c1ace-f91c-4b3a-b25a-db4e098b2a44 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:02.583774 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-667c1ace-f91c-4b3a-b25a-db4e098b2a44 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.154986 Jun 05 08:26:02.584397 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 467/902] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:02 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:02.589208 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-99d90b66-e7d2-4edf-be97-7d861847ad3d tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:02.589989 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-99d90b66-e7d2-4edf-be97-7d861847ad3d tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] [instance: 15fff300-f7b6-4336-a143-1e5687af979b] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:02.596924 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-99d90b66-e7d2-4edf-be97-7d861847ad3d tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:02.597380 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-99d90b66-e7d2-4edf-be97-7d861847ad3d tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:02.598508 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-99d90b66-e7d2-4edf-be97-7d861847ad3d tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:02.598958 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-99d90b66-e7d2-4edf-be97-7d861847ad3d tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:02.606678 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1a982f4f-f99d-4035-a104-4af907d65445 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:02.622255 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1a982f4f-f99d-4035-a104-4af907d65445 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:02.624551 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1a982f4f-f99d-4035-a104-4af907d65445 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:02.630488 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1a982f4f-f99d-4035-a104-4af907d65445 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 1362 microversion: 2.25 time: 0.405166 Jun 05 08:26:02.631401 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 436/903] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:02 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 1362 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:02.646988 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-10105fe4-7540-41b2-a64a-f8c2790fdd70 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:02.649633 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-10105fe4-7540-41b2-a64a-f8c2790fdd70 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:02.657025 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10105fe4-7540-41b2-a64a-f8c2790fdd70 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:02.658007 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10105fe4-7540-41b2-a64a-f8c2790fdd70 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:02.659274 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10105fe4-7540-41b2-a64a-f8c2790fdd70 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:02.659875 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10105fe4-7540-41b2-a64a-f8c2790fdd70 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:02.970463 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-10105fe4-7540-41b2-a64a-f8c2790fdd70 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:02.974032 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-99d90b66-e7d2-4edf-be97-7d861847ad3d tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/15fff300-f7b6-4336-a143-1e5687af979b" status: 200 len: 1620 microversion: 2.1 time: 0.388583 Jun 05 08:26:02.979951 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-10105fe4-7540-41b2-a64a-f8c2790fdd70 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:02.982007 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-10105fe4-7540-41b2-a64a-f8c2790fdd70 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:02.984083 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-10105fe4-7540-41b2-a64a-f8c2790fdd70 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1407 microversion: 2.20 time: 0.351394 Jun 05 08:26:02.987236 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 468/904] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:02 2022] GET /compute/v2.1/servers/15fff300-f7b6-4336-a143-1e5687af979b => generated 1620 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:02.991296 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 437/905] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:02 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1407 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:02.992914 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-75867ec9-4e28-4fa5-8308-83034942bf25 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:02.993753 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-75867ec9-4e28-4fa5-8308-83034942bf25 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 5ad92c72-624d-411d-b083-8eb7097ffbfe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:02.997729 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-02b99e8e-a638-42a0-a56d-18f6305e408a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Action: 'create', calling method: .version_select at 0x7f2433edc160>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-629546422", "policies": ["anti-affinity"]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:03.013962 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-75867ec9-4e28-4fa5-8308-83034942bf25 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:03.014532 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-75867ec9-4e28-4fa5-8308-83034942bf25 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:03.015908 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-75867ec9-4e28-4fa5-8308-83034942bf25 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:03.016339 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-02b99e8e-a638-42a0-a56d-18f6305e408a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for project 5241947581244d30ba1528e6d5fad743. Resources: {'server_groups'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:26:03.017265 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-75867ec9-4e28-4fa5-8308-83034942bf25 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:03.021897 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-02b99e8e-a638-42a0-a56d-18f6305e408a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for user 27beb829232e464092b06d904b9d6ec0 and project 5241947581244d30ba1528e6d5fad743. Resources: {'server_groups'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:26:03.049431 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-75867ec9-4e28-4fa5-8308-83034942bf25 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 5ad92c72-624d-411d-b083-8eb7097ffbfe] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:26:03.070082 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-02b99e8e-a638-42a0-a56d-18f6305e408a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for project 5241947581244d30ba1528e6d5fad743. Resources: {'server_groups'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:26:03.077411 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-02b99e8e-a638-42a0-a56d-18f6305e408a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for user 27beb829232e464092b06d904b9d6ec0 and project 5241947581244d30ba1528e6d5fad743. Resources: {'server_groups'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:26:03.091891 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-02b99e8e-a638-42a0-a56d-18f6305e408a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.099184 Jun 05 08:26:03.092683 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 438/906] 10.222.0.33 () {60 vars in 1173 bytes} [Sun Jun 5 08:26:02 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:03.148697 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-75867ec9-4e28-4fa5-8308-83034942bf25 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe" status: 204 len: 0 microversion: 2.1 time: 0.159375 Jun 05 08:26:03.152607 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 469/907] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:26:02 2022] DELETE /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:26:03.155708 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-74c0de33-bb04-4ab5-a8a3-cc6fffd2683d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:03.156857 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-74c0de33-bb04-4ab5-a8a3-cc6fffd2683d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:03.163730 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-74c0de33-bb04-4ab5-a8a3-cc6fffd2683d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:03.164727 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-74c0de33-bb04-4ab5-a8a3-cc6fffd2683d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:03.165724 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-74c0de33-bb04-4ab5-a8a3-cc6fffd2683d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:03.166653 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-74c0de33-bb04-4ab5-a8a3-cc6fffd2683d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:03.167832 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c866fac1-0915-4dd5-8cb2-f1ee9a334baf tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:03.169300 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c866fac1-0915-4dd5-8cb2-f1ee9a334baf tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 32ee0b81-4a5b-4181-b43c-ad4cdecd0a70] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:03.176717 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c866fac1-0915-4dd5-8cb2-f1ee9a334baf tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:03.177455 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c866fac1-0915-4dd5-8cb2-f1ee9a334baf tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:03.178405 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c866fac1-0915-4dd5-8cb2-f1ee9a334baf tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:03.179142 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c866fac1-0915-4dd5-8cb2-f1ee9a334baf tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:03.224684 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:03.245312 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c866fac1-0915-4dd5-8cb2-f1ee9a334baf tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:03.245898 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c866fac1-0915-4dd5-8cb2-f1ee9a334baf tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:03.246377 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-c866fac1-0915-4dd5-8cb2-f1ee9a334baf tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lazy-loading 'fault' on Instance uuid 32ee0b81-4a5b-4181-b43c-ad4cdecd0a70 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:03.323858 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c866fac1-0915-4dd5-8cb2-f1ee9a334baf tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e0d123924c06bb36aeab9c2fa720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad02ddb51f51433a82e0c6361e6ed6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:03.335862 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c866fac1-0915-4dd5-8cb2-f1ee9a334baf tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "GET /compute/v2.1/servers/32ee0b81-4a5b-4181-b43c-ad4cdecd0a70" status: 200 len: 1368 microversion: 2.1 time: 0.172495 Jun 05 08:26:03.340554 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 470/908] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:03 2022] GET /compute/v2.1/servers/32ee0b81-4a5b-4181-b43c-ad4cdecd0a70 => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:26:03.348146 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-69ec9c5f-3fdd-4098-92c9-6c365f7da8d9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-617254726", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "c495f782-f724-4f9f-829f-175dec3e3807"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:03.391564 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-74c0de33-bb04-4ab5-a8a3-cc6fffd2683d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:03.400372 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-74c0de33-bb04-4ab5-a8a3-cc6fffd2683d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.249395 Jun 05 08:26:03.401279 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 439/909] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:03 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:03.415390 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-69ec9c5f-3fdd-4098-92c9-6c365f7da8d9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] validate_networks() for None {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:26:03.603556 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8ba51578-4d9e-4377-a73e-d38256bbac1f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:03.604812 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8ba51578-4d9e-4377-a73e-d38256bbac1f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:03.613788 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8ba51578-4d9e-4377-a73e-d38256bbac1f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:03.615269 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8ba51578-4d9e-4377-a73e-d38256bbac1f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:03.616348 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8ba51578-4d9e-4377-a73e-d38256bbac1f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:03.617140 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8ba51578-4d9e-4377-a73e-d38256bbac1f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:03.661406 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8ba51578-4d9e-4377-a73e-d38256bbac1f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:03.662209 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8ba51578-4d9e-4377-a73e-d38256bbac1f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:03.662835 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-8ba51578-4d9e-4377-a73e-d38256bbac1f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:03.666577 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-69ec9c5f-3fdd-4098-92c9-6c365f7da8d9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:26:03.667237 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-69ec9c5f-3fdd-4098-92c9-6c365f7da8d9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:26:03.667844 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-69ec9c5f-3fdd-4098-92c9-6c365f7da8d9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:26:03.668377 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-69ec9c5f-3fdd-4098-92c9-6c365f7da8d9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:26:03.668888 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-69ec9c5f-3fdd-4098-92c9-6c365f7da8d9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:26:03.693658 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-69ec9c5f-3fdd-4098-92c9-6c365f7da8d9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:03.694214 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-69ec9c5f-3fdd-4098-92c9-6c365f7da8d9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:03.695199 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-69ec9c5f-3fdd-4098-92c9-6c365f7da8d9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:03.701506 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-69ec9c5f-3fdd-4098-92c9-6c365f7da8d9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:03.724329 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-69ec9c5f-3fdd-4098-92c9-6c365f7da8d9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for project 5241947581244d30ba1528e6d5fad743. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:26:03.729887 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8ba51578-4d9e-4377-a73e-d38256bbac1f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:03.740069 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-69ec9c5f-3fdd-4098-92c9-6c365f7da8d9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for user 27beb829232e464092b06d904b9d6ec0 and project 5241947581244d30ba1528e6d5fad743. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:26:03.743919 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8ba51578-4d9e-4377-a73e-d38256bbac1f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.147082 Jun 05 08:26:03.744772 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 440/910] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:03 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:03.753935 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a88c14df-0569-4e72-ac09-97f533eec931 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:03.754768 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a88c14df-0569-4e72-ac09-97f533eec931 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:03.760945 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:03.761703 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-69ec9c5f-3fdd-4098-92c9-6c365f7da8d9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Going to run 2 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:26:03.762479 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a88c14df-0569-4e72-ac09-97f533eec931 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:03.762940 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a88c14df-0569-4e72-ac09-97f533eec931 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:03.763731 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a88c14df-0569-4e72-ac09-97f533eec931 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:03.764243 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a88c14df-0569-4e72-ac09-97f533eec931 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:03.764451 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-69ec9c5f-3fdd-4098-92c9-6c365f7da8d9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 5d6c0691-aa2b-4d7f-b424-2a9129f285bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:26:03.824575 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-69ec9c5f-3fdd-4098-92c9-6c365f7da8d9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119049) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jun 05 08:26:03.861039 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-69ec9c5f-3fdd-4098-92c9-6c365f7da8d9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for project 5241947581244d30ba1528e6d5fad743. Resources: {'server_group_members'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:26:03.871264 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-69ec9c5f-3fdd-4098-92c9-6c365f7da8d9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for user 27beb829232e464092b06d904b9d6ec0 and project 5241947581244d30ba1528e6d5fad743. Resources: {'server_group_members'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:26:03.908467 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:03.937907 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-69ec9c5f-3fdd-4098-92c9-6c365f7da8d9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for project 5241947581244d30ba1528e6d5fad743. Resources: {'server_group_members'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:26:03.944295 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-69ec9c5f-3fdd-4098-92c9-6c365f7da8d9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for user 27beb829232e464092b06d904b9d6ec0 and project 5241947581244d30ba1528e6d5fad743. Resources: {'server_group_members'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:26:03.964394 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-69ec9c5f-3fdd-4098-92c9-6c365f7da8d9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: fedc49cc-1b5e-4c16-ab6d-da3afb5e567d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=5d6c0691-aa2b-4d7f-b424-2a9129f285bb,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:26:04.005808 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a88c14df-0569-4e72-ac09-97f533eec931 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:04.017221 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a88c14df-0569-4e72-ac09-97f533eec931 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:04.019081 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a88c14df-0569-4e72-ac09-97f533eec931 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:04.020410 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a88c14df-0569-4e72-ac09-97f533eec931 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 1362 microversion: 2.25 time: 0.274306 Jun 05 08:26:04.021112 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 441/911] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:03 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:04.026181 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-32f76919-7856-48ea-9a7b-96010332efb4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:04.027000 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-32f76919-7856-48ea-9a7b-96010332efb4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:04.033873 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-32f76919-7856-48ea-9a7b-96010332efb4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:04.034550 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-32f76919-7856-48ea-9a7b-96010332efb4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:04.035485 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-32f76919-7856-48ea-9a7b-96010332efb4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:04.035920 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-32f76919-7856-48ea-9a7b-96010332efb4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:04.046718 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-69ec9c5f-3fdd-4098-92c9-6c365f7da8d9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for project 5241947581244d30ba1528e6d5fad743. Resources: {'server_group_members'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:26:04.053625 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-69ec9c5f-3fdd-4098-92c9-6c365f7da8d9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for user 27beb829232e464092b06d904b9d6ec0 and project 5241947581244d30ba1528e6d5fad743. Resources: {'server_group_members'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:26:04.093780 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-69ec9c5f-3fdd-4098-92c9-6c365f7da8d9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for project 5241947581244d30ba1528e6d5fad743. Resources: {'server_group_members'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:26:04.099033 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-69ec9c5f-3fdd-4098-92c9-6c365f7da8d9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for user 27beb829232e464092b06d904b9d6ec0 and project 5241947581244d30ba1528e6d5fad743. Resources: {'server_group_members'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:26:04.136411 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-69ec9c5f-3fdd-4098-92c9-6c365f7da8d9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.794544 Jun 05 08:26:04.137944 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 471/912] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:26:03 2022] POST /compute/v2.1/servers => generated 32 bytes in 797 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jun 05 08:26:04.146240 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6f826411-59a2-4b98-9d81-dfd12b8634aa tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:04.150422 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6f826411-59a2-4b98-9d81-dfd12b8634aa tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:04.151538 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6f826411-59a2-4b98-9d81-dfd12b8634aa tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Searching by: {'deleted': False, 'project_id': '5241947581244d30ba1528e6d5fad743'} {{(pid=119049) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 05 08:26:04.172219 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6f826411-59a2-4b98-9d81-dfd12b8634aa tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:04.172868 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6f826411-59a2-4b98-9d81-dfd12b8634aa tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:04.173688 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6f826411-59a2-4b98-9d81-dfd12b8634aa tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:04.174269 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6f826411-59a2-4b98-9d81-dfd12b8634aa tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:04.207748 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.multi_cell_list [None req-6f826411-59a2-4b98-9d81-dfd12b8634aa tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=119049) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 05 08:26:04.241156 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6f826411-59a2-4b98-9d81-dfd12b8634aa tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.099118 Jun 05 08:26:04.242124 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 472/913] 10.222.0.33 () {58 vars in 1124 bytes} [Sun Jun 5 08:26:04 2022] GET /compute/v2.1/servers => generated 1663 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:26:04.253746 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-535505b9-c5e2-4812-b6d2-d5529dc978fe tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:04.254353 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-535505b9-c5e2-4812-b6d2-d5529dc978fe tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: fedc49cc-1b5e-4c16-ab6d-da3afb5e567d] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:04.330249 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-32f76919-7856-48ea-9a7b-96010332efb4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:04.332752 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-535505b9-c5e2-4812-b6d2-d5529dc978fe tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:04.339700 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-535505b9-c5e2-4812-b6d2-d5529dc978fe tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d" status: 200 len: 1218 microversion: 2.1 time: 0.090377 Jun 05 08:26:04.342570 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-32f76919-7856-48ea-9a7b-96010332efb4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:04.344339 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-32f76919-7856-48ea-9a7b-96010332efb4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:04.345533 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-32f76919-7856-48ea-9a7b-96010332efb4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1407 microversion: 2.20 time: 0.323296 Jun 05 08:26:04.346111 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 442/914] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:04 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1407 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:04.353106 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 473/915] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:04 2022] GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:04.363396 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2f311a6d-7f38-45f2-9ff0-b0549eb4dbe5 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:04.364021 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2f311a6d-7f38-45f2-9ff0-b0549eb4dbe5 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 32ee0b81-4a5b-4181-b43c-ad4cdecd0a70] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:04.371336 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2f311a6d-7f38-45f2-9ff0-b0549eb4dbe5 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:04.372264 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2f311a6d-7f38-45f2-9ff0-b0549eb4dbe5 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:04.374045 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2f311a6d-7f38-45f2-9ff0-b0549eb4dbe5 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:04.375664 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2f311a6d-7f38-45f2-9ff0-b0549eb4dbe5 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:04.419550 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c22740b4-e1c1-4f84-bc3b-2157c39b7156 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:04.420310 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c22740b4-e1c1-4f84-bc3b-2157c39b7156 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:04.428126 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2f311a6d-7f38-45f2-9ff0-b0549eb4dbe5 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:04.428613 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2f311a6d-7f38-45f2-9ff0-b0549eb4dbe5 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:04.429337 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-2f311a6d-7f38-45f2-9ff0-b0549eb4dbe5 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lazy-loading 'fault' on Instance uuid 32ee0b81-4a5b-4181-b43c-ad4cdecd0a70 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:04.441735 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c22740b4-e1c1-4f84-bc3b-2157c39b7156 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:04.442194 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c22740b4-e1c1-4f84-bc3b-2157c39b7156 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:04.442977 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c22740b4-e1c1-4f84-bc3b-2157c39b7156 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:04.443414 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c22740b4-e1c1-4f84-bc3b-2157c39b7156 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:04.516980 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2f311a6d-7f38-45f2-9ff0-b0549eb4dbe5 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e0d123924c06bb36aeab9c2fa720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad02ddb51f51433a82e0c6361e6ed6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:04.527363 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2f311a6d-7f38-45f2-9ff0-b0549eb4dbe5 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "GET /compute/v2.1/servers/32ee0b81-4a5b-4181-b43c-ad4cdecd0a70" status: 200 len: 1368 microversion: 2.1 time: 0.168479 Jun 05 08:26:04.532285 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 443/916] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:04 2022] GET /compute/v2.1/servers/32ee0b81-4a5b-4181-b43c-ad4cdecd0a70 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:04.546365 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b1839cb0-1b51-420c-bf50-b7c702b74ea2 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:04.548310 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b1839cb0-1b51-420c-bf50-b7c702b74ea2 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: a1b50f75-ca7f-4320-bbd6-363b4d656cd8] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:04.559659 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b1839cb0-1b51-420c-bf50-b7c702b74ea2 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:04.563542 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b1839cb0-1b51-420c-bf50-b7c702b74ea2 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:04.564616 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b1839cb0-1b51-420c-bf50-b7c702b74ea2 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:04.565204 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b1839cb0-1b51-420c-bf50-b7c702b74ea2 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:04.838418 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c22740b4-e1c1-4f84-bc3b-2157c39b7156 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:04.849358 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c22740b4-e1c1-4f84-bc3b-2157c39b7156 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.434378 Jun 05 08:26:04.862376 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 474/917] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:04 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:04.862376 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0297cc43-983c-47df-acf6-1a8a66d24478 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:04.862646 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0297cc43-983c-47df-acf6-1a8a66d24478 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:04.882414 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0297cc43-983c-47df-acf6-1a8a66d24478 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:04.882895 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0297cc43-983c-47df-acf6-1a8a66d24478 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:04.883688 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0297cc43-983c-47df-acf6-1a8a66d24478 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:04.884175 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0297cc43-983c-47df-acf6-1a8a66d24478 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:04.957211 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0297cc43-983c-47df-acf6-1a8a66d24478 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:04.957776 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0297cc43-983c-47df-acf6-1a8a66d24478 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:04.958670 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-0297cc43-983c-47df-acf6-1a8a66d24478 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:05.026147 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0297cc43-983c-47df-acf6-1a8a66d24478 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:05.039181 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0297cc43-983c-47df-acf6-1a8a66d24478 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.184265 Jun 05 08:26:05.050966 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 475/918] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:04 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:05.050966 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bc3f0c2f-37cf-4762-a4a0-25368af4fde6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:05.051530 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-bc3f0c2f-37cf-4762-a4a0-25368af4fde6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:05.056535 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b1839cb0-1b51-420c-bf50-b7c702b74ea2 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e0d123924c06bb36aeab9c2fa720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad02ddb51f51433a82e0c6361e6ed6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:05.064493 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b1839cb0-1b51-420c-bf50-b7c702b74ea2 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "GET /compute/v2.1/servers/a1b50f75-ca7f-4320-bbd6-363b4d656cd8" status: 200 len: 1523 microversion: 2.1 time: 0.523016 Jun 05 08:26:05.068305 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 444/919] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:04 2022] GET /compute/v2.1/servers/a1b50f75-ca7f-4320-bbd6-363b4d656cd8 => generated 1523 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:05.079088 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bc3f0c2f-37cf-4762-a4a0-25368af4fde6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:05.079707 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bc3f0c2f-37cf-4762-a4a0-25368af4fde6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:05.080593 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bc3f0c2f-37cf-4762-a4a0-25368af4fde6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:05.081040 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bc3f0c2f-37cf-4762-a4a0-25368af4fde6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:05.313622 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-bc3f0c2f-37cf-4762-a4a0-25368af4fde6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:05.331625 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-bc3f0c2f-37cf-4762-a4a0-25368af4fde6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:05.333630 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-bc3f0c2f-37cf-4762-a4a0-25368af4fde6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:05.334854 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bc3f0c2f-37cf-4762-a4a0-25368af4fde6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 1558 microversion: 2.25 time: 0.291552 Jun 05 08:26:05.335841 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 476/920] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:05 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 1558 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:05.353315 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-88a67d0b-6a36-4a26-aebd-96aacd59880d tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:05.354340 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-88a67d0b-6a36-4a26-aebd-96aacd59880d tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:05.362535 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c18a2b49-38cb-4cb7-8edb-5bc7e5c6ee7a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:05.363347 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c18a2b49-38cb-4cb7-8edb-5bc7e5c6ee7a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: fedc49cc-1b5e-4c16-ab6d-da3afb5e567d] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:05.364380 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-88a67d0b-6a36-4a26-aebd-96aacd59880d tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:05.365081 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-88a67d0b-6a36-4a26-aebd-96aacd59880d tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:05.366054 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-88a67d0b-6a36-4a26-aebd-96aacd59880d tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:05.366650 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-88a67d0b-6a36-4a26-aebd-96aacd59880d tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:05.369645 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c18a2b49-38cb-4cb7-8edb-5bc7e5c6ee7a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:05.370101 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c18a2b49-38cb-4cb7-8edb-5bc7e5c6ee7a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:05.371058 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c18a2b49-38cb-4cb7-8edb-5bc7e5c6ee7a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:05.371508 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c18a2b49-38cb-4cb7-8edb-5bc7e5c6ee7a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:05.528359 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c18a2b49-38cb-4cb7-8edb-5bc7e5c6ee7a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:05.538164 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c18a2b49-38cb-4cb7-8edb-5bc7e5c6ee7a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d" status: 200 len: 1214 microversion: 2.1 time: 0.183108 Jun 05 08:26:05.550456 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 477/921] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:05 2022] GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d => generated 1214 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:05.556210 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6b26a255-3531-4d1a-8876-912a588e34e3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:05.556765 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6b26a255-3531-4d1a-8876-912a588e34e3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:05.564959 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6b26a255-3531-4d1a-8876-912a588e34e3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:05.564959 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6b26a255-3531-4d1a-8876-912a588e34e3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:05.565699 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6b26a255-3531-4d1a-8876-912a588e34e3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:05.566146 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6b26a255-3531-4d1a-8876-912a588e34e3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:05.682455 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-88a67d0b-6a36-4a26-aebd-96aacd59880d tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lazy-loading 'services' on Instance uuid 476cc23e-487d-4d15-849e-208df0e985b1 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:05.716536 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-88a67d0b-6a36-4a26-aebd-96aacd59880d tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 2051 microversion: 2.25 time: 0.366348 Jun 05 08:26:05.719240 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 445/922] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:05 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 2051 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:05.753098 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6418a6b3-560b-4688-a17b-70dc77f64ee2 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:05.764153 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6418a6b3-560b-4688-a17b-70dc77f64ee2 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:05.782336 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6418a6b3-560b-4688-a17b-70dc77f64ee2 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:05.786142 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6418a6b3-560b-4688-a17b-70dc77f64ee2 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:05.788639 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6418a6b3-560b-4688-a17b-70dc77f64ee2 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:05.794318 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6418a6b3-560b-4688-a17b-70dc77f64ee2 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:05.820418 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6b26a255-3531-4d1a-8876-912a588e34e3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:05.841734 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6b26a255-3531-4d1a-8876-912a588e34e3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:05.842543 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6b26a255-3531-4d1a-8876-912a588e34e3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:05.844994 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6b26a255-3531-4d1a-8876-912a588e34e3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1407 microversion: 2.20 time: 0.293403 Jun 05 08:26:05.845885 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 478/923] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:05 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1407 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:05.870618 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-cc5ecf51-d237-4298-aa9f-135913257b7f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:05.871338 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-cc5ecf51-d237-4298-aa9f-135913257b7f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:05.882949 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cc5ecf51-d237-4298-aa9f-135913257b7f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:05.885169 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cc5ecf51-d237-4298-aa9f-135913257b7f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:05.888442 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cc5ecf51-d237-4298-aa9f-135913257b7f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:05.889089 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cc5ecf51-d237-4298-aa9f-135913257b7f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:06.441474 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-6418a6b3-560b-4688-a17b-70dc77f64ee2 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lazy-loading 'services' on Instance uuid 476cc23e-487d-4d15-849e-208df0e985b1 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:06.478447 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6418a6b3-560b-4688-a17b-70dc77f64ee2 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 2051 microversion: 2.25 time: 0.734052 Jun 05 08:26:06.481379 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 446/924] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:05 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 2051 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:06.487928 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-81a0fb93-4582-41b6-829d-2ad5a91da91b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:06.492877 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-81a0fb93-4582-41b6-829d-2ad5a91da91b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:06.498955 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-81a0fb93-4582-41b6-829d-2ad5a91da91b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:06.501111 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-81a0fb93-4582-41b6-829d-2ad5a91da91b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:06.502362 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-81a0fb93-4582-41b6-829d-2ad5a91da91b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:06.502959 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-81a0fb93-4582-41b6-829d-2ad5a91da91b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:06.524964 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-cc5ecf51-d237-4298-aa9f-135913257b7f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:06.536967 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-cc5ecf51-d237-4298-aa9f-135913257b7f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.671056 Jun 05 08:26:06.537556 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 479/925] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:05 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:06.566270 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-81a0fb93-4582-41b6-829d-2ad5a91da91b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:06.568680 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a5ad6fdc-c24e-41af-b07f-72d515dc1550 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:06.569346 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-81a0fb93-4582-41b6-829d-2ad5a91da91b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:06.569480 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a5ad6fdc-c24e-41af-b07f-72d515dc1550 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: a1b50f75-ca7f-4320-bbd6-363b4d656cd8] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:06.570093 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-81a0fb93-4582-41b6-829d-2ad5a91da91b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:06.588360 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a5ad6fdc-c24e-41af-b07f-72d515dc1550 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:06.589173 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a5ad6fdc-c24e-41af-b07f-72d515dc1550 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:06.590120 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a5ad6fdc-c24e-41af-b07f-72d515dc1550 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:06.590769 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a5ad6fdc-c24e-41af-b07f-72d515dc1550 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:06.693859 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-81a0fb93-4582-41b6-829d-2ad5a91da91b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:06.706868 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-81a0fb93-4582-41b6-829d-2ad5a91da91b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.224370 Jun 05 08:26:06.717704 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 447/926] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:06 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:06.747861 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c41e71ca-84c2-4a44-a09c-c4e3612da94a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:06.754138 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:26:06.754138 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:26:06.757078 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c41e71ca-84c2-4a44-a09c-c4e3612da94a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:06.762790 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c41e71ca-84c2-4a44-a09c-c4e3612da94a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:06.770836 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c41e71ca-84c2-4a44-a09c-c4e3612da94a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:06.774641 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c41e71ca-84c2-4a44-a09c-c4e3612da94a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:06.811759 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c41e71ca-84c2-4a44-a09c-c4e3612da94a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.090021 Jun 05 08:26:06.814233 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 448/927] 10.222.0.33 () {60 vars in 1216 bytes} [Sun Jun 5 08:26:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:26:06.822442 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-fe574a1b-5ce9-4b7b-bdbf-08093cc75a57 req-fa1bc4f2-b794-4e86-805a-873604d5b589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1b50f75-ca7f-4320-bbd6-363b4d656cd8", "name": "network-vif-deleted", "tag": "979ddd25-4bd3-4566-91d5-2e2a41a40011"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:06.833130 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-fe574a1b-5ce9-4b7b-bdbf-08093cc75a57 req-fa1bc4f2-b794-4e86-805a-873604d5b589 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:06.833848 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-fe574a1b-5ce9-4b7b-bdbf-08093cc75a57 req-fa1bc4f2-b794-4e86-805a-873604d5b589 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:06.865151 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-fe574a1b-5ce9-4b7b-bdbf-08093cc75a57 req-fa1bc4f2-b794-4e86-805a-873604d5b589 service nova] Creating event network-vif-deleted:979ddd25-4bd3-4566-91d5-2e2a41a40011 for instance a1b50f75-ca7f-4320-bbd6-363b4d656cd8 on n-h1-844739-1 Jun 05 08:26:06.870810 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-fe574a1b-5ce9-4b7b-bdbf-08093cc75a57 req-fa1bc4f2-b794-4e86-805a-873604d5b589 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055119 Jun 05 08:26:06.872014 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 449/928] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:06.882598 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2852d346-d2ee-44eb-86de-756297451153 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:06.883743 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2852d346-d2ee-44eb-86de-756297451153 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: fedc49cc-1b5e-4c16-ab6d-da3afb5e567d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:06.892446 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2852d346-d2ee-44eb-86de-756297451153 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:06.893292 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2852d346-d2ee-44eb-86de-756297451153 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:06.894254 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2852d346-d2ee-44eb-86de-756297451153 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:06.894857 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2852d346-d2ee-44eb-86de-756297451153 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:07.293018 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a5ad6fdc-c24e-41af-b07f-72d515dc1550 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e0d123924c06bb36aeab9c2fa720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad02ddb51f51433a82e0c6361e6ed6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:07.304308 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a5ad6fdc-c24e-41af-b07f-72d515dc1550 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "GET /compute/v2.1/servers/a1b50f75-ca7f-4320-bbd6-363b4d656cd8" status: 200 len: 1481 microversion: 2.1 time: 0.746961 Jun 05 08:26:07.306019 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 480/929] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:06 2022] GET /compute/v2.1/servers/a1b50f75-ca7f-4320-bbd6-363b4d656cd8 => generated 1481 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:07.310993 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5105a8db-e31b-4c5a-9970-a45c658d14b9 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:07.311787 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5105a8db-e31b-4c5a-9970-a45c658d14b9 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:07.320082 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5105a8db-e31b-4c5a-9970-a45c658d14b9 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:07.320812 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5105a8db-e31b-4c5a-9970-a45c658d14b9 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:07.321589 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5105a8db-e31b-4c5a-9970-a45c658d14b9 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:07.322060 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5105a8db-e31b-4c5a-9970-a45c658d14b9 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:07.363335 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2852d346-d2ee-44eb-86de-756297451153 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:07.371899 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2852d346-d2ee-44eb-86de-756297451153 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d" status: 200 len: 1276 microversion: 2.1 time: 0.493483 Jun 05 08:26:07.382255 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 450/930] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:06 2022] GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d => generated 1276 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:07.387952 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7f3de5a5-bdaf-4e50-ab18-7fba021ef1ea tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:07.388933 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7f3de5a5-bdaf-4e50-ab18-7fba021ef1ea tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:07.396794 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7f3de5a5-bdaf-4e50-ab18-7fba021ef1ea tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:07.397245 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7f3de5a5-bdaf-4e50-ab18-7fba021ef1ea tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:07.398239 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7f3de5a5-bdaf-4e50-ab18-7fba021ef1ea tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:07.398685 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7f3de5a5-bdaf-4e50-ab18-7fba021ef1ea tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:07.401827 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5105a8db-e31b-4c5a-9970-a45c658d14b9 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1/action" status: 202 len: 0 microversion: 2.25 time: 0.094250 Jun 05 08:26:07.403383 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=100 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:07.404525 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 481/931] 10.222.0.33 () {62 vars in 1318 bytes} [Sun Jun 5 08:26:07 2022] POST /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:26:07.413679 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6e67a9e4-bf8c-4664-ae40-c4f1b1c62cae tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:07.414680 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6e67a9e4-bf8c-4664-ae40-c4f1b1c62cae tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:07.440496 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6e67a9e4-bf8c-4664-ae40-c4f1b1c62cae tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:07.444539 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6e67a9e4-bf8c-4664-ae40-c4f1b1c62cae tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:07.448138 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6e67a9e4-bf8c-4664-ae40-c4f1b1c62cae tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:07.448794 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6e67a9e4-bf8c-4664-ae40-c4f1b1c62cae tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:08.054248 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7f3de5a5-bdaf-4e50-ab18-7fba021ef1ea tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:08.068870 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7f3de5a5-bdaf-4e50-ab18-7fba021ef1ea tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:08.070373 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7f3de5a5-bdaf-4e50-ab18-7fba021ef1ea tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:08.075597 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7f3de5a5-bdaf-4e50-ab18-7fba021ef1ea tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1407 microversion: 2.20 time: 0.691420 Jun 05 08:26:08.091484 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 451/932] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:07 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1407 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:08.100261 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-6e67a9e4-bf8c-4664-ae40-c4f1b1c62cae tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lazy-loading 'services' on Instance uuid 476cc23e-487d-4d15-849e-208df0e985b1 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:08.106262 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cdacbf2f-dee5-4fc2-ab8b-1510238fa984 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:08.107659 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-cdacbf2f-dee5-4fc2-ab8b-1510238fa984 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:08.123376 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cdacbf2f-dee5-4fc2-ab8b-1510238fa984 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:08.128467 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cdacbf2f-dee5-4fc2-ab8b-1510238fa984 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:08.129570 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cdacbf2f-dee5-4fc2-ab8b-1510238fa984 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:08.131373 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cdacbf2f-dee5-4fc2-ab8b-1510238fa984 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:08.152474 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6e67a9e4-bf8c-4664-ae40-c4f1b1c62cae tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 2056 microversion: 2.25 time: 0.743452 Jun 05 08:26:08.154272 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 482/933] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:07 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 2056 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:08.163803 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-738bda95-820b-45a4-ac50-304252ec53dd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:08.165193 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-738bda95-820b-45a4-ac50-304252ec53dd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:08.174624 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-738bda95-820b-45a4-ac50-304252ec53dd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:08.175182 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-738bda95-820b-45a4-ac50-304252ec53dd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:08.176313 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-738bda95-820b-45a4-ac50-304252ec53dd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:08.176836 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-738bda95-820b-45a4-ac50-304252ec53dd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:08.231755 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-738bda95-820b-45a4-ac50-304252ec53dd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:08.232450 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-738bda95-820b-45a4-ac50-304252ec53dd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:08.233012 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-738bda95-820b-45a4-ac50-304252ec53dd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:08.403901 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-738bda95-820b-45a4-ac50-304252ec53dd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:08.416420 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-738bda95-820b-45a4-ac50-304252ec53dd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.260701 Jun 05 08:26:08.418039 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 483/934] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:08 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:08.426771 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4e503533-4c73-48c5-b7f5-6acd35f912e6 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:08.429646 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4e503533-4c73-48c5-b7f5-6acd35f912e6 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: a1b50f75-ca7f-4320-bbd6-363b4d656cd8] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:08.439068 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4e503533-4c73-48c5-b7f5-6acd35f912e6 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:08.440057 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4e503533-4c73-48c5-b7f5-6acd35f912e6 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:08.442470 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4e503533-4c73-48c5-b7f5-6acd35f912e6 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:08.443516 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4e503533-4c73-48c5-b7f5-6acd35f912e6 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:08.525191 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4e503533-4c73-48c5-b7f5-6acd35f912e6 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:08.525679 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4e503533-4c73-48c5-b7f5-6acd35f912e6 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:08.526142 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-4e503533-4c73-48c5-b7f5-6acd35f912e6 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lazy-loading 'fault' on Instance uuid a1b50f75-ca7f-4320-bbd6-363b4d656cd8 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:08.694676 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4e503533-4c73-48c5-b7f5-6acd35f912e6 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e0d123924c06bb36aeab9c2fa720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad02ddb51f51433a82e0c6361e6ed6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:08.709159 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4e503533-4c73-48c5-b7f5-6acd35f912e6 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "GET /compute/v2.1/servers/a1b50f75-ca7f-4320-bbd6-363b4d656cd8" status: 200 len: 1368 microversion: 2.1 time: 0.289361 Jun 05 08:26:08.709911 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 484/935] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:08 2022] GET /compute/v2.1/servers/a1b50f75-ca7f-4320-bbd6-363b4d656cd8 => generated 1368 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:08.736351 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9f5913d9-e8a8-4fe4-8f9c-9211ba876e50 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:08.736980 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9f5913d9-e8a8-4fe4-8f9c-9211ba876e50 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: fedc49cc-1b5e-4c16-ab6d-da3afb5e567d] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:08.751450 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9f5913d9-e8a8-4fe4-8f9c-9211ba876e50 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:08.752389 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9f5913d9-e8a8-4fe4-8f9c-9211ba876e50 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:08.754820 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9f5913d9-e8a8-4fe4-8f9c-9211ba876e50 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:08.757619 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9f5913d9-e8a8-4fe4-8f9c-9211ba876e50 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:08.806599 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-cdacbf2f-dee5-4fc2-ab8b-1510238fa984 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:08.821228 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-cdacbf2f-dee5-4fc2-ab8b-1510238fa984 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.718503 Jun 05 08:26:08.826947 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 452/936] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:08 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:08.839615 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6a23f54f-52a3-4c75-9031-4881771ec30c tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:08.840276 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6a23f54f-52a3-4c75-9031-4881771ec30c tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 5ad92c72-624d-411d-b083-8eb7097ffbfe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:08.852809 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6a23f54f-52a3-4c75-9031-4881771ec30c tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:08.854511 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6a23f54f-52a3-4c75-9031-4881771ec30c tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:08.856568 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6a23f54f-52a3-4c75-9031-4881771ec30c tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:08.857322 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6a23f54f-52a3-4c75-9031-4881771ec30c tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:08.928926 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6a23f54f-52a3-4c75-9031-4881771ec30c tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:08.929285 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6a23f54f-52a3-4c75-9031-4881771ec30c tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:08.929917 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-6a23f54f-52a3-4c75-9031-4881771ec30c tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lazy-loading 'fault' on Instance uuid 5ad92c72-624d-411d-b083-8eb7097ffbfe {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:09.021858 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9f5913d9-e8a8-4fe4-8f9c-9211ba876e50 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:09.025758 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:09.044790 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9f5913d9-e8a8-4fe4-8f9c-9211ba876e50 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d" status: 200 len: 1276 microversion: 2.1 time: 0.322781 Jun 05 08:26:09.045874 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 485/937] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:08 2022] GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d => generated 1276 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:09.057353 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-4867c5c1-8ff3-465b-82d3-9baa89799fb4 req-292cea71-2fc4-46ef-9d68-dcd21c85c697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ad92c72-624d-411d-b083-8eb7097ffbfe", "name": "network-vif-deleted", "tag": "0a210eba-2292-4ffe-838d-feb9e31e4828"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:09.068875 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-4867c5c1-8ff3-465b-82d3-9baa89799fb4 req-292cea71-2fc4-46ef-9d68-dcd21c85c697 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:09.069433 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-4867c5c1-8ff3-465b-82d3-9baa89799fb4 req-292cea71-2fc4-46ef-9d68-dcd21c85c697 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:09.086867 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-4867c5c1-8ff3-465b-82d3-9baa89799fb4 req-292cea71-2fc4-46ef-9d68-dcd21c85c697 service nova] Creating event network-vif-deleted:0a210eba-2292-4ffe-838d-feb9e31e4828 for instance 5ad92c72-624d-411d-b083-8eb7097ffbfe on n-h1-844739-1 Jun 05 08:26:09.094830 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6a23f54f-52a3-4c75-9031-4881771ec30c tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e0d123924c06bb36aeab9c2fa720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad02ddb51f51433a82e0c6361e6ed6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:09.096400 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-4867c5c1-8ff3-465b-82d3-9baa89799fb4 req-292cea71-2fc4-46ef-9d68-dcd21c85c697 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049103 Jun 05 08:26:09.097437 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 486/938] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:09.105714 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a22b77e2-1cc0-4b1a-ab6f-354a3de239b1 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:09.106426 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a22b77e2-1cc0-4b1a-ab6f-354a3de239b1 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:09.107738 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6a23f54f-52a3-4c75-9031-4881771ec30c tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe" status: 200 len: 1374 microversion: 2.1 time: 0.269821 Jun 05 08:26:09.112348 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 453/939] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:08 2022] GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe => generated 1374 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:09.119195 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a22b77e2-1cc0-4b1a-ab6f-354a3de239b1 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:09.119656 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a22b77e2-1cc0-4b1a-ab6f-354a3de239b1 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:09.120473 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a22b77e2-1cc0-4b1a-ab6f-354a3de239b1 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:09.121191 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a22b77e2-1cc0-4b1a-ab6f-354a3de239b1 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:09.172060 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4be1b3a4-9db6-45a0-a447-14718f93b448 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:09.173176 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4be1b3a4-9db6-45a0-a447-14718f93b448 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:09.180365 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4be1b3a4-9db6-45a0-a447-14718f93b448 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:09.181133 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4be1b3a4-9db6-45a0-a447-14718f93b448 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:09.182367 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4be1b3a4-9db6-45a0-a447-14718f93b448 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:09.183276 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4be1b3a4-9db6-45a0-a447-14718f93b448 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:09.706846 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a22b77e2-1cc0-4b1a-ab6f-354a3de239b1 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:09.720007 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a22b77e2-1cc0-4b1a-ab6f-354a3de239b1 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:09.722027 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a22b77e2-1cc0-4b1a-ab6f-354a3de239b1 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:09.723013 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a22b77e2-1cc0-4b1a-ab6f-354a3de239b1 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1407 microversion: 2.20 time: 0.624004 Jun 05 08:26:09.723780 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 487/940] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:09 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1407 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:09.737892 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-f97b2512-8209-4b77-8c05-da3db04c08da req-6e21d5d8-1c45-4c89-9f11-a40e07b393d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b271002d-4613-405c-aeed-7c06b205a045", "name": "network-vif-plugged", "status": "completed", "tag": "642e2803-a706-408c-b7c4-6157cb18ee50"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:09.747140 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-f97b2512-8209-4b77-8c05-da3db04c08da req-6e21d5d8-1c45-4c89-9f11-a40e07b393d7 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:09.747463 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-f97b2512-8209-4b77-8c05-da3db04c08da req-6e21d5d8-1c45-4c89-9f11-a40e07b393d7 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:09.762414 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-f97b2512-8209-4b77-8c05-da3db04c08da req-6e21d5d8-1c45-4c89-9f11-a40e07b393d7 service nova] Creating event network-vif-plugged:642e2803-a706-408c-b7c4-6157cb18ee50 for instance b271002d-4613-405c-aeed-7c06b205a045 on n-h2-844739-1 Jun 05 08:26:09.768723 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-f97b2512-8209-4b77-8c05-da3db04c08da req-6e21d5d8-1c45-4c89-9f11-a40e07b393d7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041662 Jun 05 08:26:09.769442 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 488/941] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:09.775765 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9ec1953b-746d-43e4-9d0e-5ba08ccd024f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:09.776529 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9ec1953b-746d-43e4-9d0e-5ba08ccd024f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:09.784865 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9ec1953b-746d-43e4-9d0e-5ba08ccd024f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:09.785179 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9ec1953b-746d-43e4-9d0e-5ba08ccd024f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:09.786056 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9ec1953b-746d-43e4-9d0e-5ba08ccd024f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:09.786428 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9ec1953b-746d-43e4-9d0e-5ba08ccd024f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:09.902478 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9ec1953b-746d-43e4-9d0e-5ba08ccd024f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:09.903892 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-4be1b3a4-9db6-45a0-a447-14718f93b448 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lazy-loading 'services' on Instance uuid 476cc23e-487d-4d15-849e-208df0e985b1 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:09.904476 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9ec1953b-746d-43e4-9d0e-5ba08ccd024f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:09.905058 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-9ec1953b-746d-43e4-9d0e-5ba08ccd024f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:09.957185 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4be1b3a4-9db6-45a0-a447-14718f93b448 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 2036 microversion: 2.25 time: 0.788801 Jun 05 08:26:09.957810 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 454/942] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:09 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 2036 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:09.992663 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8b3ec5b2-e27f-4978-933f-31a76121d68d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:09.993357 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8b3ec5b2-e27f-4978-933f-31a76121d68d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:10.005679 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8b3ec5b2-e27f-4978-933f-31a76121d68d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:10.010426 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8b3ec5b2-e27f-4978-933f-31a76121d68d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:10.018476 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8b3ec5b2-e27f-4978-933f-31a76121d68d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:10.021087 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8b3ec5b2-e27f-4978-933f-31a76121d68d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:10.060449 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9ec1953b-746d-43e4-9d0e-5ba08ccd024f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:10.071043 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9ec1953b-746d-43e4-9d0e-5ba08ccd024f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.300346 Jun 05 08:26:10.073676 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 489/943] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:09 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:10.087055 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1ed90961-126e-4a24-aafb-407634ed985d tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-844739-1", "block_migration": "auto"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:10.088344 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1ed90961-126e-4a24-aafb-407634ed985d tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:10.101482 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ed90961-126e-4a24-aafb-407634ed985d tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:10.104894 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ed90961-126e-4a24-aafb-407634ed985d tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:10.107513 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ed90961-126e-4a24-aafb-407634ed985d tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:10.108152 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ed90961-126e-4a24-aafb-407634ed985d tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:10.170122 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-1ed90961-126e-4a24-aafb-407634ed985d tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lazy-loading 'flavor' on Instance uuid 476cc23e-487d-4d15-849e-208df0e985b1 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:10.186540 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1ed90961-126e-4a24-aafb-407634ed985d tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Going to try to live migrate instance to n-h2-844739-1 {{(pid=119049) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 05 08:26:10.747518 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8b3ec5b2-e27f-4978-933f-31a76121d68d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:10.758837 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8b3ec5b2-e27f-4978-933f-31a76121d68d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.799127 Jun 05 08:26:10.760670 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 455/944] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:09 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:10.766436 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f58cad50-b4e3-4a6f-9a8b-e26d595b1080 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:10.767296 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f58cad50-b4e3-4a6f-9a8b-e26d595b1080 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: fedc49cc-1b5e-4c16-ab6d-da3afb5e567d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:10.778446 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f58cad50-b4e3-4a6f-9a8b-e26d595b1080 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:10.779078 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f58cad50-b4e3-4a6f-9a8b-e26d595b1080 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:10.780028 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f58cad50-b4e3-4a6f-9a8b-e26d595b1080 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:10.781672 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f58cad50-b4e3-4a6f-9a8b-e26d595b1080 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:11.894834 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f58cad50-b4e3-4a6f-9a8b-e26d595b1080 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:11.905774 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f58cad50-b4e3-4a6f-9a8b-e26d595b1080 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d" status: 200 len: 1318 microversion: 2.1 time: 1.143242 Jun 05 08:26:11.906358 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 456/945] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:10 2022] GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d => generated 1318 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:11.920700 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-75e1a171-8d2b-45b5-9c83-b8e1c7e4c0b7 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:11.925008 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-75e1a171-8d2b-45b5-9c83-b8e1c7e4c0b7 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] [instance: 5ad92c72-624d-411d-b083-8eb7097ffbfe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:11.942958 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-75e1a171-8d2b-45b5-9c83-b8e1c7e4c0b7 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:11.946351 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-75e1a171-8d2b-45b5-9c83-b8e1c7e4c0b7 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:11.947394 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-75e1a171-8d2b-45b5-9c83-b8e1c7e4c0b7 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:11.949778 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-75e1a171-8d2b-45b5-9c83-b8e1c7e4c0b7 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:12.069949 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-75e1a171-8d2b-45b5-9c83-b8e1c7e4c0b7 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:12.075567 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-75e1a171-8d2b-45b5-9c83-b8e1c7e4c0b7 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:12.076461 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-75e1a171-8d2b-45b5-9c83-b8e1c7e4c0b7 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Lazy-loading 'fault' on Instance uuid 5ad92c72-624d-411d-b083-8eb7097ffbfe {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:12.224115 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-75e1a171-8d2b-45b5-9c83-b8e1c7e4c0b7 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1248e0d123924c06bb36aeab9c2fa720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad02ddb51f51433a82e0c6361e6ed6eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:12.235929 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-75e1a171-8d2b-45b5-9c83-b8e1c7e4c0b7 tempest-ListServersNegativeTestJSON-1372585794 tempest-ListServersNegativeTestJSON-1372585794-project] 10.222.0.33 "GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe" status: 200 len: 1368 microversion: 2.1 time: 0.323395 Jun 05 08:26:12.238107 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 457/946] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:11 2022] GET /compute/v2.1/servers/5ad92c72-624d-411d-b083-8eb7097ffbfe => generated 1368 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:12.244531 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-12b4852b-cabd-4bc4-8bc4-a677042a3c42 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:12.245520 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-12b4852b-cabd-4bc4-8bc4-a677042a3c42 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:12.271244 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-12b4852b-cabd-4bc4-8bc4-a677042a3c42 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:12.271971 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-12b4852b-cabd-4bc4-8bc4-a677042a3c42 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:12.272946 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-12b4852b-cabd-4bc4-8bc4-a677042a3c42 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:12.277714 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-12b4852b-cabd-4bc4-8bc4-a677042a3c42 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:12.419249 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1ed90961-126e-4a24-aafb-407634ed985d tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1/action" status: 202 len: 0 microversion: 2.25 time: 2.343612 Jun 05 08:26:12.420256 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 490/947] 10.222.0.33 () {62 vars in 1318 bytes} [Sun Jun 5 08:26:10 2022] POST /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1/action => generated 0 bytes in 2346 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:26:12.426988 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-94ec8559-de71-4ec6-9b9b-bb2e06613428 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:12.427830 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-94ec8559-de71-4ec6-9b9b-bb2e06613428 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:12.440508 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-94ec8559-de71-4ec6-9b9b-bb2e06613428 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:12.448193 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-94ec8559-de71-4ec6-9b9b-bb2e06613428 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:12.449844 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-94ec8559-de71-4ec6-9b9b-bb2e06613428 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:12.450436 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-94ec8559-de71-4ec6-9b9b-bb2e06613428 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:12.541277 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-94ec8559-de71-4ec6-9b9b-bb2e06613428 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:12.541755 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-94ec8559-de71-4ec6-9b9b-bb2e06613428 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:12.542233 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-94ec8559-de71-4ec6-9b9b-bb2e06613428 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:12.697177 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-94ec8559-de71-4ec6-9b9b-bb2e06613428 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:12.713104 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-94ec8559-de71-4ec6-9b9b-bb2e06613428 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.291431 Jun 05 08:26:12.714421 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 491/948] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:12 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:12.725825 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-33f2decd-5165-457b-b579-18f17f585284 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:12.728581 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-33f2decd-5165-457b-b579-18f17f585284 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:12.737336 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-33f2decd-5165-457b-b579-18f17f585284 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:12.738132 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-33f2decd-5165-457b-b579-18f17f585284 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:12.739336 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-33f2decd-5165-457b-b579-18f17f585284 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:12.740427 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-33f2decd-5165-457b-b579-18f17f585284 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:12.783026 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-12b4852b-cabd-4bc4-8bc4-a677042a3c42 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:12.791516 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-12b4852b-cabd-4bc4-8bc4-a677042a3c42 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:12.793076 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-12b4852b-cabd-4bc4-8bc4-a677042a3c42 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:12.802981 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-12b4852b-cabd-4bc4-8bc4-a677042a3c42 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1599 microversion: 2.20 time: 0.553379 Jun 05 08:26:12.804219 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 458/949] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:12 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1599 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:12.816145 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6488014c-dcdf-4eed-8c49-b2a71818be6c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:12.816785 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6488014c-dcdf-4eed-8c49-b2a71818be6c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:12.832082 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6488014c-dcdf-4eed-8c49-b2a71818be6c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:12.834736 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6488014c-dcdf-4eed-8c49-b2a71818be6c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:12.835730 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6488014c-dcdf-4eed-8c49-b2a71818be6c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:12.836902 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6488014c-dcdf-4eed-8c49-b2a71818be6c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:13.086092 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=16 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:13.384886 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-33f2decd-5165-457b-b579-18f17f585284 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:13.397714 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-33f2decd-5165-457b-b579-18f17f585284 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.681770 Jun 05 08:26:13.411644 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 492/950] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:12 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:13.419819 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5a650ee1-ebf9-463c-aa82-3325ba15104c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:13.425695 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5a650ee1-ebf9-463c-aa82-3325ba15104c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:13.433280 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a650ee1-ebf9-463c-aa82-3325ba15104c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:13.434132 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a650ee1-ebf9-463c-aa82-3325ba15104c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:13.435185 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a650ee1-ebf9-463c-aa82-3325ba15104c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:13.436079 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a650ee1-ebf9-463c-aa82-3325ba15104c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:13.455637 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6488014c-dcdf-4eed-8c49-b2a71818be6c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:13.465916 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6488014c-dcdf-4eed-8c49-b2a71818be6c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:13.474932 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6488014c-dcdf-4eed-8c49-b2a71818be6c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:13.477669 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6488014c-dcdf-4eed-8c49-b2a71818be6c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 1568 microversion: 2.25 time: 0.671148 Jun 05 08:26:13.479632 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 459/951] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:12 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 1568 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:13.488819 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-468f2aec-d64b-4a15-87ce-0184cc9e5f96 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:13.495016 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-468f2aec-d64b-4a15-87ce-0184cc9e5f96 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: fedc49cc-1b5e-4c16-ab6d-da3afb5e567d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:13.511853 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-468f2aec-d64b-4a15-87ce-0184cc9e5f96 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:13.512837 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-468f2aec-d64b-4a15-87ce-0184cc9e5f96 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:13.513939 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-468f2aec-d64b-4a15-87ce-0184cc9e5f96 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:13.515231 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-468f2aec-d64b-4a15-87ce-0184cc9e5f96 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:13.731496 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5a650ee1-ebf9-463c-aa82-3325ba15104c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.317857 Jun 05 08:26:13.735878 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 493/952] 10.222.0.33 () {60 vars in 1315 bytes} [Sun Jun 5 08:26:13 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-interface => generated 285 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:26:13.747394 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a31205ce-8c22-478a-905e-54eec4a03039 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:13.750172 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a31205ce-8c22-478a-905e-54eec4a03039 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:13.762882 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a31205ce-8c22-478a-905e-54eec4a03039 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:13.763869 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a31205ce-8c22-478a-905e-54eec4a03039 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:13.767316 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a31205ce-8c22-478a-905e-54eec4a03039 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:13.769993 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a31205ce-8c22-478a-905e-54eec4a03039 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:13.844991 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:13.848804 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a31205ce-8c22-478a-905e-54eec4a03039 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:13.849744 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a31205ce-8c22-478a-905e-54eec4a03039 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:13.851988 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-a31205ce-8c22-478a-905e-54eec4a03039 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:14.068872 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a31205ce-8c22-478a-905e-54eec4a03039 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:14.080824 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a31205ce-8c22-478a-905e-54eec4a03039 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.341886 Jun 05 08:26:14.081670 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 494/953] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:13 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:14.204934 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-468f2aec-d64b-4a15-87ce-0184cc9e5f96 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:14.247996 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-f76b6b6d-50fc-4078-a1f4-6fb6560c0d5a req-f2d62adf-3099-4822-96d2-028594739f55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fedc49cc-1b5e-4c16-ab6d-da3afb5e567d", "tag": "cb2b2764-b1e0-4358-bc3b-4a0b8b4f76b9"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:14.255860 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-468f2aec-d64b-4a15-87ce-0184cc9e5f96 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d" status: 200 len: 1318 microversion: 2.1 time: 0.758127 Jun 05 08:26:14.267261 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 460/954] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:13 2022] GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d => generated 1318 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:14.267673 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=4 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:14.267673 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-f76b6b6d-50fc-4078-a1f4-6fb6560c0d5a req-f2d62adf-3099-4822-96d2-028594739f55 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:14.267673 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-f76b6b6d-50fc-4078-a1f4-6fb6560c0d5a req-f2d62adf-3099-4822-96d2-028594739f55 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:14.294673 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-f76b6b6d-50fc-4078-a1f4-6fb6560c0d5a req-f2d62adf-3099-4822-96d2-028594739f55 service nova] Creating event network-changed:cb2b2764-b1e0-4358-bc3b-4a0b8b4f76b9 for instance fedc49cc-1b5e-4c16-ab6d-da3afb5e567d on n-h2-844739-1 Jun 05 08:26:14.301337 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-f76b6b6d-50fc-4078-a1f4-6fb6560c0d5a req-f2d62adf-3099-4822-96d2-028594739f55 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057023 Jun 05 08:26:14.302337 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 495/955] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:26:14.420176 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9524bcb7-31c1-422a-aac4-81f48ccfbd61 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:14.421804 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9524bcb7-31c1-422a-aac4-81f48ccfbd61 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:14.434791 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9524bcb7-31c1-422a-aac4-81f48ccfbd61 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:14.436902 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9524bcb7-31c1-422a-aac4-81f48ccfbd61 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:14.437747 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9524bcb7-31c1-422a-aac4-81f48ccfbd61 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:14.438199 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9524bcb7-31c1-422a-aac4-81f48ccfbd61 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:14.500622 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2023b407-9fcf-4bae-8213-87d224bf7fb0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:14.503273 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2023b407-9fcf-4bae-8213-87d224bf7fb0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:14.526249 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=30 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:14.542242 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2023b407-9fcf-4bae-8213-87d224bf7fb0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:14.547849 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2023b407-9fcf-4bae-8213-87d224bf7fb0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:14.550787 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2023b407-9fcf-4bae-8213-87d224bf7fb0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:14.552768 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2023b407-9fcf-4bae-8213-87d224bf7fb0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:15.103131 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-9524bcb7-31c1-422a-aac4-81f48ccfbd61 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:15.144469 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9524bcb7-31c1-422a-aac4-81f48ccfbd61 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.727973 Jun 05 08:26:15.157354 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 461/956] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:14 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:15.170136 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0d844a87-7c6d-49f6-bec7-84dadceaaad9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:15.172321 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0d844a87-7c6d-49f6-bec7-84dadceaaad9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:15.185164 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0d844a87-7c6d-49f6-bec7-84dadceaaad9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:15.185850 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0d844a87-7c6d-49f6-bec7-84dadceaaad9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:15.188404 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0d844a87-7c6d-49f6-bec7-84dadceaaad9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:15.189067 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0d844a87-7c6d-49f6-bec7-84dadceaaad9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:15.275769 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0d844a87-7c6d-49f6-bec7-84dadceaaad9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:15.277247 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0d844a87-7c6d-49f6-bec7-84dadceaaad9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:15.282117 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-0d844a87-7c6d-49f6-bec7-84dadceaaad9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:16.018458 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0d844a87-7c6d-49f6-bec7-84dadceaaad9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:16.026296 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0d844a87-7c6d-49f6-bec7-84dadceaaad9 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.862989 Jun 05 08:26:16.029875 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 462/957] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:15 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:16.041821 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-a508133a-2fda-40c4-8382-00bfca8d3087 req-ed7805df-bd92-4240-a894-6ffe3b658023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "476cc23e-487d-4d15-849e-208df0e985b1", "name": "network-vif-unplugged", "status": "completed", "tag": "b7264816-9730-49ab-bb1c-4148a2e5aaef"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:16.065115 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-a508133a-2fda-40c4-8382-00bfca8d3087 req-ed7805df-bd92-4240-a894-6ffe3b658023 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:16.065983 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-a508133a-2fda-40c4-8382-00bfca8d3087 req-ed7805df-bd92-4240-a894-6ffe3b658023 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:16.090798 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-a508133a-2fda-40c4-8382-00bfca8d3087 req-ed7805df-bd92-4240-a894-6ffe3b658023 service nova] Creating event network-vif-unplugged:b7264816-9730-49ab-bb1c-4148a2e5aaef for instance 476cc23e-487d-4d15-849e-208df0e985b1 on n-h1-844739-1 Jun 05 08:26:16.100545 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-a508133a-2fda-40c4-8382-00bfca8d3087 req-ed7805df-bd92-4240-a894-6ffe3b658023 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069105 Jun 05 08:26:16.109663 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 463/958] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:16.119590 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a4663aca-fecc-4bad-871d-052d23b9cf33 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:16.121385 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a4663aca-fecc-4bad-871d-052d23b9cf33 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: fedc49cc-1b5e-4c16-ab6d-da3afb5e567d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:16.131670 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a4663aca-fecc-4bad-871d-052d23b9cf33 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:16.132335 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a4663aca-fecc-4bad-871d-052d23b9cf33 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:16.133339 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a4663aca-fecc-4bad-871d-052d23b9cf33 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:16.133963 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a4663aca-fecc-4bad-871d-052d23b9cf33 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:16.344941 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2023b407-9fcf-4bae-8213-87d224bf7fb0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:16.353240 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2023b407-9fcf-4bae-8213-87d224bf7fb0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:16.355046 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2023b407-9fcf-4bae-8213-87d224bf7fb0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:16.356479 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2023b407-9fcf-4bae-8213-87d224bf7fb0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 1568 microversion: 2.25 time: 1.861192 Jun 05 08:26:16.367595 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 496/959] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:14 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 1568 bytes in 1873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:26:16.372848 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-417e0479-005c-4053-9a62-adc0138c9bf6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:16.374391 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-417e0479-005c-4053-9a62-adc0138c9bf6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:16.381308 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-417e0479-005c-4053-9a62-adc0138c9bf6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:16.382128 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-417e0479-005c-4053-9a62-adc0138c9bf6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:16.383134 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-417e0479-005c-4053-9a62-adc0138c9bf6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:16.383794 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-417e0479-005c-4053-9a62-adc0138c9bf6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:16.789249 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=6 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:16.915869 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a4663aca-fecc-4bad-871d-052d23b9cf33 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:16.930727 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a4663aca-fecc-4bad-871d-052d23b9cf33 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d" status: 200 len: 1318 microversion: 2.1 time: 0.819450 Jun 05 08:26:16.936116 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 464/960] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:16 2022] GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d => generated 1318 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:16.947961 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-98f1c680-1fa1-48f1-b49f-f8e79d61c06b req-8877aa42-afba-44f0-9cd1-feba7e8450f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d6c0691-aa2b-4d7f-b424-2a9129f285bb", "tag": "53d0d855-1312-418f-bb21-a68f6df44657"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:16.976913 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-98f1c680-1fa1-48f1-b49f-f8e79d61c06b req-8877aa42-afba-44f0-9cd1-feba7e8450f3 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:16.977969 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-98f1c680-1fa1-48f1-b49f-f8e79d61c06b req-8877aa42-afba-44f0-9cd1-feba7e8450f3 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:17.009826 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-98f1c680-1fa1-48f1-b49f-f8e79d61c06b req-8877aa42-afba-44f0-9cd1-feba7e8450f3 service nova] Creating event network-changed:53d0d855-1312-418f-bb21-a68f6df44657 for instance 5d6c0691-aa2b-4d7f-b424-2a9129f285bb on n-h1-844739-1 Jun 05 08:26:17.025246 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-98f1c680-1fa1-48f1-b49f-f8e79d61c06b req-8877aa42-afba-44f0-9cd1-feba7e8450f3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086594 Jun 05 08:26:17.026399 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 465/961] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:17.049053 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ae290abd-dc2d-426c-a3e9-59eb5a2591b8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:17.050073 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ae290abd-dc2d-426c-a3e9-59eb5a2591b8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:17.069442 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ae290abd-dc2d-426c-a3e9-59eb5a2591b8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:17.070184 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ae290abd-dc2d-426c-a3e9-59eb5a2591b8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:17.071313 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ae290abd-dc2d-426c-a3e9-59eb5a2591b8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:17.072066 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ae290abd-dc2d-426c-a3e9-59eb5a2591b8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:17.159808 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ae290abd-dc2d-426c-a3e9-59eb5a2591b8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:17.160479 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ae290abd-dc2d-426c-a3e9-59eb5a2591b8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:17.161412 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-ae290abd-dc2d-426c-a3e9-59eb5a2591b8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:17.431931 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ae290abd-dc2d-426c-a3e9-59eb5a2591b8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:17.462586 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ae290abd-dc2d-426c-a3e9-59eb5a2591b8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.416853 Jun 05 08:26:17.466438 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 466/962] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:17 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:17.481910 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-08fd5d04-6f00-4b64-bd40-4d4a4bac71dd tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:17.482546 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-08fd5d04-6f00-4b64-bd40-4d4a4bac71dd tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:17.504108 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-08fd5d04-6f00-4b64-bd40-4d4a4bac71dd tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:17.505705 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-08fd5d04-6f00-4b64-bd40-4d4a4bac71dd tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:17.507021 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-08fd5d04-6f00-4b64-bd40-4d4a4bac71dd tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:17.507631 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-08fd5d04-6f00-4b64-bd40-4d4a4bac71dd tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:17.533548 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=100 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:17.585908 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-417e0479-005c-4053-9a62-adc0138c9bf6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:17.603352 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-417e0479-005c-4053-9a62-adc0138c9bf6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 1.232960 Jun 05 08:26:17.604666 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 497/963] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:16 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:17.933168 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bf634d2b-b645-418b-b029-90f927c44e09 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1767731211", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "4d5ebf49-2f35-4257-aa72-c00ef90e9d30"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:17.981117 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-08fd5d04-6f00-4b64-bd40-4d4a4bac71dd tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:17.993254 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-08fd5d04-6f00-4b64-bd40-4d4a4bac71dd tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:17.995585 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-08fd5d04-6f00-4b64-bd40-4d4a4bac71dd tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:17.996987 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-bf634d2b-b645-418b-b029-90f927c44e09 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] validate_networks() for [('4d5ebf49-2f35-4257-aa72-c00ef90e9d30', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:26:17.997330 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-08fd5d04-6f00-4b64-bd40-4d4a4bac71dd tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 1568 microversion: 2.25 time: 0.527070 Jun 05 08:26:17.999207 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 467/964] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:17 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 1568 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:18.004186 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-dadd3243-60f1-48b0-92e4-c610db3513e3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:18.005259 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-dadd3243-60f1-48b0-92e4-c610db3513e3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: fedc49cc-1b5e-4c16-ab6d-da3afb5e567d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:18.011878 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dadd3243-60f1-48b0-92e4-c610db3513e3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:18.013065 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dadd3243-60f1-48b0-92e4-c610db3513e3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:18.013942 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dadd3243-60f1-48b0-92e4-c610db3513e3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:18.015261 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dadd3243-60f1-48b0-92e4-c610db3513e3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:18.776225 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-dadd3243-60f1-48b0-92e4-c610db3513e3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:18.788827 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-dadd3243-60f1-48b0-92e4-c610db3513e3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d" status: 200 len: 1318 microversion: 2.1 time: 0.788251 Jun 05 08:26:18.789506 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 468/965] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:17 2022] GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d => generated 1318 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:18.806076 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-a6d4650e-3af4-421a-b070-927b0bff374c req-022ed77a-bd85-4a8d-a21d-5807ee7e347d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "476cc23e-487d-4d15-849e-208df0e985b1", "tag": "b7264816-9730-49ab-bb1c-4148a2e5aaef"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:18.816679 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-a6d4650e-3af4-421a-b070-927b0bff374c req-022ed77a-bd85-4a8d-a21d-5807ee7e347d service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:18.817525 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-a6d4650e-3af4-421a-b070-927b0bff374c req-022ed77a-bd85-4a8d-a21d-5807ee7e347d service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:18.835865 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-a6d4650e-3af4-421a-b070-927b0bff374c req-022ed77a-bd85-4a8d-a21d-5807ee7e347d service nova] Creating event network-changed:b7264816-9730-49ab-bb1c-4148a2e5aaef for instance 476cc23e-487d-4d15-849e-208df0e985b1 on n-h1-844739-1 Jun 05 08:26:18.844967 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-a6d4650e-3af4-421a-b070-927b0bff374c req-022ed77a-bd85-4a8d-a21d-5807ee7e347d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043630 Jun 05 08:26:18.846773 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 469/966] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:18.858037 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e825fa00-943c-49f7-9714-1e05a7afd20c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:18.859471 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e825fa00-943c-49f7-9714-1e05a7afd20c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:18.878660 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e825fa00-943c-49f7-9714-1e05a7afd20c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:18.879769 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e825fa00-943c-49f7-9714-1e05a7afd20c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:18.882739 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e825fa00-943c-49f7-9714-1e05a7afd20c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:18.884440 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e825fa00-943c-49f7-9714-1e05a7afd20c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:18.934882 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e825fa00-943c-49f7-9714-1e05a7afd20c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:18.935692 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e825fa00-943c-49f7-9714-1e05a7afd20c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:18.937011 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-e825fa00-943c-49f7-9714-1e05a7afd20c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:19.034256 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e825fa00-943c-49f7-9714-1e05a7afd20c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:19.049025 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e825fa00-943c-49f7-9714-1e05a7afd20c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.199188 Jun 05 08:26:19.050010 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 470/967] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:18 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:19.063932 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5fb6542e-f4b1-445a-8d63-aeab9a25965a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:19.064812 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5fb6542e-f4b1-445a-8d63-aeab9a25965a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:19.075694 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5fb6542e-f4b1-445a-8d63-aeab9a25965a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:19.076430 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5fb6542e-f4b1-445a-8d63-aeab9a25965a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:19.079194 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5fb6542e-f4b1-445a-8d63-aeab9a25965a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:19.079816 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5fb6542e-f4b1-445a-8d63-aeab9a25965a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:19.488191 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-bf634d2b-b645-418b-b029-90f927c44e09 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:26:19.489801 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-bf634d2b-b645-418b-b029-90f927c44e09 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:26:19.490659 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-bf634d2b-b645-418b-b029-90f927c44e09 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:26:19.491396 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-bf634d2b-b645-418b-b029-90f927c44e09 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:26:19.491986 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-bf634d2b-b645-418b-b029-90f927c44e09 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:26:19.507777 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bf634d2b-b645-418b-b029-90f927c44e09 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:19.510419 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bf634d2b-b645-418b-b029-90f927c44e09 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:19.511906 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bf634d2b-b645-418b-b029-90f927c44e09 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:19.512599 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bf634d2b-b645-418b-b029-90f927c44e09 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:19.533155 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5fb6542e-f4b1-445a-8d63-aeab9a25965a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:19.553749 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5fb6542e-f4b1-445a-8d63-aeab9a25965a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.501414 Jun 05 08:26:19.555489 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-bf634d2b-b645-418b-b029-90f927c44e09 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Getting quotas for project e96dedf15be442108c8d5d5ec1775a88. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:26:19.564472 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-bf634d2b-b645-418b-b029-90f927c44e09 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Getting quotas for user bca3243fc2bf41448a184c03df437f8c and project e96dedf15be442108c8d5d5ec1775a88. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:26:19.565361 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 471/968] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:19 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:19.570513 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-efbe6fb8-4b8e-4c60-9a1a-a7ad6b0612e8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:19.571140 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-efbe6fb8-4b8e-4c60-9a1a-a7ad6b0612e8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:19.585493 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-bf634d2b-b645-418b-b029-90f927c44e09 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Going to run 2 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:26:19.587823 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-bf634d2b-b645-418b-b029-90f927c44e09 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 9e3f0d36-6bfe-4cb0-a001-4940b6da70e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:26:19.596689 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-efbe6fb8-4b8e-4c60-9a1a-a7ad6b0612e8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:19.597144 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-efbe6fb8-4b8e-4c60-9a1a-a7ad6b0612e8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:19.597958 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-efbe6fb8-4b8e-4c60-9a1a-a7ad6b0612e8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:19.598404 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-efbe6fb8-4b8e-4c60-9a1a-a7ad6b0612e8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:19.660907 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-bf634d2b-b645-418b-b029-90f927c44e09 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 05801050-4724-44df-8f50-9317e26f10d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=9e3f0d36-6bfe-4cb0-a001-4940b6da70e5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:26:19.732274 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bf634d2b-b645-418b-b029-90f927c44e09 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.933712 Jun 05 08:26:19.734181 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 498/969] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:26:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:26:19.739988 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-5392131b-01b3-410d-a5a3-7e7fa48ad2c7 req-f0dce74b-0a69-461c-bee4-c5bdcc676097 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b271002d-4613-405c-aeed-7c06b205a045", "tag": "642e2803-a706-408c-b7c4-6157cb18ee50"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:19.750002 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-5392131b-01b3-410d-a5a3-7e7fa48ad2c7 req-f0dce74b-0a69-461c-bee4-c5bdcc676097 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:19.750822 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-5392131b-01b3-410d-a5a3-7e7fa48ad2c7 req-f0dce74b-0a69-461c-bee4-c5bdcc676097 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:19.769408 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-5392131b-01b3-410d-a5a3-7e7fa48ad2c7 req-f0dce74b-0a69-461c-bee4-c5bdcc676097 service nova] Creating event network-changed:642e2803-a706-408c-b7c4-6157cb18ee50 for instance b271002d-4613-405c-aeed-7c06b205a045 on n-h2-844739-1 Jun 05 08:26:19.775175 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-5392131b-01b3-410d-a5a3-7e7fa48ad2c7 req-f0dce74b-0a69-461c-bee4-c5bdcc676097 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039520 Jun 05 08:26:19.776895 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 499/970] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:19.784135 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-dcf4a3a6-955c-4bd6-b512-4017b9fe017e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:19.788806 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-dcf4a3a6-955c-4bd6-b512-4017b9fe017e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:19.789602 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-dcf4a3a6-955c-4bd6-b512-4017b9fe017e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Searching by: {'deleted': False, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88'} {{(pid=119049) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 05 08:26:19.827429 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dcf4a3a6-955c-4bd6-b512-4017b9fe017e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:19.828098 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dcf4a3a6-955c-4bd6-b512-4017b9fe017e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:19.832064 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dcf4a3a6-955c-4bd6-b512-4017b9fe017e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:19.834741 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dcf4a3a6-955c-4bd6-b512-4017b9fe017e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:19.882946 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-dcf4a3a6-955c-4bd6-b512-4017b9fe017e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.104359 Jun 05 08:26:19.883552 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 500/971] 10.222.0.33 () {58 vars in 1124 bytes} [Sun Jun 5 08:26:19 2022] GET /compute/v2.1/servers => generated 677 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:19.888665 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f3c6088c-036c-45e6-957c-04691b8618a9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:19.896566 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f3c6088c-036c-45e6-957c-04691b8618a9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: fedc49cc-1b5e-4c16-ab6d-da3afb5e567d] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:19.914251 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f3c6088c-036c-45e6-957c-04691b8618a9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:19.914726 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f3c6088c-036c-45e6-957c-04691b8618a9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:19.919188 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f3c6088c-036c-45e6-957c-04691b8618a9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:19.919827 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f3c6088c-036c-45e6-957c-04691b8618a9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:20.018627 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-efbe6fb8-4b8e-4c60-9a1a-a7ad6b0612e8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:20.030751 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-efbe6fb8-4b8e-4c60-9a1a-a7ad6b0612e8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:20.036918 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-efbe6fb8-4b8e-4c60-9a1a-a7ad6b0612e8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:20.038159 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-efbe6fb8-4b8e-4c60-9a1a-a7ad6b0612e8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 1568 microversion: 2.25 time: 0.471716 Jun 05 08:26:20.039103 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 472/972] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:19 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 1568 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:20.063494 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-89051add-d0b4-4182-a2d3-7c9a54edfba7 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:20.064286 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-89051add-d0b4-4182-a2d3-7c9a54edfba7 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 05801050-4724-44df-8f50-9317e26f10d4] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:20.193886 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-89051add-d0b4-4182-a2d3-7c9a54edfba7 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:20.205809 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-89051add-d0b4-4182-a2d3-7c9a54edfba7 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/05801050-4724-44df-8f50-9317e26f10d4" status: 200 len: 1220 microversion: 2.1 time: 0.152930 Jun 05 08:26:20.216517 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 473/973] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:20 2022] GET /compute/v2.1/servers/05801050-4724-44df-8f50-9317e26f10d4 => generated 1220 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:20.224885 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3b8a250e-6e39-442a-84bd-cf51c55baf7c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:20.224885 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3b8a250e-6e39-442a-84bd-cf51c55baf7c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:20.230971 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3b8a250e-6e39-442a-84bd-cf51c55baf7c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:20.231428 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3b8a250e-6e39-442a-84bd-cf51c55baf7c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:20.232244 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3b8a250e-6e39-442a-84bd-cf51c55baf7c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:20.232680 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3b8a250e-6e39-442a-84bd-cf51c55baf7c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:20.305082 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3b8a250e-6e39-442a-84bd-cf51c55baf7c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:20.307010 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3b8a250e-6e39-442a-84bd-cf51c55baf7c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:20.307895 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-3b8a250e-6e39-442a-84bd-cf51c55baf7c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:20.432226 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3b8a250e-6e39-442a-84bd-cf51c55baf7c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:20.442757 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f3c6088c-036c-45e6-957c-04691b8618a9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:20.444119 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3b8a250e-6e39-442a-84bd-cf51c55baf7c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.222353 Jun 05 08:26:20.445014 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 474/974] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:20 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:20.459072 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f3c6088c-036c-45e6-957c-04691b8618a9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d" status: 200 len: 1318 microversion: 2.1 time: 0.574278 Jun 05 08:26:20.459836 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 501/975] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:19 2022] GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d => generated 1318 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:20.572957 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b4fa00aa-bcd0-48db-a219-86b928dee94c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:20.573952 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b4fa00aa-bcd0-48db-a219-86b928dee94c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:20.586482 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b4fa00aa-bcd0-48db-a219-86b928dee94c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:20.587047 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b4fa00aa-bcd0-48db-a219-86b928dee94c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:20.587869 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b4fa00aa-bcd0-48db-a219-86b928dee94c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:20.588354 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b4fa00aa-bcd0-48db-a219-86b928dee94c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:20.797523 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b4fa00aa-bcd0-48db-a219-86b928dee94c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:20.807868 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b4fa00aa-bcd0-48db-a219-86b928dee94c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.238868 Jun 05 08:26:20.809065 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 475/976] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:20 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:21.056996 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-93ead84d-33cf-4586-9243-5bbc39929749 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:21.058284 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-93ead84d-33cf-4586-9243-5bbc39929749 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:21.065435 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-93ead84d-33cf-4586-9243-5bbc39929749 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:21.066094 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-93ead84d-33cf-4586-9243-5bbc39929749 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:21.067043 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-93ead84d-33cf-4586-9243-5bbc39929749 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:21.067646 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-93ead84d-33cf-4586-9243-5bbc39929749 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:21.224890 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d7039a4a-6ea3-43ea-ba14-e759dcb7940e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:21.226291 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d7039a4a-6ea3-43ea-ba14-e759dcb7940e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 05801050-4724-44df-8f50-9317e26f10d4] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:21.236503 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d7039a4a-6ea3-43ea-ba14-e759dcb7940e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:21.237239 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d7039a4a-6ea3-43ea-ba14-e759dcb7940e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:21.244578 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d7039a4a-6ea3-43ea-ba14-e759dcb7940e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:21.245969 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d7039a4a-6ea3-43ea-ba14-e759dcb7940e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:21.514853 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d7039a4a-6ea3-43ea-ba14-e759dcb7940e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:21.523230 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d7039a4a-6ea3-43ea-ba14-e759dcb7940e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/05801050-4724-44df-8f50-9317e26f10d4" status: 200 len: 1224 microversion: 2.1 time: 0.303419 Jun 05 08:26:21.524255 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 476/977] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:21 2022] GET /compute/v2.1/servers/05801050-4724-44df-8f50-9317e26f10d4 => generated 1224 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:21.530410 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-87cef44c-a6a9-44e1-bbea-0e0605752024 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:21.539025 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-87cef44c-a6a9-44e1-bbea-0e0605752024 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:21.575407 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-87cef44c-a6a9-44e1-bbea-0e0605752024 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:21.582871 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-87cef44c-a6a9-44e1-bbea-0e0605752024 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:21.584844 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-87cef44c-a6a9-44e1-bbea-0e0605752024 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:21.588497 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-93ead84d-33cf-4586-9243-5bbc39929749 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:21.589273 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-87cef44c-a6a9-44e1-bbea-0e0605752024 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:21.598005 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-93ead84d-33cf-4586-9243-5bbc39929749 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:21.609751 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-93ead84d-33cf-4586-9243-5bbc39929749 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:21.611207 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-93ead84d-33cf-4586-9243-5bbc39929749 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 1568 microversion: 2.25 time: 0.558962 Jun 05 08:26:21.612306 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 502/978] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:21 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 1568 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:21.617049 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5164b515-a085-420b-b392-86f49de02d5d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:21.622283 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5164b515-a085-420b-b392-86f49de02d5d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: fedc49cc-1b5e-4c16-ab6d-da3afb5e567d] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:21.638383 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5164b515-a085-420b-b392-86f49de02d5d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:21.639241 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5164b515-a085-420b-b392-86f49de02d5d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:21.640590 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5164b515-a085-420b-b392-86f49de02d5d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:21.645405 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5164b515-a085-420b-b392-86f49de02d5d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:21.696603 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-87cef44c-a6a9-44e1-bbea-0e0605752024 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:21.697428 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-87cef44c-a6a9-44e1-bbea-0e0605752024 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:21.698115 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-87cef44c-a6a9-44e1-bbea-0e0605752024 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:21.872640 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-87cef44c-a6a9-44e1-bbea-0e0605752024 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:21.884821 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-87cef44c-a6a9-44e1-bbea-0e0605752024 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.359288 Jun 05 08:26:21.885443 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 477/979] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:21 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:21.898603 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-68af7e0f-5e84-44cc-9d3b-49347fc7e7d7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:21.899236 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-68af7e0f-5e84-44cc-9d3b-49347fc7e7d7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:21.915968 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-68af7e0f-5e84-44cc-9d3b-49347fc7e7d7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:21.916452 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-68af7e0f-5e84-44cc-9d3b-49347fc7e7d7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:21.917246 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-68af7e0f-5e84-44cc-9d3b-49347fc7e7d7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:21.917691 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-68af7e0f-5e84-44cc-9d3b-49347fc7e7d7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:22.143114 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5164b515-a085-420b-b392-86f49de02d5d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:22.158860 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:22.167545 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5164b515-a085-420b-b392-86f49de02d5d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d" status: 200 len: 1318 microversion: 2.1 time: 0.553524 Jun 05 08:26:22.173014 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-68af7e0f-5e84-44cc-9d3b-49347fc7e7d7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:22.176746 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 503/980] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:21 2022] GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d => generated 1318 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:22.182798 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-68af7e0f-5e84-44cc-9d3b-49347fc7e7d7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.296077 Jun 05 08:26:22.183873 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 478/981] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:21 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:22.543149 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-73c16ab4-e092-409a-afba-966a0380c1f6 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:22.543832 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-73c16ab4-e092-409a-afba-966a0380c1f6 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 05801050-4724-44df-8f50-9317e26f10d4] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:22.568182 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-73c16ab4-e092-409a-afba-966a0380c1f6 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:22.568645 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-73c16ab4-e092-409a-afba-966a0380c1f6 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:22.569446 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-73c16ab4-e092-409a-afba-966a0380c1f6 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:22.569898 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-73c16ab4-e092-409a-afba-966a0380c1f6 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:22.630228 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5a1cfb08-7bf4-4832-b86c-9bf4e1dd9579 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:22.630851 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5a1cfb08-7bf4-4832-b86c-9bf4e1dd9579 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:22.642112 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5a1cfb08-7bf4-4832-b86c-9bf4e1dd9579 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:22.642837 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5a1cfb08-7bf4-4832-b86c-9bf4e1dd9579 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:22.644938 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5a1cfb08-7bf4-4832-b86c-9bf4e1dd9579 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:22.653086 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5a1cfb08-7bf4-4832-b86c-9bf4e1dd9579 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:22.778488 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-73c16ab4-e092-409a-afba-966a0380c1f6 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:22.794692 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-73c16ab4-e092-409a-afba-966a0380c1f6 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/05801050-4724-44df-8f50-9317e26f10d4" status: 200 len: 1280 microversion: 2.1 time: 0.256631 Jun 05 08:26:22.796126 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 504/982] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:22 2022] GET /compute/v2.1/servers/05801050-4724-44df-8f50-9317e26f10d4 => generated 1280 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:22.905561 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-985bab51-244e-4ac1-b3f6-7561e09d5b3a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:22.906351 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-985bab51-244e-4ac1-b3f6-7561e09d5b3a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:22.922796 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-985bab51-244e-4ac1-b3f6-7561e09d5b3a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:22.923382 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-985bab51-244e-4ac1-b3f6-7561e09d5b3a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:22.924364 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-985bab51-244e-4ac1-b3f6-7561e09d5b3a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:22.925087 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-985bab51-244e-4ac1-b3f6-7561e09d5b3a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:22.965783 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-985bab51-244e-4ac1-b3f6-7561e09d5b3a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:22.968516 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-985bab51-244e-4ac1-b3f6-7561e09d5b3a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:22.972627 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-985bab51-244e-4ac1-b3f6-7561e09d5b3a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:23.136889 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-985bab51-244e-4ac1-b3f6-7561e09d5b3a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:23.160682 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-985bab51-244e-4ac1-b3f6-7561e09d5b3a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.261325 Jun 05 08:26:23.165125 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 505/983] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:22 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:23.193761 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2a38e835-438c-45f1-a92a-48d36b9e61a7 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:23.196314 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2a38e835-438c-45f1-a92a-48d36b9e61a7 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: fedc49cc-1b5e-4c16-ab6d-da3afb5e567d] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:23.202932 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2a38e835-438c-45f1-a92a-48d36b9e61a7 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:23.203774 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2a38e835-438c-45f1-a92a-48d36b9e61a7 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:23.204770 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2a38e835-438c-45f1-a92a-48d36b9e61a7 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:23.205370 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2a38e835-438c-45f1-a92a-48d36b9e61a7 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:23.218838 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5a1cfb08-7bf4-4832-b86c-9bf4e1dd9579 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:23.228585 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5a1cfb08-7bf4-4832-b86c-9bf4e1dd9579 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:23.234711 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5a1cfb08-7bf4-4832-b86c-9bf4e1dd9579 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:23.235923 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5a1cfb08-7bf4-4832-b86c-9bf4e1dd9579 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 1568 microversion: 2.25 time: 0.609640 Jun 05 08:26:23.236523 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 479/984] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:22 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 1568 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:23.253307 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-936e72a3-2b15-4cc2-af7f-304f601b4e82 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:23.253949 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-936e72a3-2b15-4cc2-af7f-304f601b4e82 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:23.259752 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=100 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:23.261672 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-936e72a3-2b15-4cc2-af7f-304f601b4e82 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:23.262199 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-936e72a3-2b15-4cc2-af7f-304f601b4e82 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:23.262997 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-936e72a3-2b15-4cc2-af7f-304f601b4e82 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:23.263501 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-936e72a3-2b15-4cc2-af7f-304f601b4e82 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:23.587319 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2a38e835-438c-45f1-a92a-48d36b9e61a7 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:23.598243 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2a38e835-438c-45f1-a92a-48d36b9e61a7 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d" status: 200 len: 1318 microversion: 2.1 time: 0.407602 Jun 05 08:26:23.598872 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 506/985] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:23 2022] GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d => generated 1318 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:23.602828 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-936e72a3-2b15-4cc2-af7f-304f601b4e82 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:23.617764 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-936e72a3-2b15-4cc2-af7f-304f601b4e82 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.372456 Jun 05 08:26:23.625950 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 480/986] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:23 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:23.653428 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-fe54dfba-de61-448d-9e7d-85e28499b43b req-12ee8f4d-3125-4b84-b8b9-d6e9326bc8c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fedc49cc-1b5e-4c16-ab6d-da3afb5e567d", "name": "network-vif-plugged", "status": "completed", "tag": "cb2b2764-b1e0-4358-bc3b-4a0b8b4f76b9"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:23.670981 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-fe54dfba-de61-448d-9e7d-85e28499b43b req-12ee8f4d-3125-4b84-b8b9-d6e9326bc8c4 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:23.671427 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-fe54dfba-de61-448d-9e7d-85e28499b43b req-12ee8f4d-3125-4b84-b8b9-d6e9326bc8c4 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:23.685416 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-fe54dfba-de61-448d-9e7d-85e28499b43b req-12ee8f4d-3125-4b84-b8b9-d6e9326bc8c4 service nova] Creating event network-vif-plugged:cb2b2764-b1e0-4358-bc3b-4a0b8b4f76b9 for instance fedc49cc-1b5e-4c16-ab6d-da3afb5e567d on n-h2-844739-1 Jun 05 08:26:23.691561 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-fe54dfba-de61-448d-9e7d-85e28499b43b req-12ee8f4d-3125-4b84-b8b9-d6e9326bc8c4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041951 Jun 05 08:26:23.692816 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 507/987] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:23.814305 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0c384721-60f3-485e-b228-ae429fd5bba8 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:23.815272 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0c384721-60f3-485e-b228-ae429fd5bba8 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 05801050-4724-44df-8f50-9317e26f10d4] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:23.823841 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0c384721-60f3-485e-b228-ae429fd5bba8 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:23.824755 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0c384721-60f3-485e-b228-ae429fd5bba8 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:23.825667 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0c384721-60f3-485e-b228-ae429fd5bba8 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:23.827134 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0c384721-60f3-485e-b228-ae429fd5bba8 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:23.942652 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0c384721-60f3-485e-b228-ae429fd5bba8 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:23.959505 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0c384721-60f3-485e-b228-ae429fd5bba8 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/05801050-4724-44df-8f50-9317e26f10d4" status: 200 len: 1278 microversion: 2.1 time: 0.150177 Jun 05 08:26:23.979541 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 481/988] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:23 2022] GET /compute/v2.1/servers/05801050-4724-44df-8f50-9317e26f10d4 => generated 1278 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:26:24.182366 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-15846196-fb58-4620-b440-81e0bf8dff0a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:24.183744 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-15846196-fb58-4620-b440-81e0bf8dff0a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:24.191381 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-15846196-fb58-4620-b440-81e0bf8dff0a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:24.192211 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-15846196-fb58-4620-b440-81e0bf8dff0a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:24.193066 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-15846196-fb58-4620-b440-81e0bf8dff0a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:24.193574 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-15846196-fb58-4620-b440-81e0bf8dff0a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:24.226918 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-15846196-fb58-4620-b440-81e0bf8dff0a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:24.227367 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-15846196-fb58-4620-b440-81e0bf8dff0a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:24.227815 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-15846196-fb58-4620-b440-81e0bf8dff0a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:24.255796 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5871fd35-f1ec-4ff4-ba87-106ed5bb772b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:24.256464 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5871fd35-f1ec-4ff4-ba87-106ed5bb772b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:24.263011 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5871fd35-f1ec-4ff4-ba87-106ed5bb772b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:24.265051 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5871fd35-f1ec-4ff4-ba87-106ed5bb772b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:24.266046 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5871fd35-f1ec-4ff4-ba87-106ed5bb772b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:24.266495 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5871fd35-f1ec-4ff4-ba87-106ed5bb772b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:24.277652 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-15846196-fb58-4620-b440-81e0bf8dff0a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:24.290908 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-15846196-fb58-4620-b440-81e0bf8dff0a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.112694 Jun 05 08:26:24.293798 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 508/989] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:24 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:24.482109 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5871fd35-f1ec-4ff4-ba87-106ed5bb772b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:24.501323 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5871fd35-f1ec-4ff4-ba87-106ed5bb772b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:24.503153 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5871fd35-f1ec-4ff4-ba87-106ed5bb772b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:24.504379 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5871fd35-f1ec-4ff4-ba87-106ed5bb772b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 1568 microversion: 2.25 time: 0.254304 Jun 05 08:26:24.504940 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 482/990] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:24 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 1568 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:26:24.616451 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a4216d3d-fecc-4dda-b561-eee74942e9c6 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:24.617379 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a4216d3d-fecc-4dda-b561-eee74942e9c6 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: fedc49cc-1b5e-4c16-ab6d-da3afb5e567d] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:24.630837 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a4216d3d-fecc-4dda-b561-eee74942e9c6 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:24.633075 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a4216d3d-fecc-4dda-b561-eee74942e9c6 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:24.634169 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a4216d3d-fecc-4dda-b561-eee74942e9c6 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:24.637127 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-89058792-0a15-458f-a719-18e41f7e1c99 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:24.637340 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a4216d3d-fecc-4dda-b561-eee74942e9c6 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:24.639272 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-89058792-0a15-458f-a719-18e41f7e1c99 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:24.649139 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-89058792-0a15-458f-a719-18e41f7e1c99 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:24.649963 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-89058792-0a15-458f-a719-18e41f7e1c99 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:24.651083 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-89058792-0a15-458f-a719-18e41f7e1c99 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:24.652011 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-89058792-0a15-458f-a719-18e41f7e1c99 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:24.924138 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a4216d3d-fecc-4dda-b561-eee74942e9c6 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:24.936898 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a4216d3d-fecc-4dda-b561-eee74942e9c6 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d" status: 200 len: 1318 microversion: 2.1 time: 0.325076 Jun 05 08:26:24.937648 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 509/991] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:24 2022] GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:24.941365 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-89058792-0a15-458f-a719-18e41f7e1c99 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:24.954171 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-89058792-0a15-458f-a719-18e41f7e1c99 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.321943 Jun 05 08:26:24.955712 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 483/992] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:24 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:24.987596 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-44db4f15-5483-4bcf-acf0-03ccdb2a5cb0 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:24.988272 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-44db4f15-5483-4bcf-acf0-03ccdb2a5cb0 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 05801050-4724-44df-8f50-9317e26f10d4] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:25.001857 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-44db4f15-5483-4bcf-acf0-03ccdb2a5cb0 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:25.002336 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-44db4f15-5483-4bcf-acf0-03ccdb2a5cb0 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:25.003812 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-44db4f15-5483-4bcf-acf0-03ccdb2a5cb0 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:25.004462 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-44db4f15-5483-4bcf-acf0-03ccdb2a5cb0 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:25.250131 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-04531cc9-f097-4405-811f-885137ecd5bf tempest-FloatingIPDetailsTestJSON-819258004 tempest-FloatingIPDetailsTestJSON-819258004-project] Action: 'create', calling method: .version_select at 0x7f2433973430>, body: {"pool": null} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:25.271940 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-44db4f15-5483-4bcf-acf0-03ccdb2a5cb0 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:25.344581 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-44db4f15-5483-4bcf-acf0-03ccdb2a5cb0 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/05801050-4724-44df-8f50-9317e26f10d4" status: 200 len: 1320 microversion: 2.1 time: 0.361127 Jun 05 08:26:25.345209 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 510/993] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:24 2022] GET /compute/v2.1/servers/05801050-4724-44df-8f50-9317e26f10d4 => generated 1320 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:25.351836 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1f4bd95b-60d3-4f87-a9e4-4f924c9ab942 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:25.352745 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1f4bd95b-60d3-4f87-a9e4-4f924c9ab942 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:25.374048 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1f4bd95b-60d3-4f87-a9e4-4f924c9ab942 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:25.374769 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1f4bd95b-60d3-4f87-a9e4-4f924c9ab942 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:25.375747 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1f4bd95b-60d3-4f87-a9e4-4f924c9ab942 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:25.377176 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1f4bd95b-60d3-4f87-a9e4-4f924c9ab942 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:25.455135 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1f4bd95b-60d3-4f87-a9e4-4f924c9ab942 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:25.455826 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1f4bd95b-60d3-4f87-a9e4-4f924c9ab942 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:25.456564 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-1f4bd95b-60d3-4f87-a9e4-4f924c9ab942 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:25.538015 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-1f4bd95b-60d3-4f87-a9e4-4f924c9ab942 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:25.553778 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1f4bd95b-60d3-4f87-a9e4-4f924c9ab942 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.206382 Jun 05 08:26:25.558939 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 511/994] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:25 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:25.567143 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-353063cd-d50d-4cbb-8524-1e6d7ae4ab2d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:25.568314 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-353063cd-d50d-4cbb-8524-1e6d7ae4ab2d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:25.586729 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-353063cd-d50d-4cbb-8524-1e6d7ae4ab2d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:25.587873 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-353063cd-d50d-4cbb-8524-1e6d7ae4ab2d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:25.590965 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-353063cd-d50d-4cbb-8524-1e6d7ae4ab2d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:25.591707 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-353063cd-d50d-4cbb-8524-1e6d7ae4ab2d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:25.873248 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-353063cd-d50d-4cbb-8524-1e6d7ae4ab2d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:25.882832 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-353063cd-d50d-4cbb-8524-1e6d7ae4ab2d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:25.885453 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-353063cd-d50d-4cbb-8524-1e6d7ae4ab2d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:25.887320 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-353063cd-d50d-4cbb-8524-1e6d7ae4ab2d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 1568 microversion: 2.25 time: 0.326971 Jun 05 08:26:25.888078 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 512/995] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:25 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 1568 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:25.898507 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-f1753814-6a07-4a3b-9c5f-670c0784f90d req-95790bc5-f2a4-4de7-887c-05be23345f3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d6c0691-aa2b-4d7f-b424-2a9129f285bb", "name": "network-vif-plugged", "status": "completed", "tag": "53d0d855-1312-418f-bb21-a68f6df44657"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:25.907716 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-f1753814-6a07-4a3b-9c5f-670c0784f90d req-95790bc5-f2a4-4de7-887c-05be23345f3c service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:25.908190 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-f1753814-6a07-4a3b-9c5f-670c0784f90d req-95790bc5-f2a4-4de7-887c-05be23345f3c service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:25.919453 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-f1753814-6a07-4a3b-9c5f-670c0784f90d req-95790bc5-f2a4-4de7-887c-05be23345f3c service nova] Creating event network-vif-plugged:53d0d855-1312-418f-bb21-a68f6df44657 for instance 5d6c0691-aa2b-4d7f-b424-2a9129f285bb on n-h1-844739-1 Jun 05 08:26:25.924959 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-f1753814-6a07-4a3b-9c5f-670c0784f90d req-95790bc5-f2a4-4de7-887c-05be23345f3c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030415 Jun 05 08:26:25.928511 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 513/996] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:25.957360 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4a5b588f-0989-477d-8076-c346c4095b95 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:25.958070 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4a5b588f-0989-477d-8076-c346c4095b95 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: fedc49cc-1b5e-4c16-ab6d-da3afb5e567d] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:25.970025 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4a5b588f-0989-477d-8076-c346c4095b95 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:25.970770 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4a5b588f-0989-477d-8076-c346c4095b95 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:25.981342 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4a5b588f-0989-477d-8076-c346c4095b95 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:25.981342 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4a5b588f-0989-477d-8076-c346c4095b95 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:26.251237 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4a5b588f-0989-477d-8076-c346c4095b95 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:26.267405 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4a5b588f-0989-477d-8076-c346c4095b95 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d" status: 200 len: 1467 microversion: 2.1 time: 0.314697 Jun 05 08:26:26.269359 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 514/997] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:25 2022] GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d => generated 1467 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:26:26.278744 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1403171d-e0a6-42ac-8b58-c438c7281499 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:26.280957 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1403171d-e0a6-42ac-8b58-c438c7281499 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:26.288529 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1403171d-e0a6-42ac-8b58-c438c7281499 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:26.289321 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1403171d-e0a6-42ac-8b58-c438c7281499 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:26.290318 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1403171d-e0a6-42ac-8b58-c438c7281499 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:26.290963 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1403171d-e0a6-42ac-8b58-c438c7281499 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:26.877167 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-1403171d-e0a6-42ac-8b58-c438c7281499 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:26.890005 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1403171d-e0a6-42ac-8b58-c438c7281499 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.614120 Jun 05 08:26:26.892194 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 515/998] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:26 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:26.909038 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6dd3efe8-cdc2-4d53-9a74-081e0edee5b5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:26.916368 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6dd3efe8-cdc2-4d53-9a74-081e0edee5b5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 5d6c0691-aa2b-4d7f-b424-2a9129f285bb] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:26.931717 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6dd3efe8-cdc2-4d53-9a74-081e0edee5b5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:26.933680 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6dd3efe8-cdc2-4d53-9a74-081e0edee5b5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:26.937331 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6dd3efe8-cdc2-4d53-9a74-081e0edee5b5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:26.938000 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6dd3efe8-cdc2-4d53-9a74-081e0edee5b5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:27.262858 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6dd3efe8-cdc2-4d53-9a74-081e0edee5b5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:27.272105 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6dd3efe8-cdc2-4d53-9a74-081e0edee5b5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/5d6c0691-aa2b-4d7f-b424-2a9129f285bb" status: 200 len: 1318 microversion: 2.1 time: 0.378575 Jun 05 08:26:27.274306 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 516/999] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:26 2022] GET /compute/v2.1/servers/5d6c0691-aa2b-4d7f-b424-2a9129f285bb => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:27.282454 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-18396b35-ebc4-4ce0-8d00-4bd344d2b62d tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:27.287717 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-18396b35-ebc4-4ce0-8d00-4bd344d2b62d tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 05801050-4724-44df-8f50-9317e26f10d4] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:27.294292 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-18396b35-ebc4-4ce0-8d00-4bd344d2b62d tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:27.295534 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-18396b35-ebc4-4ce0-8d00-4bd344d2b62d tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:27.296519 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-18396b35-ebc4-4ce0-8d00-4bd344d2b62d tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:27.297124 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-18396b35-ebc4-4ce0-8d00-4bd344d2b62d tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:27.562165 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-18396b35-ebc4-4ce0-8d00-4bd344d2b62d tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:27.578014 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-18396b35-ebc4-4ce0-8d00-4bd344d2b62d tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/05801050-4724-44df-8f50-9317e26f10d4" status: 200 len: 1320 microversion: 2.1 time: 0.302385 Jun 05 08:26:27.580381 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 517/1000] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:27 2022] GET /compute/v2.1/servers/05801050-4724-44df-8f50-9317e26f10d4 => generated 1320 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:27.593840 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2302f5b9-2571-4a93-b386-6823d1b3379f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:27.594750 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2302f5b9-2571-4a93-b386-6823d1b3379f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:27.603002 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2302f5b9-2571-4a93-b386-6823d1b3379f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:27.603703 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2302f5b9-2571-4a93-b386-6823d1b3379f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:27.605468 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2302f5b9-2571-4a93-b386-6823d1b3379f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:27.606528 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2302f5b9-2571-4a93-b386-6823d1b3379f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:27.660295 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2302f5b9-2571-4a93-b386-6823d1b3379f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:27.660902 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2302f5b9-2571-4a93-b386-6823d1b3379f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:27.661594 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-2302f5b9-2571-4a93-b386-6823d1b3379f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:27.717561 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2302f5b9-2571-4a93-b386-6823d1b3379f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:27.725467 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2302f5b9-2571-4a93-b386-6823d1b3379f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.143812 Jun 05 08:26:27.726454 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 518/1001] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:27 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:27.731179 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2a9a8aad-70b5-4bff-8ab4-519c29f741eb tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:27.731688 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2a9a8aad-70b5-4bff-8ab4-519c29f741eb tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: 9b80f5d2-a282-4ccc-8db3-c97fa829aefe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:27.738994 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2a9a8aad-70b5-4bff-8ab4-519c29f741eb tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:27.739794 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2a9a8aad-70b5-4bff-8ab4-519c29f741eb tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:27.740391 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2a9a8aad-70b5-4bff-8ab4-519c29f741eb tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:27.740906 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2a9a8aad-70b5-4bff-8ab4-519c29f741eb tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:27.768678 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2a9a8aad-70b5-4bff-8ab4-519c29f741eb tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: 9b80f5d2-a282-4ccc-8db3-c97fa829aefe] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:26:27.826458 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=100 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:27.900234 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-04531cc9-f097-4405-811f-885137ecd5bf tempest-FloatingIPDetailsTestJSON-819258004 tempest-FloatingIPDetailsTestJSON-819258004-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.788978 Jun 05 08:26:27.901005 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 484/1002] 10.222.0.33 () {60 vars in 1169 bytes} [Sun Jun 5 08:26:25 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:26:27.912804 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fca8f09c-bd87-4739-be28-92ddffa52ed2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:27.915294 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-fca8f09c-bd87-4739-be28-92ddffa52ed2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:27.922845 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2a9a8aad-70b5-4bff-8ab4-519c29f741eb tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe" status: 204 len: 0 microversion: 2.1 time: 0.193732 Jun 05 08:26:27.923201 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fca8f09c-bd87-4739-be28-92ddffa52ed2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:27.923678 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 519/1003] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:26:27 2022] DELETE /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:26:27.924152 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fca8f09c-bd87-4739-be28-92ddffa52ed2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:27.925201 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fca8f09c-bd87-4739-be28-92ddffa52ed2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:27.925827 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fca8f09c-bd87-4739-be28-92ddffa52ed2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:27.938741 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-102a3f4f-f9b8-4b7d-9661-b0049a1a7593 req-39425126-2e29-4f9d-a37f-a7263afda674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05801050-4724-44df-8f50-9317e26f10d4", "tag": "73dd3602-41ee-4997-8f16-54fb03878f91"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:27.966566 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-102a3f4f-f9b8-4b7d-9661-b0049a1a7593 req-39425126-2e29-4f9d-a37f-a7263afda674 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:27.968514 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-102a3f4f-f9b8-4b7d-9661-b0049a1a7593 req-39425126-2e29-4f9d-a37f-a7263afda674 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:28.012069 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-102a3f4f-f9b8-4b7d-9661-b0049a1a7593 req-39425126-2e29-4f9d-a37f-a7263afda674 service nova] Creating event network-changed:73dd3602-41ee-4997-8f16-54fb03878f91 for instance 05801050-4724-44df-8f50-9317e26f10d4 on n-h1-844739-1 Jun 05 08:26:28.033941 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-102a3f4f-f9b8-4b7d-9661-b0049a1a7593 req-39425126-2e29-4f9d-a37f-a7263afda674 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108154 Jun 05 08:26:28.036907 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 520/1004] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:28.044628 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-36b92f00-c30b-49cd-9d74-a867fa8546af tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:28.048779 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-36b92f00-c30b-49cd-9d74-a867fa8546af tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:28.066760 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-36b92f00-c30b-49cd-9d74-a867fa8546af tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:28.067879 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-36b92f00-c30b-49cd-9d74-a867fa8546af tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:28.074369 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-36b92f00-c30b-49cd-9d74-a867fa8546af tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:28.075347 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-36b92f00-c30b-49cd-9d74-a867fa8546af tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:28.229896 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-fca8f09c-bd87-4739-be28-92ddffa52ed2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:28.240484 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=100 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:28.246778 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-fca8f09c-bd87-4739-be28-92ddffa52ed2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:28.248379 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-fca8f09c-bd87-4739-be28-92ddffa52ed2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:28.250096 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fca8f09c-bd87-4739-be28-92ddffa52ed2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 1543 microversion: 2.25 time: 0.341326 Jun 05 08:26:28.250811 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 485/1005] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:27 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 1543 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:28.258035 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a235860f-33c1-4f59-9d9b-e12f79d8a9c0 tempest-FloatingIPDetailsTestJSON-819258004 tempest-FloatingIPDetailsTestJSON-819258004-project] Action: 'create', calling method: .version_select at 0x7f2433973d30>, body: {"pool": null} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:28.369872 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-36b92f00-c30b-49cd-9d74-a867fa8546af tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:28.379367 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-36b92f00-c30b-49cd-9d74-a867fa8546af tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.338852 Jun 05 08:26:28.380233 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 521/1006] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:28 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:28.390464 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a7c61eca-3b39-44b7-87c8-9476523aa5b3 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:28.391160 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a7c61eca-3b39-44b7-87c8-9476523aa5b3 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: 9b80f5d2-a282-4ccc-8db3-c97fa829aefe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:28.399423 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a7c61eca-3b39-44b7-87c8-9476523aa5b3 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:28.400755 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a7c61eca-3b39-44b7-87c8-9476523aa5b3 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:28.402405 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a7c61eca-3b39-44b7-87c8-9476523aa5b3 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:28.403527 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a7c61eca-3b39-44b7-87c8-9476523aa5b3 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:28.634038 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a7c61eca-3b39-44b7-87c8-9476523aa5b3 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:28.642772 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a7c61eca-3b39-44b7-87c8-9476523aa5b3 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe" status: 200 len: 1714 microversion: 2.1 time: 0.261353 Jun 05 08:26:28.643360 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 522/1007] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:28 2022] GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe => generated 1714 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:28.647618 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f075677d-c74f-4dc1-9641-c05a381f3afa tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Calling method '.version_select at 0x7f24338df430>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:28.650051 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f075677d-c74f-4dc1-9641-c05a381f3afa tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:28.656635 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f075677d-c74f-4dc1-9641-c05a381f3afa tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:28.666861 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f075677d-c74f-4dc1-9641-c05a381f3afa tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 2606 microversion: 2.25 time: 0.022472 Jun 05 08:26:28.667789 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 523/1008] 10.222.0.33 () {60 vars in 1183 bytes} [Sun Jun 5 08:26:28 2022] GET /compute/v2.1/os-migrations => generated 2606 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:28.673505 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e478d167-61f5-411d-9ec4-05275c01fc1e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:28.674535 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e478d167-61f5-411d-9ec4-05275c01fc1e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 5d6c0691-aa2b-4d7f-b424-2a9129f285bb] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:28.686499 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e478d167-61f5-411d-9ec4-05275c01fc1e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:28.686499 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e478d167-61f5-411d-9ec4-05275c01fc1e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:28.686499 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e478d167-61f5-411d-9ec4-05275c01fc1e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:28.686499 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e478d167-61f5-411d-9ec4-05275c01fc1e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:28.928724 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e478d167-61f5-411d-9ec4-05275c01fc1e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:28.939830 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e478d167-61f5-411d-9ec4-05275c01fc1e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/5d6c0691-aa2b-4d7f-b424-2a9129f285bb" status: 200 len: 1468 microversion: 2.1 time: 0.270645 Jun 05 08:26:28.940905 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 524/1009] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:28 2022] GET /compute/v2.1/servers/5d6c0691-aa2b-4d7f-b424-2a9129f285bb => generated 1468 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:28.959821 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1671f00b-64b0-4292-b006-017d340b1632 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:28.965620 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1671f00b-64b0-4292-b006-017d340b1632 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 05801050-4724-44df-8f50-9317e26f10d4] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:28.977056 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1671f00b-64b0-4292-b006-017d340b1632 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:28.980125 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1671f00b-64b0-4292-b006-017d340b1632 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:28.981058 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1671f00b-64b0-4292-b006-017d340b1632 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:28.988642 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1671f00b-64b0-4292-b006-017d340b1632 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:29.215927 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-1671f00b-64b0-4292-b006-017d340b1632 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:29.224474 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1671f00b-64b0-4292-b006-017d340b1632 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/05801050-4724-44df-8f50-9317e26f10d4" status: 200 len: 1320 microversion: 2.1 time: 0.276355 Jun 05 08:26:29.234243 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 525/1010] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:28 2022] GET /compute/v2.1/servers/05801050-4724-44df-8f50-9317e26f10d4 => generated 1320 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:29.240649 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b6a19bfd-7604-486e-b691-f15be4d2f781 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:29.241272 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b6a19bfd-7604-486e-b691-f15be4d2f781 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:29.247270 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b6a19bfd-7604-486e-b691-f15be4d2f781 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:29.247733 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b6a19bfd-7604-486e-b691-f15be4d2f781 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:29.249736 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b6a19bfd-7604-486e-b691-f15be4d2f781 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:29.250175 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b6a19bfd-7604-486e-b691-f15be4d2f781 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:29.486894 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-b6a19bfd-7604-486e-b691-f15be4d2f781 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lazy-loading 'services' on Instance uuid 476cc23e-487d-4d15-849e-208df0e985b1 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:29.501571 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b6a19bfd-7604-486e-b691-f15be4d2f781 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 2036 microversion: 2.25 time: 0.274814 Jun 05 08:26:29.502442 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 526/1011] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:29 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 2036 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:29.507268 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-70681da8-0e94-4b00-887f-8cad284aadc6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:29.508085 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-70681da8-0e94-4b00-887f-8cad284aadc6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:29.514579 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-70681da8-0e94-4b00-887f-8cad284aadc6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:29.515309 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-70681da8-0e94-4b00-887f-8cad284aadc6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:29.516261 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-70681da8-0e94-4b00-887f-8cad284aadc6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:29.516848 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-70681da8-0e94-4b00-887f-8cad284aadc6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:29.562098 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-70681da8-0e94-4b00-887f-8cad284aadc6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:29.562551 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-70681da8-0e94-4b00-887f-8cad284aadc6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:29.563591 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-70681da8-0e94-4b00-887f-8cad284aadc6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:29.578709 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=6 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:29.697831 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-70681da8-0e94-4b00-887f-8cad284aadc6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:29.710127 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-70681da8-0e94-4b00-887f-8cad284aadc6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.206457 Jun 05 08:26:29.710717 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 527/1012] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:29 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:29.722116 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b8820ada-f49a-4090-bf10-9a373a3dea81 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:29.727358 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b8820ada-f49a-4090-bf10-9a373a3dea81 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:29.728264 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b8820ada-f49a-4090-bf10-9a373a3dea81 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Searching by: {'reservation_id': 'r-f30vae1g', 'deleted': False, 'project_id': '5241947581244d30ba1528e6d5fad743'} {{(pid=119049) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 05 08:26:29.730986 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:29.742324 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b8820ada-f49a-4090-bf10-9a373a3dea81 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:29.742771 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b8820ada-f49a-4090-bf10-9a373a3dea81 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:29.743570 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b8820ada-f49a-4090-bf10-9a373a3dea81 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:29.744002 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b8820ada-f49a-4090-bf10-9a373a3dea81 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:29.861159 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.multi_cell_list [None req-b8820ada-f49a-4090-bf10-9a373a3dea81 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119049) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 05 08:26:29.930353 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a235860f-33c1-4f59-9d9b-e12f79d8a9c0 tempest-FloatingIPDetailsTestJSON-819258004 tempest-FloatingIPDetailsTestJSON-819258004-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.678159 Jun 05 08:26:29.937541 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 486/1013] 10.222.0.33 () {60 vars in 1169 bytes} [Sun Jun 5 08:26:28 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:29.941164 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b8820ada-f49a-4090-bf10-9a373a3dea81 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:29.942383 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-983e3e03-a280-46c8-a145-9765a3f4aa67 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:29.943195 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-983e3e03-a280-46c8-a145-9765a3f4aa67 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:29.948307 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b8820ada-f49a-4090-bf10-9a373a3dea81 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:29.948836 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b8820ada-f49a-4090-bf10-9a373a3dea81 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:29.951533 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-983e3e03-a280-46c8-a145-9765a3f4aa67 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:29.952708 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-983e3e03-a280-46c8-a145-9765a3f4aa67 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:29.953642 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-983e3e03-a280-46c8-a145-9765a3f4aa67 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:29.954504 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-983e3e03-a280-46c8-a145-9765a3f4aa67 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:30.138403 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b8820ada-f49a-4090-bf10-9a373a3dea81 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?reservation_id=r-f30vae1g" status: 200 len: 2928 microversion: 2.1 time: 0.425854 Jun 05 08:26:30.138403 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 528/1014] 10.222.0.33 () {58 vars in 1196 bytes} [Sun Jun 5 08:26:29 2022] GET /compute/v2.1/servers/detail?reservation_id=r-f30vae1g => generated 2928 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:30.145756 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2966318f-783f-4b10-b1ef-1fce5c884f8a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-514068032", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "a7010e4a-eda5-41d8-af56-68a4d3196193"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:30.162788 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-983e3e03-a280-46c8-a145-9765a3f4aa67 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:30.173044 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-983e3e03-a280-46c8-a145-9765a3f4aa67 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.234211 Jun 05 08:26:30.174270 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 487/1015] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:29 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:30.187994 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8b46e637-234d-4fb3-ac31-e79f29a8171a tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:30.188672 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8b46e637-234d-4fb3-ac31-e79f29a8171a tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: 9b80f5d2-a282-4ccc-8db3-c97fa829aefe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:30.196065 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8b46e637-234d-4fb3-ac31-e79f29a8171a tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:30.196540 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8b46e637-234d-4fb3-ac31-e79f29a8171a tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:30.197352 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8b46e637-234d-4fb3-ac31-e79f29a8171a tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:30.197753 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8b46e637-234d-4fb3-ac31-e79f29a8171a tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:30.198210 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:30.214536 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-2966318f-783f-4b10-b1ef-1fce5c884f8a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] validate_networks() for [('a7010e4a-eda5-41d8-af56-68a4d3196193', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:26:30.430265 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8b46e637-234d-4fb3-ac31-e79f29a8171a tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:30.439291 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8b46e637-234d-4fb3-ac31-e79f29a8171a tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe" status: 200 len: 1714 microversion: 2.1 time: 0.263833 Jun 05 08:26:30.440461 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 488/1016] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:30 2022] GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe => generated 1714 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:30.445235 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4edc0b01-4306-47f2-b9ac-2f86a854efa1 tempest-FloatingIPDetailsTestJSON-819258004 tempest-FloatingIPDetailsTestJSON-819258004-project] Action: 'create', calling method: .version_select at 0x7f2433861ee0>, body: {"pool": null} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:31.370898 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-2966318f-783f-4b10-b1ef-1fce5c884f8a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:26:31.372235 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-2966318f-783f-4b10-b1ef-1fce5c884f8a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:26:31.372904 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-2966318f-783f-4b10-b1ef-1fce5c884f8a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:26:31.373679 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-2966318f-783f-4b10-b1ef-1fce5c884f8a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:26:31.374503 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-2966318f-783f-4b10-b1ef-1fce5c884f8a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:26:31.392422 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2966318f-783f-4b10-b1ef-1fce5c884f8a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:31.393104 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2966318f-783f-4b10-b1ef-1fce5c884f8a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:31.394931 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2966318f-783f-4b10-b1ef-1fce5c884f8a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:31.395563 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2966318f-783f-4b10-b1ef-1fce5c884f8a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:31.446843 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-2966318f-783f-4b10-b1ef-1fce5c884f8a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Getting quotas for project fb5c1766af9c4e079f74b67177db0246. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:26:31.467594 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-2966318f-783f-4b10-b1ef-1fce5c884f8a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Getting quotas for user 03720c07cc1e4ae6a2c621b1d3feed9a and project fb5c1766af9c4e079f74b67177db0246. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:26:31.504308 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2966318f-783f-4b10-b1ef-1fce5c884f8a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:26:31.507829 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2966318f-783f-4b10-b1ef-1fce5c884f8a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:26:31.591985 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2966318f-783f-4b10-b1ef-1fce5c884f8a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.451860 Jun 05 08:26:31.592974 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 529/1017] 10.222.0.33 () {62 vars in 1187 bytes} [Sun Jun 5 08:26:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1454 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 05 08:26:31.603821 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-7821477d-f58a-4211-b4dc-84c2bf98753b req-c55e5b45-55f9-44b2-aeeb-53e2149b8635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e3f0d36-6bfe-4cb0-a001-4940b6da70e5", "tag": "da3f0e4a-bf17-487b-ab03-a4b1fecf0f16"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:31.614107 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-7821477d-f58a-4211-b4dc-84c2bf98753b req-c55e5b45-55f9-44b2-aeeb-53e2149b8635 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:31.614980 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-7821477d-f58a-4211-b4dc-84c2bf98753b req-c55e5b45-55f9-44b2-aeeb-53e2149b8635 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:31.630162 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-7821477d-f58a-4211-b4dc-84c2bf98753b req-c55e5b45-55f9-44b2-aeeb-53e2149b8635 service nova] Creating event network-changed:da3f0e4a-bf17-487b-ab03-a4b1fecf0f16 for instance 9e3f0d36-6bfe-4cb0-a001-4940b6da70e5 on n-h1-844739-1 Jun 05 08:26:31.635665 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-7821477d-f58a-4211-b4dc-84c2bf98753b req-c55e5b45-55f9-44b2-aeeb-53e2149b8635 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036178 Jun 05 08:26:31.636998 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 530/1018] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:31.644252 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9357c32c-aff4-49b4-9549-a90f5ab2e45b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:31.691385 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.compute.server_groups [None req-9357c32c-aff4-49b4-9549-a90f5ab2e45b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Querying cell ceb8701a-c729-4596-86e5-c56dbc5a8933(cell1) for 2 instances {{(pid=119049) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 05 08:26:31.692414 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9357c32c-aff4-49b4-9549-a90f5ab2e45b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:31.693069 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9357c32c-aff4-49b4-9549-a90f5ab2e45b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:31.739985 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9357c32c-aff4-49b4-9549-a90f5ab2e45b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/c495f782-f724-4f9f-829f-175dec3e3807" status: 200 len: 270 microversion: 2.1 time: 0.101564 Jun 05 08:26:31.742638 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 531/1019] 10.222.0.33 () {58 vars in 1262 bytes} [Sun Jun 5 08:26:31 2022] GET /compute/v2.1/os-server-groups/c495f782-f724-4f9f-829f-175dec3e3807 => generated 270 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:31.755044 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d9014d75-1def-482a-9ad1-adca1d9c911f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:31.755801 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d9014d75-1def-482a-9ad1-adca1d9c911f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 05801050-4724-44df-8f50-9317e26f10d4] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:31.766044 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d9014d75-1def-482a-9ad1-adca1d9c911f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:31.766788 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d9014d75-1def-482a-9ad1-adca1d9c911f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:31.769520 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d9014d75-1def-482a-9ad1-adca1d9c911f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:31.770343 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d9014d75-1def-482a-9ad1-adca1d9c911f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:32.115620 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d9014d75-1def-482a-9ad1-adca1d9c911f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:32.124966 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d9014d75-1def-482a-9ad1-adca1d9c911f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/05801050-4724-44df-8f50-9317e26f10d4" status: 200 len: 1320 microversion: 2.1 time: 0.381228 Jun 05 08:26:32.134760 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 532/1020] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:31 2022] GET /compute/v2.1/servers/05801050-4724-44df-8f50-9317e26f10d4 => generated 1320 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:32.141198 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fb3ac3c6-47f2-4bd7-9cce-f59061af3ebd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:32.142097 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-fb3ac3c6-47f2-4bd7-9cce-f59061af3ebd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:32.149272 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fb3ac3c6-47f2-4bd7-9cce-f59061af3ebd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:32.149987 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fb3ac3c6-47f2-4bd7-9cce-f59061af3ebd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:32.150958 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fb3ac3c6-47f2-4bd7-9cce-f59061af3ebd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:32.151599 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fb3ac3c6-47f2-4bd7-9cce-f59061af3ebd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:32.200053 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fb3ac3c6-47f2-4bd7-9cce-f59061af3ebd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:32.200832 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fb3ac3c6-47f2-4bd7-9cce-f59061af3ebd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:32.201584 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-fb3ac3c6-47f2-4bd7-9cce-f59061af3ebd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:32.333207 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-fb3ac3c6-47f2-4bd7-9cce-f59061af3ebd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:32.342524 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fb3ac3c6-47f2-4bd7-9cce-f59061af3ebd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.205533 Jun 05 08:26:32.343118 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 533/1021] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:32 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:32.347601 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5f387017-7c15-4fb9-84ad-63a34df5e54f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:32.348986 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5f387017-7c15-4fb9-84ad-63a34df5e54f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:32.357051 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5f387017-7c15-4fb9-84ad-63a34df5e54f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:32.358204 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5f387017-7c15-4fb9-84ad-63a34df5e54f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:32.359040 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5f387017-7c15-4fb9-84ad-63a34df5e54f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:32.359659 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5f387017-7c15-4fb9-84ad-63a34df5e54f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:32.584272 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5f387017-7c15-4fb9-84ad-63a34df5e54f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:32.595075 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5f387017-7c15-4fb9-84ad-63a34df5e54f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.250883 Jun 05 08:26:32.595663 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 534/1022] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:32 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:32.600394 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2639eccd-08b8-481f-8153-d390b92c9282 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:32.601008 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2639eccd-08b8-481f-8153-d390b92c9282 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: 9b80f5d2-a282-4ccc-8db3-c97fa829aefe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:32.616382 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2639eccd-08b8-481f-8153-d390b92c9282 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:32.617890 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2639eccd-08b8-481f-8153-d390b92c9282 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:32.619016 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2639eccd-08b8-481f-8153-d390b92c9282 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:32.620069 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2639eccd-08b8-481f-8153-d390b92c9282 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:32.661459 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2639eccd-08b8-481f-8153-d390b92c9282 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:32.662515 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2639eccd-08b8-481f-8153-d390b92c9282 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:32.663252 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-2639eccd-08b8-481f-8153-d390b92c9282 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lazy-loading 'fault' on Instance uuid 9b80f5d2-a282-4ccc-8db3-c97fa829aefe {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:32.755827 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2639eccd-08b8-481f-8153-d390b92c9282 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:32.767794 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2639eccd-08b8-481f-8153-d390b92c9282 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe" status: 200 len: 1409 microversion: 2.1 time: 0.171053 Jun 05 08:26:32.769225 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 535/1023] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:32 2022] GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe => generated 1409 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:32.776886 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4ec52d42-9227-4ce9-986f-62149532b238 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:32.778154 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4ec52d42-9227-4ce9-986f-62149532b238 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:32.787403 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4ec52d42-9227-4ce9-986f-62149532b238 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:32.788458 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4ec52d42-9227-4ce9-986f-62149532b238 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:32.790027 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4ec52d42-9227-4ce9-986f-62149532b238 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:32.790836 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4ec52d42-9227-4ce9-986f-62149532b238 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:32.814794 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:32.886670 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4ec52d42-9227-4ce9-986f-62149532b238 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:32.895169 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4ec52d42-9227-4ce9-986f-62149532b238 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:32.896718 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4ec52d42-9227-4ce9-986f-62149532b238 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:32.897778 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4ec52d42-9227-4ce9-986f-62149532b238 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1265 microversion: 2.25 time: 0.126896 Jun 05 08:26:32.898347 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 536/1024] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:32 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1265 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:32.902948 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-8f5ab707-f79e-4650-b50f-7e7bb35ec606 req-db327185-9cab-4332-960e-3cfae44ebf89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "984c9830-3956-48fd-ab9e-8aad63a9cd97", "name": "network-vif-unplugged", "status": "completed", "tag": "4128ae0a-58ff-43c8-ad0a-94d8da88b8dc"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:32.911671 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-8f5ab707-f79e-4650-b50f-7e7bb35ec606 req-db327185-9cab-4332-960e-3cfae44ebf89 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:32.912255 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-8f5ab707-f79e-4650-b50f-7e7bb35ec606 req-db327185-9cab-4332-960e-3cfae44ebf89 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:32.923296 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-8f5ab707-f79e-4650-b50f-7e7bb35ec606 req-db327185-9cab-4332-960e-3cfae44ebf89 service nova] Creating event network-vif-unplugged:4128ae0a-58ff-43c8-ad0a-94d8da88b8dc for instance 984c9830-3956-48fd-ab9e-8aad63a9cd97 on n-h2-844739-1 Jun 05 08:26:32.928363 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-8f5ab707-f79e-4650-b50f-7e7bb35ec606 req-db327185-9cab-4332-960e-3cfae44ebf89 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028850 Jun 05 08:26:32.928961 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 537/1025] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:32.933869 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a095d6ad-da1a-4488-a2de-30c1aa3bc1a2 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:32.934563 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a095d6ad-da1a-4488-a2de-30c1aa3bc1a2 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] [instance: 5d6c0691-aa2b-4d7f-b424-2a9129f285bb] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:32.941345 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a095d6ad-da1a-4488-a2de-30c1aa3bc1a2 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:32.941791 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a095d6ad-da1a-4488-a2de-30c1aa3bc1a2 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:32.942728 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a095d6ad-da1a-4488-a2de-30c1aa3bc1a2 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:32.943160 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a095d6ad-da1a-4488-a2de-30c1aa3bc1a2 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:33.175391 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a095d6ad-da1a-4488-a2de-30c1aa3bc1a2 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5d6c0691-aa2b-4d7f-b424-2a9129f285bb" status: 200 len: 1619 microversion: 2.1 time: 0.245184 Jun 05 08:26:33.175981 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 538/1026] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:32 2022] GET /compute/v2.1/servers/5d6c0691-aa2b-4d7f-b424-2a9129f285bb => generated 1619 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:33.176115 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4edc0b01-4306-47f2-b9ac-2f86a854efa1 tempest-FloatingIPDetailsTestJSON-819258004 tempest-FloatingIPDetailsTestJSON-819258004-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 2.734172 Jun 05 08:26:33.183032 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 489/1027] 10.222.0.33 () {60 vars in 1169 bytes} [Sun Jun 5 08:26:30 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 2736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:33.183209 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3d9d04ad-9cf2-4692-adf7-195631bc25f4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:33.183209 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3d9d04ad-9cf2-4692-adf7-195631bc25f4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: e4c09fb3-f67f-4b07-a992-2e70683932bd] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:33.183373 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-790e0108-804c-446d-90b3-afac11964ee4 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:33.183373 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-790e0108-804c-446d-90b3-afac11964ee4 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 05801050-4724-44df-8f50-9317e26f10d4] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:33.188868 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3d9d04ad-9cf2-4692-adf7-195631bc25f4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:33.189326 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3d9d04ad-9cf2-4692-adf7-195631bc25f4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:33.190101 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3d9d04ad-9cf2-4692-adf7-195631bc25f4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:33.190545 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3d9d04ad-9cf2-4692-adf7-195631bc25f4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:33.191312 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-790e0108-804c-446d-90b3-afac11964ee4 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:33.191776 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-790e0108-804c-446d-90b3-afac11964ee4 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:33.192612 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-790e0108-804c-446d-90b3-afac11964ee4 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:33.193063 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-790e0108-804c-446d-90b3-afac11964ee4 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:33.217924 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3d9d04ad-9cf2-4692-adf7-195631bc25f4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: e4c09fb3-f67f-4b07-a992-2e70683932bd] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:26:33.294219 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3d9d04ad-9cf2-4692-adf7-195631bc25f4 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd" status: 204 len: 0 microversion: 2.1 time: 0.116967 Jun 05 08:26:33.295394 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 539/1028] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:26:33 2022] DELETE /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:26:33.301298 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b0dee4e4-4939-45d2-a81a-fe7452de5f86 tempest-FloatingIPDetailsTestJSON-819258004 tempest-FloatingIPDetailsTestJSON-819258004-project] Action: 'create', calling method: .version_select at 0x7f2433992280>, body: {"pool": null} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:33.404586 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-790e0108-804c-446d-90b3-afac11964ee4 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:33.412430 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-790e0108-804c-446d-90b3-afac11964ee4 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/05801050-4724-44df-8f50-9317e26f10d4" status: 200 len: 1320 microversion: 2.1 time: 0.234316 Jun 05 08:26:33.412998 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 490/1029] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:33 2022] GET /compute/v2.1/servers/05801050-4724-44df-8f50-9317e26f10d4 => generated 1320 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:33.417487 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-017cb76b-57a7-4427-a198-e40443c1f6b9 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:33.418088 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-017cb76b-57a7-4427-a198-e40443c1f6b9 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] [instance: fedc49cc-1b5e-4c16-ab6d-da3afb5e567d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:33.425023 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-017cb76b-57a7-4427-a198-e40443c1f6b9 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:33.425485 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-017cb76b-57a7-4427-a198-e40443c1f6b9 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:33.426305 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-017cb76b-57a7-4427-a198-e40443c1f6b9 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:33.426749 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-017cb76b-57a7-4427-a198-e40443c1f6b9 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:33.628823 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-017cb76b-57a7-4427-a198-e40443c1f6b9 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d" status: 200 len: 1618 microversion: 2.1 time: 0.214581 Jun 05 08:26:33.629406 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 491/1030] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:33 2022] GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d => generated 1618 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:33.633936 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f2dcf768-b623-4650-9746-c140af48f1c6 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:33.634549 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f2dcf768-b623-4650-9746-c140af48f1c6 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: e4c09fb3-f67f-4b07-a992-2e70683932bd] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:33.640448 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f2dcf768-b623-4650-9746-c140af48f1c6 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:33.640911 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f2dcf768-b623-4650-9746-c140af48f1c6 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:33.641761 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f2dcf768-b623-4650-9746-c140af48f1c6 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:33.642110 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f2dcf768-b623-4650-9746-c140af48f1c6 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:33.686938 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f2dcf768-b623-4650-9746-c140af48f1c6 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:33.687387 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f2dcf768-b623-4650-9746-c140af48f1c6 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:33.687842 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-f2dcf768-b623-4650-9746-c140af48f1c6 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lazy-loading 'fault' on Instance uuid e4c09fb3-f67f-4b07-a992-2e70683932bd {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:33.748175 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f2dcf768-b623-4650-9746-c140af48f1c6 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:33.758512 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f2dcf768-b623-4650-9746-c140af48f1c6 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd" status: 200 len: 1415 microversion: 2.1 time: 0.128088 Jun 05 08:26:33.759082 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 492/1031] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:33 2022] GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd => generated 1415 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:33.771949 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-88a085af-3a9c-41d5-a9eb-f656b7b8a45b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:33.772780 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-88a085af-3a9c-41d5-a9eb-f656b7b8a45b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:33.779675 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-88a085af-3a9c-41d5-a9eb-f656b7b8a45b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:33.780188 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-88a085af-3a9c-41d5-a9eb-f656b7b8a45b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:33.781163 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-88a085af-3a9c-41d5-a9eb-f656b7b8a45b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:33.781660 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-88a085af-3a9c-41d5-a9eb-f656b7b8a45b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:33.817917 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-88a085af-3a9c-41d5-a9eb-f656b7b8a45b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:33.818375 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-88a085af-3a9c-41d5-a9eb-f656b7b8a45b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:33.818839 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-88a085af-3a9c-41d5-a9eb-f656b7b8a45b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:33.890931 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-88a085af-3a9c-41d5-a9eb-f656b7b8a45b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:33.898341 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-88a085af-3a9c-41d5-a9eb-f656b7b8a45b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.138101 Jun 05 08:26:33.898904 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 493/1032] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:33 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:33.903719 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fe8a4970-ec83-498c-b209-f5cc7652e67f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:33.905576 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-fe8a4970-ec83-498c-b209-f5cc7652e67f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:33.911344 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fe8a4970-ec83-498c-b209-f5cc7652e67f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:33.911798 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fe8a4970-ec83-498c-b209-f5cc7652e67f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:33.912627 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fe8a4970-ec83-498c-b209-f5cc7652e67f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:33.913062 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fe8a4970-ec83-498c-b209-f5cc7652e67f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:34.134607 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-fe8a4970-ec83-498c-b209-f5cc7652e67f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:34.144811 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fe8a4970-ec83-498c-b209-f5cc7652e67f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.244903 Jun 05 08:26:34.145391 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 494/1033] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:33 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:34.149861 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-73ba63f0-dec6-4f3b-871c-9ffd5951838c req-4ab585ec-a27d-4adb-ae7e-45c14b397a88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b80f5d2-a282-4ccc-8db3-c97fa829aefe", "name": "network-vif-deleted", "tag": "dd1eaf3c-4246-487f-b193-efb1262f0dba"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:34.158454 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-73ba63f0-dec6-4f3b-871c-9ffd5951838c req-4ab585ec-a27d-4adb-ae7e-45c14b397a88 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:34.158871 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-73ba63f0-dec6-4f3b-871c-9ffd5951838c req-4ab585ec-a27d-4adb-ae7e-45c14b397a88 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:34.170844 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-73ba63f0-dec6-4f3b-871c-9ffd5951838c req-4ab585ec-a27d-4adb-ae7e-45c14b397a88 service nova] Creating event network-vif-deleted:dd1eaf3c-4246-487f-b193-efb1262f0dba for instance 9b80f5d2-a282-4ccc-8db3-c97fa829aefe on n-h2-844739-1 Jun 05 08:26:34.176645 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-73ba63f0-dec6-4f3b-871c-9ffd5951838c req-4ab585ec-a27d-4adb-ae7e-45c14b397a88 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029819 Jun 05 08:26:34.177540 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 495/1034] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:34.182436 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-73b273da-10b8-48a8-8605-ce647bf9cea8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1913206993", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "8719f86c-4f4f-4c65-b580-c5d526d05175"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:34.234574 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-73b273da-10b8-48a8-8605-ce647bf9cea8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] validate_networks() for None {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:26:34.568510 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-73b273da-10b8-48a8-8605-ce647bf9cea8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:26:34.568940 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-73b273da-10b8-48a8-8605-ce647bf9cea8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:26:34.569418 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-73b273da-10b8-48a8-8605-ce647bf9cea8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:26:34.569830 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-73b273da-10b8-48a8-8605-ce647bf9cea8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:26:34.570248 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-73b273da-10b8-48a8-8605-ce647bf9cea8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:26:34.579844 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-73b273da-10b8-48a8-8605-ce647bf9cea8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:34.580517 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-73b273da-10b8-48a8-8605-ce647bf9cea8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:34.581332 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-73b273da-10b8-48a8-8605-ce647bf9cea8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:34.581779 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-73b273da-10b8-48a8-8605-ce647bf9cea8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:34.599577 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-73b273da-10b8-48a8-8605-ce647bf9cea8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for project 5241947581244d30ba1528e6d5fad743. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:26:34.604463 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-73b273da-10b8-48a8-8605-ce647bf9cea8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for user 27beb829232e464092b06d904b9d6ec0 and project 5241947581244d30ba1528e6d5fad743. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:26:34.616831 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-73b273da-10b8-48a8-8605-ce647bf9cea8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:26:34.619252 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-73b273da-10b8-48a8-8605-ce647bf9cea8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 698ff3cb-adbd-40f3-92e8-5106c2ef6268] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:26:34.666713 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-73b273da-10b8-48a8-8605-ce647bf9cea8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.488084 Jun 05 08:26:34.667593 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 496/1035] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:26:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:26:34.673083 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-60e9265b-170e-4bec-be41-f79178d711a1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:34.673683 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-60e9265b-170e-4bec-be41-f79178d711a1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:34.681459 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-60e9265b-170e-4bec-be41-f79178d711a1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:34.682205 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-60e9265b-170e-4bec-be41-f79178d711a1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:34.683364 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-60e9265b-170e-4bec-be41-f79178d711a1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:34.684221 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-60e9265b-170e-4bec-be41-f79178d711a1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:34.780188 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-60e9265b-170e-4bec-be41-f79178d711a1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:34.798957 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-60e9265b-170e-4bec-be41-f79178d711a1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:34.800592 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-60e9265b-170e-4bec-be41-f79178d711a1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:34.801850 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-60e9265b-170e-4bec-be41-f79178d711a1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1265 microversion: 2.25 time: 0.133531 Jun 05 08:26:34.802722 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 497/1036] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:34 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1265 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:34.806970 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2070bb26-ca40-434f-beb0-ab97f2aedd3c tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:34.807584 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2070bb26-ca40-434f-beb0-ab97f2aedd3c tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 05801050-4724-44df-8f50-9317e26f10d4] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:34.813601 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2070bb26-ca40-434f-beb0-ab97f2aedd3c tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:34.814059 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2070bb26-ca40-434f-beb0-ab97f2aedd3c tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:34.814834 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2070bb26-ca40-434f-beb0-ab97f2aedd3c tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:34.815281 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2070bb26-ca40-434f-beb0-ab97f2aedd3c tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:34.962099 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b0dee4e4-4939-45d2-a81a-fe7452de5f86 tempest-FloatingIPDetailsTestJSON-819258004 tempest-FloatingIPDetailsTestJSON-819258004-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.665275 Jun 05 08:26:34.964416 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 540/1037] 10.222.0.33 () {60 vars in 1169 bytes} [Sun Jun 5 08:26:33 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:34.970900 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6876fd42-1edd-48bb-aef3-f15fe73baa84 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:34.971841 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6876fd42-1edd-48bb-aef3-f15fe73baa84 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 698ff3cb-adbd-40f3-92e8-5106c2ef6268] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:35.023387 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2070bb26-ca40-434f-beb0-ab97f2aedd3c tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:35.033117 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2070bb26-ca40-434f-beb0-ab97f2aedd3c tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/05801050-4724-44df-8f50-9317e26f10d4" status: 200 len: 1320 microversion: 2.1 time: 0.229682 Jun 05 08:26:35.034102 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 498/1038] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:34 2022] GET /compute/v2.1/servers/05801050-4724-44df-8f50-9317e26f10d4 => generated 1320 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:35.039941 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f06e46aa-0b46-4c21-bf66-67ecd259019e tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:35.040710 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f06e46aa-0b46-4c21-bf66-67ecd259019e tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: e4c09fb3-f67f-4b07-a992-2e70683932bd] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:35.043088 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6876fd42-1edd-48bb-aef3-f15fe73baa84 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:35.047664 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f06e46aa-0b46-4c21-bf66-67ecd259019e tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:35.048159 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f06e46aa-0b46-4c21-bf66-67ecd259019e tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:35.049150 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f06e46aa-0b46-4c21-bf66-67ecd259019e tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:35.049591 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f06e46aa-0b46-4c21-bf66-67ecd259019e tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:35.051788 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6876fd42-1edd-48bb-aef3-f15fe73baa84 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/698ff3cb-adbd-40f3-92e8-5106c2ef6268" status: 200 len: 1217 microversion: 2.1 time: 0.087690 Jun 05 08:26:35.062394 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 541/1039] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:34 2022] GET /compute/v2.1/servers/698ff3cb-adbd-40f3-92e8-5106c2ef6268 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:35.062394 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9dcf7372-2f40-4a39-aa02-be873f768fbe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:35.062394 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9dcf7372-2f40-4a39-aa02-be873f768fbe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:35.068561 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9dcf7372-2f40-4a39-aa02-be873f768fbe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:35.069211 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9dcf7372-2f40-4a39-aa02-be873f768fbe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:35.070004 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9dcf7372-2f40-4a39-aa02-be873f768fbe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:35.070447 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9dcf7372-2f40-4a39-aa02-be873f768fbe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:35.085824 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f06e46aa-0b46-4c21-bf66-67ecd259019e tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:35.086270 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f06e46aa-0b46-4c21-bf66-67ecd259019e tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:35.086952 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-f06e46aa-0b46-4c21-bf66-67ecd259019e tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lazy-loading 'fault' on Instance uuid e4c09fb3-f67f-4b07-a992-2e70683932bd {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:35.105621 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9dcf7372-2f40-4a39-aa02-be873f768fbe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:35.106076 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9dcf7372-2f40-4a39-aa02-be873f768fbe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:35.106531 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-9dcf7372-2f40-4a39-aa02-be873f768fbe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:35.134956 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f06e46aa-0b46-4c21-bf66-67ecd259019e tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:35.144569 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f06e46aa-0b46-4c21-bf66-67ecd259019e tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd" status: 200 len: 1415 microversion: 2.1 time: 0.109124 Jun 05 08:26:35.145168 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 499/1040] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:35 2022] GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd => generated 1415 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:35.149737 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-fabc1dfa-40dd-4adf-bef8-d252bd2071a6 req-7106fda3-830d-4845-9c9d-4569f5829359 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "984c9830-3956-48fd-ab9e-8aad63a9cd97", "tag": "4128ae0a-58ff-43c8-ad0a-94d8da88b8dc"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:35.173611 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9dcf7372-2f40-4a39-aa02-be873f768fbe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:35.180080 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-fabc1dfa-40dd-4adf-bef8-d252bd2071a6 req-7106fda3-830d-4845-9c9d-4569f5829359 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:35.180723 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-fabc1dfa-40dd-4adf-bef8-d252bd2071a6 req-7106fda3-830d-4845-9c9d-4569f5829359 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:35.182883 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9dcf7372-2f40-4a39-aa02-be873f768fbe tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.129164 Jun 05 08:26:35.183852 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 542/1041] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:35 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:35.196502 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bb8e38e6-6d0a-4b01-a442-8fd9c87c7c1a tempest-FloatingIPDetailsTestJSON-819258004 tempest-FloatingIPDetailsTestJSON-819258004-project] Calling method '.version_select at 0x7f243392ab80>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:35.197310 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-fabc1dfa-40dd-4adf-bef8-d252bd2071a6 req-7106fda3-830d-4845-9c9d-4569f5829359 service nova] Creating event network-changed:4128ae0a-58ff-43c8-ad0a-94d8da88b8dc for instance 984c9830-3956-48fd-ab9e-8aad63a9cd97 on n-h2-844739-1 Jun 05 08:26:35.202816 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-fabc1dfa-40dd-4adf-bef8-d252bd2071a6 req-7106fda3-830d-4845-9c9d-4569f5829359 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056295 Jun 05 08:26:35.212419 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 500/1042] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:35.221941 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d980a33f-f903-4b18-bdfc-19619a37f070 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:35.222762 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d980a33f-f903-4b18-bdfc-19619a37f070 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:35.230609 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d980a33f-f903-4b18-bdfc-19619a37f070 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:35.230609 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d980a33f-f903-4b18-bdfc-19619a37f070 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:35.230995 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d980a33f-f903-4b18-bdfc-19619a37f070 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:35.231394 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d980a33f-f903-4b18-bdfc-19619a37f070 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:35.467066 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d980a33f-f903-4b18-bdfc-19619a37f070 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:35.475641 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d980a33f-f903-4b18-bdfc-19619a37f070 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.261939 Jun 05 08:26:35.485207 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 501/1043] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:35 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:35.486305 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e9c7cf2b-bf8a-4c2a-a64e-1200a8c197a5 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '.version_select at 0x7f2433973670>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:35.494698 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bb8e38e6-6d0a-4b01-a442-8fd9c87c7c1a tempest-FloatingIPDetailsTestJSON-819258004 tempest-FloatingIPDetailsTestJSON-819258004-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/6ebe8a01-c0e4-4e0b-9afa-bc0b7a021ac2" status: 200 len: 142 microversion: 2.1 time: 0.309781 Jun 05 08:26:35.495294 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 543/1044] 10.222.0.33 () {58 vars in 1259 bytes} [Sun Jun 5 08:26:35 2022] GET /compute/v2.1/os-floating-ips/6ebe8a01-c0e4-4e0b-9afa-bc0b7a021ac2 => generated 142 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:35.507858 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-75b605f8-aac1-4e46-9ab3-d29bfc3ce082 tempest-FloatingIPDetailsTestJSON-819258004 tempest-FloatingIPDetailsTestJSON-819258004-project] Calling method '.version_select at 0x7f243391a940>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:35.509482 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e9c7cf2b-bf8a-4c2a-a64e-1200a8c197a5 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1041185333" status: 202 len: 0 microversion: 2.1 time: 0.032164 Jun 05 08:26:35.510278 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 502/1045] 10.222.0.33 () {58 vars in 1220 bytes} [Sun Jun 5 08:26:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1041185333 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:26:35.824310 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-07103e78-4108-4b1c-be99-81bf62f3c43f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:35.827191 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-07103e78-4108-4b1c-be99-81bf62f3c43f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:35.841000 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-07103e78-4108-4b1c-be99-81bf62f3c43f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:35.842265 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-07103e78-4108-4b1c-be99-81bf62f3c43f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:35.848280 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-07103e78-4108-4b1c-be99-81bf62f3c43f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:35.849137 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-07103e78-4108-4b1c-be99-81bf62f3c43f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:36.049274 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-07103e78-4108-4b1c-be99-81bf62f3c43f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:36.067484 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-07103e78-4108-4b1c-be99-81bf62f3c43f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:36.070893 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-07103e78-4108-4b1c-be99-81bf62f3c43f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:36.072267 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-07103e78-4108-4b1c-be99-81bf62f3c43f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1265 microversion: 2.25 time: 0.252668 Jun 05 08:26:36.085568 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 503/1046] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:35 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1265 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:36.099451 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c947bfaa-edeb-4f0b-9bf9-a28152a5fde1 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:36.103601 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c947bfaa-edeb-4f0b-9bf9-a28152a5fde1 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 05801050-4724-44df-8f50-9317e26f10d4] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:36.121987 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c947bfaa-edeb-4f0b-9bf9-a28152a5fde1 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:36.122822 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c947bfaa-edeb-4f0b-9bf9-a28152a5fde1 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:36.123976 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c947bfaa-edeb-4f0b-9bf9-a28152a5fde1 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:36.124624 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c947bfaa-edeb-4f0b-9bf9-a28152a5fde1 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:36.964952 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c947bfaa-edeb-4f0b-9bf9-a28152a5fde1 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:36.978866 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c947bfaa-edeb-4f0b-9bf9-a28152a5fde1 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/05801050-4724-44df-8f50-9317e26f10d4" status: 200 len: 1320 microversion: 2.1 time: 0.891975 Jun 05 08:26:36.979461 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 504/1047] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:36 2022] GET /compute/v2.1/servers/05801050-4724-44df-8f50-9317e26f10d4 => generated 1320 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:36.984669 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3b0b70c2-418b-4e81-8001-3f6bfe83d534 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:36.985814 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3b0b70c2-418b-4e81-8001-3f6bfe83d534 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 698ff3cb-adbd-40f3-92e8-5106c2ef6268] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:36.991994 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3b0b70c2-418b-4e81-8001-3f6bfe83d534 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:36.992538 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3b0b70c2-418b-4e81-8001-3f6bfe83d534 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:36.993356 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3b0b70c2-418b-4e81-8001-3f6bfe83d534 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:36.994025 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3b0b70c2-418b-4e81-8001-3f6bfe83d534 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:37.173298 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3b0b70c2-418b-4e81-8001-3f6bfe83d534 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:37.190417 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3b0b70c2-418b-4e81-8001-3f6bfe83d534 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/698ff3cb-adbd-40f3-92e8-5106c2ef6268" status: 200 len: 1275 microversion: 2.1 time: 0.209648 Jun 05 08:26:37.191778 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 505/1048] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:36 2022] GET /compute/v2.1/servers/698ff3cb-adbd-40f3-92e8-5106c2ef6268 => generated 1275 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:37.207773 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f5434882-98e9-4e88-835c-d132508a0547 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:37.209293 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f5434882-98e9-4e88-835c-d132508a0547 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:37.217051 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f5434882-98e9-4e88-835c-d132508a0547 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:37.217610 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f5434882-98e9-4e88-835c-d132508a0547 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:37.218466 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f5434882-98e9-4e88-835c-d132508a0547 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:37.219144 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f5434882-98e9-4e88-835c-d132508a0547 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:37.239580 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=100 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:37.255585 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f5434882-98e9-4e88-835c-d132508a0547 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:37.256072 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f5434882-98e9-4e88-835c-d132508a0547 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:37.256660 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-f5434882-98e9-4e88-835c-d132508a0547 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:37.379479 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f5434882-98e9-4e88-835c-d132508a0547 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:37.393558 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f5434882-98e9-4e88-835c-d132508a0547 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.199561 Jun 05 08:26:37.395748 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 506/1049] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:37 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:37.410400 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-583a0376-3966-48d7-bb09-99b09aac5b31 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:37.411379 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-583a0376-3966-48d7-bb09-99b09aac5b31 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:37.434753 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-583a0376-3966-48d7-bb09-99b09aac5b31 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:37.438352 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-583a0376-3966-48d7-bb09-99b09aac5b31 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:37.439239 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-583a0376-3966-48d7-bb09-99b09aac5b31 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:37.439681 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-583a0376-3966-48d7-bb09-99b09aac5b31 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:37.922056 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-583a0376-3966-48d7-bb09-99b09aac5b31 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:37.931053 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-583a0376-3966-48d7-bb09-99b09aac5b31 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.533996 Jun 05 08:26:37.931636 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 507/1050] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:37 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:37.937552 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-30ac5de5-5a60-4d02-89b9-cf0ae7611a0b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:37.938672 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-30ac5de5-5a60-4d02-89b9-cf0ae7611a0b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:37.947726 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-30ac5de5-5a60-4d02-89b9-cf0ae7611a0b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:37.948587 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-30ac5de5-5a60-4d02-89b9-cf0ae7611a0b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:37.949366 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-30ac5de5-5a60-4d02-89b9-cf0ae7611a0b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:37.949801 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-30ac5de5-5a60-4d02-89b9-cf0ae7611a0b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:38.136097 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-30ac5de5-5a60-4d02-89b9-cf0ae7611a0b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:38.149205 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-30ac5de5-5a60-4d02-89b9-cf0ae7611a0b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:38.150896 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-30ac5de5-5a60-4d02-89b9-cf0ae7611a0b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:38.152874 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-30ac5de5-5a60-4d02-89b9-cf0ae7611a0b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1319 microversion: 2.25 time: 0.219404 Jun 05 08:26:38.154616 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 508/1051] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:37 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:38.162796 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9e76e419-9e6f-48a6-b4a8-c499bfc3884c tempest-ServersWithSpecificFlavorTestJSON-377976084 tempest-ServersWithSpecificFlavorTestJSON-377976084-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:38.163833 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:26:38.163833 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:26:38.187981 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9e76e419-9e6f-48a6-b4a8-c499bfc3884c tempest-ServersWithSpecificFlavorTestJSON-377976084 tempest-ServersWithSpecificFlavorTestJSON-377976084-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1638903052" status: 202 len: 0 microversion: 2.1 time: 0.032746 Jun 05 08:26:38.189374 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-75b605f8-aac1-4e46-9ab3-d29bfc3ce082 tempest-FloatingIPDetailsTestJSON-819258004 tempest-FloatingIPDetailsTestJSON-819258004-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/6ebe8a01-c0e4-4e0b-9afa-bc0b7a021ac2" status: 202 len: 0 microversion: 2.1 time: 2.686453 Jun 05 08:26:38.189873 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 509/1052] 10.222.0.33 () {58 vars in 1160 bytes} [Sun Jun 5 08:26:38 2022] DELETE /compute/v2.1/flavors/1638903052 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:26:38.191849 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 544/1053] 10.222.0.33 () {58 vars in 1262 bytes} [Sun Jun 5 08:26:35 2022] DELETE /compute/v2.1/os-floating-ips/6ebe8a01-c0e4-4e0b-9afa-bc0b7a021ac2 => generated 0 bytes in 2690 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 05 08:26:38.200143 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bfd08847-bc59-4b8b-9ea4-835dbc6c895e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:38.201343 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-a971b060-b045-40f3-ad40-0e2ea8516585 req-60eec9ea-7b55-49d8-ac4a-c345d3c2ebe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05801050-4724-44df-8f50-9317e26f10d4", "name": "network-vif-plugged", "status": "completed", "tag": "73dd3602-41ee-4997-8f16-54fb03878f91"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:38.201861 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-bfd08847-bc59-4b8b-9ea4-835dbc6c895e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 05801050-4724-44df-8f50-9317e26f10d4] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:38.212138 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bfd08847-bc59-4b8b-9ea4-835dbc6c895e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:38.213356 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bfd08847-bc59-4b8b-9ea4-835dbc6c895e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:38.215017 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bfd08847-bc59-4b8b-9ea4-835dbc6c895e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:38.215444 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-a971b060-b045-40f3-ad40-0e2ea8516585 req-60eec9ea-7b55-49d8-ac4a-c345d3c2ebe3 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:38.216004 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bfd08847-bc59-4b8b-9ea4-835dbc6c895e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:38.216154 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-a971b060-b045-40f3-ad40-0e2ea8516585 req-60eec9ea-7b55-49d8-ac4a-c345d3c2ebe3 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:38.234206 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-a971b060-b045-40f3-ad40-0e2ea8516585 req-60eec9ea-7b55-49d8-ac4a-c345d3c2ebe3 service nova] Creating event network-vif-plugged:73dd3602-41ee-4997-8f16-54fb03878f91 for instance 05801050-4724-44df-8f50-9317e26f10d4 on n-h1-844739-1 Jun 05 08:26:38.241200 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-a971b060-b045-40f3-ad40-0e2ea8516585 req-60eec9ea-7b55-49d8-ac4a-c345d3c2ebe3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049097 Jun 05 08:26:38.242213 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 510/1054] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:38.248775 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c17f1494-e079-4a1e-a855-50894c316fb9 tempest-ServersWithSpecificFlavorTestJSON-377976084 tempest-ServersWithSpecificFlavorTestJSON-377976084-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:38.275631 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c17f1494-e079-4a1e-a855-50894c316fb9 tempest-ServersWithSpecificFlavorTestJSON-377976084 tempest-ServersWithSpecificFlavorTestJSON-377976084-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.032026 Jun 05 08:26:38.276607 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 511/1055] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:26:38 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:38.285263 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a9db02e9-a71f-4022-b16b-6daf0a83c93a tempest-FloatingIPDetailsTestJSON-819258004 tempest-FloatingIPDetailsTestJSON-819258004-project] Calling method '.version_select at 0x7f24337ae3a0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:39.031520 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a9db02e9-a71f-4022-b16b-6daf0a83c93a tempest-FloatingIPDetailsTestJSON-819258004 tempest-FloatingIPDetailsTestJSON-819258004-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.753625 Jun 05 08:26:39.039051 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 512/1056] 10.222.0.33 () {58 vars in 1163 bytes} [Sun Jun 5 08:26:38 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:26:39.045342 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c4f78d84-fc15-4937-9f89-b8c65e518cc4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:39.046568 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c4f78d84-fc15-4937-9f89-b8c65e518cc4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 698ff3cb-adbd-40f3-92e8-5106c2ef6268] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:39.053780 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c4f78d84-fc15-4937-9f89-b8c65e518cc4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:39.054390 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c4f78d84-fc15-4937-9f89-b8c65e518cc4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:39.055286 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c4f78d84-fc15-4937-9f89-b8c65e518cc4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:39.056448 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c4f78d84-fc15-4937-9f89-b8c65e518cc4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:39.132754 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-bfd08847-bc59-4b8b-9ea4-835dbc6c895e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:39.140508 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bfd08847-bc59-4b8b-9ea4-835dbc6c895e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/05801050-4724-44df-8f50-9317e26f10d4" status: 200 len: 1320 microversion: 2.1 time: 0.946485 Jun 05 08:26:39.141098 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 545/1057] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:38 2022] GET /compute/v2.1/servers/05801050-4724-44df-8f50-9317e26f10d4 => generated 1320 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:39.145765 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b8cf8763-242f-4b98-a6e3-b06e257086ff tempest-ServersWithSpecificFlavorTestJSON-377976084 tempest-ServersWithSpecificFlavorTestJSON-377976084-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:39.146626 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:26:39.146626 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:26:39.165870 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b8cf8763-242f-4b98-a6e3-b06e257086ff tempest-ServersWithSpecificFlavorTestJSON-377976084 tempest-ServersWithSpecificFlavorTestJSON-377976084-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1541174189" status: 202 len: 0 microversion: 2.1 time: 0.023328 Jun 05 08:26:39.170381 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 546/1058] 10.222.0.33 () {58 vars in 1160 bytes} [Sun Jun 5 08:26:39 2022] DELETE /compute/v2.1/flavors/1541174189 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:26:39.172607 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a1fbbbf4-23c0-48d1-b6ab-473ce307a12a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:39.173242 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a1fbbbf4-23c0-48d1-b6ab-473ce307a12a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:39.180860 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a1fbbbf4-23c0-48d1-b6ab-473ce307a12a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:39.181615 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a1fbbbf4-23c0-48d1-b6ab-473ce307a12a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:39.182513 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a1fbbbf4-23c0-48d1-b6ab-473ce307a12a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:39.183029 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a1fbbbf4-23c0-48d1-b6ab-473ce307a12a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:39.220400 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a1fbbbf4-23c0-48d1-b6ab-473ce307a12a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:39.221031 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a1fbbbf4-23c0-48d1-b6ab-473ce307a12a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:39.221262 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-a1fbbbf4-23c0-48d1-b6ab-473ce307a12a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:39.316196 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a1fbbbf4-23c0-48d1-b6ab-473ce307a12a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:39.324214 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a1fbbbf4-23c0-48d1-b6ab-473ce307a12a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.156272 Jun 05 08:26:39.324798 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 547/1059] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:39 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:39.332404 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-78c9d8e4-3885-4c56-8bae-4c7225ac0e59 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:39.333023 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-78c9d8e4-3885-4c56-8bae-4c7225ac0e59 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:39.339561 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-78c9d8e4-3885-4c56-8bae-4c7225ac0e59 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:39.340115 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-78c9d8e4-3885-4c56-8bae-4c7225ac0e59 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:39.340962 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-78c9d8e4-3885-4c56-8bae-4c7225ac0e59 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:39.342166 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-78c9d8e4-3885-4c56-8bae-4c7225ac0e59 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:39.427834 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c4f78d84-fc15-4937-9f89-b8c65e518cc4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:39.439444 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c4f78d84-fc15-4937-9f89-b8c65e518cc4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/698ff3cb-adbd-40f3-92e8-5106c2ef6268" status: 200 len: 1317 microversion: 2.1 time: 0.398686 Jun 05 08:26:39.444100 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 513/1060] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:39 2022] GET /compute/v2.1/servers/698ff3cb-adbd-40f3-92e8-5106c2ef6268 => generated 1317 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:39.445451 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-94a7818c-0b2f-4c9d-b17f-9bb800917d5e tempest-FloatingIPDetailsTestJSON-819258004 tempest-FloatingIPDetailsTestJSON-819258004-project] Calling method '.version_select at 0x7f24337aeca0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:39.760708 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-78c9d8e4-3885-4c56-8bae-4c7225ac0e59 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:39.771510 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-78c9d8e4-3885-4c56-8bae-4c7225ac0e59 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.445483 Jun 05 08:26:39.781311 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 548/1061] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:39 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:39.781311 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-834d8a2a-85c3-422e-a642-bc59db5a8328 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:39.781311 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-834d8a2a-85c3-422e-a642-bc59db5a8328 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:39.784147 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-834d8a2a-85c3-422e-a642-bc59db5a8328 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:39.784610 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-834d8a2a-85c3-422e-a642-bc59db5a8328 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:39.785386 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-834d8a2a-85c3-422e-a642-bc59db5a8328 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:39.785828 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-834d8a2a-85c3-422e-a642-bc59db5a8328 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:39.932032 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-94a7818c-0b2f-4c9d-b17f-9bb800917d5e tempest-FloatingIPDetailsTestJSON-819258004 tempest-FloatingIPDetailsTestJSON-819258004-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.490701 Jun 05 08:26:39.933099 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 514/1062] 10.222.0.33 () {58 vars in 1148 bytes} [Sun Jun 5 08:26:39 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:39.946840 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e7e654d5-db23-48e7-a0e2-367707e4928e tempest-ServersWithSpecificFlavorTestJSON-377976084 tempest-ServersWithSpecificFlavorTestJSON-377976084-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:39.967763 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e7e654d5-db23-48e7-a0e2-367707e4928e tempest-ServersWithSpecificFlavorTestJSON-377976084 tempest-ServersWithSpecificFlavorTestJSON-377976084-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024472 Jun 05 08:26:39.968385 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 515/1063] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:26:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:39.974657 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-529bafd3-9118-4ea5-a556-5cd230019815 tempest-FloatingIPDetailsTestJSON-819258004 tempest-FloatingIPDetailsTestJSON-819258004-project] Calling method '.version_select at 0x7f2433973e50>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:40.228861 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-834d8a2a-85c3-422e-a642-bc59db5a8328 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:40.238851 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-834d8a2a-85c3-422e-a642-bc59db5a8328 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:40.242632 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-834d8a2a-85c3-422e-a642-bc59db5a8328 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:40.243798 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-834d8a2a-85c3-422e-a642-bc59db5a8328 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1361 microversion: 2.25 time: 0.470227 Jun 05 08:26:40.244666 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 549/1064] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:39 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1361 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:40.249744 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b417dc7b-f442-466b-a601-231b889a5449 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:40.250247 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b417dc7b-f442-466b-a601-231b889a5449 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: 9b80f5d2-a282-4ccc-8db3-c97fa829aefe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:40.256558 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b417dc7b-f442-466b-a601-231b889a5449 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:40.257011 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b417dc7b-f442-466b-a601-231b889a5449 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:40.257786 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b417dc7b-f442-466b-a601-231b889a5449 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:40.258228 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b417dc7b-f442-466b-a601-231b889a5449 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:40.283493 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b417dc7b-f442-466b-a601-231b889a5449 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: 9b80f5d2-a282-4ccc-8db3-c97fa829aefe] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:26:40.359686 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b417dc7b-f442-466b-a601-231b889a5449 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe" status: 204 len: 0 microversion: 2.1 time: 0.113944 Jun 05 08:26:40.360633 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 550/1065] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:26:40 2022] DELETE /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:26:40.365939 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-89c0be78-0efd-4179-93cc-12cbcbdae6e2 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:40.366642 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-89c0be78-0efd-4179-93cc-12cbcbdae6e2 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 05801050-4724-44df-8f50-9317e26f10d4] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:40.374007 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-89c0be78-0efd-4179-93cc-12cbcbdae6e2 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:40.374610 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-89c0be78-0efd-4179-93cc-12cbcbdae6e2 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:40.375395 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-89c0be78-0efd-4179-93cc-12cbcbdae6e2 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:40.376067 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-89c0be78-0efd-4179-93cc-12cbcbdae6e2 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:40.845300 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-89c0be78-0efd-4179-93cc-12cbcbdae6e2 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:40.854094 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-89c0be78-0efd-4179-93cc-12cbcbdae6e2 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/05801050-4724-44df-8f50-9317e26f10d4" status: 200 len: 1320 microversion: 2.1 time: 0.492105 Jun 05 08:26:40.866003 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 551/1066] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:40 2022] GET /compute/v2.1/servers/05801050-4724-44df-8f50-9317e26f10d4 => generated 1320 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:40.872657 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-f5dc0c18-a1b4-4dbb-affa-1a39a4144cc7 req-112077f1-c04d-46a0-9f7a-180949fd0358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e3f0d36-6bfe-4cb0-a001-4940b6da70e5", "name": "network-vif-plugged", "status": "completed", "tag": "da3f0e4a-bf17-487b-ab03-a4b1fecf0f16"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:40.884159 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-f5dc0c18-a1b4-4dbb-affa-1a39a4144cc7 req-112077f1-c04d-46a0-9f7a-180949fd0358 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:40.884909 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-f5dc0c18-a1b4-4dbb-affa-1a39a4144cc7 req-112077f1-c04d-46a0-9f7a-180949fd0358 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:40.898865 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-f5dc0c18-a1b4-4dbb-affa-1a39a4144cc7 req-112077f1-c04d-46a0-9f7a-180949fd0358 service nova] Creating event network-vif-plugged:da3f0e4a-bf17-487b-ab03-a4b1fecf0f16 for instance 9e3f0d36-6bfe-4cb0-a001-4940b6da70e5 on n-h1-844739-1 Jun 05 08:26:40.905600 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-f5dc0c18-a1b4-4dbb-affa-1a39a4144cc7 req-112077f1-c04d-46a0-9f7a-180949fd0358 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037138 Jun 05 08:26:40.906791 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 552/1067] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:40.912276 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e05867ac-fab3-49bc-b452-54be2c75fc29 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:40.913172 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e05867ac-fab3-49bc-b452-54be2c75fc29 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:40.921050 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e05867ac-fab3-49bc-b452-54be2c75fc29 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:40.921781 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e05867ac-fab3-49bc-b452-54be2c75fc29 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:40.924455 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e05867ac-fab3-49bc-b452-54be2c75fc29 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:40.925759 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e05867ac-fab3-49bc-b452-54be2c75fc29 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:40.959301 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e05867ac-fab3-49bc-b452-54be2c75fc29 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:40.959755 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e05867ac-fab3-49bc-b452-54be2c75fc29 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:40.960282 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-e05867ac-fab3-49bc-b452-54be2c75fc29 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:41.077406 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e05867ac-fab3-49bc-b452-54be2c75fc29 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:41.085001 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e05867ac-fab3-49bc-b452-54be2c75fc29 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.176901 Jun 05 08:26:41.085576 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 553/1068] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:40 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:41.089962 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-48725d4b-e66b-4dbf-acf6-969734045a9b tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:41.090572 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-48725d4b-e66b-4dbf-acf6-969734045a9b tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: 9b80f5d2-a282-4ccc-8db3-c97fa829aefe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:41.096907 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-48725d4b-e66b-4dbf-acf6-969734045a9b tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:41.097370 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-48725d4b-e66b-4dbf-acf6-969734045a9b tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:41.098149 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-48725d4b-e66b-4dbf-acf6-969734045a9b tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:41.098601 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-48725d4b-e66b-4dbf-acf6-969734045a9b tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:41.129555 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-48725d4b-e66b-4dbf-acf6-969734045a9b tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:41.129957 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-48725d4b-e66b-4dbf-acf6-969734045a9b tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:41.130480 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-48725d4b-e66b-4dbf-acf6-969734045a9b tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lazy-loading 'fault' on Instance uuid 9b80f5d2-a282-4ccc-8db3-c97fa829aefe {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:41.230566 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-48725d4b-e66b-4dbf-acf6-969734045a9b tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:41.234296 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:41.244253 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-48725d4b-e66b-4dbf-acf6-969734045a9b tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe" status: 200 len: 1409 microversion: 2.1 time: 0.157623 Jun 05 08:26:41.244869 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 554/1069] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:41 2022] GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe => generated 1409 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:41.250533 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-996c6b37-0634-4a65-a256-02e3246adbdc tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:41.251141 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-996c6b37-0634-4a65-a256-02e3246adbdc tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 698ff3cb-adbd-40f3-92e8-5106c2ef6268] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:41.257730 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-996c6b37-0634-4a65-a256-02e3246adbdc tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:41.258182 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-996c6b37-0634-4a65-a256-02e3246adbdc tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:41.258960 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-996c6b37-0634-4a65-a256-02e3246adbdc tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:41.259395 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-996c6b37-0634-4a65-a256-02e3246adbdc tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:41.418135 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=8 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:41.708512 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-996c6b37-0634-4a65-a256-02e3246adbdc tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:41.721211 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-996c6b37-0634-4a65-a256-02e3246adbdc tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/698ff3cb-adbd-40f3-92e8-5106c2ef6268" status: 200 len: 1317 microversion: 2.1 time: 0.474890 Jun 05 08:26:41.724683 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 555/1070] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:41 2022] GET /compute/v2.1/servers/698ff3cb-adbd-40f3-92e8-5106c2ef6268 => generated 1317 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:41.732520 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-885f0db5-efb8-4c99-9429-364deaedcf31 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:41.733416 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-885f0db5-efb8-4c99-9429-364deaedcf31 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:41.740074 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-885f0db5-efb8-4c99-9429-364deaedcf31 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:41.744680 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-885f0db5-efb8-4c99-9429-364deaedcf31 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:41.746148 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-885f0db5-efb8-4c99-9429-364deaedcf31 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:41.746707 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-885f0db5-efb8-4c99-9429-364deaedcf31 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:42.126171 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-529bafd3-9118-4ea5-a556-5cd230019815 tempest-FloatingIPDetailsTestJSON-819258004 tempest-FloatingIPDetailsTestJSON-819258004-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/a60b340f-61a7-43b5-b1be-daad33fd814f" status: 202 len: 0 microversion: 2.1 time: 2.155596 Jun 05 08:26:42.127267 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 516/1071] 10.222.0.33 () {58 vars in 1262 bytes} [Sun Jun 5 08:26:39 2022] DELETE /compute/v2.1/os-floating-ips/a60b340f-61a7-43b5-b1be-daad33fd814f => generated 0 bytes in 2158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:26:42.132625 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b843a654-a919-4d98-b661-25061fc83381 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:42.133246 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b843a654-a919-4d98-b661-25061fc83381 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:42.139099 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-885f0db5-efb8-4c99-9429-364deaedcf31 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:42.140029 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b843a654-a919-4d98-b661-25061fc83381 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:42.140558 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b843a654-a919-4d98-b661-25061fc83381 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:42.141354 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b843a654-a919-4d98-b661-25061fc83381 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:42.141966 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b843a654-a919-4d98-b661-25061fc83381 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:42.150657 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-885f0db5-efb8-4c99-9429-364deaedcf31 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.424930 Jun 05 08:26:42.151446 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 556/1072] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:41 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:42.158217 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-1709c38c-0dfb-46bc-9c91-93b42ba420a7 req-4f54a5d6-a374-4f67-bfa2-f4b1b5c93b4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "698ff3cb-adbd-40f3-92e8-5106c2ef6268", "tag": "b97f6282-a66c-4ac6-a237-2d0f246eb96f"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:42.168964 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-1709c38c-0dfb-46bc-9c91-93b42ba420a7 req-4f54a5d6-a374-4f67-bfa2-f4b1b5c93b4a service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:42.170124 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-1709c38c-0dfb-46bc-9c91-93b42ba420a7 req-4f54a5d6-a374-4f67-bfa2-f4b1b5c93b4a service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:42.187556 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-1709c38c-0dfb-46bc-9c91-93b42ba420a7 req-4f54a5d6-a374-4f67-bfa2-f4b1b5c93b4a service nova] Creating event network-changed:b97f6282-a66c-4ac6-a237-2d0f246eb96f for instance 698ff3cb-adbd-40f3-92e8-5106c2ef6268 on n-h2-844739-1 Jun 05 08:26:42.193967 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-1709c38c-0dfb-46bc-9c91-93b42ba420a7 req-4f54a5d6-a374-4f67-bfa2-f4b1b5c93b4a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040543 Jun 05 08:26:42.194583 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 557/1073] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:42.200075 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e6338523-c1db-459c-99b4-3f36ae51e4bd tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:42.202115 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e6338523-c1db-459c-99b4-3f36ae51e4bd tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 05801050-4724-44df-8f50-9317e26f10d4] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:42.204130 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:42.210154 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e6338523-c1db-459c-99b4-3f36ae51e4bd tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:42.210624 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e6338523-c1db-459c-99b4-3f36ae51e4bd tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:42.211422 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e6338523-c1db-459c-99b4-3f36ae51e4bd tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:42.211855 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e6338523-c1db-459c-99b4-3f36ae51e4bd tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:42.717742 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b843a654-a919-4d98-b661-25061fc83381 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:42.725901 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b843a654-a919-4d98-b661-25061fc83381 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:42.727398 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b843a654-a919-4d98-b661-25061fc83381 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:42.728535 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b843a654-a919-4d98-b661-25061fc83381 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1361 microversion: 2.25 time: 0.600166 Jun 05 08:26:42.729095 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 517/1074] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:42 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1361 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:42.744098 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-175e8962-87b8-4fab-bea6-c2d80f1ef8db tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:42.744708 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-175e8962-87b8-4fab-bea6-c2d80f1ef8db tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:42.749278 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e6338523-c1db-459c-99b4-3f36ae51e4bd tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:42.751436 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-175e8962-87b8-4fab-bea6-c2d80f1ef8db tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:42.752120 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-175e8962-87b8-4fab-bea6-c2d80f1ef8db tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:42.753084 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-175e8962-87b8-4fab-bea6-c2d80f1ef8db tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:42.753705 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-175e8962-87b8-4fab-bea6-c2d80f1ef8db tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:42.757020 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e6338523-c1db-459c-99b4-3f36ae51e4bd tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/05801050-4724-44df-8f50-9317e26f10d4" status: 200 len: 1508 microversion: 2.1 time: 0.561302 Jun 05 08:26:42.757959 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 558/1075] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:42 2022] GET /compute/v2.1/servers/05801050-4724-44df-8f50-9317e26f10d4 => generated 1508 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:42.762812 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6af26e4c-b346-48f5-b3db-59b23623b561 tempest-FloatingIPDetailsTestJSON-819258004 tempest-FloatingIPDetailsTestJSON-819258004-project] Calling method '.version_select at 0x7f24339d88b0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:42.791244 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-175e8962-87b8-4fab-bea6-c2d80f1ef8db tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:42.791857 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-175e8962-87b8-4fab-bea6-c2d80f1ef8db tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:42.792448 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-175e8962-87b8-4fab-bea6-c2d80f1ef8db tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:42.875479 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-175e8962-87b8-4fab-bea6-c2d80f1ef8db tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:42.883180 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-175e8962-87b8-4fab-bea6-c2d80f1ef8db tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.142793 Jun 05 08:26:42.883852 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 518/1076] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:42 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:42.892844 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-bbfed597-ac3f-463a-ae24-aa1fee280c49 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:42.892844 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-bbfed597-ac3f-463a-ae24-aa1fee280c49 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: 9b80f5d2-a282-4ccc-8db3-c97fa829aefe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:42.894900 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bbfed597-ac3f-463a-ae24-aa1fee280c49 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:42.895371 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bbfed597-ac3f-463a-ae24-aa1fee280c49 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:42.896159 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bbfed597-ac3f-463a-ae24-aa1fee280c49 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:42.896602 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bbfed597-ac3f-463a-ae24-aa1fee280c49 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:42.925459 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:42.929970 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bbfed597-ac3f-463a-ae24-aa1fee280c49 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:42.930433 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bbfed597-ac3f-463a-ae24-aa1fee280c49 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:42.930890 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-bbfed597-ac3f-463a-ae24-aa1fee280c49 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lazy-loading 'fault' on Instance uuid 9b80f5d2-a282-4ccc-8db3-c97fa829aefe {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:43.005848 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-bbfed597-ac3f-463a-ae24-aa1fee280c49 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:43.016167 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-bbfed597-ac3f-463a-ae24-aa1fee280c49 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe" status: 200 len: 1409 microversion: 2.1 time: 0.130860 Jun 05 08:26:43.017006 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 519/1077] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:42 2022] GET /compute/v2.1/servers/9b80f5d2-a282-4ccc-8db3-c97fa829aefe => generated 1409 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:43.021270 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-44c85936-0a91-4dd5-bb2d-3896049509d5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:43.021884 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-44c85936-0a91-4dd5-bb2d-3896049509d5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 698ff3cb-adbd-40f3-92e8-5106c2ef6268] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:43.028480 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-44c85936-0a91-4dd5-bb2d-3896049509d5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:43.029428 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-44c85936-0a91-4dd5-bb2d-3896049509d5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:43.030207 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-44c85936-0a91-4dd5-bb2d-3896049509d5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:43.030649 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-44c85936-0a91-4dd5-bb2d-3896049509d5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:43.363420 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-44c85936-0a91-4dd5-bb2d-3896049509d5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:43.370760 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-44c85936-0a91-4dd5-bb2d-3896049509d5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/698ff3cb-adbd-40f3-92e8-5106c2ef6268" status: 200 len: 1317 microversion: 2.1 time: 0.353027 Jun 05 08:26:43.371343 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 520/1078] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:43 2022] GET /compute/v2.1/servers/698ff3cb-adbd-40f3-92e8-5106c2ef6268 => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:43.375962 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-30a1ce83-9329-48c0-a9ca-135bc5a03e27 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:43.376594 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-30a1ce83-9329-48c0-a9ca-135bc5a03e27 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 9e3f0d36-6bfe-4cb0-a001-4940b6da70e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:43.382193 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-30a1ce83-9329-48c0-a9ca-135bc5a03e27 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:43.382646 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-30a1ce83-9329-48c0-a9ca-135bc5a03e27 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:43.383402 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-30a1ce83-9329-48c0-a9ca-135bc5a03e27 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:43.383838 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-30a1ce83-9329-48c0-a9ca-135bc5a03e27 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:43.671524 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-30a1ce83-9329-48c0-a9ca-135bc5a03e27 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:43.679118 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-30a1ce83-9329-48c0-a9ca-135bc5a03e27 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/9e3f0d36-6bfe-4cb0-a001-4940b6da70e5" status: 200 len: 1320 microversion: 2.1 time: 0.306811 Jun 05 08:26:43.679778 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 521/1079] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:43 2022] GET /compute/v2.1/servers/9e3f0d36-6bfe-4cb0-a001-4940b6da70e5 => generated 1320 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:43.686472 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4abe5a11-046d-42ce-9b74-139426393c45 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:43.686740 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4abe5a11-046d-42ce-9b74-139426393c45 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: e4c09fb3-f67f-4b07-a992-2e70683932bd] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:43.696015 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4abe5a11-046d-42ce-9b74-139426393c45 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:43.696522 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4abe5a11-046d-42ce-9b74-139426393c45 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:43.697300 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4abe5a11-046d-42ce-9b74-139426393c45 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:43.697736 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4abe5a11-046d-42ce-9b74-139426393c45 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:43.724026 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4abe5a11-046d-42ce-9b74-139426393c45 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: e4c09fb3-f67f-4b07-a992-2e70683932bd] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:26:43.803192 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4abe5a11-046d-42ce-9b74-139426393c45 tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd" status: 204 len: 0 microversion: 2.1 time: 0.122143 Jun 05 08:26:43.804115 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 522/1080] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:26:43 2022] DELETE /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:26:43.809553 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-923a754e-e038-452f-9519-6c6f2fb2250e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:43.810759 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-923a754e-e038-452f-9519-6c6f2fb2250e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:43.817243 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-923a754e-e038-452f-9519-6c6f2fb2250e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:43.817696 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-923a754e-e038-452f-9519-6c6f2fb2250e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:43.818468 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-923a754e-e038-452f-9519-6c6f2fb2250e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:43.818904 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-923a754e-e038-452f-9519-6c6f2fb2250e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:44.045002 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-923a754e-e038-452f-9519-6c6f2fb2250e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:44.053155 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-923a754e-e038-452f-9519-6c6f2fb2250e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.247909 Jun 05 08:26:44.053731 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 523/1081] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:43 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:44.058217 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5972ab20-b252-46ae-8cfd-e10156f932b7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:44.058839 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5972ab20-b252-46ae-8cfd-e10156f932b7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:44.065959 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5972ab20-b252-46ae-8cfd-e10156f932b7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:44.066422 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5972ab20-b252-46ae-8cfd-e10156f932b7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:44.067212 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5972ab20-b252-46ae-8cfd-e10156f932b7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:44.067659 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5972ab20-b252-46ae-8cfd-e10156f932b7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:44.102280 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6af26e4c-b346-48f5-b3db-59b23623b561 tempest-FloatingIPDetailsTestJSON-819258004 tempest-FloatingIPDetailsTestJSON-819258004-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/77eb65f1-0b09-4272-b6ef-ea19b80f5fa4" status: 202 len: 0 microversion: 2.1 time: 1.343003 Jun 05 08:26:44.102897 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 559/1082] 10.222.0.33 () {58 vars in 1262 bytes} [Sun Jun 5 08:26:42 2022] DELETE /compute/v2.1/os-floating-ips/77eb65f1-0b09-4272-b6ef-ea19b80f5fa4 => generated 0 bytes in 1344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:26:44.108001 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a2abbd7e-593b-40b6-9327-bc3bea38d0ca tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:44.108645 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a2abbd7e-593b-40b6-9327-bc3bea38d0ca tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: e4c09fb3-f67f-4b07-a992-2e70683932bd] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:44.114883 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a2abbd7e-593b-40b6-9327-bc3bea38d0ca tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:44.115341 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a2abbd7e-593b-40b6-9327-bc3bea38d0ca tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:44.116152 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a2abbd7e-593b-40b6-9327-bc3bea38d0ca tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:44.116600 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a2abbd7e-593b-40b6-9327-bc3bea38d0ca tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:44.148149 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a2abbd7e-593b-40b6-9327-bc3bea38d0ca tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:44.148607 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a2abbd7e-593b-40b6-9327-bc3bea38d0ca tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:44.149061 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-a2abbd7e-593b-40b6-9327-bc3bea38d0ca tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lazy-loading 'fault' on Instance uuid e4c09fb3-f67f-4b07-a992-2e70683932bd {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:44.210639 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a2abbd7e-593b-40b6-9327-bc3bea38d0ca tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:44.220114 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a2abbd7e-593b-40b6-9327-bc3bea38d0ca tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd" status: 200 len: 1415 microversion: 2.1 time: 0.116149 Jun 05 08:26:44.220710 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 560/1083] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:44 2022] GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd => generated 1415 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:44.225770 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c13336c5-1b71-49dc-98ca-659d4f399481 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:44.226383 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c13336c5-1b71-49dc-98ca-659d4f399481 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:44.233129 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c13336c5-1b71-49dc-98ca-659d4f399481 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:44.233582 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c13336c5-1b71-49dc-98ca-659d4f399481 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:44.234349 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c13336c5-1b71-49dc-98ca-659d4f399481 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:44.234786 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c13336c5-1b71-49dc-98ca-659d4f399481 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:44.256720 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5972ab20-b252-46ae-8cfd-e10156f932b7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:44.265149 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5972ab20-b252-46ae-8cfd-e10156f932b7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:44.265774 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c13336c5-1b71-49dc-98ca-659d4f399481 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:44.266225 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c13336c5-1b71-49dc-98ca-659d4f399481 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:44.266672 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5972ab20-b252-46ae-8cfd-e10156f932b7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:44.266805 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-c13336c5-1b71-49dc-98ca-659d4f399481 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:44.267890 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5972ab20-b252-46ae-8cfd-e10156f932b7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1361 microversion: 2.25 time: 0.213237 Jun 05 08:26:44.268487 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 524/1084] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:44 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:44.273178 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-74e26b49-b35d-4f04-baee-506cd5f04a94 tempest-FloatingIPDetailsTestJSON-819258004 tempest-FloatingIPDetailsTestJSON-819258004-project] Calling method '.version_select at 0x7f243370c310>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:44.382926 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c13336c5-1b71-49dc-98ca-659d4f399481 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:44.388816 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c13336c5-1b71-49dc-98ca-659d4f399481 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.165777 Jun 05 08:26:44.397899 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 561/1085] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:44 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:44.401242 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d6acc2c6-3113-4e21-8dcb-0b5349a283bb tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:44.401859 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d6acc2c6-3113-4e21-8dcb-0b5349a283bb tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 698ff3cb-adbd-40f3-92e8-5106c2ef6268] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:44.408420 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d6acc2c6-3113-4e21-8dcb-0b5349a283bb tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:44.408873 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d6acc2c6-3113-4e21-8dcb-0b5349a283bb tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:44.409639 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d6acc2c6-3113-4e21-8dcb-0b5349a283bb tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:44.410075 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d6acc2c6-3113-4e21-8dcb-0b5349a283bb tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:44.589585 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:44.611599 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=6 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:44.724510 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d6acc2c6-3113-4e21-8dcb-0b5349a283bb tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:44.733020 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d6acc2c6-3113-4e21-8dcb-0b5349a283bb tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/698ff3cb-adbd-40f3-92e8-5106c2ef6268" status: 200 len: 1317 microversion: 2.1 time: 0.342012 Jun 05 08:26:44.733531 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 562/1086] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:44 2022] GET /compute/v2.1/servers/698ff3cb-adbd-40f3-92e8-5106c2ef6268 => generated 1317 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:44.737958 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-1f5741ce-8e01-4b85-a2b8-5bc1f30cb938 req-7221d53b-3192-44e9-8b91-dc058e00d67a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d031b21-37d5-4454-bed7-db50a225bce5", "tag": "8d0bec8a-b955-48a2-b49c-95afe47c2245"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:44.746037 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-1f5741ce-8e01-4b85-a2b8-5bc1f30cb938 req-7221d53b-3192-44e9-8b91-dc058e00d67a service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:44.746477 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-1f5741ce-8e01-4b85-a2b8-5bc1f30cb938 req-7221d53b-3192-44e9-8b91-dc058e00d67a service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:44.760168 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-1f5741ce-8e01-4b85-a2b8-5bc1f30cb938 req-7221d53b-3192-44e9-8b91-dc058e00d67a service nova] Creating event network-changed:8d0bec8a-b955-48a2-b49c-95afe47c2245 for instance 5d031b21-37d5-4454-bed7-db50a225bce5 on n-h1-844739-1 Jun 05 08:26:44.765801 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-1f5741ce-8e01-4b85-a2b8-5bc1f30cb938 req-7221d53b-3192-44e9-8b91-dc058e00d67a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031163 Jun 05 08:26:44.766389 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 563/1087] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:44.771234 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-65ff0e59-1fc2-4c19-bcc7-52a712d130ab tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:44.771929 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-65ff0e59-1fc2-4c19-bcc7-52a712d130ab tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 9e3f0d36-6bfe-4cb0-a001-4940b6da70e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:44.780304 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-65ff0e59-1fc2-4c19-bcc7-52a712d130ab tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:44.780617 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-65ff0e59-1fc2-4c19-bcc7-52a712d130ab tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:44.782612 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-65ff0e59-1fc2-4c19-bcc7-52a712d130ab tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:44.783055 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-65ff0e59-1fc2-4c19-bcc7-52a712d130ab tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:45.049775 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=10 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:45.180013 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-65ff0e59-1fc2-4c19-bcc7-52a712d130ab tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:45.189281 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-65ff0e59-1fc2-4c19-bcc7-52a712d130ab tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/9e3f0d36-6bfe-4cb0-a001-4940b6da70e5" status: 200 len: 1508 microversion: 2.1 time: 0.421688 Jun 05 08:26:45.189957 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 564/1088] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:44 2022] GET /compute/v2.1/servers/9e3f0d36-6bfe-4cb0-a001-4940b6da70e5 => generated 1508 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:45.194849 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c96477a4-3a1d-4254-9cfb-f2f06213f516 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:45.195688 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c96477a4-3a1d-4254-9cfb-f2f06213f516 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:45.202357 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c96477a4-3a1d-4254-9cfb-f2f06213f516 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:45.203061 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c96477a4-3a1d-4254-9cfb-f2f06213f516 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:45.203841 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c96477a4-3a1d-4254-9cfb-f2f06213f516 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:45.204555 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c96477a4-3a1d-4254-9cfb-f2f06213f516 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:45.422644 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c96477a4-3a1d-4254-9cfb-f2f06213f516 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:45.432676 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c96477a4-3a1d-4254-9cfb-f2f06213f516 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.241469 Jun 05 08:26:45.433243 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 565/1089] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:45 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:45.446735 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2a9900d4-4ed0-4dea-908e-c9d78fd53938 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:45.447889 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2a9900d4-4ed0-4dea-908e-c9d78fd53938 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 9e3f0d36-6bfe-4cb0-a001-4940b6da70e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:45.458823 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2a9900d4-4ed0-4dea-908e-c9d78fd53938 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:45.459276 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2a9900d4-4ed0-4dea-908e-c9d78fd53938 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:45.460122 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2a9900d4-4ed0-4dea-908e-c9d78fd53938 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:45.460542 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2a9900d4-4ed0-4dea-908e-c9d78fd53938 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:45.495101 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2a9900d4-4ed0-4dea-908e-c9d78fd53938 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 9e3f0d36-6bfe-4cb0-a001-4940b6da70e5] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:26:45.583152 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-74e26b49-b35d-4f04-baee-506cd5f04a94 tempest-FloatingIPDetailsTestJSON-819258004 tempest-FloatingIPDetailsTestJSON-819258004-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/e877107d-3bf2-44e1-9351-9ba7c88ac319" status: 202 len: 0 microversion: 2.1 time: 1.313330 Jun 05 08:26:45.584279 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 525/1090] 10.222.0.33 () {58 vars in 1262 bytes} [Sun Jun 5 08:26:44 2022] DELETE /compute/v2.1/os-floating-ips/e877107d-3bf2-44e1-9351-9ba7c88ac319 => generated 0 bytes in 1315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:26:45.589188 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-71ce8e03-7754-467e-8abb-1eea7d51f5cc tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:45.589981 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-71ce8e03-7754-467e-8abb-1eea7d51f5cc tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] [instance: e4c09fb3-f67f-4b07-a992-2e70683932bd] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:45.598596 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2a9900d4-4ed0-4dea-908e-c9d78fd53938 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9e3f0d36-6bfe-4cb0-a001-4940b6da70e5" status: 204 len: 0 microversion: 2.1 time: 0.162092 Jun 05 08:26:45.598851 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-71ce8e03-7754-467e-8abb-1eea7d51f5cc tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:45.599257 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-71ce8e03-7754-467e-8abb-1eea7d51f5cc tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:45.599372 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 566/1091] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:26:45 2022] DELETE /compute/v2.1/servers/9e3f0d36-6bfe-4cb0-a001-4940b6da70e5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:26:45.603267 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-71ce8e03-7754-467e-8abb-1eea7d51f5cc tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:45.603728 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-71ce8e03-7754-467e-8abb-1eea7d51f5cc tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:45.606340 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-150f39e2-4a47-456d-989f-3496f9d046ff tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:45.607192 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-150f39e2-4a47-456d-989f-3496f9d046ff tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:45.613556 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-150f39e2-4a47-456d-989f-3496f9d046ff tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:45.614680 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-150f39e2-4a47-456d-989f-3496f9d046ff tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:45.615555 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-150f39e2-4a47-456d-989f-3496f9d046ff tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:45.615939 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-150f39e2-4a47-456d-989f-3496f9d046ff tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:45.639067 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-71ce8e03-7754-467e-8abb-1eea7d51f5cc tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:45.639534 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-71ce8e03-7754-467e-8abb-1eea7d51f5cc tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:45.639978 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-71ce8e03-7754-467e-8abb-1eea7d51f5cc tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Lazy-loading 'fault' on Instance uuid e4c09fb3-f67f-4b07-a992-2e70683932bd {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:45.699270 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-71ce8e03-7754-467e-8abb-1eea7d51f5cc tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4cc519c13c4b88bfff58f418bcdb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0348d3b9a38d437c8e82a24be537c848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:45.718861 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-71ce8e03-7754-467e-8abb-1eea7d51f5cc tempest-ServersWithSpecificFlavorTestJSON-2126239023 tempest-ServersWithSpecificFlavorTestJSON-2126239023-project] 10.222.0.33 "GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd" status: 200 len: 1415 microversion: 2.1 time: 0.133480 Jun 05 08:26:45.734446 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 526/1092] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:45 2022] GET /compute/v2.1/servers/e4c09fb3-f67f-4b07-a992-2e70683932bd => generated 1415 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:45.739612 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2ac198c8-05f7-4fe7-b2d2-5565230f5cdf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:45.740505 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2ac198c8-05f7-4fe7-b2d2-5565230f5cdf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:45.750026 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2ac198c8-05f7-4fe7-b2d2-5565230f5cdf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:45.750763 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2ac198c8-05f7-4fe7-b2d2-5565230f5cdf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:45.753930 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2ac198c8-05f7-4fe7-b2d2-5565230f5cdf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:45.754628 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2ac198c8-05f7-4fe7-b2d2-5565230f5cdf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:45.791769 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2ac198c8-05f7-4fe7-b2d2-5565230f5cdf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:45.792516 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2ac198c8-05f7-4fe7-b2d2-5565230f5cdf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:45.793140 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-2ac198c8-05f7-4fe7-b2d2-5565230f5cdf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:45.799150 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:46.146380 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2ac198c8-05f7-4fe7-b2d2-5565230f5cdf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:46.159467 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2ac198c8-05f7-4fe7-b2d2-5565230f5cdf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.422154 Jun 05 08:26:46.169912 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 527/1093] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:45 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:46.175188 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e1bc6963-7fe8-43d8-abfa-f9f133788f7b tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:46.175892 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e1bc6963-7fe8-43d8-abfa-f9f133788f7b tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 05801050-4724-44df-8f50-9317e26f10d4] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:46.182675 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e1bc6963-7fe8-43d8-abfa-f9f133788f7b tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:46.183399 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e1bc6963-7fe8-43d8-abfa-f9f133788f7b tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:46.184399 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e1bc6963-7fe8-43d8-abfa-f9f133788f7b tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:46.185239 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e1bc6963-7fe8-43d8-abfa-f9f133788f7b tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:46.224719 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e1bc6963-7fe8-43d8-abfa-f9f133788f7b tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 05801050-4724-44df-8f50-9317e26f10d4] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:26:46.233938 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-150f39e2-4a47-456d-989f-3496f9d046ff tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:46.247057 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-150f39e2-4a47-456d-989f-3496f9d046ff tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:46.248725 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-150f39e2-4a47-456d-989f-3496f9d046ff tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:46.250360 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-150f39e2-4a47-456d-989f-3496f9d046ff tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1361 microversion: 2.25 time: 0.649212 Jun 05 08:26:46.250507 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 567/1094] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:45 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1361 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:46.270029 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b7ae424d-c22c-43bf-bb67-cd1255549915 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:46.271112 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b7ae424d-c22c-43bf-bb67-cd1255549915 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 698ff3cb-adbd-40f3-92e8-5106c2ef6268] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:46.288078 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b7ae424d-c22c-43bf-bb67-cd1255549915 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:46.288078 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b7ae424d-c22c-43bf-bb67-cd1255549915 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:46.288078 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b7ae424d-c22c-43bf-bb67-cd1255549915 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:46.288559 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b7ae424d-c22c-43bf-bb67-cd1255549915 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:46.367442 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e1bc6963-7fe8-43d8-abfa-f9f133788f7b tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "DELETE /compute/v2.1/servers/05801050-4724-44df-8f50-9317e26f10d4" status: 204 len: 0 microversion: 2.1 time: 0.194829 Jun 05 08:26:46.369189 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 528/1095] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:26:46 2022] DELETE /compute/v2.1/servers/05801050-4724-44df-8f50-9317e26f10d4 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:26:46.423406 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-45c47beb-e627-4145-ab5a-f41dcbd40a88 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1611367109", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "4d5ebf49-2f35-4257-aa72-c00ef90e9d30"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:46.490653 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-45c47beb-e627-4145-ab5a-f41dcbd40a88 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] validate_networks() for [('4d5ebf49-2f35-4257-aa72-c00ef90e9d30', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:26:46.729920 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b7ae424d-c22c-43bf-bb67-cd1255549915 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:46.740375 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b7ae424d-c22c-43bf-bb67-cd1255549915 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/698ff3cb-adbd-40f3-92e8-5106c2ef6268" status: 200 len: 1317 microversion: 2.1 time: 0.474025 Jun 05 08:26:46.741233 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 568/1096] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:46 2022] GET /compute/v2.1/servers/698ff3cb-adbd-40f3-92e8-5106c2ef6268 => generated 1317 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:46.745486 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-edf066d7-3c5a-4d5b-adae-034c3f2369c3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:46.746082 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-edf066d7-3c5a-4d5b-adae-034c3f2369c3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:46.764657 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-edf066d7-3c5a-4d5b-adae-034c3f2369c3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:46.765104 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-edf066d7-3c5a-4d5b-adae-034c3f2369c3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:46.765885 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-edf066d7-3c5a-4d5b-adae-034c3f2369c3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:46.766314 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-edf066d7-3c5a-4d5b-adae-034c3f2369c3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:47.240204 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-edf066d7-3c5a-4d5b-adae-034c3f2369c3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:47.261543 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-edf066d7-3c5a-4d5b-adae-034c3f2369c3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.512268 Jun 05 08:26:47.274616 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 569/1097] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:46 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:47.281101 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8477c174-8c6e-46de-ac4b-93f2d3b6432d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:47.281944 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8477c174-8c6e-46de-ac4b-93f2d3b6432d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:47.289089 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8477c174-8c6e-46de-ac4b-93f2d3b6432d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:47.289732 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8477c174-8c6e-46de-ac4b-93f2d3b6432d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:47.290659 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8477c174-8c6e-46de-ac4b-93f2d3b6432d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:47.291248 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8477c174-8c6e-46de-ac4b-93f2d3b6432d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:47.347956 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8477c174-8c6e-46de-ac4b-93f2d3b6432d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:47.348699 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8477c174-8c6e-46de-ac4b-93f2d3b6432d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:47.349337 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-8477c174-8c6e-46de-ac4b-93f2d3b6432d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:47.557212 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8477c174-8c6e-46de-ac4b-93f2d3b6432d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:47.573814 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8477c174-8c6e-46de-ac4b-93f2d3b6432d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.293230 Jun 05 08:26:47.576219 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 570/1098] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:47 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:47.586425 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3217e299-e716-465e-928b-3bb674e31376 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:47.589806 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3217e299-e716-465e-928b-3bb674e31376 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:47.605457 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3217e299-e716-465e-928b-3bb674e31376 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:47.606300 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3217e299-e716-465e-928b-3bb674e31376 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:47.608475 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3217e299-e716-465e-928b-3bb674e31376 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:47.609924 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3217e299-e716-465e-928b-3bb674e31376 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:47.671781 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:48.007802 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-45c47beb-e627-4145-ab5a-f41dcbd40a88 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:26:48.008459 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-45c47beb-e627-4145-ab5a-f41dcbd40a88 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:26:48.009096 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-45c47beb-e627-4145-ab5a-f41dcbd40a88 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:26:48.009619 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-45c47beb-e627-4145-ab5a-f41dcbd40a88 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:26:48.010137 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-45c47beb-e627-4145-ab5a-f41dcbd40a88 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:26:48.027205 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-45c47beb-e627-4145-ab5a-f41dcbd40a88 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:48.028227 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-45c47beb-e627-4145-ab5a-f41dcbd40a88 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:48.029989 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-45c47beb-e627-4145-ab5a-f41dcbd40a88 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:48.030800 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-45c47beb-e627-4145-ab5a-f41dcbd40a88 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:48.051308 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-45c47beb-e627-4145-ab5a-f41dcbd40a88 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Getting quotas for project e96dedf15be442108c8d5d5ec1775a88. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:26:48.057060 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-45c47beb-e627-4145-ab5a-f41dcbd40a88 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Getting quotas for user bca3243fc2bf41448a184c03df437f8c and project e96dedf15be442108c8d5d5ec1775a88. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:26:48.070962 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-45c47beb-e627-4145-ab5a-f41dcbd40a88 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Going to run 2 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:26:48.073784 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-45c47beb-e627-4145-ab5a-f41dcbd40a88 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 1adbf51b-8e22-4283-ad4f-d72b85fc5db7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:26:48.120637 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-45c47beb-e627-4145-ab5a-f41dcbd40a88 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 2725f200-5bb2-4b65-af28-186bfead7f64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=1adbf51b-8e22-4283-ad4f-d72b85fc5db7,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:26:48.217552 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-45c47beb-e627-4145-ab5a-f41dcbd40a88 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.800889 Jun 05 08:26:48.220799 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 529/1099] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:26:46 2022] POST /compute/v2.1/servers => generated 32 bytes in 1806 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Jun 05 08:26:48.234322 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3217e299-e716-465e-928b-3bb674e31376 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:48.235986 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d4fb082e-e6fe-4355-8af2-b513cc2e47a4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:48.237151 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d4fb082e-e6fe-4355-8af2-b513cc2e47a4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 698ff3cb-adbd-40f3-92e8-5106c2ef6268] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:48.252620 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d4fb082e-e6fe-4355-8af2-b513cc2e47a4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:48.252899 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d4fb082e-e6fe-4355-8af2-b513cc2e47a4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:48.254363 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d4fb082e-e6fe-4355-8af2-b513cc2e47a4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:48.254913 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d4fb082e-e6fe-4355-8af2-b513cc2e47a4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:48.258424 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3217e299-e716-465e-928b-3bb674e31376 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:48.263622 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3217e299-e716-465e-928b-3bb674e31376 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:48.265030 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3217e299-e716-465e-928b-3bb674e31376 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1361 microversion: 2.25 time: 0.686971 Jun 05 08:26:48.276883 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 571/1100] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:47 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1361 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:48.276883 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-b6b56408-0301-4d3c-8043-d0afa0b43813 req-8f6b43ea-ea41-4947-9004-083704e7c4ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698ff3cb-adbd-40f3-92e8-5106c2ef6268", "name": "network-vif-plugged", "status": "completed", "tag": "b97f6282-a66c-4ac6-a237-2d0f246eb96f"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:48.299403 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-b6b56408-0301-4d3c-8043-d0afa0b43813 req-8f6b43ea-ea41-4947-9004-083704e7c4ab service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:48.299846 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-b6b56408-0301-4d3c-8043-d0afa0b43813 req-8f6b43ea-ea41-4947-9004-083704e7c4ab service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:48.328644 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-b6b56408-0301-4d3c-8043-d0afa0b43813 req-8f6b43ea-ea41-4947-9004-083704e7c4ab service nova] Creating event network-vif-plugged:b97f6282-a66c-4ac6-a237-2d0f246eb96f for instance 698ff3cb-adbd-40f3-92e8-5106c2ef6268 on n-h2-844739-1 Jun 05 08:26:48.336139 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-b6b56408-0301-4d3c-8043-d0afa0b43813 req-8f6b43ea-ea41-4947-9004-083704e7c4ab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067111 Jun 05 08:26:48.337222 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 572/1101] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:48.345214 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-347cd469-b8e2-45ea-ba6f-bdd1d95ae4e3 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:48.349128 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-347cd469-b8e2-45ea-ba6f-bdd1d95ae4e3 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:48.350021 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-347cd469-b8e2-45ea-ba6f-bdd1d95ae4e3 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Searching by: {'deleted': False, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88'} {{(pid=119049) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 05 08:26:48.390272 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-347cd469-b8e2-45ea-ba6f-bdd1d95ae4e3 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:48.391076 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-347cd469-b8e2-45ea-ba6f-bdd1d95ae4e3 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:48.392356 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-347cd469-b8e2-45ea-ba6f-bdd1d95ae4e3 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:48.393053 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-347cd469-b8e2-45ea-ba6f-bdd1d95ae4e3 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:48.471442 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.multi_cell_list [None req-347cd469-b8e2-45ea-ba6f-bdd1d95ae4e3 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=119049) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 05 08:26:48.520351 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-347cd469-b8e2-45ea-ba6f-bdd1d95ae4e3 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.181577 Jun 05 08:26:48.526447 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 573/1102] 10.222.0.33 () {58 vars in 1124 bytes} [Sun Jun 5 08:26:48 2022] GET /compute/v2.1/servers => generated 1337 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:48.527897 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bb7bf093-a216-4cbb-8bb8-2e5b67f73f16 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:48.529600 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-bb7bf093-a216-4cbb-8bb8-2e5b67f73f16 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:48.537411 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bb7bf093-a216-4cbb-8bb8-2e5b67f73f16 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:48.537895 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bb7bf093-a216-4cbb-8bb8-2e5b67f73f16 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:48.538758 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bb7bf093-a216-4cbb-8bb8-2e5b67f73f16 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:48.539274 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bb7bf093-a216-4cbb-8bb8-2e5b67f73f16 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:48.914098 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d4fb082e-e6fe-4355-8af2-b513cc2e47a4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:48.941764 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d4fb082e-e6fe-4355-8af2-b513cc2e47a4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/698ff3cb-adbd-40f3-92e8-5106c2ef6268" status: 200 len: 1317 microversion: 2.1 time: 0.718911 Jun 05 08:26:48.943307 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 530/1103] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:48 2022] GET /compute/v2.1/servers/698ff3cb-adbd-40f3-92e8-5106c2ef6268 => generated 1317 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:48.949024 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-488c5bef-c060-4017-b66b-dd9c260a7aaa tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:48.951779 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-488c5bef-c060-4017-b66b-dd9c260a7aaa tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 2725f200-5bb2-4b65-af28-186bfead7f64] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:49.085123 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-488c5bef-c060-4017-b66b-dd9c260a7aaa tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:49.099695 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-488c5bef-c060-4017-b66b-dd9c260a7aaa tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64" status: 200 len: 1218 microversion: 2.1 time: 0.152124 Jun 05 08:26:49.102495 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 531/1104] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:48 2022] GET /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64 => generated 1218 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:49.121005 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-bb7bf093-a216-4cbb-8bb8-2e5b67f73f16 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:49.121995 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0bc9e755-f8e0-490b-a852-688fd7cd9ea8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:49.126382 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0bc9e755-f8e0-490b-a852-688fd7cd9ea8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:49.130450 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bb7bf093-a216-4cbb-8bb8-2e5b67f73f16 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.608005 Jun 05 08:26:49.136684 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 574/1105] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:48 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:49.145270 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0bc9e755-f8e0-490b-a852-688fd7cd9ea8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:49.145737 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0bc9e755-f8e0-490b-a852-688fd7cd9ea8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:49.152807 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0bc9e755-f8e0-490b-a852-688fd7cd9ea8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:49.153341 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0bc9e755-f8e0-490b-a852-688fd7cd9ea8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:49.212973 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0bc9e755-f8e0-490b-a852-688fd7cd9ea8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:49.213848 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0bc9e755-f8e0-490b-a852-688fd7cd9ea8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:49.214520 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-0bc9e755-f8e0-490b-a852-688fd7cd9ea8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:49.283247 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e3cbeb7f-ce3a-4810-b076-9942c31252ea tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:49.283878 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e3cbeb7f-ce3a-4810-b076-9942c31252ea tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:49.292265 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e3cbeb7f-ce3a-4810-b076-9942c31252ea tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:49.292962 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e3cbeb7f-ce3a-4810-b076-9942c31252ea tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:49.299259 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e3cbeb7f-ce3a-4810-b076-9942c31252ea tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:49.299921 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e3cbeb7f-ce3a-4810-b076-9942c31252ea tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:49.378021 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0bc9e755-f8e0-490b-a852-688fd7cd9ea8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:49.429777 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0bc9e755-f8e0-490b-a852-688fd7cd9ea8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.319716 Jun 05 08:26:49.444480 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 532/1106] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:49 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:49.687111 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e3cbeb7f-ce3a-4810-b076-9942c31252ea tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:49.700949 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e3cbeb7f-ce3a-4810-b076-9942c31252ea tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:49.702607 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e3cbeb7f-ce3a-4810-b076-9942c31252ea tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:49.703797 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e3cbeb7f-ce3a-4810-b076-9942c31252ea tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1361 microversion: 2.25 time: 0.424493 Jun 05 08:26:49.704403 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 575/1107] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:49 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1361 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:26:49.963328 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a6894b83-db23-43d3-a80d-79d32eea2ad4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:49.964197 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a6894b83-db23-43d3-a80d-79d32eea2ad4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 698ff3cb-adbd-40f3-92e8-5106c2ef6268] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:49.989355 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a6894b83-db23-43d3-a80d-79d32eea2ad4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:49.990957 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a6894b83-db23-43d3-a80d-79d32eea2ad4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:49.994563 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a6894b83-db23-43d3-a80d-79d32eea2ad4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:49.995146 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a6894b83-db23-43d3-a80d-79d32eea2ad4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:50.130362 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b299f597-d372-42a3-a325-524d8ffe4630 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:50.131900 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b299f597-d372-42a3-a325-524d8ffe4630 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 2725f200-5bb2-4b65-af28-186bfead7f64] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:50.156927 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b299f597-d372-42a3-a325-524d8ffe4630 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:50.157388 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b299f597-d372-42a3-a325-524d8ffe4630 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:50.158193 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b299f597-d372-42a3-a325-524d8ffe4630 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:50.158634 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b299f597-d372-42a3-a325-524d8ffe4630 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:51.244447 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b299f597-d372-42a3-a325-524d8ffe4630 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:51.258791 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b299f597-d372-42a3-a325-524d8ffe4630 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64" status: 200 len: 1270 microversion: 2.1 time: 1.140450 Jun 05 08:26:51.270784 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 576/1108] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:50 2022] GET /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64 => generated 1270 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:51.276828 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-42c43186-a3eb-40f2-bf61-70fb39dc3464 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:51.279084 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-42c43186-a3eb-40f2-bf61-70fb39dc3464 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:51.286463 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42c43186-a3eb-40f2-bf61-70fb39dc3464 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:51.287268 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42c43186-a3eb-40f2-bf61-70fb39dc3464 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:51.290259 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42c43186-a3eb-40f2-bf61-70fb39dc3464 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:51.292597 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42c43186-a3eb-40f2-bf61-70fb39dc3464 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:51.369622 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a6894b83-db23-43d3-a80d-79d32eea2ad4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:51.377581 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a6894b83-db23-43d3-a80d-79d32eea2ad4 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/698ff3cb-adbd-40f3-92e8-5106c2ef6268" status: 200 len: 1317 microversion: 2.1 time: 1.418672 Jun 05 08:26:51.390064 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 533/1109] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:49 2022] GET /compute/v2.1/servers/698ff3cb-adbd-40f3-92e8-5106c2ef6268 => generated 1317 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:51.390447 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0b56c6ce-82dc-4442-8bba-6b4c4715d297 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:51.397226 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0b56c6ce-82dc-4442-8bba-6b4c4715d297 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:51.415545 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0b56c6ce-82dc-4442-8bba-6b4c4715d297 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:51.416074 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0b56c6ce-82dc-4442-8bba-6b4c4715d297 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:51.417210 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0b56c6ce-82dc-4442-8bba-6b4c4715d297 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:51.421559 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0b56c6ce-82dc-4442-8bba-6b4c4715d297 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:51.497670 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0b56c6ce-82dc-4442-8bba-6b4c4715d297 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:51.498087 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0b56c6ce-82dc-4442-8bba-6b4c4715d297 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:51.498567 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-0b56c6ce-82dc-4442-8bba-6b4c4715d297 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:51.600918 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0b56c6ce-82dc-4442-8bba-6b4c4715d297 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:51.613136 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0b56c6ce-82dc-4442-8bba-6b4c4715d297 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.227586 Jun 05 08:26:51.614385 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 534/1110] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:51 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:51.620695 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-777517de-bd01-42ef-8751-f4783149b38b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:51.621665 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-777517de-bd01-42ef-8751-f4783149b38b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:51.630396 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-777517de-bd01-42ef-8751-f4783149b38b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:51.631329 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-777517de-bd01-42ef-8751-f4783149b38b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:51.632359 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-777517de-bd01-42ef-8751-f4783149b38b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:51.633043 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-777517de-bd01-42ef-8751-f4783149b38b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:52.122604 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-42c43186-a3eb-40f2-bf61-70fb39dc3464 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:52.131619 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-42c43186-a3eb-40f2-bf61-70fb39dc3464 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.859315 Jun 05 08:26:52.142668 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 577/1111] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:51 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:52.147246 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-cc0379fc-e10f-4cc7-af7f-51af3b4e88be req-a87134ea-f0f5-4fee-aa00-87a595834f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e3f0d36-6bfe-4cb0-a001-4940b6da70e5", "name": "network-vif-deleted", "tag": "da3f0e4a-bf17-487b-ab03-a4b1fecf0f16"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:52.176191 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-cc0379fc-e10f-4cc7-af7f-51af3b4e88be req-a87134ea-f0f5-4fee-aa00-87a595834f2a service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:52.176639 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-cc0379fc-e10f-4cc7-af7f-51af3b4e88be req-a87134ea-f0f5-4fee-aa00-87a595834f2a service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:52.205657 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-777517de-bd01-42ef-8751-f4783149b38b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:52.216453 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-777517de-bd01-42ef-8751-f4783149b38b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:52.217196 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-cc0379fc-e10f-4cc7-af7f-51af3b4e88be req-a87134ea-f0f5-4fee-aa00-87a595834f2a service nova] Creating event network-vif-deleted:da3f0e4a-bf17-487b-ab03-a4b1fecf0f16 for instance 9e3f0d36-6bfe-4cb0-a001-4940b6da70e5 on n-h1-844739-1 Jun 05 08:26:52.218315 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-777517de-bd01-42ef-8751-f4783149b38b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:52.219333 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-777517de-bd01-42ef-8751-f4783149b38b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1361 microversion: 2.25 time: 0.602701 Jun 05 08:26:52.222303 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-cc0379fc-e10f-4cc7-af7f-51af3b4e88be req-a87134ea-f0f5-4fee-aa00-87a595834f2a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078607 Jun 05 08:26:52.223334 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 578/1112] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:52.228824 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 535/1113] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:51 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1361 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:52.277933 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-693a5f72-88d4-4e21-9a03-2e81039072c7 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:52.279635 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-693a5f72-88d4-4e21-9a03-2e81039072c7 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 2725f200-5bb2-4b65-af28-186bfead7f64] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:52.303091 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-693a5f72-88d4-4e21-9a03-2e81039072c7 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:52.320265 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-693a5f72-88d4-4e21-9a03-2e81039072c7 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:52.321447 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-693a5f72-88d4-4e21-9a03-2e81039072c7 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:52.321911 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-693a5f72-88d4-4e21-9a03-2e81039072c7 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:52.402957 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f17936ef-0802-4a37-a11d-a6ae498d1d5b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:52.405403 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f17936ef-0802-4a37-a11d-a6ae498d1d5b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 698ff3cb-adbd-40f3-92e8-5106c2ef6268] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:52.415556 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f17936ef-0802-4a37-a11d-a6ae498d1d5b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:52.416015 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f17936ef-0802-4a37-a11d-a6ae498d1d5b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:52.416819 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f17936ef-0802-4a37-a11d-a6ae498d1d5b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:52.417264 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f17936ef-0802-4a37-a11d-a6ae498d1d5b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:52.604926 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-693a5f72-88d4-4e21-9a03-2e81039072c7 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:52.629390 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-693a5f72-88d4-4e21-9a03-2e81039072c7 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64" status: 200 len: 1276 microversion: 2.1 time: 0.355723 Jun 05 08:26:52.634205 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 579/1114] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:52 2022] GET /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64 => generated 1276 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:52.639211 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0c0d8531-447e-44a4-bdb5-1058d1b408f8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:52.639895 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0c0d8531-447e-44a4-bdb5-1058d1b408f8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:52.655387 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0c0d8531-447e-44a4-bdb5-1058d1b408f8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:52.657000 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0c0d8531-447e-44a4-bdb5-1058d1b408f8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:52.658280 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0c0d8531-447e-44a4-bdb5-1058d1b408f8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:52.658726 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0c0d8531-447e-44a4-bdb5-1058d1b408f8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:52.740172 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0c0d8531-447e-44a4-bdb5-1058d1b408f8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:52.741872 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0c0d8531-447e-44a4-bdb5-1058d1b408f8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:52.743248 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-0c0d8531-447e-44a4-bdb5-1058d1b408f8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:52.967576 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0c0d8531-447e-44a4-bdb5-1058d1b408f8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:52.980340 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0c0d8531-447e-44a4-bdb5-1058d1b408f8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.342119 Jun 05 08:26:52.982988 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 580/1115] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:52 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:52.998176 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-f4a8467c-1099-454c-820e-9f8b0a958e54 req-b3f65325-8da3-488f-8f4b-14c890dba6be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d031b21-37d5-4454-bed7-db50a225bce5", "name": "network-vif-plugged", "status": "completed", "tag": "8d0bec8a-b955-48a2-b49c-95afe47c2245"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:53.021608 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-f4a8467c-1099-454c-820e-9f8b0a958e54 req-b3f65325-8da3-488f-8f4b-14c890dba6be service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:53.022061 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-f4a8467c-1099-454c-820e-9f8b0a958e54 req-b3f65325-8da3-488f-8f4b-14c890dba6be service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:53.070830 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-f4a8467c-1099-454c-820e-9f8b0a958e54 req-b3f65325-8da3-488f-8f4b-14c890dba6be service nova] Creating event network-vif-plugged:8d0bec8a-b955-48a2-b49c-95afe47c2245 for instance 5d031b21-37d5-4454-bed7-db50a225bce5 on n-h1-844739-1 Jun 05 08:26:53.082661 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-f4a8467c-1099-454c-820e-9f8b0a958e54 req-b3f65325-8da3-488f-8f4b-14c890dba6be service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097941 Jun 05 08:26:53.086950 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 581/1116] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:53.106777 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f17936ef-0802-4a37-a11d-a6ae498d1d5b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:53.126771 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f17936ef-0802-4a37-a11d-a6ae498d1d5b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/698ff3cb-adbd-40f3-92e8-5106c2ef6268" status: 200 len: 1467 microversion: 2.1 time: 0.727872 Jun 05 08:26:53.141132 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 536/1117] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:52 2022] GET /compute/v2.1/servers/698ff3cb-adbd-40f3-92e8-5106c2ef6268 => generated 1467 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:53.157978 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f72b9034-8c3c-49dc-a444-43e242cc05f8 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:53.158836 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f72b9034-8c3c-49dc-a444-43e242cc05f8 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] [instance: 698ff3cb-adbd-40f3-92e8-5106c2ef6268] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:53.165114 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f72b9034-8c3c-49dc-a444-43e242cc05f8 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:53.165568 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f72b9034-8c3c-49dc-a444-43e242cc05f8 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:53.166355 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f72b9034-8c3c-49dc-a444-43e242cc05f8 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:53.166789 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f72b9034-8c3c-49dc-a444-43e242cc05f8 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:53.322656 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-eb5624ce-1bc3-478c-b18d-c619a6ea6d4c tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1851787663", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:53.383655 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-eb5624ce-1bc3-478c-b18d-c619a6ea6d4c tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] validate_networks() for None {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:26:53.699370 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f72b9034-8c3c-49dc-a444-43e242cc05f8 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/698ff3cb-adbd-40f3-92e8-5106c2ef6268" status: 200 len: 1618 microversion: 2.1 time: 0.545186 Jun 05 08:26:53.706593 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 537/1118] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:53 2022] GET /compute/v2.1/servers/698ff3cb-adbd-40f3-92e8-5106c2ef6268 => generated 1618 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:26:53.712847 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8e83eb19-34cb-4ef2-a727-7bcff1f98dca tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:53.713821 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8e83eb19-34cb-4ef2-a727-7bcff1f98dca tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:53.722827 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8e83eb19-34cb-4ef2-a727-7bcff1f98dca tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:53.723476 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8e83eb19-34cb-4ef2-a727-7bcff1f98dca tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:53.724321 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8e83eb19-34cb-4ef2-a727-7bcff1f98dca tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:53.724763 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8e83eb19-34cb-4ef2-a727-7bcff1f98dca tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:54.064416 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-eb5624ce-1bc3-478c-b18d-c619a6ea6d4c tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:26:54.064842 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-eb5624ce-1bc3-478c-b18d-c619a6ea6d4c tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:26:54.065318 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-eb5624ce-1bc3-478c-b18d-c619a6ea6d4c tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:26:54.066410 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-eb5624ce-1bc3-478c-b18d-c619a6ea6d4c tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:26:54.066410 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-eb5624ce-1bc3-478c-b18d-c619a6ea6d4c tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:26:54.075578 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-eb5624ce-1bc3-478c-b18d-c619a6ea6d4c tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:54.076412 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-eb5624ce-1bc3-478c-b18d-c619a6ea6d4c tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:54.076863 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-eb5624ce-1bc3-478c-b18d-c619a6ea6d4c tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:54.077302 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-eb5624ce-1bc3-478c-b18d-c619a6ea6d4c tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:54.093884 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-eb5624ce-1bc3-478c-b18d-c619a6ea6d4c tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Getting quotas for project bc76c30c981d4c69b229b6d7415c910c. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:26:54.098562 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-eb5624ce-1bc3-478c-b18d-c619a6ea6d4c tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Getting quotas for user 6cdc8382bafd49a3877df672d02f8206 and project bc76c30c981d4c69b229b6d7415c910c. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:26:54.110565 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-eb5624ce-1bc3-478c-b18d-c619a6ea6d4c tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:26:54.112967 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-eb5624ce-1bc3-478c-b18d-c619a6ea6d4c tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:26:54.163145 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-eb5624ce-1bc3-478c-b18d-c619a6ea6d4c tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.063735 Jun 05 08:26:54.168943 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 582/1119] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:26:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:26:54.168943 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3a980b03-5cfc-4051-8365-a5fd30a2bc0b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:54.169979 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3a980b03-5cfc-4051-8365-a5fd30a2bc0b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:54.176681 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3a980b03-5cfc-4051-8365-a5fd30a2bc0b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:54.177136 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3a980b03-5cfc-4051-8365-a5fd30a2bc0b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:54.177916 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3a980b03-5cfc-4051-8365-a5fd30a2bc0b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:54.178357 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3a980b03-5cfc-4051-8365-a5fd30a2bc0b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:54.560771 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8e83eb19-34cb-4ef2-a727-7bcff1f98dca tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:54.569020 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8e83eb19-34cb-4ef2-a727-7bcff1f98dca tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.861098 Jun 05 08:26:54.569815 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 538/1120] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:53 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:54.582879 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-738f5351-8304-43be-a4f4-d178688a66cb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:54.583857 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-738f5351-8304-43be-a4f4-d178688a66cb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:54.591193 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-738f5351-8304-43be-a4f4-d178688a66cb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:54.591822 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-738f5351-8304-43be-a4f4-d178688a66cb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:54.592649 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-738f5351-8304-43be-a4f4-d178688a66cb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:54.593097 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-738f5351-8304-43be-a4f4-d178688a66cb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:54.619284 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-738f5351-8304-43be-a4f4-d178688a66cb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/ips" status: 200 len: 152 microversion: 2.20 time: 0.048175 Jun 05 08:26:54.619886 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 539/1121] 10.222.0.33 () {60 vars in 1288 bytes} [Sun Jun 5 08:26:54 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/ips => generated 152 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:26:54.625016 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-df99f825-690b-437b-9a75-c7d429bc00e3 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:54.625641 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-df99f825-690b-437b-9a75-c7d429bc00e3 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 2725f200-5bb2-4b65-af28-186bfead7f64] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:54.632176 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-df99f825-690b-437b-9a75-c7d429bc00e3 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:54.632637 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-df99f825-690b-437b-9a75-c7d429bc00e3 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:54.633462 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-df99f825-690b-437b-9a75-c7d429bc00e3 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:54.633892 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-df99f825-690b-437b-9a75-c7d429bc00e3 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:54.734122 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-df99f825-690b-437b-9a75-c7d429bc00e3 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:54.747253 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-df99f825-690b-437b-9a75-c7d429bc00e3 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64" status: 200 len: 1276 microversion: 2.1 time: 0.126178 Jun 05 08:26:54.748414 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 540/1122] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:54 2022] GET /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64 => generated 1276 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:54.754810 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-8d769359-2456-4b46-b58c-2a000efaf6ca req-cef833d8-001f-43b9-bdb5-af7ab8827c76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05801050-4724-44df-8f50-9317e26f10d4", "name": "network-vif-deleted", "tag": "73dd3602-41ee-4997-8f16-54fb03878f91"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:54.767802 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-8d769359-2456-4b46-b58c-2a000efaf6ca req-cef833d8-001f-43b9-bdb5-af7ab8827c76 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:54.768641 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-8d769359-2456-4b46-b58c-2a000efaf6ca req-cef833d8-001f-43b9-bdb5-af7ab8827c76 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:54.784661 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-8d769359-2456-4b46-b58c-2a000efaf6ca req-cef833d8-001f-43b9-bdb5-af7ab8827c76 service nova] Creating event network-vif-deleted:73dd3602-41ee-4997-8f16-54fb03878f91 for instance 05801050-4724-44df-8f50-9317e26f10d4 on n-h1-844739-1 Jun 05 08:26:54.786227 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3a980b03-5cfc-4051-8365-a5fd30a2bc0b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:54.790445 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-8d769359-2456-4b46-b58c-2a000efaf6ca req-cef833d8-001f-43b9-bdb5-af7ab8827c76 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040567 Jun 05 08:26:54.791585 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 541/1123] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:54.798152 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4aabc9fd-f093-4ed0-a16a-14ad4519e8fe tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1876568143", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["8719f86c-4f4f-4c65-b580-c5d526d05175"]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:54.848469 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3a980b03-5cfc-4051-8365-a5fd30a2bc0b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:54.865148 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3a980b03-5cfc-4051-8365-a5fd30a2bc0b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:54.866642 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3a980b03-5cfc-4051-8365-a5fd30a2bc0b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1361 microversion: 2.25 time: 0.701852 Jun 05 08:26:54.867985 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 583/1124] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:54 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1361 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:54.896471 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-4aabc9fd-f093-4ed0-a16a-14ad4519e8fe tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] validate_networks() for None {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:26:54.901522 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e2c60945-6b0d-4879-88ea-4231d2bbfdd1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:54.902139 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e2c60945-6b0d-4879-88ea-4231d2bbfdd1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:54.925032 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e2c60945-6b0d-4879-88ea-4231d2bbfdd1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:54.931169 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e2c60945-6b0d-4879-88ea-4231d2bbfdd1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:54.932394 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e2c60945-6b0d-4879-88ea-4231d2bbfdd1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:54.933085 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e2c60945-6b0d-4879-88ea-4231d2bbfdd1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:55.009238 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e2c60945-6b0d-4879-88ea-4231d2bbfdd1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:55.011800 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e2c60945-6b0d-4879-88ea-4231d2bbfdd1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:55.012852 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-e2c60945-6b0d-4879-88ea-4231d2bbfdd1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:55.104145 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e2c60945-6b0d-4879-88ea-4231d2bbfdd1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:55.111794 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e2c60945-6b0d-4879-88ea-4231d2bbfdd1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.220824 Jun 05 08:26:55.115201 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 584/1125] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:54 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:55.120933 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2c562c5a-4c53-4ca8-abed-5ac3577eb0f7 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:55.124751 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2c562c5a-4c53-4ca8-abed-5ac3577eb0f7 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:55.151207 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2c562c5a-4c53-4ca8-abed-5ac3577eb0f7 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:55.151794 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2c562c5a-4c53-4ca8-abed-5ac3577eb0f7 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:55.156584 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2c562c5a-4c53-4ca8-abed-5ac3577eb0f7 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:55.157096 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2c562c5a-4c53-4ca8-abed-5ac3577eb0f7 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:55.354087 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2c562c5a-4c53-4ca8-abed-5ac3577eb0f7 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdc8382bafd49a3877df672d02f8206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76c30c981d4c69b229b6d7415c910c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:55.369599 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2c562c5a-4c53-4ca8-abed-5ac3577eb0f7 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5" status: 200 len: 1220 microversion: 2.1 time: 0.253145 Jun 05 08:26:55.388759 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 585/1126] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:55 2022] GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5 => generated 1220 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:55.401416 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-7e53f2ac-091a-4bf5-9b53-ec3438da67cf req-0fd57e7c-3a1e-4f02-b58b-3e0ff93f246b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05801050-4724-44df-8f50-9317e26f10d4", "name": "network-vif-unplugged", "status": "completed", "tag": "73dd3602-41ee-4997-8f16-54fb03878f91"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:55.418961 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-7e53f2ac-091a-4bf5-9b53-ec3438da67cf req-0fd57e7c-3a1e-4f02-b58b-3e0ff93f246b service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:55.419953 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-7e53f2ac-091a-4bf5-9b53-ec3438da67cf req-0fd57e7c-3a1e-4f02-b58b-3e0ff93f246b service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:55.445632 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-7e53f2ac-091a-4bf5-9b53-ec3438da67cf req-0fd57e7c-3a1e-4f02-b58b-3e0ff93f246b service nova] Creating event network-vif-unplugged:73dd3602-41ee-4997-8f16-54fb03878f91 for instance 05801050-4724-44df-8f50-9317e26f10d4 on n-h1-844739-1 Jun 05 08:26:55.451975 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-7e53f2ac-091a-4bf5-9b53-ec3438da67cf req-0fd57e7c-3a1e-4f02-b58b-3e0ff93f246b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061549 Jun 05 08:26:55.453337 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 586/1127] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:55.486005 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-4aabc9fd-f093-4ed0-a16a-14ad4519e8fe tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:26:55.488567 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-4aabc9fd-f093-4ed0-a16a-14ad4519e8fe tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:26:55.489231 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-4aabc9fd-f093-4ed0-a16a-14ad4519e8fe tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:26:55.490287 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-4aabc9fd-f093-4ed0-a16a-14ad4519e8fe tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:26:55.492646 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-4aabc9fd-f093-4ed0-a16a-14ad4519e8fe tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:26:55.520211 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4aabc9fd-f093-4ed0-a16a-14ad4519e8fe tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:55.524568 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4aabc9fd-f093-4ed0-a16a-14ad4519e8fe tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:55.525636 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4aabc9fd-f093-4ed0-a16a-14ad4519e8fe tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:55.526278 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4aabc9fd-f093-4ed0-a16a-14ad4519e8fe tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:55.550285 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-4aabc9fd-f093-4ed0-a16a-14ad4519e8fe tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for project 5241947581244d30ba1528e6d5fad743. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:26:55.558094 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-4aabc9fd-f093-4ed0-a16a-14ad4519e8fe tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for user 27beb829232e464092b06d904b9d6ec0 and project 5241947581244d30ba1528e6d5fad743. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:26:55.579756 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4aabc9fd-f093-4ed0-a16a-14ad4519e8fe tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:26:55.585441 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4aabc9fd-f093-4ed0-a16a-14ad4519e8fe tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 4210ab7f-0e7d-4e20-ba9b-9869c01c92ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:26:55.589388 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5db496ca-3c33-4d8b-8c4e-6044f8ad5367 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:55.589965 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5db496ca-3c33-4d8b-8c4e-6044f8ad5367 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:55.600790 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5db496ca-3c33-4d8b-8c4e-6044f8ad5367 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:55.603375 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5db496ca-3c33-4d8b-8c4e-6044f8ad5367 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:55.604213 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5db496ca-3c33-4d8b-8c4e-6044f8ad5367 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:55.604666 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5db496ca-3c33-4d8b-8c4e-6044f8ad5367 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:55.670938 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4aabc9fd-f093-4ed0-a16a-14ad4519e8fe tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.877733 Jun 05 08:26:55.676330 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 542/1128] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:26:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:26:55.685092 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d4885d4e-8b84-44bf-b8ca-24dc9519d87f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:55.690612 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d4885d4e-8b84-44bf-b8ca-24dc9519d87f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 4210ab7f-0e7d-4e20-ba9b-9869c01c92ae] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:55.709454 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:55.912767 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d4885d4e-8b84-44bf-b8ca-24dc9519d87f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:55.927420 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d4885d4e-8b84-44bf-b8ca-24dc9519d87f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae" status: 200 len: 1217 microversion: 2.1 time: 0.248883 Jun 05 08:26:55.937479 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 543/1129] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:55 2022] GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae => generated 1217 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:55.937479 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a2a8645f-7d88-4e97-933d-01ec8cdac371 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:55.937479 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a2a8645f-7d88-4e97-933d-01ec8cdac371 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 2725f200-5bb2-4b65-af28-186bfead7f64] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:55.951543 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a2a8645f-7d88-4e97-933d-01ec8cdac371 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:55.957867 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a2a8645f-7d88-4e97-933d-01ec8cdac371 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:55.958814 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a2a8645f-7d88-4e97-933d-01ec8cdac371 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:55.959477 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a2a8645f-7d88-4e97-933d-01ec8cdac371 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:56.141430 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5db496ca-3c33-4d8b-8c4e-6044f8ad5367 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:56.150939 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5db496ca-3c33-4d8b-8c4e-6044f8ad5367 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.567547 Jun 05 08:26:56.155761 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 587/1130] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:55 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:26:56.166343 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-77dfe8b6-1623-48b6-b291-c42eda89a511 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:56.166977 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-77dfe8b6-1623-48b6-b291-c42eda89a511 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:56.193649 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-77dfe8b6-1623-48b6-b291-c42eda89a511 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:56.195043 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-77dfe8b6-1623-48b6-b291-c42eda89a511 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:56.196402 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-77dfe8b6-1623-48b6-b291-c42eda89a511 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:56.199251 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-77dfe8b6-1623-48b6-b291-c42eda89a511 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:56.374077 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a2a8645f-7d88-4e97-933d-01ec8cdac371 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:56.382360 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a2a8645f-7d88-4e97-933d-01ec8cdac371 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64" status: 200 len: 1318 microversion: 2.1 time: 0.452858 Jun 05 08:26:56.382945 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 544/1131] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:55 2022] GET /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64 => generated 1318 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:56.413099 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-46795cc4-2773-4d7d-b46e-aa95ca9713e6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:56.415284 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-46795cc4-2773-4d7d-b46e-aa95ca9713e6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:56.447836 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-46795cc4-2773-4d7d-b46e-aa95ca9713e6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:56.448891 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-46795cc4-2773-4d7d-b46e-aa95ca9713e6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:56.452522 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-46795cc4-2773-4d7d-b46e-aa95ca9713e6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:56.453406 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-46795cc4-2773-4d7d-b46e-aa95ca9713e6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:56.566253 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-46795cc4-2773-4d7d-b46e-aa95ca9713e6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:56.568585 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-46795cc4-2773-4d7d-b46e-aa95ca9713e6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:56.569692 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-46795cc4-2773-4d7d-b46e-aa95ca9713e6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:56.595121 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-77dfe8b6-1623-48b6-b291-c42eda89a511 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:56.609413 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-77dfe8b6-1623-48b6-b291-c42eda89a511 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:56.613101 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-77dfe8b6-1623-48b6-b291-c42eda89a511 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:56.614787 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-77dfe8b6-1623-48b6-b291-c42eda89a511 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1361 microversion: 2.25 time: 0.457600 Jun 05 08:26:56.615613 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 588/1132] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:56 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1361 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:56.622268 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b01c7179-2b69-4229-af72-ccc4f0e1380b tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:56.623213 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b01c7179-2b69-4229-af72-ccc4f0e1380b tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:56.633847 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b01c7179-2b69-4229-af72-ccc4f0e1380b tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:56.634721 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b01c7179-2b69-4229-af72-ccc4f0e1380b tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:56.635833 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b01c7179-2b69-4229-af72-ccc4f0e1380b tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:56.637150 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b01c7179-2b69-4229-af72-ccc4f0e1380b tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:56.673018 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-46795cc4-2773-4d7d-b46e-aa95ca9713e6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:56.676753 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:56.689070 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-46795cc4-2773-4d7d-b46e-aa95ca9713e6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.287451 Jun 05 08:26:56.689963 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 545/1133] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:56 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:56.740074 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b01c7179-2b69-4229-af72-ccc4f0e1380b tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdc8382bafd49a3877df672d02f8206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76c30c981d4c69b229b6d7415c910c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:56.750549 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b01c7179-2b69-4229-af72-ccc4f0e1380b tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5" status: 200 len: 1220 microversion: 2.1 time: 0.132914 Jun 05 08:26:56.751844 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 589/1134] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:56 2022] GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5 => generated 1220 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:56.823070 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-635baf2e-a338-46aa-a375-b99391869813 req-700e2fc3-7d8d-41d3-a849-94c68bfb5322 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2725f200-5bb2-4b65-af28-186bfead7f64", "tag": "b0406d71-f20c-4491-9e27-c5f2fb5f3588"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:56.835719 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-635baf2e-a338-46aa-a375-b99391869813 req-700e2fc3-7d8d-41d3-a849-94c68bfb5322 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:56.836229 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-635baf2e-a338-46aa-a375-b99391869813 req-700e2fc3-7d8d-41d3-a849-94c68bfb5322 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:56.861579 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-635baf2e-a338-46aa-a375-b99391869813 req-700e2fc3-7d8d-41d3-a849-94c68bfb5322 service nova] Creating event network-changed:b0406d71-f20c-4491-9e27-c5f2fb5f3588 for instance 2725f200-5bb2-4b65-af28-186bfead7f64 on n-h2-844739-1 Jun 05 08:26:56.885848 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-635baf2e-a338-46aa-a375-b99391869813 req-700e2fc3-7d8d-41d3-a849-94c68bfb5322 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064615 Jun 05 08:26:56.889504 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 546/1135] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:26:56.946023 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c6369fa8-12ab-4754-a056-99abc6f86b2e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:56.946727 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c6369fa8-12ab-4754-a056-99abc6f86b2e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 4210ab7f-0e7d-4e20-ba9b-9869c01c92ae] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:56.960314 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c6369fa8-12ab-4754-a056-99abc6f86b2e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:56.961469 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c6369fa8-12ab-4754-a056-99abc6f86b2e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:56.966522 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c6369fa8-12ab-4754-a056-99abc6f86b2e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:56.968153 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c6369fa8-12ab-4754-a056-99abc6f86b2e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:56.989869 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=100 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:57.044414 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c6369fa8-12ab-4754-a056-99abc6f86b2e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:57.054708 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c6369fa8-12ab-4754-a056-99abc6f86b2e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae" status: 200 len: 1269 microversion: 2.1 time: 0.112965 Jun 05 08:26:57.055611 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 590/1136] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:56 2022] GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae => generated 1269 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:57.175528 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-85f3b6b3-5674-4c8a-89c8-777fa36e1f92 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:57.176439 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-85f3b6b3-5674-4c8a-89c8-777fa36e1f92 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:57.183734 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-85f3b6b3-5674-4c8a-89c8-777fa36e1f92 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:57.197733 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-85f3b6b3-5674-4c8a-89c8-777fa36e1f92 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:57.198832 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-85f3b6b3-5674-4c8a-89c8-777fa36e1f92 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:57.199462 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-85f3b6b3-5674-4c8a-89c8-777fa36e1f92 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:57.411320 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-16c66648-e799-4956-8588-c1484c777e19 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:57.412590 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-16c66648-e799-4956-8588-c1484c777e19 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 2725f200-5bb2-4b65-af28-186bfead7f64] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:57.423521 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-16c66648-e799-4956-8588-c1484c777e19 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:57.424278 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-16c66648-e799-4956-8588-c1484c777e19 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:57.425797 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-16c66648-e799-4956-8588-c1484c777e19 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:57.426404 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-16c66648-e799-4956-8588-c1484c777e19 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:57.556725 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-85f3b6b3-5674-4c8a-89c8-777fa36e1f92 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:57.567810 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-85f3b6b3-5674-4c8a-89c8-777fa36e1f92 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.396838 Jun 05 08:26:57.568780 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 547/1137] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:57 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:57.635058 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3ea93caa-f58a-42e3-bad2-3f59d585bf23 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:57.635837 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3ea93caa-f58a-42e3-bad2-3f59d585bf23 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:57.643347 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3ea93caa-f58a-42e3-bad2-3f59d585bf23 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:57.643992 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3ea93caa-f58a-42e3-bad2-3f59d585bf23 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:57.644967 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3ea93caa-f58a-42e3-bad2-3f59d585bf23 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:57.645590 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3ea93caa-f58a-42e3-bad2-3f59d585bf23 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:57.659287 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-16c66648-e799-4956-8588-c1484c777e19 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:57.668226 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-16c66648-e799-4956-8588-c1484c777e19 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64" status: 200 len: 1318 microversion: 2.1 time: 0.271578 Jun 05 08:26:57.669913 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 591/1138] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:57 2022] GET /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64 => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:57.706269 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9ef64ab1-2a98-43b5-88c3-dacf6ff9bfae tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:57.707249 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9ef64ab1-2a98-43b5-88c3-dacf6ff9bfae tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:57.714063 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9ef64ab1-2a98-43b5-88c3-dacf6ff9bfae tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:57.714517 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9ef64ab1-2a98-43b5-88c3-dacf6ff9bfae tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:57.716155 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9ef64ab1-2a98-43b5-88c3-dacf6ff9bfae tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:57.716284 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9ef64ab1-2a98-43b5-88c3-dacf6ff9bfae tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:57.749470 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9ef64ab1-2a98-43b5-88c3-dacf6ff9bfae tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:57.749679 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9ef64ab1-2a98-43b5-88c3-dacf6ff9bfae tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:57.750210 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-9ef64ab1-2a98-43b5-88c3-dacf6ff9bfae tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:57.804103 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9ef64ab1-2a98-43b5-88c3-dacf6ff9bfae tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:57.814974 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9ef64ab1-2a98-43b5-88c3-dacf6ff9bfae tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.112223 Jun 05 08:26:57.816445 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 592/1139] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:57 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:26:57.824297 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-aecb6b0a-ae02-4157-8085-8c62ceab6e93 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:57.825660 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-aecb6b0a-ae02-4157-8085-8c62ceab6e93 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:57.827405 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3ea93caa-f58a-42e3-bad2-3f59d585bf23 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:57.832786 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:26:57.837554 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3ea93caa-f58a-42e3-bad2-3f59d585bf23 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:57.839573 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3ea93caa-f58a-42e3-bad2-3f59d585bf23 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:57.840943 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aecb6b0a-ae02-4157-8085-8c62ceab6e93 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:57.841462 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aecb6b0a-ae02-4157-8085-8c62ceab6e93 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:57.841715 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3ea93caa-f58a-42e3-bad2-3f59d585bf23 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1361 microversion: 2.25 time: 0.211621 Jun 05 08:26:57.842502 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 548/1140] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:57 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:26:57.842654 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aecb6b0a-ae02-4157-8085-8c62ceab6e93 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:57.843052 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aecb6b0a-ae02-4157-8085-8c62ceab6e93 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:57.902197 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-93012681-72a1-4efa-afc3-729bd03c41f9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:26:57.904508 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-93012681-72a1-4efa-afc3-729bd03c41f9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:57.912430 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-93012681-72a1-4efa-afc3-729bd03c41f9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:57.913135 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-93012681-72a1-4efa-afc3-729bd03c41f9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:57.914267 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-93012681-72a1-4efa-afc3-729bd03c41f9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:57.914865 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-93012681-72a1-4efa-afc3-729bd03c41f9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:57.922199 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-aecb6b0a-ae02-4157-8085-8c62ceab6e93 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdc8382bafd49a3877df672d02f8206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76c30c981d4c69b229b6d7415c910c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:57.930160 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-aecb6b0a-ae02-4157-8085-8c62ceab6e93 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5" status: 200 len: 1220 microversion: 2.1 time: 0.112200 Jun 05 08:26:57.940016 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 593/1141] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:57 2022] GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5 => generated 1220 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:57.944171 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-93012681-72a1-4efa-afc3-729bd03c41f9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lazy-loading 'flavor' on Instance uuid b271002d-4613-405c-aeed-7c06b205a045 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:58.073961 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9a7daacc-0164-4a09-b8f4-5131034fba79 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:58.077187 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9a7daacc-0164-4a09-b8f4-5131034fba79 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 4210ab7f-0e7d-4e20-ba9b-9869c01c92ae] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:58.083413 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9a7daacc-0164-4a09-b8f4-5131034fba79 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:58.084016 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9a7daacc-0164-4a09-b8f4-5131034fba79 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:58.084959 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9a7daacc-0164-4a09-b8f4-5131034fba79 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:58.085554 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9a7daacc-0164-4a09-b8f4-5131034fba79 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:58.149464 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9a7daacc-0164-4a09-b8f4-5131034fba79 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:58.158507 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9a7daacc-0164-4a09-b8f4-5131034fba79 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae" status: 200 len: 1275 microversion: 2.1 time: 0.088229 Jun 05 08:26:58.163707 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 594/1142] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:58 2022] GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae => generated 1275 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:58.260120 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-93012681-72a1-4efa-afc3-729bd03c41f9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "POST /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/action" status: 202 len: 0 microversion: 2.20 time: 0.361936 Jun 05 08:26:58.260791 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 549/1143] 10.222.0.33 () {62 vars in 1318 bytes} [Sun Jun 5 08:26:57 2022] POST /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 05 08:26:58.269455 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-25902cc0-2d4c-4d48-88d6-93b973ce8903 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:58.270068 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-25902cc0-2d4c-4d48-88d6-93b973ce8903 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:58.275986 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-25902cc0-2d4c-4d48-88d6-93b973ce8903 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:58.276461 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-25902cc0-2d4c-4d48-88d6-93b973ce8903 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:58.277218 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-25902cc0-2d4c-4d48-88d6-93b973ce8903 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:58.278594 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-25902cc0-2d4c-4d48-88d6-93b973ce8903 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:58.430343 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-25902cc0-2d4c-4d48-88d6-93b973ce8903 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:58.440867 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-25902cc0-2d4c-4d48-88d6-93b973ce8903 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:58.443416 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-25902cc0-2d4c-4d48-88d6-93b973ce8903 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:58.445113 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-25902cc0-2d4c-4d48-88d6-93b973ce8903 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1724 microversion: 2.20 time: 0.179527 Jun 05 08:26:58.457591 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 595/1144] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:58 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:58.587265 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f2245db3-bc62-42d6-a2dc-0c3916a7037c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:58.588109 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f2245db3-bc62-42d6-a2dc-0c3916a7037c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:58.595477 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f2245db3-bc62-42d6-a2dc-0c3916a7037c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:58.596179 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f2245db3-bc62-42d6-a2dc-0c3916a7037c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:58.596977 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f2245db3-bc62-42d6-a2dc-0c3916a7037c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:58.597424 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f2245db3-bc62-42d6-a2dc-0c3916a7037c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:58.686930 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-cb385664-4e31-4c0f-8049-8775e0b03bf2 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:58.687886 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-cb385664-4e31-4c0f-8049-8775e0b03bf2 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 2725f200-5bb2-4b65-af28-186bfead7f64] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:58.694225 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cb385664-4e31-4c0f-8049-8775e0b03bf2 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:58.694970 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cb385664-4e31-4c0f-8049-8775e0b03bf2 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:58.695979 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cb385664-4e31-4c0f-8049-8775e0b03bf2 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:58.697213 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cb385664-4e31-4c0f-8049-8775e0b03bf2 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:58.903144 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f2245db3-bc62-42d6-a2dc-0c3916a7037c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:58.911317 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f2245db3-bc62-42d6-a2dc-0c3916a7037c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.329209 Jun 05 08:26:58.912149 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 550/1145] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:58 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:58.916791 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-efade160-cc68-4a05-aeec-e0e5b24eb3c1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:58.917602 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-efade160-cc68-4a05-aeec-e0e5b24eb3c1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:58.925268 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-efade160-cc68-4a05-aeec-e0e5b24eb3c1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:58.926147 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-efade160-cc68-4a05-aeec-e0e5b24eb3c1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:58.927872 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-efade160-cc68-4a05-aeec-e0e5b24eb3c1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:58.928538 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-efade160-cc68-4a05-aeec-e0e5b24eb3c1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:58.967412 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-efade160-cc68-4a05-aeec-e0e5b24eb3c1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:58.969087 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-efade160-cc68-4a05-aeec-e0e5b24eb3c1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:58.969868 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-efade160-cc68-4a05-aeec-e0e5b24eb3c1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:26:59.104719 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-efade160-cc68-4a05-aeec-e0e5b24eb3c1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:59.112958 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-efade160-cc68-4a05-aeec-e0e5b24eb3c1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.199651 Jun 05 08:26:59.114246 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 551/1146] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:58 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:59.118977 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-38eb1d80-b1da-4789-8562-ed2e300e2dd7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:59.119596 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-38eb1d80-b1da-4789-8562-ed2e300e2dd7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:59.132865 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-38eb1d80-b1da-4789-8562-ed2e300e2dd7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:59.133542 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-38eb1d80-b1da-4789-8562-ed2e300e2dd7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:59.134499 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-38eb1d80-b1da-4789-8562-ed2e300e2dd7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:59.135108 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-38eb1d80-b1da-4789-8562-ed2e300e2dd7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:59.168011 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-cb385664-4e31-4c0f-8049-8775e0b03bf2 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:59.176914 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-cb385664-4e31-4c0f-8049-8775e0b03bf2 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64" status: 200 len: 1318 microversion: 2.1 time: 0.494655 Jun 05 08:26:59.189114 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 596/1147] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:58 2022] GET /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64 => generated 1318 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:59.194995 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3e8432e7-d69c-4763-840f-35c31ab9c4bc tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:59.196179 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3e8432e7-d69c-4763-840f-35c31ab9c4bc tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:59.205584 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3e8432e7-d69c-4763-840f-35c31ab9c4bc tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:59.206437 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3e8432e7-d69c-4763-840f-35c31ab9c4bc tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:59.207494 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3e8432e7-d69c-4763-840f-35c31ab9c4bc tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:59.208210 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3e8432e7-d69c-4763-840f-35c31ab9c4bc tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:59.319554 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3e8432e7-d69c-4763-840f-35c31ab9c4bc tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdc8382bafd49a3877df672d02f8206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76c30c981d4c69b229b6d7415c910c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:59.329877 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3e8432e7-d69c-4763-840f-35c31ab9c4bc tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5" status: 200 len: 1220 microversion: 2.1 time: 0.139329 Jun 05 08:26:59.330735 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 597/1148] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:59 2022] GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5 => generated 1220 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:59.335552 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-82b4aba0-2828-433a-b2ca-4ab6e4680c6b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:59.336385 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-82b4aba0-2828-433a-b2ca-4ab6e4680c6b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 4210ab7f-0e7d-4e20-ba9b-9869c01c92ae] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:59.344261 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-82b4aba0-2828-433a-b2ca-4ab6e4680c6b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:59.344859 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-82b4aba0-2828-433a-b2ca-4ab6e4680c6b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:59.346172 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-82b4aba0-2828-433a-b2ca-4ab6e4680c6b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:59.346617 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-82b4aba0-2828-433a-b2ca-4ab6e4680c6b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:59.488152 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-82b4aba0-2828-433a-b2ca-4ab6e4680c6b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:59.500284 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-82b4aba0-2828-433a-b2ca-4ab6e4680c6b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae" status: 200 len: 1275 microversion: 2.1 time: 0.168343 Jun 05 08:26:59.501273 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 598/1149] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:59 2022] GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae => generated 1275 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:26:59.506297 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-22d24b75-ef72-4f2c-828a-dc379122214b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:59.507093 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-22d24b75-ef72-4f2c-828a-dc379122214b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:59.517163 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-22d24b75-ef72-4f2c-828a-dc379122214b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:59.517624 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-22d24b75-ef72-4f2c-828a-dc379122214b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:59.518862 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-22d24b75-ef72-4f2c-828a-dc379122214b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:59.519301 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-22d24b75-ef72-4f2c-828a-dc379122214b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:59.569326 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-38eb1d80-b1da-4789-8562-ed2e300e2dd7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:59.584807 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-38eb1d80-b1da-4789-8562-ed2e300e2dd7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:59.586936 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-38eb1d80-b1da-4789-8562-ed2e300e2dd7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:59.588427 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-38eb1d80-b1da-4789-8562-ed2e300e2dd7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1361 microversion: 2.25 time: 0.473207 Jun 05 08:26:59.599931 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 552/1150] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:59 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1361 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:26:59.923363 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-22d24b75-ef72-4f2c-828a-dc379122214b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:59.930562 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c80a5eb4-c66b-41b5-b574-cd6dcbd162cc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:26:59.934066 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c80a5eb4-c66b-41b5-b574-cd6dcbd162cc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:26:59.944718 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-22d24b75-ef72-4f2c-828a-dc379122214b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:59.946398 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c80a5eb4-c66b-41b5-b574-cd6dcbd162cc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:59.946849 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c80a5eb4-c66b-41b5-b574-cd6dcbd162cc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:59.948288 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-22d24b75-ef72-4f2c-828a-dc379122214b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:26:59.949378 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c80a5eb4-c66b-41b5-b574-cd6dcbd162cc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:26:59.951366 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c80a5eb4-c66b-41b5-b574-cd6dcbd162cc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:26:59.953388 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-22d24b75-ef72-4f2c-828a-dc379122214b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1724 microversion: 2.20 time: 0.448719 Jun 05 08:26:59.956031 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 599/1151] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:26:59 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1724 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:00.130033 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5e38c518-7112-4b1a-a33f-ef6ff197a010 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:00.130812 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5e38c518-7112-4b1a-a33f-ef6ff197a010 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:00.136896 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5e38c518-7112-4b1a-a33f-ef6ff197a010 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:00.137918 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5e38c518-7112-4b1a-a33f-ef6ff197a010 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:00.138705 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5e38c518-7112-4b1a-a33f-ef6ff197a010 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:00.139147 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5e38c518-7112-4b1a-a33f-ef6ff197a010 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:00.171360 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5e38c518-7112-4b1a-a33f-ef6ff197a010 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:00.171360 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5e38c518-7112-4b1a-a33f-ef6ff197a010 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:00.171671 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-5e38c518-7112-4b1a-a33f-ef6ff197a010 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:00.236146 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5e38c518-7112-4b1a-a33f-ef6ff197a010 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:00.253158 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c80a5eb4-c66b-41b5-b574-cd6dcbd162cc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:00.271854 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c80a5eb4-c66b-41b5-b574-cd6dcbd162cc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.343332 Jun 05 08:27:00.272389 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5e38c518-7112-4b1a-a33f-ef6ff197a010 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.144268 Jun 05 08:27:00.273307 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 600/1152] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:00 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:27:00.274682 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 553/1153] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:26:59 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:00.303347 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-70004a07-478f-45bd-9bf8-38c899ec5988 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:00.305903 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-70004a07-478f-45bd-9bf8-38c899ec5988 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 2725f200-5bb2-4b65-af28-186bfead7f64] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:00.313355 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-70004a07-478f-45bd-9bf8-38c899ec5988 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:00.313998 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-70004a07-478f-45bd-9bf8-38c899ec5988 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:00.315243 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-70004a07-478f-45bd-9bf8-38c899ec5988 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:00.316155 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-70004a07-478f-45bd-9bf8-38c899ec5988 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:00.347657 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-20bc90ed-be4e-41c7-93f4-89050a596b5e tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:00.348568 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-20bc90ed-be4e-41c7-93f4-89050a596b5e tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:00.362691 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-20bc90ed-be4e-41c7-93f4-89050a596b5e tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:00.363465 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-20bc90ed-be4e-41c7-93f4-89050a596b5e tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:00.364535 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-20bc90ed-be4e-41c7-93f4-89050a596b5e tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:00.364985 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-20bc90ed-be4e-41c7-93f4-89050a596b5e tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:00.506657 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-20bc90ed-be4e-41c7-93f4-89050a596b5e tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdc8382bafd49a3877df672d02f8206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76c30c981d4c69b229b6d7415c910c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:00.519014 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-20bc90ed-be4e-41c7-93f4-89050a596b5e tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5" status: 200 len: 1220 microversion: 2.1 time: 0.175670 Jun 05 08:27:00.530471 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 554/1154] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:00 2022] GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5 => generated 1220 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:00.541219 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7dde57d6-7501-41de-99e8-2cd31d79a794 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:00.543133 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7dde57d6-7501-41de-99e8-2cd31d79a794 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 4210ab7f-0e7d-4e20-ba9b-9869c01c92ae] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:00.569211 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7dde57d6-7501-41de-99e8-2cd31d79a794 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:00.570904 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7dde57d6-7501-41de-99e8-2cd31d79a794 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:00.572447 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7dde57d6-7501-41de-99e8-2cd31d79a794 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:00.574863 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7dde57d6-7501-41de-99e8-2cd31d79a794 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:00.643023 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-70004a07-478f-45bd-9bf8-38c899ec5988 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:00.650806 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-70004a07-478f-45bd-9bf8-38c899ec5988 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64" status: 200 len: 1318 microversion: 2.1 time: 0.375143 Jun 05 08:27:00.652082 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 601/1155] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:00 2022] GET /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64 => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:00.675094 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a8900abc-7464-45a9-8e8a-deea3e2876ce tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:00.675970 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a8900abc-7464-45a9-8e8a-deea3e2876ce tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:00.690852 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a8900abc-7464-45a9-8e8a-deea3e2876ce tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:00.691574 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a8900abc-7464-45a9-8e8a-deea3e2876ce tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:00.692105 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a8900abc-7464-45a9-8e8a-deea3e2876ce tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:00.692546 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a8900abc-7464-45a9-8e8a-deea3e2876ce tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:01.233822 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7dde57d6-7501-41de-99e8-2cd31d79a794 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:01.241554 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7dde57d6-7501-41de-99e8-2cd31d79a794 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae" status: 200 len: 1317 microversion: 2.1 time: 0.708939 Jun 05 08:27:01.242208 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 555/1156] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:00 2022] GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae => generated 1317 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:01.251525 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fe6fd27d-835d-4d90-bcec-6e5d56124d17 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:01.251525 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-fe6fd27d-835d-4d90-bcec-6e5d56124d17 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:01.253852 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fe6fd27d-835d-4d90-bcec-6e5d56124d17 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:01.254440 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fe6fd27d-835d-4d90-bcec-6e5d56124d17 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:01.255280 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fe6fd27d-835d-4d90-bcec-6e5d56124d17 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:01.255792 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fe6fd27d-835d-4d90-bcec-6e5d56124d17 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:01.322202 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a8900abc-7464-45a9-8e8a-deea3e2876ce tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:01.330576 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a8900abc-7464-45a9-8e8a-deea3e2876ce tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:01.332107 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a8900abc-7464-45a9-8e8a-deea3e2876ce tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:01.333224 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a8900abc-7464-45a9-8e8a-deea3e2876ce tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1361 microversion: 2.25 time: 0.676100 Jun 05 08:27:01.333970 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 602/1157] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:00 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1361 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:01.338737 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c409d16f-ca5c-4c2b-ac80-aa39c76454fc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:01.338915 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c409d16f-ca5c-4c2b-ac80-aa39c76454fc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:01.346203 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c409d16f-ca5c-4c2b-ac80-aa39c76454fc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:01.346648 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c409d16f-ca5c-4c2b-ac80-aa39c76454fc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:01.347445 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c409d16f-ca5c-4c2b-ac80-aa39c76454fc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:01.347862 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c409d16f-ca5c-4c2b-ac80-aa39c76454fc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:01.605871 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-fe6fd27d-835d-4d90-bcec-6e5d56124d17 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:01.629620 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-fe6fd27d-835d-4d90-bcec-6e5d56124d17 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:01.633352 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-fe6fd27d-835d-4d90-bcec-6e5d56124d17 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:01.635463 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fe6fd27d-835d-4d90-bcec-6e5d56124d17 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1724 microversion: 2.20 time: 0.391994 Jun 05 08:27:01.638172 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 556/1158] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:01 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1724 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:01.646634 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8f93e653-9b34-4350-b69b-eec63c4f129e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:01.647254 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8f93e653-9b34-4350-b69b-eec63c4f129e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:01.658689 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8f93e653-9b34-4350-b69b-eec63c4f129e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:01.659417 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8f93e653-9b34-4350-b69b-eec63c4f129e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:01.661249 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8f93e653-9b34-4350-b69b-eec63c4f129e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:01.662874 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8f93e653-9b34-4350-b69b-eec63c4f129e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:01.697624 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c409d16f-ca5c-4c2b-ac80-aa39c76454fc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:01.707871 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8f93e653-9b34-4350-b69b-eec63c4f129e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:01.708586 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8f93e653-9b34-4350-b69b-eec63c4f129e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:01.709208 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-8f93e653-9b34-4350-b69b-eec63c4f129e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:01.711500 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c409d16f-ca5c-4c2b-ac80-aa39c76454fc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.376407 Jun 05 08:27:01.712806 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 603/1159] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:01 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:01.732156 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2d27bfb6-af2b-4714-8c57-fd133fce18cc tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:01.733031 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2d27bfb6-af2b-4714-8c57-fd133fce18cc tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:01.739639 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2d27bfb6-af2b-4714-8c57-fd133fce18cc tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:01.741211 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2d27bfb6-af2b-4714-8c57-fd133fce18cc tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:01.742143 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2d27bfb6-af2b-4714-8c57-fd133fce18cc tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:01.742885 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2d27bfb6-af2b-4714-8c57-fd133fce18cc tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:01.768711 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8f93e653-9b34-4350-b69b-eec63c4f129e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:01.777960 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8f93e653-9b34-4350-b69b-eec63c4f129e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.137926 Jun 05 08:27:01.781489 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 557/1160] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:01 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:01.788524 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c5f52174-9bb6-4a7b-90de-785607551b9f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:01.789498 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c5f52174-9bb6-4a7b-90de-785607551b9f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 2725f200-5bb2-4b65-af28-186bfead7f64] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:01.796698 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c5f52174-9bb6-4a7b-90de-785607551b9f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:01.797529 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c5f52174-9bb6-4a7b-90de-785607551b9f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:01.798560 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c5f52174-9bb6-4a7b-90de-785607551b9f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:01.799227 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c5f52174-9bb6-4a7b-90de-785607551b9f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:01.837631 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2d27bfb6-af2b-4714-8c57-fd133fce18cc tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdc8382bafd49a3877df672d02f8206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76c30c981d4c69b229b6d7415c910c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:01.847006 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2d27bfb6-af2b-4714-8c57-fd133fce18cc tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5" status: 200 len: 1220 microversion: 2.1 time: 0.132784 Jun 05 08:27:01.858536 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 604/1161] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:01 2022] GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5 => generated 1220 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:02.020902 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c5f52174-9bb6-4a7b-90de-785607551b9f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:02.033809 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c5f52174-9bb6-4a7b-90de-785607551b9f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64" status: 200 len: 1318 microversion: 2.1 time: 0.250685 Jun 05 08:27:02.044816 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 558/1162] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:01 2022] GET /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:02.260312 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-96a4b28a-9e40-491b-b2b6-f2038e87864b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:02.260737 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-96a4b28a-9e40-491b-b2b6-f2038e87864b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 4210ab7f-0e7d-4e20-ba9b-9869c01c92ae] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:02.269776 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-96a4b28a-9e40-491b-b2b6-f2038e87864b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:02.270194 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-96a4b28a-9e40-491b-b2b6-f2038e87864b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:02.270958 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-96a4b28a-9e40-491b-b2b6-f2038e87864b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:02.271680 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-96a4b28a-9e40-491b-b2b6-f2038e87864b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:02.302877 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-dd933a00-7cf3-4d7c-96ee-fc4409e227dc req-66d363c9-b4c8-4211-af1c-dc636fc7aacf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4210ab7f-0e7d-4e20-ba9b-9869c01c92ae", "tag": "c96022c4-72c8-4057-ae15-32029528ca3e"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:02.321874 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-dd933a00-7cf3-4d7c-96ee-fc4409e227dc req-66d363c9-b4c8-4211-af1c-dc636fc7aacf service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:02.322333 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-dd933a00-7cf3-4d7c-96ee-fc4409e227dc req-66d363c9-b4c8-4211-af1c-dc636fc7aacf service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:02.364518 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-dd933a00-7cf3-4d7c-96ee-fc4409e227dc req-66d363c9-b4c8-4211-af1c-dc636fc7aacf service nova] Creating event network-changed:c96022c4-72c8-4057-ae15-32029528ca3e for instance 4210ab7f-0e7d-4e20-ba9b-9869c01c92ae on n-h2-844739-1 Jun 05 08:27:02.374149 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-dd933a00-7cf3-4d7c-96ee-fc4409e227dc req-66d363c9-b4c8-4211-af1c-dc636fc7aacf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076233 Jun 05 08:27:02.374769 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 559/1163] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:27:02.394122 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-471c02e5-c26d-457f-b866-4b83d1ac7775 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:02.395352 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-471c02e5-c26d-457f-b866-4b83d1ac7775 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:02.403108 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-471c02e5-c26d-457f-b866-4b83d1ac7775 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:02.403842 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-471c02e5-c26d-457f-b866-4b83d1ac7775 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:02.404823 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-471c02e5-c26d-457f-b866-4b83d1ac7775 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:02.405425 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-471c02e5-c26d-457f-b866-4b83d1ac7775 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:02.809789 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-471c02e5-c26d-457f-b866-4b83d1ac7775 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:02.813871 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-96a4b28a-9e40-491b-b2b6-f2038e87864b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:02.822824 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-96a4b28a-9e40-491b-b2b6-f2038e87864b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae" status: 200 len: 1317 microversion: 2.1 time: 0.567435 Jun 05 08:27:02.824172 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-471c02e5-c26d-457f-b866-4b83d1ac7775 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:02.828805 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-471c02e5-c26d-457f-b866-4b83d1ac7775 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:02.831286 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-471c02e5-c26d-457f-b866-4b83d1ac7775 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1361 microversion: 2.25 time: 0.450165 Jun 05 08:27:02.832567 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 560/1165] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:02 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1361 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:02.832765 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 605/1165] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:02 2022] GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae => generated 1317 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:02.837817 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2245c387-6a6f-4886-9041-24864bfb2bce tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:02.838466 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2245c387-6a6f-4886-9041-24864bfb2bce tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:02.841646 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d0d1bc9d-c7ce-47c6-bb99-1195ef70e392 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:02.842574 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d0d1bc9d-c7ce-47c6-bb99-1195ef70e392 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:02.845584 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2245c387-6a6f-4886-9041-24864bfb2bce tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:02.845584 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2245c387-6a6f-4886-9041-24864bfb2bce tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:02.846342 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2245c387-6a6f-4886-9041-24864bfb2bce tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:02.846782 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2245c387-6a6f-4886-9041-24864bfb2bce tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:02.853739 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=100 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:02.860609 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d0d1bc9d-c7ce-47c6-bb99-1195ef70e392 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:02.861085 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d0d1bc9d-c7ce-47c6-bb99-1195ef70e392 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:02.861949 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d0d1bc9d-c7ce-47c6-bb99-1195ef70e392 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:02.862458 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d0d1bc9d-c7ce-47c6-bb99-1195ef70e392 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:02.868001 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:03.173534 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2245c387-6a6f-4886-9041-24864bfb2bce tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:03.183468 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2245c387-6a6f-4886-9041-24864bfb2bce tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.348673 Jun 05 08:27:03.188990 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 606/1166] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:02 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:03.201961 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2f725439-ac35-4be1-9076-e342745892a6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:03.202589 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2f725439-ac35-4be1-9076-e342745892a6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:03.208642 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2f725439-ac35-4be1-9076-e342745892a6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:03.209100 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2f725439-ac35-4be1-9076-e342745892a6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:03.209927 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2f725439-ac35-4be1-9076-e342745892a6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:03.210373 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2f725439-ac35-4be1-9076-e342745892a6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:03.236022 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d0d1bc9d-c7ce-47c6-bb99-1195ef70e392 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:03.244485 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2f725439-ac35-4be1-9076-e342745892a6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:03.245818 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2f725439-ac35-4be1-9076-e342745892a6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:03.247019 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-2f725439-ac35-4be1-9076-e342745892a6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:03.254994 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d0d1bc9d-c7ce-47c6-bb99-1195ef70e392 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:03.256543 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d0d1bc9d-c7ce-47c6-bb99-1195ef70e392 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:03.257749 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d0d1bc9d-c7ce-47c6-bb99-1195ef70e392 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1724 microversion: 2.20 time: 0.422641 Jun 05 08:27:03.258315 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 561/1167] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:02 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1724 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:03.276442 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-926e342c-6923-4b9d-8e1c-3ed657c0a7de tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:03.277793 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-926e342c-6923-4b9d-8e1c-3ed657c0a7de tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:03.284260 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-926e342c-6923-4b9d-8e1c-3ed657c0a7de tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:03.284987 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-926e342c-6923-4b9d-8e1c-3ed657c0a7de tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:03.285933 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-926e342c-6923-4b9d-8e1c-3ed657c0a7de tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:03.286522 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-926e342c-6923-4b9d-8e1c-3ed657c0a7de tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:03.356451 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2f725439-ac35-4be1-9076-e342745892a6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:03.370520 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2f725439-ac35-4be1-9076-e342745892a6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.177418 Jun 05 08:27:03.371421 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 607/1168] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:03 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:03.376278 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-582a9ee6-2466-4c11-b32c-7c965ff284e5 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:03.386020 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-582a9ee6-2466-4c11-b32c-7c965ff284e5 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 2725f200-5bb2-4b65-af28-186bfead7f64] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:03.405809 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-582a9ee6-2466-4c11-b32c-7c965ff284e5 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:03.406583 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-582a9ee6-2466-4c11-b32c-7c965ff284e5 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:03.407593 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-582a9ee6-2466-4c11-b32c-7c965ff284e5 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:03.408239 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-582a9ee6-2466-4c11-b32c-7c965ff284e5 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:03.599347 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-926e342c-6923-4b9d-8e1c-3ed657c0a7de tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdc8382bafd49a3877df672d02f8206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76c30c981d4c69b229b6d7415c910c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:03.608150 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-926e342c-6923-4b9d-8e1c-3ed657c0a7de tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5" status: 200 len: 1212 microversion: 2.1 time: 0.348565 Jun 05 08:27:03.609848 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 562/1169] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:03 2022] GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5 => generated 1212 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:03.674394 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-582a9ee6-2466-4c11-b32c-7c965ff284e5 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:03.697763 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-582a9ee6-2466-4c11-b32c-7c965ff284e5 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64" status: 200 len: 1318 microversion: 2.1 time: 0.324733 Jun 05 08:27:03.710784 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 608/1170] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:03 2022] GET /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64 => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:03.717337 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-41b05e5c-b7d3-413e-a74c-d6dc3e7811f3 req-78650f7e-e51a-4c99-b407-9dcfe0f07094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2725f200-5bb2-4b65-af28-186bfead7f64", "name": "network-vif-plugged", "status": "completed", "tag": "b0406d71-f20c-4491-9e27-c5f2fb5f3588"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:03.726713 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-41b05e5c-b7d3-413e-a74c-d6dc3e7811f3 req-78650f7e-e51a-4c99-b407-9dcfe0f07094 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:03.727000 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-41b05e5c-b7d3-413e-a74c-d6dc3e7811f3 req-78650f7e-e51a-4c99-b407-9dcfe0f07094 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:03.740820 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-41b05e5c-b7d3-413e-a74c-d6dc3e7811f3 req-78650f7e-e51a-4c99-b407-9dcfe0f07094 service nova] Creating event network-vif-plugged:b0406d71-f20c-4491-9e27-c5f2fb5f3588 for instance 2725f200-5bb2-4b65-af28-186bfead7f64 on n-h2-844739-1 Jun 05 08:27:03.769612 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-41b05e5c-b7d3-413e-a74c-d6dc3e7811f3 req-78650f7e-e51a-4c99-b407-9dcfe0f07094 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062216 Jun 05 08:27:03.772011 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 563/1171] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:03.848815 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-307dfe5d-7bd8-40d1-8fd7-0f77ce26ecbc tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:03.850200 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-307dfe5d-7bd8-40d1-8fd7-0f77ce26ecbc tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 4210ab7f-0e7d-4e20-ba9b-9869c01c92ae] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:03.850484 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b8d11f38-8d43-4c21-92dc-7b7e31ca012f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:03.851662 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b8d11f38-8d43-4c21-92dc-7b7e31ca012f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:03.862014 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-307dfe5d-7bd8-40d1-8fd7-0f77ce26ecbc tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:03.862873 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-307dfe5d-7bd8-40d1-8fd7-0f77ce26ecbc tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:03.864181 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-307dfe5d-7bd8-40d1-8fd7-0f77ce26ecbc tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:03.864953 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-307dfe5d-7bd8-40d1-8fd7-0f77ce26ecbc tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:03.865074 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b8d11f38-8d43-4c21-92dc-7b7e31ca012f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:03.865621 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b8d11f38-8d43-4c21-92dc-7b7e31ca012f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:03.866336 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b8d11f38-8d43-4c21-92dc-7b7e31ca012f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:03.867197 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b8d11f38-8d43-4c21-92dc-7b7e31ca012f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:04.084961 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=4 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:04.107472 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-307dfe5d-7bd8-40d1-8fd7-0f77ce26ecbc tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:04.109718 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=6 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:04.116541 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-307dfe5d-7bd8-40d1-8fd7-0f77ce26ecbc tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae" status: 200 len: 1317 microversion: 2.1 time: 0.278596 Jun 05 08:27:04.117124 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 609/1172] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:03 2022] GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:04.118497 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b8d11f38-8d43-4c21-92dc-7b7e31ca012f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:04.123523 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-114c220c-c098-4532-8809-4b6126e1cea7 req-659a3769-3cc9-40c9-9555-409d2d140951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1adbf51b-8e22-4283-ad4f-d72b85fc5db7", "tag": "1a266bd8-8f0b-477e-b683-06f944fd4f80"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:04.130396 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b8d11f38-8d43-4c21-92dc-7b7e31ca012f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:04.132378 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-114c220c-c098-4532-8809-4b6126e1cea7 req-659a3769-3cc9-40c9-9555-409d2d140951 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:04.132992 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-114c220c-c098-4532-8809-4b6126e1cea7 req-659a3769-3cc9-40c9-9555-409d2d140951 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:04.134100 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b8d11f38-8d43-4c21-92dc-7b7e31ca012f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:04.136101 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b8d11f38-8d43-4c21-92dc-7b7e31ca012f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1558 microversion: 2.25 time: 0.289910 Jun 05 08:27:04.138747 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 564/1173] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:03 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1558 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:04.145734 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-114c220c-c098-4532-8809-4b6126e1cea7 req-659a3769-3cc9-40c9-9555-409d2d140951 service nova] Creating event network-changed:1a266bd8-8f0b-477e-b683-06f944fd4f80 for instance 1adbf51b-8e22-4283-ad4f-d72b85fc5db7 on n-h1-844739-1 Jun 05 08:27:04.160350 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9a5f45ff-befa-4fe4-b284-6a24398c02e2 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:04.161946 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9a5f45ff-befa-4fe4-b284-6a24398c02e2 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:04.171369 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-114c220c-c098-4532-8809-4b6126e1cea7 req-659a3769-3cc9-40c9-9555-409d2d140951 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052858 Jun 05 08:27:04.172742 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 610/1174] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:04.176364 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9a5f45ff-befa-4fe4-b284-6a24398c02e2 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:04.176865 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9a5f45ff-befa-4fe4-b284-6a24398c02e2 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:04.177776 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9a5f45ff-befa-4fe4-b284-6a24398c02e2 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:04.178389 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9a5f45ff-befa-4fe4-b284-6a24398c02e2 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:04.201434 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5325af3b-2b9f-41d5-a607-bc1627967621 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:04.202406 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5325af3b-2b9f-41d5-a607-bc1627967621 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:04.211501 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5325af3b-2b9f-41d5-a607-bc1627967621 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:04.216796 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5325af3b-2b9f-41d5-a607-bc1627967621 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:04.217839 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5325af3b-2b9f-41d5-a607-bc1627967621 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:04.218448 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5325af3b-2b9f-41d5-a607-bc1627967621 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:04.457559 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5325af3b-2b9f-41d5-a607-bc1627967621 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:04.466290 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-9a5f45ff-befa-4fe4-b284-6a24398c02e2 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lazy-loading 'services' on Instance uuid 5d031b21-37d5-4454-bed7-db50a225bce5 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:04.474473 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5325af3b-2b9f-41d5-a607-bc1627967621 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.277255 Jun 05 08:27:04.484723 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 611/1175] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:04 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:27:04.490039 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b003e953-2a78-4bb4-9d45-97740498ce64 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:04.490864 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b003e953-2a78-4bb4-9d45-97740498ce64 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:04.495711 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9a5f45ff-befa-4fe4-b284-6a24398c02e2 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 2050 microversion: 2.25 time: 0.345656 Jun 05 08:27:04.497020 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 565/1176] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:04 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 2050 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:04.500602 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b003e953-2a78-4bb4-9d45-97740498ce64 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:04.501627 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b003e953-2a78-4bb4-9d45-97740498ce64 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:04.503019 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b003e953-2a78-4bb4-9d45-97740498ce64 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:04.504370 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b003e953-2a78-4bb4-9d45-97740498ce64 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:04.670308 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7843de92-f770-418e-ab5b-1ad64e64931c tempest-FlavorsV261TestJSON-71851012 tempest-FlavorsV261TestJSON-71851012-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1359432161", "id": 1534141133, "os-flavor-access:is_public": "True"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:04.672139 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:27:04.672139 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:27:04.691318 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7843de92-f770-418e-ab5b-1ad64e64931c tempest-FlavorsV261TestJSON-71851012 tempest-FlavorsV261TestJSON-71851012-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.193227 Jun 05 08:27:04.692104 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 566/1177] 10.222.0.33 () {62 vars in 1187 bytes} [Sun Jun 5 08:27:04 2022] POST /compute/v2.1/flavors => generated 468 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:27:04.697662 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e744c328-c289-4ca7-bae4-2569cd4e4693 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:04.699125 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e744c328-c289-4ca7-bae4-2569cd4e4693 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:04.712575 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b003e953-2a78-4bb4-9d45-97740498ce64 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:04.717131 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e744c328-c289-4ca7-bae4-2569cd4e4693 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:04.717778 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e744c328-c289-4ca7-bae4-2569cd4e4693 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:04.718610 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e744c328-c289-4ca7-bae4-2569cd4e4693 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:04.719053 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e744c328-c289-4ca7-bae4-2569cd4e4693 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:04.720982 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b003e953-2a78-4bb4-9d45-97740498ce64 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:04.722828 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b003e953-2a78-4bb4-9d45-97740498ce64 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:04.725511 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b003e953-2a78-4bb4-9d45-97740498ce64 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1724 microversion: 2.20 time: 0.239442 Jun 05 08:27:04.731893 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 612/1178] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:04 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:04.731893 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1ee8888d-dde3-4c81-82ec-44054b82da44 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:04.732287 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:27:04.732287 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:27:04.733746 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ee8888d-dde3-4c81-82ec-44054b82da44 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:04.735045 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ee8888d-dde3-4c81-82ec-44054b82da44 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:04.735858 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ee8888d-dde3-4c81-82ec-44054b82da44 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:04.736388 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ee8888d-dde3-4c81-82ec-44054b82da44 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:04.750800 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e744c328-c289-4ca7-bae4-2569cd4e4693 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:04.751247 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e744c328-c289-4ca7-bae4-2569cd4e4693 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:04.751698 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-e744c328-c289-4ca7-bae4-2569cd4e4693 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:04.760872 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1ee8888d-dde3-4c81-82ec-44054b82da44 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.033349 Jun 05 08:27:04.761721 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 613/1179] 10.222.0.33 () {60 vars in 1216 bytes} [Sun Jun 5 08:27:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:27:04.766427 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6d93fbe4-fe86-436f-89e9-e6912bba6de0 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:04.767273 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6d93fbe4-fe86-436f-89e9-e6912bba6de0 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:04.777114 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6d93fbe4-fe86-436f-89e9-e6912bba6de0 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:04.777992 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6d93fbe4-fe86-436f-89e9-e6912bba6de0 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:04.778904 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6d93fbe4-fe86-436f-89e9-e6912bba6de0 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:04.779453 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6d93fbe4-fe86-436f-89e9-e6912bba6de0 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:04.886999 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e744c328-c289-4ca7-bae4-2569cd4e4693 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:04.904247 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6d93fbe4-fe86-436f-89e9-e6912bba6de0 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdc8382bafd49a3877df672d02f8206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76c30c981d4c69b229b6d7415c910c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:04.911033 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e744c328-c289-4ca7-bae4-2569cd4e4693 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.217282 Jun 05 08:27:04.915928 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6d93fbe4-fe86-436f-89e9-e6912bba6de0 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5" status: 200 len: 1274 microversion: 2.1 time: 0.152967 Jun 05 08:27:04.917056 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 614/1180] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:04 2022] GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5 => generated 1274 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:04.922421 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 567/1181] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:04 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:04.928462 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1f1aacf1-9830-403a-b518-9249e2552251 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:04.929238 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1f1aacf1-9830-403a-b518-9249e2552251 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 2725f200-5bb2-4b65-af28-186bfead7f64] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:04.940727 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1f1aacf1-9830-403a-b518-9249e2552251 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:04.941114 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1f1aacf1-9830-403a-b518-9249e2552251 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:04.944949 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1f1aacf1-9830-403a-b518-9249e2552251 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:04.945411 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1f1aacf1-9830-403a-b518-9249e2552251 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:05.142279 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c8097bd4-5082-4489-aff3-ae43530b0443 tempest-FlavorsV261TestJSON-1513285177 tempest-FlavorsV261TestJSON-1513285177-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:05.161259 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c8097bd4-5082-4489-aff3-ae43530b0443 tempest-FlavorsV261TestJSON-1513285177 tempest-FlavorsV261TestJSON-1513285177-project] 10.222.0.33 "GET /compute/v2.1/flavors/1534141133" status: 200 len: 468 microversion: 2.61 time: 0.242875 Jun 05 08:27:05.162469 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 615/1182] 10.222.0.33 () {60 vars in 1198 bytes} [Sun Jun 5 08:27:04 2022] GET /compute/v2.1/flavors/1534141133 => generated 468 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:27:05.167322 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-28ae26f7-2e22-4f4b-af08-436e2e78c22a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:05.168781 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-28ae26f7-2e22-4f4b-af08-436e2e78c22a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 4210ab7f-0e7d-4e20-ba9b-9869c01c92ae] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:05.176366 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-28ae26f7-2e22-4f4b-af08-436e2e78c22a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:05.177593 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-28ae26f7-2e22-4f4b-af08-436e2e78c22a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:05.178861 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-28ae26f7-2e22-4f4b-af08-436e2e78c22a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:05.179511 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-28ae26f7-2e22-4f4b-af08-436e2e78c22a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:05.439394 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1f1aacf1-9830-403a-b518-9249e2552251 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:05.452160 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1f1aacf1-9830-403a-b518-9249e2552251 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64" status: 200 len: 1318 microversion: 2.1 time: 0.527611 Jun 05 08:27:05.452863 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 568/1183] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:04 2022] GET /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64 => generated 1318 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:05.467511 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d08a4151-b863-45e5-891f-39c6bc3db148 tempest-FlavorsV261TestJSON-71851012 tempest-FlavorsV261TestJSON-71851012-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:05.482636 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:27:05.482636 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:27:05.509288 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-28ae26f7-2e22-4f4b-af08-436e2e78c22a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:05.511359 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d08a4151-b863-45e5-891f-39c6bc3db148 tempest-FlavorsV261TestJSON-71851012 tempest-FlavorsV261TestJSON-71851012-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/1534141133" status: 200 len: 469 microversion: 2.61 time: 0.055516 Jun 05 08:27:05.513573 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 569/1184] 10.222.0.33 () {62 vars in 1218 bytes} [Sun Jun 5 08:27:05 2022] PUT /compute/v2.1/flavors/1534141133 => generated 469 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:27:05.518612 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f7e4659d-2563-49a9-a399-327fd0d43870 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:05.519845 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f7e4659d-2563-49a9-a399-327fd0d43870 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:05.525687 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-28ae26f7-2e22-4f4b-af08-436e2e78c22a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae" status: 200 len: 1317 microversion: 2.1 time: 0.361917 Jun 05 08:27:05.527087 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f7e4659d-2563-49a9-a399-327fd0d43870 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:05.528821 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f7e4659d-2563-49a9-a399-327fd0d43870 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:05.529819 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f7e4659d-2563-49a9-a399-327fd0d43870 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:05.530398 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f7e4659d-2563-49a9-a399-327fd0d43870 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:05.536598 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 616/1185] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:05 2022] GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:05.550322 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f68e4a28-0b84-43a3-b42c-2e34d5b50526 tempest-FlavorsV261TestJSON-1513285177 tempest-FlavorsV261TestJSON-1513285177-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:05.555497 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=4 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:05.594939 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f68e4a28-0b84-43a3-b42c-2e34d5b50526 tempest-FlavorsV261TestJSON-1513285177 tempest-FlavorsV261TestJSON-1513285177-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.056388 Jun 05 08:27:05.596123 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 617/1186] 10.222.0.33 () {60 vars in 1186 bytes} [Sun Jun 5 08:27:05 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:05.612312 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-82191553-3fc7-4d0b-823e-c5313a10d080 tempest-FlavorsV261TestJSON-1513285177 tempest-FlavorsV261TestJSON-1513285177-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:05.634741 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-82191553-3fc7-4d0b-823e-c5313a10d080 tempest-FlavorsV261TestJSON-1513285177 tempest-FlavorsV261TestJSON-1513285177-project] 10.222.0.33 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.026073 Jun 05 08:27:05.635851 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 618/1187] 10.222.0.33 () {60 vars in 1165 bytes} [Sun Jun 5 08:27:05 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:05.649888 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-33447583-c281-4626-9855-af1471ec1ae6 tempest-FlavorsV261TestJSON-71851012 tempest-FlavorsV261TestJSON-71851012-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:05.650978 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:27:05.650978 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:27:05.671206 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-33447583-c281-4626-9855-af1471ec1ae6 tempest-FlavorsV261TestJSON-71851012 tempest-FlavorsV261TestJSON-71851012-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1534141133" status: 202 len: 0 microversion: 2.61 time: 0.025001 Jun 05 08:27:05.673725 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 619/1188] 10.222.0.33 () {60 vars in 1201 bytes} [Sun Jun 5 08:27:05 2022] DELETE /compute/v2.1/flavors/1534141133 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:27:05.689815 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-99770b0d-3645-47b1-9cb0-5061aecc7465 tempest-FlavorsV261TestJSON-71851012 tempest-FlavorsV261TestJSON-71851012-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:05.722759 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-99770b0d-3645-47b1-9cb0-5061aecc7465 tempest-FlavorsV261TestJSON-71851012 tempest-FlavorsV261TestJSON-71851012-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.044800 Jun 05 08:27:05.724482 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 620/1189] 10.222.0.33 () {60 vars in 1186 bytes} [Sun Jun 5 08:27:05 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:05.744055 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-736f7bcc-41ca-4031-93aa-3d7c756fae85 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:05.745456 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-736f7bcc-41ca-4031-93aa-3d7c756fae85 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:05.757768 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-736f7bcc-41ca-4031-93aa-3d7c756fae85 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:05.758226 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-736f7bcc-41ca-4031-93aa-3d7c756fae85 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:05.759015 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-736f7bcc-41ca-4031-93aa-3d7c756fae85 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:05.759449 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-736f7bcc-41ca-4031-93aa-3d7c756fae85 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:05.807276 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f7e4659d-2563-49a9-a399-327fd0d43870 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:05.831722 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f7e4659d-2563-49a9-a399-327fd0d43870 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.314853 Jun 05 08:27:05.844463 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 570/1190] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:05 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:05.933605 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5e3c9655-c800-4fe8-933a-f62a172c5d3d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:05.939088 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5e3c9655-c800-4fe8-933a-f62a172c5d3d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:05.943883 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=16 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:05.963980 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5e3c9655-c800-4fe8-933a-f62a172c5d3d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:05.968385 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5e3c9655-c800-4fe8-933a-f62a172c5d3d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:05.970746 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5e3c9655-c800-4fe8-933a-f62a172c5d3d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:05.973584 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5e3c9655-c800-4fe8-933a-f62a172c5d3d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:06.023909 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5e3c9655-c800-4fe8-933a-f62a172c5d3d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:06.024537 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5e3c9655-c800-4fe8-933a-f62a172c5d3d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:06.025014 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-5e3c9655-c800-4fe8-933a-f62a172c5d3d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:06.095596 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5e3c9655-c800-4fe8-933a-f62a172c5d3d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:06.104887 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5e3c9655-c800-4fe8-933a-f62a172c5d3d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.179714 Jun 05 08:27:06.105912 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 571/1191] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:05 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:06.113606 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-35d8bb90-2a27-4bb1-bbbb-f6657b98a6fb tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:06.114528 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-35d8bb90-2a27-4bb1-bbbb-f6657b98a6fb tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:06.122937 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-35d8bb90-2a27-4bb1-bbbb-f6657b98a6fb tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:06.123521 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-35d8bb90-2a27-4bb1-bbbb-f6657b98a6fb tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:06.128449 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-35d8bb90-2a27-4bb1-bbbb-f6657b98a6fb tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:06.129155 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-35d8bb90-2a27-4bb1-bbbb-f6657b98a6fb tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:06.149643 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-736f7bcc-41ca-4031-93aa-3d7c756fae85 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:06.159929 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-736f7bcc-41ca-4031-93aa-3d7c756fae85 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:06.161634 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-736f7bcc-41ca-4031-93aa-3d7c756fae85 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:06.162893 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-736f7bcc-41ca-4031-93aa-3d7c756fae85 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1724 microversion: 2.20 time: 0.422768 Jun 05 08:27:06.163813 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 621/1192] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:05 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1724 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:27:06.327282 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-35d8bb90-2a27-4bb1-bbbb-f6657b98a6fb tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdc8382bafd49a3877df672d02f8206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76c30c981d4c69b229b6d7415c910c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:06.346933 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-35d8bb90-2a27-4bb1-bbbb-f6657b98a6fb tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5" status: 200 len: 1316 microversion: 2.1 time: 0.229574 Jun 05 08:27:06.356955 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 572/1193] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:06 2022] GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5 => generated 1316 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:06.470057 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d8cdbbe7-4f06-4315-a128-240659ff05cb tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:06.475199 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d8cdbbe7-4f06-4315-a128-240659ff05cb tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 2725f200-5bb2-4b65-af28-186bfead7f64] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:06.485236 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d8cdbbe7-4f06-4315-a128-240659ff05cb tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:06.485697 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d8cdbbe7-4f06-4315-a128-240659ff05cb tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:06.486507 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d8cdbbe7-4f06-4315-a128-240659ff05cb tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:06.486945 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d8cdbbe7-4f06-4315-a128-240659ff05cb tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:06.543477 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ad52977a-ea65-4f86-8164-64c83f6bd6c3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:06.544592 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ad52977a-ea65-4f86-8164-64c83f6bd6c3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 4210ab7f-0e7d-4e20-ba9b-9869c01c92ae] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:06.552345 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ad52977a-ea65-4f86-8164-64c83f6bd6c3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:06.553569 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ad52977a-ea65-4f86-8164-64c83f6bd6c3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:06.554694 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ad52977a-ea65-4f86-8164-64c83f6bd6c3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:06.555352 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ad52977a-ea65-4f86-8164-64c83f6bd6c3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:06.775284 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d8cdbbe7-4f06-4315-a128-240659ff05cb tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:06.790058 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d8cdbbe7-4f06-4315-a128-240659ff05cb tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64" status: 200 len: 1318 microversion: 2.1 time: 0.325086 Jun 05 08:27:06.791314 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 622/1194] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:06 2022] GET /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64 => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:06.840892 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ad52977a-ea65-4f86-8164-64c83f6bd6c3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:06.852728 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ad52977a-ea65-4f86-8164-64c83f6bd6c3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae" status: 200 len: 1317 microversion: 2.1 time: 0.312598 Jun 05 08:27:06.852975 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ec091507-2bce-40c8-8861-ddc9b2d913d8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:06.857118 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ec091507-2bce-40c8-8861-ddc9b2d913d8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:06.858846 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 573/1195] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:06 2022] GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:06.878447 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ec091507-2bce-40c8-8861-ddc9b2d913d8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:06.883510 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ec091507-2bce-40c8-8861-ddc9b2d913d8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:06.884614 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ec091507-2bce-40c8-8861-ddc9b2d913d8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:06.885063 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ec091507-2bce-40c8-8861-ddc9b2d913d8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:07.033160 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ec091507-2bce-40c8-8861-ddc9b2d913d8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:07.041812 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ec091507-2bce-40c8-8861-ddc9b2d913d8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1550 microversion: 2.1 time: 0.194297 Jun 05 08:27:07.042384 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 623/1196] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:06 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1550 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:27:07.122509 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5f52de10-211a-4df7-b8cb-eb58e39c7af5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:07.123201 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5f52de10-211a-4df7-b8cb-eb58e39c7af5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:07.129651 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5f52de10-211a-4df7-b8cb-eb58e39c7af5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:07.130106 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5f52de10-211a-4df7-b8cb-eb58e39c7af5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:07.130881 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5f52de10-211a-4df7-b8cb-eb58e39c7af5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:07.131319 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5f52de10-211a-4df7-b8cb-eb58e39c7af5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:07.165635 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5f52de10-211a-4df7-b8cb-eb58e39c7af5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:07.166093 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5f52de10-211a-4df7-b8cb-eb58e39c7af5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:07.166551 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-5f52de10-211a-4df7-b8cb-eb58e39c7af5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:07.181721 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c3d850fd-822b-4c00-9554-0b30a132cd98 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:07.182337 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c3d850fd-822b-4c00-9554-0b30a132cd98 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:07.189034 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c3d850fd-822b-4c00-9554-0b30a132cd98 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:07.189460 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c3d850fd-822b-4c00-9554-0b30a132cd98 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:07.190234 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c3d850fd-822b-4c00-9554-0b30a132cd98 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:07.190676 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c3d850fd-822b-4c00-9554-0b30a132cd98 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:07.216536 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5f52de10-211a-4df7-b8cb-eb58e39c7af5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:07.228004 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5f52de10-211a-4df7-b8cb-eb58e39c7af5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.109766 Jun 05 08:27:07.228884 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 574/1197] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:07 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:07.364636 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b5424bee-0c08-4f8a-8c8d-7b8677928e70 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:07.365257 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b5424bee-0c08-4f8a-8c8d-7b8677928e70 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:07.372053 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b5424bee-0c08-4f8a-8c8d-7b8677928e70 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:07.372526 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b5424bee-0c08-4f8a-8c8d-7b8677928e70 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:07.373393 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b5424bee-0c08-4f8a-8c8d-7b8677928e70 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:07.373840 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b5424bee-0c08-4f8a-8c8d-7b8677928e70 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:07.393549 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c3d850fd-822b-4c00-9554-0b30a132cd98 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:07.420806 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c3d850fd-822b-4c00-9554-0b30a132cd98 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:07.423183 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c3d850fd-822b-4c00-9554-0b30a132cd98 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:07.424641 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c3d850fd-822b-4c00-9554-0b30a132cd98 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1724 microversion: 2.20 time: 0.246786 Jun 05 08:27:07.425344 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 624/1198] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:07 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:27:07.438417 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d05c6bea-fc00-4359-acbe-937ca64c15ef tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "326ddb91-10fa-48bc-b487-0aa7d11a57cb", "device": "/dev/xvdb"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:07.439819 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d05c6bea-fc00-4359-acbe-937ca64c15ef tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:07.448930 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d05c6bea-fc00-4359-acbe-937ca64c15ef tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:07.449791 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d05c6bea-fc00-4359-acbe-937ca64c15ef tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:07.450552 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d05c6bea-fc00-4359-acbe-937ca64c15ef tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:07.451181 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d05c6bea-fc00-4359-acbe-937ca64c15ef tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:07.524549 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b5424bee-0c08-4f8a-8c8d-7b8677928e70 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdc8382bafd49a3877df672d02f8206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76c30c981d4c69b229b6d7415c910c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:07.536904 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b5424bee-0c08-4f8a-8c8d-7b8677928e70 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5" status: 200 len: 1316 microversion: 2.1 time: 0.173976 Jun 05 08:27:07.537722 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 575/1199] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:07 2022] GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5 => generated 1316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:27:07.807364 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9e9f1a07-8516-45fa-87cb-e1bcd178106f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:07.807951 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9e9f1a07-8516-45fa-87cb-e1bcd178106f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 2725f200-5bb2-4b65-af28-186bfead7f64] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:07.814473 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9e9f1a07-8516-45fa-87cb-e1bcd178106f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:07.814932 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9e9f1a07-8516-45fa-87cb-e1bcd178106f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:07.815705 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9e9f1a07-8516-45fa-87cb-e1bcd178106f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:07.816188 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9e9f1a07-8516-45fa-87cb-e1bcd178106f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:07.952266 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-9e9f1a07-8516-45fa-87cb-e1bcd178106f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:07.960679 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9e9f1a07-8516-45fa-87cb-e1bcd178106f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64" status: 200 len: 1506 microversion: 2.1 time: 0.157274 Jun 05 08:27:07.961257 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 576/1200] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:07 2022] GET /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:27:07.967130 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0a9f320a-0230-47d0-a855-02cf0722c868 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:07.967758 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0a9f320a-0230-47d0-a855-02cf0722c868 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 4210ab7f-0e7d-4e20-ba9b-9869c01c92ae] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:07.973645 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0a9f320a-0230-47d0-a855-02cf0722c868 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:07.974097 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0a9f320a-0230-47d0-a855-02cf0722c868 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:07.974868 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0a9f320a-0230-47d0-a855-02cf0722c868 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:07.975315 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0a9f320a-0230-47d0-a855-02cf0722c868 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:08.113383 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0a9f320a-0230-47d0-a855-02cf0722c868 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:08.121854 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0a9f320a-0230-47d0-a855-02cf0722c868 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae" status: 200 len: 1317 microversion: 2.1 time: 0.159581 Jun 05 08:27:08.122761 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 577/1201] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:07 2022] GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:08.129753 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b7758b56-c4f5-4650-b9ca-aab050b1d831 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:08.130666 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b7758b56-c4f5-4650-b9ca-aab050b1d831 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 1adbf51b-8e22-4283-ad4f-d72b85fc5db7] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:08.140147 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b7758b56-c4f5-4650-b9ca-aab050b1d831 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:08.141066 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b7758b56-c4f5-4650-b9ca-aab050b1d831 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:08.141962 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b7758b56-c4f5-4650-b9ca-aab050b1d831 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:08.142526 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b7758b56-c4f5-4650-b9ca-aab050b1d831 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:08.321876 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b7758b56-c4f5-4650-b9ca-aab050b1d831 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:08.339345 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b7758b56-c4f5-4650-b9ca-aab050b1d831 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/1adbf51b-8e22-4283-ad4f-d72b85fc5db7" status: 200 len: 1318 microversion: 2.1 time: 0.213418 Jun 05 08:27:08.341752 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 578/1202] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:08 2022] GET /compute/v2.1/servers/1adbf51b-8e22-4283-ad4f-d72b85fc5db7 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:08.350803 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1cf99a69-e24e-40f4-bc43-0e9ebae94832 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:08.351582 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1cf99a69-e24e-40f4-bc43-0e9ebae94832 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:08.377702 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1cf99a69-e24e-40f4-bc43-0e9ebae94832 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:08.378219 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1cf99a69-e24e-40f4-bc43-0e9ebae94832 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:08.379003 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1cf99a69-e24e-40f4-bc43-0e9ebae94832 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:08.379452 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1cf99a69-e24e-40f4-bc43-0e9ebae94832 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:08.384542 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=100 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:08.519946 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d05c6bea-fc00-4359-acbe-937ca64c15ef tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "POST /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.086602 Jun 05 08:27:08.524322 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 625/1203] 10.222.0.33 () {62 vars in 1363 bytes} [Sun Jun 5 08:27:07 2022] POST /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5/os-volume_attachments => generated 194 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:27:08.534948 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9bcf7805-b1ae-4b83-bb1f-04d03064485a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:08.537427 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9bcf7805-b1ae-4b83-bb1f-04d03064485a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:08.548327 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1cf99a69-e24e-40f4-bc43-0e9ebae94832 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:08.561346 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9bcf7805-b1ae-4b83-bb1f-04d03064485a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:08.561917 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1cf99a69-e24e-40f4-bc43-0e9ebae94832 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1540 microversion: 2.1 time: 0.217592 Jun 05 08:27:08.563939 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 579/1204] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:08 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1540 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:08.574315 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9bcf7805-b1ae-4b83-bb1f-04d03064485a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:08.576560 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9bcf7805-b1ae-4b83-bb1f-04d03064485a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:08.577576 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9bcf7805-b1ae-4b83-bb1f-04d03064485a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:08.579853 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-24d00eed-483e-4926-8e60-8ba9bef9b5fc tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:08.585461 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-24d00eed-483e-4926-8e60-8ba9bef9b5fc tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:08.598137 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-24d00eed-483e-4926-8e60-8ba9bef9b5fc tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:08.600575 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-24d00eed-483e-4926-8e60-8ba9bef9b5fc tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:08.601406 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-24d00eed-483e-4926-8e60-8ba9bef9b5fc tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:08.601849 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-24d00eed-483e-4926-8e60-8ba9bef9b5fc tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:08.657332 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9bcf7805-b1ae-4b83-bb1f-04d03064485a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:08.658063 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9bcf7805-b1ae-4b83-bb1f-04d03064485a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:08.658688 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-9bcf7805-b1ae-4b83-bb1f-04d03064485a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:08.749493 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9bcf7805-b1ae-4b83-bb1f-04d03064485a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:08.763789 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9bcf7805-b1ae-4b83-bb1f-04d03064485a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.237734 Jun 05 08:27:08.780461 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 626/1205] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:08 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:08.786569 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1272adc2-88f2-4cb4-bb58-066c63f8df21 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:08.787389 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1272adc2-88f2-4cb4-bb58-066c63f8df21 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:08.794656 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1272adc2-88f2-4cb4-bb58-066c63f8df21 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:08.796640 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1272adc2-88f2-4cb4-bb58-066c63f8df21 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:08.797599 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1272adc2-88f2-4cb4-bb58-066c63f8df21 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:08.798155 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1272adc2-88f2-4cb4-bb58-066c63f8df21 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:08.806081 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:08.837917 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-24d00eed-483e-4926-8e60-8ba9bef9b5fc tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:08.851802 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-24d00eed-483e-4926-8e60-8ba9bef9b5fc tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:08.859290 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-24d00eed-483e-4926-8e60-8ba9bef9b5fc tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:08.860877 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-24d00eed-483e-4926-8e60-8ba9bef9b5fc tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1724 microversion: 2.20 time: 0.295757 Jun 05 08:27:08.862073 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 580/1206] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:08 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1724 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:08.870207 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0470c0c2-f123-4ae3-a7a8-90ad597a6a68 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Calling method '.version_select at 0x7f24336b8160>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:08.881349 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0470c0c2-f123-4ae3-a7a8-90ad597a6a68 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:08.882063 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0470c0c2-f123-4ae3-a7a8-90ad597a6a68 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:08.901804 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0470c0c2-f123-4ae3-a7a8-90ad597a6a68 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 1934 microversion: 2.1 time: 0.038499 Jun 05 08:27:08.904719 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 581/1207] 10.222.0.33 () {58 vars in 1142 bytes} [Sun Jun 5 08:27:08 2022] GET /compute/v2.1/os-migrations => generated 1934 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:08.918630 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-103f339a-4d61-42ad-9d62-c74939c0df58 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:08.920698 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-103f339a-4d61-42ad-9d62-c74939c0df58 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:08.932809 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-103f339a-4d61-42ad-9d62-c74939c0df58 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:08.940768 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-103f339a-4d61-42ad-9d62-c74939c0df58 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:08.941793 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-103f339a-4d61-42ad-9d62-c74939c0df58 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:08.942388 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-103f339a-4d61-42ad-9d62-c74939c0df58 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:09.000688 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-1272adc2-88f2-4cb4-bb58-066c63f8df21 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdc8382bafd49a3877df672d02f8206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76c30c981d4c69b229b6d7415c910c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:09.020713 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1272adc2-88f2-4cb4-bb58-066c63f8df21 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5" status: 200 len: 1316 microversion: 2.1 time: 0.237566 Jun 05 08:27:09.032391 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 627/1208] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:08 2022] GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5 => generated 1316 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:09.140156 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-690568ff-49fd-4cb5-a174-dccc36bd87c0 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:09.141069 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-690568ff-49fd-4cb5-a174-dccc36bd87c0 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 4210ab7f-0e7d-4e20-ba9b-9869c01c92ae] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:09.149185 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-690568ff-49fd-4cb5-a174-dccc36bd87c0 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:09.150857 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-690568ff-49fd-4cb5-a174-dccc36bd87c0 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:09.153741 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-690568ff-49fd-4cb5-a174-dccc36bd87c0 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:09.154534 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-690568ff-49fd-4cb5-a174-dccc36bd87c0 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:09.165726 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-103f339a-4d61-42ad-9d62-c74939c0df58 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1691 microversion: 2.1 time: 0.252620 Jun 05 08:27:09.166639 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 582/1209] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:08 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1691 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:27:09.182446 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e4de45a4-0c77-4c05-bb42-463256fcd339 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:09.183377 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e4de45a4-0c77-4c05-bb42-463256fcd339 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:09.190406 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e4de45a4-0c77-4c05-bb42-463256fcd339 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:09.190879 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e4de45a4-0c77-4c05-bb42-463256fcd339 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:09.191807 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e4de45a4-0c77-4c05-bb42-463256fcd339 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:09.192445 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e4de45a4-0c77-4c05-bb42-463256fcd339 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:09.537226 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e4de45a4-0c77-4c05-bb42-463256fcd339 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1691 microversion: 2.1 time: 0.358452 Jun 05 08:27:09.548067 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 583/1210] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:09 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1691 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:09.553427 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4149f16b-391a-4d1b-8833-fecec16e514f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:09.554728 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4149f16b-391a-4d1b-8833-fecec16e514f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 1adbf51b-8e22-4283-ad4f-d72b85fc5db7] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:09.567332 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:09.577841 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4149f16b-391a-4d1b-8833-fecec16e514f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:09.578969 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4149f16b-391a-4d1b-8833-fecec16e514f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:09.582052 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4149f16b-391a-4d1b-8833-fecec16e514f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:09.582716 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4149f16b-391a-4d1b-8833-fecec16e514f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:09.583381 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-690568ff-49fd-4cb5-a174-dccc36bd87c0 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:09.592339 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-690568ff-49fd-4cb5-a174-dccc36bd87c0 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae" status: 200 len: 1317 microversion: 2.1 time: 0.457304 Jun 05 08:27:09.601096 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 628/1211] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:09 2022] GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae => generated 1317 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:09.903849 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e28965c6-298b-4752-9ad0-2f1bfec5cb45 tempest-InstanceUsageAuditLogTestJSON-1339671317 tempest-InstanceUsageAuditLogTestJSON-1339671317-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:09.905129 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:27:09.905129 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:27:09.909042 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4149f16b-391a-4d1b-8833-fecec16e514f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:09.917786 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4149f16b-391a-4d1b-8833-fecec16e514f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/1adbf51b-8e22-4283-ad4f-d72b85fc5db7" status: 200 len: 1318 microversion: 2.1 time: 0.378726 Jun 05 08:27:09.919380 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 584/1212] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:09 2022] GET /compute/v2.1/servers/1adbf51b-8e22-4283-ad4f-d72b85fc5db7 => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:09.929817 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-598e1a47-d0ec-4e99-910a-ce688ecc0ae2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:09.930560 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-598e1a47-d0ec-4e99-910a-ce688ecc0ae2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:09.953703 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-598e1a47-d0ec-4e99-910a-ce688ecc0ae2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:09.957017 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-598e1a47-d0ec-4e99-910a-ce688ecc0ae2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:09.960872 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-598e1a47-d0ec-4e99-910a-ce688ecc0ae2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:09.969894 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-598e1a47-d0ec-4e99-910a-ce688ecc0ae2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:09.975330 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e28965c6-298b-4752-9ad0-2f1bfec5cb45 tempest-InstanceUsageAuditLogTestJSON-1339671317 tempest-InstanceUsageAuditLogTestJSON-1339671317-project-admin] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log/2022-06-05 08:27:09" status: 200 len: 318 microversion: 2.1 time: 0.371671 Jun 05 08:27:09.979119 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 629/1213] 10.222.0.33 () {58 vars in 1250 bytes} [Sun Jun 5 08:27:09 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-06-05%2008%3A27%3A09 => generated 318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:09.997937 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f89cee43-b25f-40bc-b67d-a38ab6606396 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:09.999897 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f89cee43-b25f-40bc-b67d-a38ab6606396 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:10.017758 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f89cee43-b25f-40bc-b67d-a38ab6606396 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:10.018238 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f89cee43-b25f-40bc-b67d-a38ab6606396 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:10.019113 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f89cee43-b25f-40bc-b67d-a38ab6606396 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:10.020960 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f89cee43-b25f-40bc-b67d-a38ab6606396 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:10.092451 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f89cee43-b25f-40bc-b67d-a38ab6606396 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:10.094196 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f89cee43-b25f-40bc-b67d-a38ab6606396 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:10.095475 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-f89cee43-b25f-40bc-b67d-a38ab6606396 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:10.183292 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f89cee43-b25f-40bc-b67d-a38ab6606396 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:10.195616 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f89cee43-b25f-40bc-b67d-a38ab6606396 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.215220 Jun 05 08:27:10.206346 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 630/1214] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:09 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:10.216394 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-e6bae0a6-d729-4eed-b41e-19e97ca24de6 req-711857de-2dee-4298-85b7-24f28fcdb6ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab76465b-2e53-4bf6-8371-6393b1aa99b5", "tag": "3d68c41c-fd5e-43a4-bd8e-d093440b6f3b"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:10.240305 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-e6bae0a6-d729-4eed-b41e-19e97ca24de6 req-711857de-2dee-4298-85b7-24f28fcdb6ea service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:10.249466 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-e6bae0a6-d729-4eed-b41e-19e97ca24de6 req-711857de-2dee-4298-85b7-24f28fcdb6ea service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:10.287109 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-598e1a47-d0ec-4e99-910a-ce688ecc0ae2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lazy-loading 'services' on Instance uuid 984c9830-3956-48fd-ab9e-8aad63a9cd97 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:10.302371 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-e6bae0a6-d729-4eed-b41e-19e97ca24de6 req-711857de-2dee-4298-85b7-24f28fcdb6ea service nova] Creating event network-changed:3d68c41c-fd5e-43a4-bd8e-d093440b6f3b for instance ab76465b-2e53-4bf6-8371-6393b1aa99b5 on n-h1-844739-1 Jun 05 08:27:10.320263 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-e6bae0a6-d729-4eed-b41e-19e97ca24de6 req-711857de-2dee-4298-85b7-24f28fcdb6ea service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117386 Jun 05 08:27:10.321257 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 631/1215] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:10.326738 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4e1871d9-5ac1-480b-ba9c-aef3d77db11f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:10.327431 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4e1871d9-5ac1-480b-ba9c-aef3d77db11f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:10.349349 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4e1871d9-5ac1-480b-ba9c-aef3d77db11f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:10.349883 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4e1871d9-5ac1-480b-ba9c-aef3d77db11f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:10.350953 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4e1871d9-5ac1-480b-ba9c-aef3d77db11f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:10.357366 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4e1871d9-5ac1-480b-ba9c-aef3d77db11f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:10.526818 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-598e1a47-d0ec-4e99-910a-ce688ecc0ae2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "DELETE /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments/1f41593c-9364-47bc-b99a-e4d9b91e8afa" status: 202 len: 0 microversion: 2.1 time: 0.605951 Jun 05 08:27:10.531828 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 585/1216] 10.222.0.33 () {58 vars in 1415 bytes} [Sun Jun 5 08:27:09 2022] DELETE /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments/1f41593c-9364-47bc-b99a-e4d9b91e8afa => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:27:10.536979 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-15588bc6-d4b4-4f8b-b891-f60fce1a3939 req-fa2ee792-b125-452e-8927-3ed49b4236de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4210ab7f-0e7d-4e20-ba9b-9869c01c92ae", "name": "network-vif-plugged", "status": "completed", "tag": "c96022c4-72c8-4057-ae15-32029528ca3e"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:10.563039 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-15588bc6-d4b4-4f8b-b891-f60fce1a3939 req-fa2ee792-b125-452e-8927-3ed49b4236de service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:10.563515 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-15588bc6-d4b4-4f8b-b891-f60fce1a3939 req-fa2ee792-b125-452e-8927-3ed49b4236de service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:10.594246 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-15588bc6-d4b4-4f8b-b891-f60fce1a3939 req-fa2ee792-b125-452e-8927-3ed49b4236de service nova] Creating event network-vif-plugged:c96022c4-72c8-4057-ae15-32029528ca3e for instance 4210ab7f-0e7d-4e20-ba9b-9869c01c92ae on n-h2-844739-1 Jun 05 08:27:10.614401 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-15588bc6-d4b4-4f8b-b891-f60fce1a3939 req-fa2ee792-b125-452e-8927-3ed49b4236de service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081172 Jun 05 08:27:10.615308 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 586/1217] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:10.620494 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-553eb07d-71d1-4a74-94eb-91869d71b22b tempest-InstanceUsageAuditLogTestJSON-1339671317 tempest-InstanceUsageAuditLogTestJSON-1339671317-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:10.621414 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:27:10.621414 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:27:10.627394 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4e1871d9-5ac1-480b-ba9c-aef3d77db11f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:10.659049 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4e1871d9-5ac1-480b-ba9c-aef3d77db11f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:10.663206 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4e1871d9-5ac1-480b-ba9c-aef3d77db11f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:10.665897 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-553eb07d-71d1-4a74-94eb-91869d71b22b tempest-InstanceUsageAuditLogTestJSON-1339671317 tempest-InstanceUsageAuditLogTestJSON-1339671317-project-admin] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.049340 Jun 05 08:27:10.666543 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 587/1218] 10.222.0.33 () {58 vars in 1184 bytes} [Sun Jun 5 08:27:10 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:10.674008 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4e1871d9-5ac1-480b-ba9c-aef3d77db11f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1724 microversion: 2.20 time: 0.351480 Jun 05 08:27:10.682270 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 632/1219] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:10 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1724 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:10.694291 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2e9efffc-17e3-4f19-95f0-3cf736b9b2c4 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:10.695070 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2e9efffc-17e3-4f19-95f0-3cf736b9b2c4 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:10.700618 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2f2afb22-4715-433b-b0ca-1c8cf0584fc9 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:10.701634 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2f2afb22-4715-433b-b0ca-1c8cf0584fc9 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:10.710644 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2e9efffc-17e3-4f19-95f0-3cf736b9b2c4 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:10.711143 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2e9efffc-17e3-4f19-95f0-3cf736b9b2c4 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:10.711976 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2e9efffc-17e3-4f19-95f0-3cf736b9b2c4 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:10.712545 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2e9efffc-17e3-4f19-95f0-3cf736b9b2c4 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:10.727944 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2f2afb22-4715-433b-b0ca-1c8cf0584fc9 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:10.730950 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2f2afb22-4715-433b-b0ca-1c8cf0584fc9 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:10.738257 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2f2afb22-4715-433b-b0ca-1c8cf0584fc9 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:10.739273 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2f2afb22-4715-433b-b0ca-1c8cf0584fc9 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:10.819572 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2f2afb22-4715-433b-b0ca-1c8cf0584fc9 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136112 Jun 05 08:27:10.823013 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 633/1220] 10.222.0.33 () {58 vars in 1301 bytes} [Sun Jun 5 08:27:10 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:10.837556 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-86f8f445-6d44-4bd0-a176-961792b9e9f0 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:10.838247 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-86f8f445-6d44-4bd0-a176-961792b9e9f0 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 4210ab7f-0e7d-4e20-ba9b-9869c01c92ae] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:10.853894 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-86f8f445-6d44-4bd0-a176-961792b9e9f0 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:10.854556 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-86f8f445-6d44-4bd0-a176-961792b9e9f0 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:10.855422 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-86f8f445-6d44-4bd0-a176-961792b9e9f0 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:10.855989 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-86f8f445-6d44-4bd0-a176-961792b9e9f0 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:11.135815 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-86f8f445-6d44-4bd0-a176-961792b9e9f0 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:11.147557 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-86f8f445-6d44-4bd0-a176-961792b9e9f0 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae" status: 200 len: 1317 microversion: 2.1 time: 0.323547 Jun 05 08:27:11.150268 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 634/1221] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:10 2022] GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae => generated 1317 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:11.165623 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1549ec05-8bec-4d17-9f4c-cfd9469ec75e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:11.166478 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1549ec05-8bec-4d17-9f4c-cfd9469ec75e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 1adbf51b-8e22-4283-ad4f-d72b85fc5db7] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:11.182464 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1549ec05-8bec-4d17-9f4c-cfd9469ec75e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:11.183100 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1549ec05-8bec-4d17-9f4c-cfd9469ec75e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:11.185131 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1549ec05-8bec-4d17-9f4c-cfd9469ec75e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:11.186489 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1549ec05-8bec-4d17-9f4c-cfd9469ec75e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:11.527056 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-1549ec05-8bec-4d17-9f4c-cfd9469ec75e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:11.536458 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1549ec05-8bec-4d17-9f4c-cfd9469ec75e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/1adbf51b-8e22-4283-ad4f-d72b85fc5db7" status: 200 len: 1318 microversion: 2.1 time: 0.385016 Jun 05 08:27:11.539401 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 635/1222] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:11 2022] GET /compute/v2.1/servers/1adbf51b-8e22-4283-ad4f-d72b85fc5db7 => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:11.547099 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2e9efffc-17e3-4f19-95f0-3cf736b9b2c4 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdc8382bafd49a3877df672d02f8206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76c30c981d4c69b229b6d7415c910c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:11.547951 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0a75e796-53f1-434a-abef-49f37065d7cf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:11.548769 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0a75e796-53f1-434a-abef-49f37065d7cf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:11.554322 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:11.556407 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0a75e796-53f1-434a-abef-49f37065d7cf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:11.556881 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0a75e796-53f1-434a-abef-49f37065d7cf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:11.557620 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0a75e796-53f1-434a-abef-49f37065d7cf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:11.558059 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0a75e796-53f1-434a-abef-49f37065d7cf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:11.563103 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2e9efffc-17e3-4f19-95f0-3cf736b9b2c4 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5" status: 200 len: 1316 microversion: 2.1 time: 0.894291 Jun 05 08:27:11.565193 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 588/1223] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:10 2022] GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5 => generated 1316 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:11.595847 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0a75e796-53f1-434a-abef-49f37065d7cf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:11.596373 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0a75e796-53f1-434a-abef-49f37065d7cf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:11.596840 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-0a75e796-53f1-434a-abef-49f37065d7cf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:11.658738 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0a75e796-53f1-434a-abef-49f37065d7cf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:11.670418 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0a75e796-53f1-434a-abef-49f37065d7cf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.126158 Jun 05 08:27:11.679726 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 636/1224] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:11 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:11.711150 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-406816a6-5c12-44e4-93fd-dd690936770c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:11.711972 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-406816a6-5c12-44e4-93fd-dd690936770c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:11.720588 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-406816a6-5c12-44e4-93fd-dd690936770c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:11.721346 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-406816a6-5c12-44e4-93fd-dd690936770c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:11.722315 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-406816a6-5c12-44e4-93fd-dd690936770c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:11.722919 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-406816a6-5c12-44e4-93fd-dd690936770c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:11.836095 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0627bbc6-ad6b-4133-82e8-85a936ca99f0 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:11.837601 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0627bbc6-ad6b-4133-82e8-85a936ca99f0 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:11.848380 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0627bbc6-ad6b-4133-82e8-85a936ca99f0 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:11.849295 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0627bbc6-ad6b-4133-82e8-85a936ca99f0 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:11.854715 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0627bbc6-ad6b-4133-82e8-85a936ca99f0 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:11.857374 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0627bbc6-ad6b-4133-82e8-85a936ca99f0 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:11.961091 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0627bbc6-ad6b-4133-82e8-85a936ca99f0 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129904 Jun 05 08:27:11.966062 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 637/1225] 10.222.0.33 () {58 vars in 1301 bytes} [Sun Jun 5 08:27:11 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:12.024743 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-406816a6-5c12-44e4-93fd-dd690936770c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:12.037159 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-406816a6-5c12-44e4-93fd-dd690936770c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:12.040254 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-406816a6-5c12-44e4-93fd-dd690936770c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:12.041918 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-406816a6-5c12-44e4-93fd-dd690936770c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1724 microversion: 2.20 time: 0.346527 Jun 05 08:27:12.053821 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 589/1226] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:11 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1724 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:12.167350 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5827371b-2787-4d41-8451-3b2e5d3cc81e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:12.168548 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5827371b-2787-4d41-8451-3b2e5d3cc81e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 4210ab7f-0e7d-4e20-ba9b-9869c01c92ae] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:12.174903 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5827371b-2787-4d41-8451-3b2e5d3cc81e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:12.175361 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5827371b-2787-4d41-8451-3b2e5d3cc81e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:12.176168 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5827371b-2787-4d41-8451-3b2e5d3cc81e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:12.176621 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5827371b-2787-4d41-8451-3b2e5d3cc81e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:12.340204 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5827371b-2787-4d41-8451-3b2e5d3cc81e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:12.352748 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5827371b-2787-4d41-8451-3b2e5d3cc81e tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae" status: 200 len: 1317 microversion: 2.1 time: 0.189588 Jun 05 08:27:12.356151 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 638/1227] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:12 2022] GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:12.555389 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-405d7ded-fafd-43b4-ad48-7cc55f4bc5b0 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:12.556182 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-405d7ded-fafd-43b4-ad48-7cc55f4bc5b0 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 1adbf51b-8e22-4283-ad4f-d72b85fc5db7] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:12.568274 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-405d7ded-fafd-43b4-ad48-7cc55f4bc5b0 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:12.568951 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-405d7ded-fafd-43b4-ad48-7cc55f4bc5b0 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:12.570035 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-405d7ded-fafd-43b4-ad48-7cc55f4bc5b0 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:12.570630 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-405d7ded-fafd-43b4-ad48-7cc55f4bc5b0 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:12.581989 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e3dc59c8-603f-464d-95a0-d8306f9ba760 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:12.583358 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e3dc59c8-603f-464d-95a0-d8306f9ba760 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:12.596332 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e3dc59c8-603f-464d-95a0-d8306f9ba760 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:12.597875 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e3dc59c8-603f-464d-95a0-d8306f9ba760 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:12.601224 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e3dc59c8-603f-464d-95a0-d8306f9ba760 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:12.604002 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e3dc59c8-603f-464d-95a0-d8306f9ba760 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:12.861050 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e3dc59c8-603f-464d-95a0-d8306f9ba760 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdc8382bafd49a3877df672d02f8206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76c30c981d4c69b229b6d7415c910c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:12.871941 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e3dc59c8-603f-464d-95a0-d8306f9ba760 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5" status: 200 len: 1316 microversion: 2.1 time: 0.294700 Jun 05 08:27:12.875879 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-405d7ded-fafd-43b4-ad48-7cc55f4bc5b0 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:12.876771 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 639/1228] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:12 2022] GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5 => generated 1316 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:27:12.884781 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-405d7ded-fafd-43b4-ad48-7cc55f4bc5b0 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/1adbf51b-8e22-4283-ad4f-d72b85fc5db7" status: 200 len: 1318 microversion: 2.1 time: 0.333404 Jun 05 08:27:12.892136 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 590/1229] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:12 2022] GET /compute/v2.1/servers/1adbf51b-8e22-4283-ad4f-d72b85fc5db7 => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:12.894946 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6ca367f1-5db6-48f1-942d-b973c69cad1d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:12.895831 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6ca367f1-5db6-48f1-942d-b973c69cad1d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:12.907870 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6ca367f1-5db6-48f1-942d-b973c69cad1d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:12.908667 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6ca367f1-5db6-48f1-942d-b973c69cad1d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:12.909698 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6ca367f1-5db6-48f1-942d-b973c69cad1d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:12.910300 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6ca367f1-5db6-48f1-942d-b973c69cad1d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:12.967927 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6ca367f1-5db6-48f1-942d-b973c69cad1d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:12.968631 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6ca367f1-5db6-48f1-942d-b973c69cad1d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:12.969161 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-6ca367f1-5db6-48f1-942d-b973c69cad1d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:12.975242 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-558ba9b3-baac-487e-8e23-28ec78225642 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:12.976437 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-558ba9b3-baac-487e-8e23-28ec78225642 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:12.984392 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-558ba9b3-baac-487e-8e23-28ec78225642 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:12.984849 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-558ba9b3-baac-487e-8e23-28ec78225642 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:12.985637 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-558ba9b3-baac-487e-8e23-28ec78225642 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:12.986075 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-558ba9b3-baac-487e-8e23-28ec78225642 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:13.026956 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6ca367f1-5db6-48f1-942d-b973c69cad1d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:13.035697 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6ca367f1-5db6-48f1-942d-b973c69cad1d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.156388 Jun 05 08:27:13.036580 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 640/1230] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:12 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:13.062839 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-189796e2-9458-47ce-8831-8ba7890f4036 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:13.063465 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-189796e2-9458-47ce-8831-8ba7890f4036 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:13.072077 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-558ba9b3-baac-487e-8e23-28ec78225642 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093287 Jun 05 08:27:13.073646 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 591/1231] 10.222.0.33 () {58 vars in 1301 bytes} [Sun Jun 5 08:27:12 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:13.082045 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-189796e2-9458-47ce-8831-8ba7890f4036 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:13.083399 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-189796e2-9458-47ce-8831-8ba7890f4036 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:13.086203 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-189796e2-9458-47ce-8831-8ba7890f4036 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:13.092759 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-189796e2-9458-47ce-8831-8ba7890f4036 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:13.100368 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-f46bf847-85fd-4a38-8a0d-2dcf12b9a14f req-cee06dd9-3b35-45b4-be7d-91a91aea5261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1adbf51b-8e22-4283-ad4f-d72b85fc5db7", "name": "network-vif-plugged", "status": "completed", "tag": "1a266bd8-8f0b-477e-b683-06f944fd4f80"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:13.133950 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-f46bf847-85fd-4a38-8a0d-2dcf12b9a14f req-cee06dd9-3b35-45b4-be7d-91a91aea5261 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:13.134413 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-f46bf847-85fd-4a38-8a0d-2dcf12b9a14f req-cee06dd9-3b35-45b4-be7d-91a91aea5261 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:13.166299 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-f46bf847-85fd-4a38-8a0d-2dcf12b9a14f req-cee06dd9-3b35-45b4-be7d-91a91aea5261 service nova] Creating event network-vif-plugged:1a266bd8-8f0b-477e-b683-06f944fd4f80 for instance 1adbf51b-8e22-4283-ad4f-d72b85fc5db7 on n-h1-844739-1 Jun 05 08:27:13.188504 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-f46bf847-85fd-4a38-8a0d-2dcf12b9a14f req-cee06dd9-3b35-45b4-be7d-91a91aea5261 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085854 Jun 05 08:27:13.192093 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 592/1232] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:27:13.317171 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-189796e2-9458-47ce-8831-8ba7890f4036 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:13.325758 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-189796e2-9458-47ce-8831-8ba7890f4036 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:13.327266 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-189796e2-9458-47ce-8831-8ba7890f4036 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:13.328686 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-189796e2-9458-47ce-8831-8ba7890f4036 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1724 microversion: 2.20 time: 0.272297 Jun 05 08:27:13.329454 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 641/1233] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:13 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:13.372889 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c65468f6-be88-450d-b567-7f9788e99220 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:13.373599 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c65468f6-be88-450d-b567-7f9788e99220 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 4210ab7f-0e7d-4e20-ba9b-9869c01c92ae] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:13.384934 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c65468f6-be88-450d-b567-7f9788e99220 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:13.385399 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c65468f6-be88-450d-b567-7f9788e99220 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:13.386210 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c65468f6-be88-450d-b567-7f9788e99220 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:13.386788 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c65468f6-be88-450d-b567-7f9788e99220 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:13.530078 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c65468f6-be88-450d-b567-7f9788e99220 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:13.539883 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c65468f6-be88-450d-b567-7f9788e99220 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae" status: 200 len: 1466 microversion: 2.1 time: 0.173154 Jun 05 08:27:13.540710 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 593/1234] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:13 2022] GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae => generated 1466 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:13.557846 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-47b3bc09-fdf6-45f0-aa2d-fee27722d5b5 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:13.559052 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-47b3bc09-fdf6-45f0-aa2d-fee27722d5b5 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] [instance: 4210ab7f-0e7d-4e20-ba9b-9869c01c92ae] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:13.568322 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-47b3bc09-fdf6-45f0-aa2d-fee27722d5b5 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:13.568778 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-47b3bc09-fdf6-45f0-aa2d-fee27722d5b5 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:13.570195 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-47b3bc09-fdf6-45f0-aa2d-fee27722d5b5 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:13.570639 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-47b3bc09-fdf6-45f0-aa2d-fee27722d5b5 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:13.894222 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-af78bc1a-7dfd-4c04-af58-9d2fd769ac82 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:13.895590 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-af78bc1a-7dfd-4c04-af58-9d2fd769ac82 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:13.904324 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-af78bc1a-7dfd-4c04-af58-9d2fd769ac82 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:13.905389 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-af78bc1a-7dfd-4c04-af58-9d2fd769ac82 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:13.906722 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-af78bc1a-7dfd-4c04-af58-9d2fd769ac82 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:13.907482 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-af78bc1a-7dfd-4c04-af58-9d2fd769ac82 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:14.097621 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-47b3bc09-fdf6-45f0-aa2d-fee27722d5b5 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae" status: 200 len: 1617 microversion: 2.1 time: 0.543648 Jun 05 08:27:14.098241 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 642/1235] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:13 2022] GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae => generated 1617 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:14.128030 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a6dc8e85-b9b7-42b2-8d75-5c67bc1463a2 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:14.129697 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a6dc8e85-b9b7-42b2-8d75-5c67bc1463a2 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 1adbf51b-8e22-4283-ad4f-d72b85fc5db7] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:14.142264 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a6dc8e85-b9b7-42b2-8d75-5c67bc1463a2 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:14.143820 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a6dc8e85-b9b7-42b2-8d75-5c67bc1463a2 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:14.152928 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a6dc8e85-b9b7-42b2-8d75-5c67bc1463a2 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:14.153483 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a6dc8e85-b9b7-42b2-8d75-5c67bc1463a2 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:14.327643 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-af78bc1a-7dfd-4c04-af58-9d2fd769ac82 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdc8382bafd49a3877df672d02f8206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76c30c981d4c69b229b6d7415c910c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:14.341776 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-af78bc1a-7dfd-4c04-af58-9d2fd769ac82 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5" status: 200 len: 1316 microversion: 2.1 time: 0.451143 Jun 05 08:27:14.342664 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 594/1236] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:13 2022] GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5 => generated 1316 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:27:14.347376 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-55af39e4-15f4-49f4-a706-dd62e352eec0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:14.354860 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-55af39e4-15f4-49f4-a706-dd62e352eec0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:14.367137 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-55af39e4-15f4-49f4-a706-dd62e352eec0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:14.368231 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-55af39e4-15f4-49f4-a706-dd62e352eec0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:14.369543 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-55af39e4-15f4-49f4-a706-dd62e352eec0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:14.370361 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-55af39e4-15f4-49f4-a706-dd62e352eec0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:14.406359 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a6dc8e85-b9b7-42b2-8d75-5c67bc1463a2 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:14.416092 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a6dc8e85-b9b7-42b2-8d75-5c67bc1463a2 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/1adbf51b-8e22-4283-ad4f-d72b85fc5db7" status: 200 len: 1318 microversion: 2.1 time: 0.306386 Jun 05 08:27:14.417306 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 643/1237] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:14 2022] GET /compute/v2.1/servers/1adbf51b-8e22-4283-ad4f-d72b85fc5db7 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:14.423701 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-656c7f67-cf7e-446d-9cf2-c10e0029ecdd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:14.428839 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-656c7f67-cf7e-446d-9cf2-c10e0029ecdd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:14.438961 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-55af39e4-15f4-49f4-a706-dd62e352eec0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:14.440979 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-55af39e4-15f4-49f4-a706-dd62e352eec0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:14.441836 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-55af39e4-15f4-49f4-a706-dd62e352eec0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:14.443878 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-656c7f67-cf7e-446d-9cf2-c10e0029ecdd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:14.447792 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-656c7f67-cf7e-446d-9cf2-c10e0029ecdd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:14.450529 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-656c7f67-cf7e-446d-9cf2-c10e0029ecdd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:14.451266 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-656c7f67-cf7e-446d-9cf2-c10e0029ecdd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:14.474854 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=100 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:14.507204 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-656c7f67-cf7e-446d-9cf2-c10e0029ecdd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088332 Jun 05 08:27:14.510730 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 644/1238] 10.222.0.33 () {58 vars in 1301 bytes} [Sun Jun 5 08:27:14 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:14.515840 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-55af39e4-15f4-49f4-a706-dd62e352eec0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:14.529837 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-55af39e4-15f4-49f4-a706-dd62e352eec0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.185969 Jun 05 08:27:14.530703 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 595/1239] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:14 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:14.541971 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-eac4d86d-5f9b-4bfd-aac0-fc4553e25d68 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:14.543547 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-eac4d86d-5f9b-4bfd-aac0-fc4553e25d68 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:14.548892 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-636a2727-b165-42f6-9262-dabe5903c09a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-702360934", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "8719f86c-4f4f-4c65-b580-c5d526d05175"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:14.562128 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-eac4d86d-5f9b-4bfd-aac0-fc4553e25d68 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:14.562779 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-eac4d86d-5f9b-4bfd-aac0-fc4553e25d68 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:14.563822 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-eac4d86d-5f9b-4bfd-aac0-fc4553e25d68 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:14.566246 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-eac4d86d-5f9b-4bfd-aac0-fc4553e25d68 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:14.637418 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-636a2727-b165-42f6-9262-dabe5903c09a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] validate_networks() for None {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:27:14.742020 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:14.823663 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-eac4d86d-5f9b-4bfd-aac0-fc4553e25d68 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:14.841648 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-eac4d86d-5f9b-4bfd-aac0-fc4553e25d68 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:14.848298 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-eac4d86d-5f9b-4bfd-aac0-fc4553e25d68 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:14.851137 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-eac4d86d-5f9b-4bfd-aac0-fc4553e25d68 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1745 microversion: 2.20 time: 0.318986 Jun 05 08:27:14.853095 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 596/1240] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:14 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1745 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:14.993493 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-636a2727-b165-42f6-9262-dabe5903c09a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:27:14.994903 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-636a2727-b165-42f6-9262-dabe5903c09a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:27:14.996245 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-636a2727-b165-42f6-9262-dabe5903c09a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:27:14.996797 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-636a2727-b165-42f6-9262-dabe5903c09a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:27:14.997311 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-636a2727-b165-42f6-9262-dabe5903c09a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:27:15.006477 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-636a2727-b165-42f6-9262-dabe5903c09a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:15.006904 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-636a2727-b165-42f6-9262-dabe5903c09a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:15.007838 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-636a2727-b165-42f6-9262-dabe5903c09a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:15.008329 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-636a2727-b165-42f6-9262-dabe5903c09a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:15.012960 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a787a039-c152-477d-be09-76935618bbfb tempest-QuotasAdminTestV236-1582256587 tempest-QuotasAdminTestV236-1582256587-project-admin] Action: 'update', calling method: .version_select at 0x7f2433716670>, body: {"quota_set": {"ram": "5120"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:15.025547 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-636a2727-b165-42f6-9262-dabe5903c09a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for project 5241947581244d30ba1528e6d5fad743. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:27:15.031448 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-636a2727-b165-42f6-9262-dabe5903c09a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Getting quotas for user 27beb829232e464092b06d904b9d6ec0 and project 5241947581244d30ba1528e6d5fad743. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:27:15.046842 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-636a2727-b165-42f6-9262-dabe5903c09a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:27:15.049469 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-636a2727-b165-42f6-9262-dabe5903c09a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 789255b3-7097-4ac9-897d-71da8910700c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:27:15.085240 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a787a039-c152-477d-be09-76935618bbfb tempest-QuotasAdminTestV236-1582256587 tempest-QuotasAdminTestV236-1582256587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:15.086056 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a787a039-c152-477d-be09-76935618bbfb tempest-QuotasAdminTestV236-1582256587 tempest-QuotasAdminTestV236-1582256587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:15.087142 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a787a039-c152-477d-be09-76935618bbfb tempest-QuotasAdminTestV236-1582256587 tempest-QuotasAdminTestV236-1582256587-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:15.087838 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a787a039-c152-477d-be09-76935618bbfb tempest-QuotasAdminTestV236-1582256587 tempest-QuotasAdminTestV236-1582256587-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:15.096789 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-636a2727-b165-42f6-9262-dabe5903c09a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557965 Jun 05 08:27:15.102432 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 645/1241] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:27:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:27:15.108004 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a7691fb4-1559-42d5-a082-6640a6b43ccc tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:15.108655 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a7691fb4-1559-42d5-a082-6640a6b43ccc tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 789255b3-7097-4ac9-897d-71da8910700c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:15.159165 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a787a039-c152-477d-be09-76935618bbfb tempest-QuotasAdminTestV236-1582256587 tempest-QuotasAdminTestV236-1582256587-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/af626c7af19b4803bc76247b9772751d" status: 200 len: 240 microversion: 2.36 time: 0.285191 Jun 05 08:27:15.160795 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 597/1242] 10.222.0.33 () {62 vars in 1302 bytes} [Sun Jun 5 08:27:14 2022] PUT /compute/v2.1/os-quota-sets/af626c7af19b4803bc76247b9772751d => generated 240 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 05 08:27:15.174394 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a7691fb4-1559-42d5-a082-6640a6b43ccc tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:15.175383 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7ad736ce-7920-4b3d-9ecd-c054884608db tempest-QuotasAdminTestV236-1582256587 tempest-QuotasAdminTestV236-1582256587-project-admin] Calling method '.version_select at 0x7f243370ce50>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:15.182438 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a7691fb4-1559-42d5-a082-6640a6b43ccc tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c" status: 200 len: 1216 microversion: 2.1 time: 0.078585 Jun 05 08:27:15.183617 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 646/1243] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:15 2022] GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c => generated 1216 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:27:15.260493 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7ad736ce-7920-4b3d-9ecd-c054884608db tempest-QuotasAdminTestV236-1582256587 tempest-QuotasAdminTestV236-1582256587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:15.261162 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7ad736ce-7920-4b3d-9ecd-c054884608db tempest-QuotasAdminTestV236-1582256587 tempest-QuotasAdminTestV236-1582256587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:15.262961 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7ad736ce-7920-4b3d-9ecd-c054884608db tempest-QuotasAdminTestV236-1582256587 tempest-QuotasAdminTestV236-1582256587-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:15.264393 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7ad736ce-7920-4b3d-9ecd-c054884608db tempest-QuotasAdminTestV236-1582256587 tempest-QuotasAdminTestV236-1582256587-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:15.289828 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7ad736ce-7920-4b3d-9ecd-c054884608db tempest-QuotasAdminTestV236-1582256587 tempest-QuotasAdminTestV236-1582256587-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/af626c7af19b4803bc76247b9772751d/detail" status: 200 len: 672 microversion: 2.36 time: 0.123058 Jun 05 08:27:15.291433 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 598/1244] 10.222.0.33 () {60 vars in 1303 bytes} [Sun Jun 5 08:27:15 2022] GET /compute/v2.1/os-quota-sets/af626c7af19b4803bc76247b9772751d/detail => generated 672 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:27:15.361866 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-04c9ce12-2c72-46ab-9c7f-ef90343e4b6d tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:15.362505 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-04c9ce12-2c72-46ab-9c7f-ef90343e4b6d tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:15.381081 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-04c9ce12-2c72-46ab-9c7f-ef90343e4b6d tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:15.382032 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-04c9ce12-2c72-46ab-9c7f-ef90343e4b6d tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:15.384214 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-04c9ce12-2c72-46ab-9c7f-ef90343e4b6d tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:15.384984 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-04c9ce12-2c72-46ab-9c7f-ef90343e4b6d tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:15.436926 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f7dcd0c5-dec5-42fd-b10b-4afd95d4203c tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:15.437876 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f7dcd0c5-dec5-42fd-b10b-4afd95d4203c tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 1adbf51b-8e22-4283-ad4f-d72b85fc5db7] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:15.456347 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f7dcd0c5-dec5-42fd-b10b-4afd95d4203c tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:15.456895 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f7dcd0c5-dec5-42fd-b10b-4afd95d4203c tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:15.457785 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f7dcd0c5-dec5-42fd-b10b-4afd95d4203c tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:15.458316 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f7dcd0c5-dec5-42fd-b10b-4afd95d4203c tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:15.463350 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:15.687602 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-04c9ce12-2c72-46ab-9c7f-ef90343e4b6d tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdc8382bafd49a3877df672d02f8206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76c30c981d4c69b229b6d7415c910c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:15.693111 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-04c9ce12-2c72-46ab-9c7f-ef90343e4b6d tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5" status: 200 len: 1316 microversion: 2.1 time: 0.338073 Jun 05 08:27:15.693701 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 647/1245] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:15 2022] GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5 => generated 1316 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:15.700542 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-de238f3f-fd77-4181-90e2-11282200f6f0 tempest-QuotasAdminTestV236-1582256587 tempest-QuotasAdminTestV236-1582256587-project-admin] Action: 'update', calling method: .version_select at 0x7f243377bdc0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:15.716472 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f7dcd0c5-dec5-42fd-b10b-4afd95d4203c tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:15.725780 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f7dcd0c5-dec5-42fd-b10b-4afd95d4203c tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/1adbf51b-8e22-4283-ad4f-d72b85fc5db7" status: 200 len: 1318 microversion: 2.1 time: 0.295777 Jun 05 08:27:15.736111 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 599/1246] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:15 2022] GET /compute/v2.1/servers/1adbf51b-8e22-4283-ad4f-d72b85fc5db7 => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:27:15.741408 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-90866c6a-05c4-47b1-918c-274d03195634 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:15.742771 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-90866c6a-05c4-47b1-918c-274d03195634 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:15.751570 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-90866c6a-05c4-47b1-918c-274d03195634 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:15.752306 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-90866c6a-05c4-47b1-918c-274d03195634 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:15.754429 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-90866c6a-05c4-47b1-918c-274d03195634 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:15.755089 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-90866c6a-05c4-47b1-918c-274d03195634 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:15.793892 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-de238f3f-fd77-4181-90e2-11282200f6f0 tempest-QuotasAdminTestV236-1582256587 tempest-QuotasAdminTestV236-1582256587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:15.794431 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-de238f3f-fd77-4181-90e2-11282200f6f0 tempest-QuotasAdminTestV236-1582256587 tempest-QuotasAdminTestV236-1582256587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:15.794693 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-90866c6a-05c4-47b1-918c-274d03195634 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057181 Jun 05 08:27:15.795657 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 600/1247] 10.222.0.33 () {58 vars in 1301 bytes} [Sun Jun 5 08:27:15 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:15.798972 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-de238f3f-fd77-4181-90e2-11282200f6f0 tempest-QuotasAdminTestV236-1582256587 tempest-QuotasAdminTestV236-1582256587-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:15.799682 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-de238f3f-fd77-4181-90e2-11282200f6f0 tempest-QuotasAdminTestV236-1582256587 tempest-QuotasAdminTestV236-1582256587-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:15.802520 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-97ad282d-c4ed-41d8-afc6-b3166f493c20 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:15.803207 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-97ad282d-c4ed-41d8-afc6-b3166f493c20 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:15.810501 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-97ad282d-c4ed-41d8-afc6-b3166f493c20 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:15.811179 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-97ad282d-c4ed-41d8-afc6-b3166f493c20 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:15.812172 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-97ad282d-c4ed-41d8-afc6-b3166f493c20 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:15.812850 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-97ad282d-c4ed-41d8-afc6-b3166f493c20 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:15.844311 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-de238f3f-fd77-4181-90e2-11282200f6f0 tempest-QuotasAdminTestV236-1582256587 tempest-QuotasAdminTestV236-1582256587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:15.845027 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-de238f3f-fd77-4181-90e2-11282200f6f0 tempest-QuotasAdminTestV236-1582256587 tempest-QuotasAdminTestV236-1582256587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:15.847232 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-de238f3f-fd77-4181-90e2-11282200f6f0 tempest-QuotasAdminTestV236-1582256587 tempest-QuotasAdminTestV236-1582256587-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:15.847926 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-de238f3f-fd77-4181-90e2-11282200f6f0 tempest-QuotasAdminTestV236-1582256587 tempest-QuotasAdminTestV236-1582256587-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:15.856573 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-97ad282d-c4ed-41d8-afc6-b3166f493c20 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:15.857028 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-97ad282d-c4ed-41d8-afc6-b3166f493c20 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:15.857669 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-97ad282d-c4ed-41d8-afc6-b3166f493c20 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:15.911529 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-97ad282d-c4ed-41d8-afc6-b3166f493c20 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:15.916598 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-de238f3f-fd77-4181-90e2-11282200f6f0 tempest-QuotasAdminTestV236-1582256587 tempest-QuotasAdminTestV236-1582256587-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/af626c7af19b4803bc76247b9772751d?user_id=0218c944ef8f43b88e6625ea25c06ecc" status: 200 len: 240 microversion: 2.36 time: 0.220718 Jun 05 08:27:15.917253 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 648/1248] 10.222.0.33 () {62 vars in 1383 bytes} [Sun Jun 5 08:27:15 2022] PUT /compute/v2.1/os-quota-sets/af626c7af19b4803bc76247b9772751d?user_id=0218c944ef8f43b88e6625ea25c06ecc => generated 240 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:27:15.923651 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-97ad282d-c4ed-41d8-afc6-b3166f493c20 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.126907 Jun 05 08:27:15.925335 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 601/1249] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:15 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:15.931121 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-51ceb832-53b2-40f2-91ac-4cff4544f91c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:15.933076 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-51ceb832-53b2-40f2-91ac-4cff4544f91c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:15.938201 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6b0d481c-748a-4552-a497-550094623e85 tempest-QuotasAdminTestV236-1582256587 tempest-QuotasAdminTestV236-1582256587-project-admin] Calling method '.version_select at 0x7f243375c550>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:15.940797 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-51ceb832-53b2-40f2-91ac-4cff4544f91c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:15.941358 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-51ceb832-53b2-40f2-91ac-4cff4544f91c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:15.942304 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-51ceb832-53b2-40f2-91ac-4cff4544f91c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:15.942850 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-51ceb832-53b2-40f2-91ac-4cff4544f91c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:16.024609 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6b0d481c-748a-4552-a497-550094623e85 tempest-QuotasAdminTestV236-1582256587 tempest-QuotasAdminTestV236-1582256587-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/af626c7af19b4803bc76247b9772751d?user_id=0218c944ef8f43b88e6625ea25c06ecc" status: 200 len: 282 microversion: 2.36 time: 0.098117 Jun 05 08:27:16.025522 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 602/1250] 10.222.0.33 () {60 vars in 1363 bytes} [Sun Jun 5 08:27:15 2022] GET /compute/v2.1/os-quota-sets/af626c7af19b4803bc76247b9772751d?user_id=0218c944ef8f43b88e6625ea25c06ecc => generated 282 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:27:16.152954 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-51ceb832-53b2-40f2-91ac-4cff4544f91c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:16.172989 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-51ceb832-53b2-40f2-91ac-4cff4544f91c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:16.174907 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-51ceb832-53b2-40f2-91ac-4cff4544f91c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:16.176405 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-51ceb832-53b2-40f2-91ac-4cff4544f91c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1745 microversion: 2.20 time: 0.255303 Jun 05 08:27:16.177144 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 649/1251] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:15 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1745 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:16.201044 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2cec1423-9b20-46a6-b2bf-941aa33057a3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:16.201675 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2cec1423-9b20-46a6-b2bf-941aa33057a3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 789255b3-7097-4ac9-897d-71da8910700c] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:16.208298 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2cec1423-9b20-46a6-b2bf-941aa33057a3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:16.209163 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2cec1423-9b20-46a6-b2bf-941aa33057a3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:16.210542 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2cec1423-9b20-46a6-b2bf-941aa33057a3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:16.211747 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2cec1423-9b20-46a6-b2bf-941aa33057a3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:16.300989 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2cec1423-9b20-46a6-b2bf-941aa33057a3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:16.310835 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2cec1423-9b20-46a6-b2bf-941aa33057a3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c" status: 200 len: 1268 microversion: 2.1 time: 0.113892 Jun 05 08:27:16.320614 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 603/1252] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:16 2022] GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c => generated 1268 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:16.709964 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2514abef-7f52-4edb-a0e6-5fc7bd641be8 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:16.710957 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2514abef-7f52-4edb-a0e6-5fc7bd641be8 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:16.718579 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2514abef-7f52-4edb-a0e6-5fc7bd641be8 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:16.719033 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2514abef-7f52-4edb-a0e6-5fc7bd641be8 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:16.719809 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2514abef-7f52-4edb-a0e6-5fc7bd641be8 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:16.720287 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2514abef-7f52-4edb-a0e6-5fc7bd641be8 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:16.744340 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-39a8e16f-ace2-4cf8-b7d5-b3b20a81ef2f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:16.745217 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-39a8e16f-ace2-4cf8-b7d5-b3b20a81ef2f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 1adbf51b-8e22-4283-ad4f-d72b85fc5db7] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:16.756867 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-39a8e16f-ace2-4cf8-b7d5-b3b20a81ef2f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:16.757328 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-39a8e16f-ace2-4cf8-b7d5-b3b20a81ef2f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:16.758125 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-39a8e16f-ace2-4cf8-b7d5-b3b20a81ef2f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:16.758664 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-39a8e16f-ace2-4cf8-b7d5-b3b20a81ef2f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:17.041996 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2514abef-7f52-4edb-a0e6-5fc7bd641be8 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdc8382bafd49a3877df672d02f8206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76c30c981d4c69b229b6d7415c910c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:17.052182 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2514abef-7f52-4edb-a0e6-5fc7bd641be8 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5" status: 200 len: 1316 microversion: 2.1 time: 0.346278 Jun 05 08:27:17.060078 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 650/1253] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:16 2022] GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5 => generated 1316 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:17.066232 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c653a315-df76-42ac-98c5-9f95211ac4ad tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:17.069280 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c653a315-df76-42ac-98c5-9f95211ac4ad tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:17.084844 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c653a315-df76-42ac-98c5-9f95211ac4ad tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:17.085294 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c653a315-df76-42ac-98c5-9f95211ac4ad tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:17.086078 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c653a315-df76-42ac-98c5-9f95211ac4ad tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:17.086512 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c653a315-df76-42ac-98c5-9f95211ac4ad tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:17.147786 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-39a8e16f-ace2-4cf8-b7d5-b3b20a81ef2f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:17.160345 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-39a8e16f-ace2-4cf8-b7d5-b3b20a81ef2f tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/1adbf51b-8e22-4283-ad4f-d72b85fc5db7" status: 200 len: 1505 microversion: 2.1 time: 0.421483 Jun 05 08:27:17.172522 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 604/1254] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:16 2022] GET /compute/v2.1/servers/1adbf51b-8e22-4283-ad4f-d72b85fc5db7 => generated 1505 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:27:17.172522 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c2205f44-d2a7-491a-ba27-799745accbdf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:17.185572 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c2205f44-d2a7-491a-ba27-799745accbdf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:17.190764 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c653a315-df76-42ac-98c5-9f95211ac4ad tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127816 Jun 05 08:27:17.191372 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 651/1255] 10.222.0.33 () {58 vars in 1301 bytes} [Sun Jun 5 08:27:17 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:17.208389 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c2205f44-d2a7-491a-ba27-799745accbdf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:17.210007 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c2205f44-d2a7-491a-ba27-799745accbdf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:17.212279 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c2205f44-d2a7-491a-ba27-799745accbdf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:17.213109 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ea691ed8-f6cd-4577-bb50-d3b546d3a9c0 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:17.213912 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c2205f44-d2a7-491a-ba27-799745accbdf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:17.214987 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ea691ed8-f6cd-4577-bb50-d3b546d3a9c0 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 1adbf51b-8e22-4283-ad4f-d72b85fc5db7] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:17.238170 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ea691ed8-f6cd-4577-bb50-d3b546d3a9c0 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:17.238640 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ea691ed8-f6cd-4577-bb50-d3b546d3a9c0 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:17.241789 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ea691ed8-f6cd-4577-bb50-d3b546d3a9c0 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:17.242627 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ea691ed8-f6cd-4577-bb50-d3b546d3a9c0 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:17.288442 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ea691ed8-f6cd-4577-bb50-d3b546d3a9c0 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 1adbf51b-8e22-4283-ad4f-d72b85fc5db7] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:27:17.307145 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c2205f44-d2a7-491a-ba27-799745accbdf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:17.307757 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c2205f44-d2a7-491a-ba27-799745accbdf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:17.308877 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-c2205f44-d2a7-491a-ba27-799745accbdf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:17.396294 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c2205f44-d2a7-491a-ba27-799745accbdf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:17.400588 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ea691ed8-f6cd-4577-bb50-d3b546d3a9c0 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1adbf51b-8e22-4283-ad4f-d72b85fc5db7" status: 204 len: 0 microversion: 2.1 time: 0.200305 Jun 05 08:27:17.401441 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 652/1256] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:27:17 2022] DELETE /compute/v2.1/servers/1adbf51b-8e22-4283-ad4f-d72b85fc5db7 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:27:17.408525 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-cbb70ff3-704b-4bb5-b409-45c2c81fa2db tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:17.410122 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-cbb70ff3-704b-4bb5-b409-45c2c81fa2db tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:17.414561 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c2205f44-d2a7-491a-ba27-799745accbdf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.248127 Jun 05 08:27:17.418142 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 605/1257] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:17 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:17.423018 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cbb70ff3-704b-4bb5-b409-45c2c81fa2db tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:17.423198 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cbb70ff3-704b-4bb5-b409-45c2c81fa2db tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:17.423974 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cbb70ff3-704b-4bb5-b409-45c2c81fa2db tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:17.424433 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cbb70ff3-704b-4bb5-b409-45c2c81fa2db tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:17.434918 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f11ce5ac-6773-4d18-ae09-4bfd95989cd8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:17.435831 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f11ce5ac-6773-4d18-ae09-4bfd95989cd8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 789255b3-7097-4ac9-897d-71da8910700c] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:17.450729 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f11ce5ac-6773-4d18-ae09-4bfd95989cd8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:17.451438 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f11ce5ac-6773-4d18-ae09-4bfd95989cd8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:17.467695 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f11ce5ac-6773-4d18-ae09-4bfd95989cd8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:17.469060 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f11ce5ac-6773-4d18-ae09-4bfd95989cd8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:17.618975 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f11ce5ac-6773-4d18-ae09-4bfd95989cd8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:17.647208 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f11ce5ac-6773-4d18-ae09-4bfd95989cd8 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c" status: 200 len: 1274 microversion: 2.1 time: 0.225970 Jun 05 08:27:17.648464 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 606/1258] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:17 2022] GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c => generated 1274 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:17.673622 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-85015c07-1156-4175-a462-aa837607f59b tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:17.675154 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-85015c07-1156-4175-a462-aa837607f59b tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 2725f200-5bb2-4b65-af28-186bfead7f64] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:17.706658 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-85015c07-1156-4175-a462-aa837607f59b tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:17.707196 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-85015c07-1156-4175-a462-aa837607f59b tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:17.714720 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-85015c07-1156-4175-a462-aa837607f59b tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:17.716629 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-85015c07-1156-4175-a462-aa837607f59b tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:17.785118 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-85015c07-1156-4175-a462-aa837607f59b tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 2725f200-5bb2-4b65-af28-186bfead7f64] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:27:17.861502 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-cbb70ff3-704b-4bb5-b409-45c2c81fa2db tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:17.889684 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-cbb70ff3-704b-4bb5-b409-45c2c81fa2db tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:17.900664 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-cbb70ff3-704b-4bb5-b409-45c2c81fa2db tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:17.907715 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-cbb70ff3-704b-4bb5-b409-45c2c81fa2db tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1740 microversion: 2.20 time: 0.502499 Jun 05 08:27:17.913588 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 653/1259] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:17 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1740 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:17.924933 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-74721939-1bd9-4d62-8695-7a4d950e3ecc req-2de51b01-f0c2-467b-9545-bc600db46a9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b271002d-4613-405c-aeed-7c06b205a045", "name": "network-vif-plugged", "status": "completed", "tag": "642e2803-a706-408c-b7c4-6157cb18ee50"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:17.958103 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-74721939-1bd9-4d62-8695-7a4d950e3ecc req-2de51b01-f0c2-467b-9545-bc600db46a9f service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:17.962851 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-74721939-1bd9-4d62-8695-7a4d950e3ecc req-2de51b01-f0c2-467b-9545-bc600db46a9f service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:17.964074 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-85015c07-1156-4175-a462-aa837607f59b tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64" status: 204 len: 0 microversion: 2.1 time: 0.314210 Jun 05 08:27:17.968698 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 607/1260] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:27:17 2022] DELETE /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:27:17.979585 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7213c103-b7da-4760-87b0-370d41b07e7a tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:17.984031 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7213c103-b7da-4760-87b0-370d41b07e7a tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 1adbf51b-8e22-4283-ad4f-d72b85fc5db7] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:17.986430 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-74721939-1bd9-4d62-8695-7a4d950e3ecc req-2de51b01-f0c2-467b-9545-bc600db46a9f service nova] Creating event network-vif-plugged:642e2803-a706-408c-b7c4-6157cb18ee50 for instance b271002d-4613-405c-aeed-7c06b205a045 on n-h2-844739-1 Jun 05 08:27:17.995510 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7213c103-b7da-4760-87b0-370d41b07e7a tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:17.998973 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7213c103-b7da-4760-87b0-370d41b07e7a tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:17.999702 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7213c103-b7da-4760-87b0-370d41b07e7a tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:18.001685 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-74721939-1bd9-4d62-8695-7a4d950e3ecc req-2de51b01-f0c2-467b-9545-bc600db46a9f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084594 Jun 05 08:27:18.002278 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7213c103-b7da-4760-87b0-370d41b07e7a tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:18.003656 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 654/1261] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:18.082787 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c7c05358-5a75-484c-bf83-9d5bc457f91e tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:18.084832 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c7c05358-5a75-484c-bf83-9d5bc457f91e tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:18.110658 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c7c05358-5a75-484c-bf83-9d5bc457f91e tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:18.113476 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c7c05358-5a75-484c-bf83-9d5bc457f91e tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:18.116014 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c7c05358-5a75-484c-bf83-9d5bc457f91e tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:18.116547 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c7c05358-5a75-484c-bf83-9d5bc457f91e tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:18.389490 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c7c05358-5a75-484c-bf83-9d5bc457f91e tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdc8382bafd49a3877df672d02f8206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76c30c981d4c69b229b6d7415c910c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:18.399959 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7213c103-b7da-4760-87b0-370d41b07e7a tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:18.408431 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c7c05358-5a75-484c-bf83-9d5bc457f91e tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5" status: 200 len: 1316 microversion: 2.1 time: 0.336299 Jun 05 08:27:18.409038 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 655/1262] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:18 2022] GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5 => generated 1316 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:18.413798 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7213c103-b7da-4760-87b0-370d41b07e7a tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/1adbf51b-8e22-4283-ad4f-d72b85fc5db7" status: 200 len: 1511 microversion: 2.1 time: 0.442542 Jun 05 08:27:18.415788 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 608/1263] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:17 2022] GET /compute/v2.1/servers/1adbf51b-8e22-4283-ad4f-d72b85fc5db7 => generated 1511 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:18.422471 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-207c8fdc-76c6-4c9e-b150-555143d2e675 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:18.423580 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-207c8fdc-76c6-4c9e-b150-555143d2e675 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:18.434400 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ae991542-0aca-4885-ac40-93697cb73702 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:18.435383 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ae991542-0aca-4885-ac40-93697cb73702 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:18.447662 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ae991542-0aca-4885-ac40-93697cb73702 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:18.448607 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-207c8fdc-76c6-4c9e-b150-555143d2e675 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:18.449331 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-207c8fdc-76c6-4c9e-b150-555143d2e675 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:18.450622 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ae991542-0aca-4885-ac40-93697cb73702 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:18.451446 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ae991542-0aca-4885-ac40-93697cb73702 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:18.452520 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ae991542-0aca-4885-ac40-93697cb73702 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:18.453106 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-207c8fdc-76c6-4c9e-b150-555143d2e675 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:18.453943 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-207c8fdc-76c6-4c9e-b150-555143d2e675 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:18.539420 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-207c8fdc-76c6-4c9e-b150-555143d2e675 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123476 Jun 05 08:27:18.547484 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ae991542-0aca-4885-ac40-93697cb73702 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:18.547989 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ae991542-0aca-4885-ac40-93697cb73702 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:18.548141 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 656/1264] 10.222.0.33 () {58 vars in 1301 bytes} [Sun Jun 5 08:27:18 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:18.548637 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-ae991542-0aca-4885-ac40-93697cb73702 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:18.635437 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ae991542-0aca-4885-ac40-93697cb73702 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:18.645348 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ae991542-0aca-4885-ac40-93697cb73702 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.216125 Jun 05 08:27:18.655039 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 609/1265] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:18 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:18.665843 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-14b904fb-df45-40e0-90d5-83640d804999 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:18.666516 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-14b904fb-df45-40e0-90d5-83640d804999 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 789255b3-7097-4ac9-897d-71da8910700c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:18.681656 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-14b904fb-df45-40e0-90d5-83640d804999 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:18.682140 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-14b904fb-df45-40e0-90d5-83640d804999 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:18.684280 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-14b904fb-df45-40e0-90d5-83640d804999 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:18.684738 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-14b904fb-df45-40e0-90d5-83640d804999 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:18.932517 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d7dcb3ae-6665-48cf-bb5e-a286851713e4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:18.933803 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d7dcb3ae-6665-48cf-bb5e-a286851713e4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:18.953953 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d7dcb3ae-6665-48cf-bb5e-a286851713e4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:18.954418 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d7dcb3ae-6665-48cf-bb5e-a286851713e4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:18.956126 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d7dcb3ae-6665-48cf-bb5e-a286851713e4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:18.956126 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d7dcb3ae-6665-48cf-bb5e-a286851713e4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:19.008560 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-14b904fb-df45-40e0-90d5-83640d804999 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:19.024001 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-14b904fb-df45-40e0-90d5-83640d804999 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c" status: 200 len: 1316 microversion: 2.1 time: 0.361966 Jun 05 08:27:19.034963 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 657/1266] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:18 2022] GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c => generated 1316 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:19.180212 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d7dcb3ae-6665-48cf-bb5e-a286851713e4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:19.192971 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d7dcb3ae-6665-48cf-bb5e-a286851713e4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:19.195085 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d7dcb3ae-6665-48cf-bb5e-a286851713e4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:19.196978 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d7dcb3ae-6665-48cf-bb5e-a286851713e4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1740 microversion: 2.20 time: 0.268017 Jun 05 08:27:19.212218 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 610/1267] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:18 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1740 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:27:19.444984 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4ad215af-efe7-4b9e-8712-41b62afe78de tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:19.446598 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4df326ff-1777-4d7e-8289-1e76c33cf015 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:19.447916 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4df326ff-1777-4d7e-8289-1e76c33cf015 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:19.450254 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4ad215af-efe7-4b9e-8712-41b62afe78de tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 1adbf51b-8e22-4283-ad4f-d72b85fc5db7] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:19.471480 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4ad215af-efe7-4b9e-8712-41b62afe78de tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:19.472939 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4df326ff-1777-4d7e-8289-1e76c33cf015 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:19.476215 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4df326ff-1777-4d7e-8289-1e76c33cf015 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:19.478473 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4ad215af-efe7-4b9e-8712-41b62afe78de tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:19.481172 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4ad215af-efe7-4b9e-8712-41b62afe78de tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:19.481865 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4df326ff-1777-4d7e-8289-1e76c33cf015 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:19.484256 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4df326ff-1777-4d7e-8289-1e76c33cf015 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:19.486035 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4ad215af-efe7-4b9e-8712-41b62afe78de tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:20.086676 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4ad215af-efe7-4b9e-8712-41b62afe78de tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:20.118584 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4ad215af-efe7-4b9e-8712-41b62afe78de tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/1adbf51b-8e22-4283-ad4f-d72b85fc5db7" status: 200 len: 1511 microversion: 2.1 time: 0.682290 Jun 05 08:27:20.134089 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 611/1268] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:19 2022] GET /compute/v2.1/servers/1adbf51b-8e22-4283-ad4f-d72b85fc5db7 => generated 1511 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:20.161398 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e784801f-c85c-411e-bc3e-f1d5d55c786c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:20.165085 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e784801f-c85c-411e-bc3e-f1d5d55c786c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:20.182310 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e784801f-c85c-411e-bc3e-f1d5d55c786c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:20.182766 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e784801f-c85c-411e-bc3e-f1d5d55c786c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:20.184265 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e784801f-c85c-411e-bc3e-f1d5d55c786c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:20.198075 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e784801f-c85c-411e-bc3e-f1d5d55c786c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:20.294021 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e784801f-c85c-411e-bc3e-f1d5d55c786c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156713 Jun 05 08:27:20.301766 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 612/1269] 10.222.0.33 () {58 vars in 1301 bytes} [Sun Jun 5 08:27:20 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:20.312744 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c6ed2db2-5368-4836-8a1a-2c6c10a195df tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:20.313379 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c6ed2db2-5368-4836-8a1a-2c6c10a195df tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:20.343122 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c6ed2db2-5368-4836-8a1a-2c6c10a195df tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:20.348784 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c6ed2db2-5368-4836-8a1a-2c6c10a195df tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:20.349963 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c6ed2db2-5368-4836-8a1a-2c6c10a195df tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:20.350820 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c6ed2db2-5368-4836-8a1a-2c6c10a195df tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:20.456759 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4df326ff-1777-4d7e-8289-1e76c33cf015 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdc8382bafd49a3877df672d02f8206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76c30c981d4c69b229b6d7415c910c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:20.457313 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c6ed2db2-5368-4836-8a1a-2c6c10a195df tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:20.457721 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c6ed2db2-5368-4836-8a1a-2c6c10a195df tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:20.457858 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-c6ed2db2-5368-4836-8a1a-2c6c10a195df tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:20.466252 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4df326ff-1777-4d7e-8289-1e76c33cf015 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5" status: 200 len: 1316 microversion: 2.1 time: 1.031157 Jun 05 08:27:20.479509 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 658/1270] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:19 2022] GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5 => generated 1316 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:20.490638 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-74088651-8a5e-4e70-9a02-83dfd0b32bcb tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:20.493494 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-74088651-8a5e-4e70-9a02-83dfd0b32bcb tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 789255b3-7097-4ac9-897d-71da8910700c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:20.521983 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-74088651-8a5e-4e70-9a02-83dfd0b32bcb tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:20.539422 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-74088651-8a5e-4e70-9a02-83dfd0b32bcb tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:20.553644 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-74088651-8a5e-4e70-9a02-83dfd0b32bcb tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:20.554725 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-74088651-8a5e-4e70-9a02-83dfd0b32bcb tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:21.105405 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c6ed2db2-5368-4836-8a1a-2c6c10a195df tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:21.110412 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:21.119540 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c6ed2db2-5368-4836-8a1a-2c6c10a195df tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.816889 Jun 05 08:27:21.120150 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 613/1271] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:20 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:21.135763 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-7482b06d-8d35-4418-b6ab-cc4bc90a73c5 req-2b1ae151-af13-43c0-a409-a9af5edc4074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab76465b-2e53-4bf6-8371-6393b1aa99b5", "name": "network-vif-plugged", "status": "completed", "tag": "3d68c41c-fd5e-43a4-bd8e-d093440b6f3b"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:21.156376 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-7482b06d-8d35-4418-b6ab-cc4bc90a73c5 req-2b1ae151-af13-43c0-a409-a9af5edc4074 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:21.163076 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-7482b06d-8d35-4418-b6ab-cc4bc90a73c5 req-2b1ae151-af13-43c0-a409-a9af5edc4074 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:21.197130 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-7482b06d-8d35-4418-b6ab-cc4bc90a73c5 req-2b1ae151-af13-43c0-a409-a9af5edc4074 service nova] Creating event network-vif-plugged:3d68c41c-fd5e-43a4-bd8e-d093440b6f3b for instance ab76465b-2e53-4bf6-8371-6393b1aa99b5 on n-h1-844739-1 Jun 05 08:27:21.216549 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-7482b06d-8d35-4418-b6ab-cc4bc90a73c5 req-2b1ae151-af13-43c0-a409-a9af5edc4074 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087979 Jun 05 08:27:21.222149 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 614/1272] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:21.237583 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-10704883-25da-4199-a0b9-fa9579f18fe4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:21.244341 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-10704883-25da-4199-a0b9-fa9579f18fe4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:21.269665 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10704883-25da-4199-a0b9-fa9579f18fe4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:21.287636 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10704883-25da-4199-a0b9-fa9579f18fe4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:21.289593 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10704883-25da-4199-a0b9-fa9579f18fe4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:21.292724 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10704883-25da-4199-a0b9-fa9579f18fe4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:21.665129 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-74088651-8a5e-4e70-9a02-83dfd0b32bcb tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:21.678690 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-74088651-8a5e-4e70-9a02-83dfd0b32bcb tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c" status: 200 len: 1316 microversion: 2.1 time: 1.191785 Jun 05 08:27:21.681692 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 659/1273] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:20 2022] GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c => generated 1316 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:21.699994 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9b44ffc6-54bf-4f0c-a180-9a3457665607 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:21.708472 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9b44ffc6-54bf-4f0c-a180-9a3457665607 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 1adbf51b-8e22-4283-ad4f-d72b85fc5db7] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:21.723628 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9b44ffc6-54bf-4f0c-a180-9a3457665607 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:21.726975 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9b44ffc6-54bf-4f0c-a180-9a3457665607 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:21.730434 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9b44ffc6-54bf-4f0c-a180-9a3457665607 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:21.733400 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9b44ffc6-54bf-4f0c-a180-9a3457665607 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:21.739619 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-10704883-25da-4199-a0b9-fa9579f18fe4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:21.755094 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-10704883-25da-4199-a0b9-fa9579f18fe4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:21.767658 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-10704883-25da-4199-a0b9-fa9579f18fe4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:21.769740 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-10704883-25da-4199-a0b9-fa9579f18fe4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1740 microversion: 2.20 time: 0.545793 Jun 05 08:27:21.774607 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 615/1274] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:21 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1740 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:21.793475 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-1ad087cc-c681-488e-9af2-5390d29016bc req-59e09aca-cbaf-4561-a491-b8c86be2d3a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "789255b3-7097-4ac9-897d-71da8910700c", "tag": "480f2e74-6e36-4e1f-a0d5-0499a40cd88a"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:21.810729 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-1ad087cc-c681-488e-9af2-5390d29016bc req-59e09aca-cbaf-4561-a491-b8c86be2d3a7 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:21.837835 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-1ad087cc-c681-488e-9af2-5390d29016bc req-59e09aca-cbaf-4561-a491-b8c86be2d3a7 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:21.870991 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-1ad087cc-c681-488e-9af2-5390d29016bc req-59e09aca-cbaf-4561-a491-b8c86be2d3a7 service nova] Creating event network-changed:480f2e74-6e36-4e1f-a0d5-0499a40cd88a for instance 789255b3-7097-4ac9-897d-71da8910700c on n-h1-844739-1 Jun 05 08:27:21.884396 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-1ad087cc-c681-488e-9af2-5390d29016bc req-59e09aca-cbaf-4561-a491-b8c86be2d3a7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108287 Jun 05 08:27:21.889926 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 616/1275] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:21.895790 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-275bdf23-f0d9-47f1-817d-5c4e4353e31f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:21.900547 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-275bdf23-f0d9-47f1-817d-5c4e4353e31f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:21.912153 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:21.918366 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-275bdf23-f0d9-47f1-817d-5c4e4353e31f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:21.919257 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-275bdf23-f0d9-47f1-817d-5c4e4353e31f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:21.920665 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-275bdf23-f0d9-47f1-817d-5c4e4353e31f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:21.921339 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-275bdf23-f0d9-47f1-817d-5c4e4353e31f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:21.960096 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-275bdf23-f0d9-47f1-817d-5c4e4353e31f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068402 Jun 05 08:27:21.961668 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 617/1276] 10.222.0.33 () {58 vars in 1301 bytes} [Sun Jun 5 08:27:21 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:21.967860 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-01b48ef4-5ba0-4083-bd85-8d4b5dae1505 req-e77bcee4-221c-4e5a-9c7d-bbba75b2d024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2725f200-5bb2-4b65-af28-186bfead7f64", "name": "network-vif-deleted", "tag": "b0406d71-f20c-4491-9e27-c5f2fb5f3588"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:21.978758 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-01b48ef4-5ba0-4083-bd85-8d4b5dae1505 req-e77bcee4-221c-4e5a-9c7d-bbba75b2d024 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:21.980010 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-01b48ef4-5ba0-4083-bd85-8d4b5dae1505 req-e77bcee4-221c-4e5a-9c7d-bbba75b2d024 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:21.997041 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-01b48ef4-5ba0-4083-bd85-8d4b5dae1505 req-e77bcee4-221c-4e5a-9c7d-bbba75b2d024 service nova] Creating event network-vif-deleted:b0406d71-f20c-4491-9e27-c5f2fb5f3588 for instance 2725f200-5bb2-4b65-af28-186bfead7f64 on n-h2-844739-1 Jun 05 08:27:22.013200 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-01b48ef4-5ba0-4083-bd85-8d4b5dae1505 req-e77bcee4-221c-4e5a-9c7d-bbba75b2d024 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047678 Jun 05 08:27:22.014271 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 618/1277] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:22.029704 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-95486b73-201e-4655-8ff9-dd80f8f35e5d tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:22.031329 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-95486b73-201e-4655-8ff9-dd80f8f35e5d tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:22.049989 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-95486b73-201e-4655-8ff9-dd80f8f35e5d tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:22.050734 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-95486b73-201e-4655-8ff9-dd80f8f35e5d tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:22.055351 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9b44ffc6-54bf-4f0c-a180-9a3457665607 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:22.056392 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-95486b73-201e-4655-8ff9-dd80f8f35e5d tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:22.057530 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-95486b73-201e-4655-8ff9-dd80f8f35e5d tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:22.071434 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9b44ffc6-54bf-4f0c-a180-9a3457665607 tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/1adbf51b-8e22-4283-ad4f-d72b85fc5db7" status: 200 len: 1511 microversion: 2.1 time: 0.388330 Jun 05 08:27:22.072531 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 660/1278] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:21 2022] GET /compute/v2.1/servers/1adbf51b-8e22-4283-ad4f-d72b85fc5db7 => generated 1511 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:22.141893 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e86d63d2-53a5-4a3a-8929-1c5837916c33 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:22.142515 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e86d63d2-53a5-4a3a-8929-1c5837916c33 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:22.154877 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e86d63d2-53a5-4a3a-8929-1c5837916c33 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:22.155332 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e86d63d2-53a5-4a3a-8929-1c5837916c33 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:22.156142 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e86d63d2-53a5-4a3a-8929-1c5837916c33 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:22.156588 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e86d63d2-53a5-4a3a-8929-1c5837916c33 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:22.236826 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e86d63d2-53a5-4a3a-8929-1c5837916c33 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:22.237278 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e86d63d2-53a5-4a3a-8929-1c5837916c33 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:22.237743 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-e86d63d2-53a5-4a3a-8929-1c5837916c33 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:22.254947 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:22.349743 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e86d63d2-53a5-4a3a-8929-1c5837916c33 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:22.363559 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e86d63d2-53a5-4a3a-8929-1c5837916c33 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.225462 Jun 05 08:27:22.364451 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 661/1279] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:22 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:22.385353 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-95486b73-201e-4655-8ff9-dd80f8f35e5d tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdc8382bafd49a3877df672d02f8206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76c30c981d4c69b229b6d7415c910c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:22.397361 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-95486b73-201e-4655-8ff9-dd80f8f35e5d tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5" status: 200 len: 1316 microversion: 2.1 time: 0.380524 Jun 05 08:27:22.398149 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 619/1280] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:22 2022] GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5 => generated 1316 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:22.706010 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2bb6ad63-5715-4b0f-a9f6-eadb1fd624fe tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:22.707200 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2bb6ad63-5715-4b0f-a9f6-eadb1fd624fe tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 789255b3-7097-4ac9-897d-71da8910700c] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:22.720425 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2bb6ad63-5715-4b0f-a9f6-eadb1fd624fe tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:22.721633 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2bb6ad63-5715-4b0f-a9f6-eadb1fd624fe tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:22.724115 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2bb6ad63-5715-4b0f-a9f6-eadb1fd624fe tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:22.727963 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2bb6ad63-5715-4b0f-a9f6-eadb1fd624fe tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:22.851976 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0c4e4239-9843-400b-8aa6-ecded0ca4902 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Calling method '.version_select at 0x7f24455389d0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:22.918156 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2bb6ad63-5715-4b0f-a9f6-eadb1fd624fe tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:22.929714 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2bb6ad63-5715-4b0f-a9f6-eadb1fd624fe tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c" status: 200 len: 1316 microversion: 2.1 time: 0.231939 Jun 05 08:27:22.931150 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 620/1281] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:22 2022] GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c => generated 1316 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:27:22.937710 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-199dbdb2-2d55-4dd4-974e-3a84901ad503 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:22.939114 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-199dbdb2-2d55-4dd4-974e-3a84901ad503 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:22.949300 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-199dbdb2-2d55-4dd4-974e-3a84901ad503 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:22.950163 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-199dbdb2-2d55-4dd4-974e-3a84901ad503 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:22.951364 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-199dbdb2-2d55-4dd4-974e-3a84901ad503 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:22.952171 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-199dbdb2-2d55-4dd4-974e-3a84901ad503 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:22.982432 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:23.006888 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0c4e4239-9843-400b-8aa6-ecded0ca4902 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/91fecfc103ed4df3bf30dbf2262559cb" status: 200 len: 371 microversion: 2.1 time: 0.385800 Jun 05 08:27:23.007798 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 662/1282] 10.222.0.33 () {58 vars in 1241 bytes} [Sun Jun 5 08:27:22 2022] GET /compute/v2.1/os-quota-sets/91fecfc103ed4df3bf30dbf2262559cb => generated 371 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:27:23.021325 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-486767d6-9875-4456-95f1-d91cb9898bf8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:23.022656 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-486767d6-9875-4456-95f1-d91cb9898bf8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:23.035473 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-486767d6-9875-4456-95f1-d91cb9898bf8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:23.036269 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-486767d6-9875-4456-95f1-d91cb9898bf8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:23.037236 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-486767d6-9875-4456-95f1-d91cb9898bf8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:23.037887 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-486767d6-9875-4456-95f1-d91cb9898bf8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:23.075701 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-486767d6-9875-4456-95f1-d91cb9898bf8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061363 Jun 05 08:27:23.080655 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 663/1283] 10.222.0.33 () {58 vars in 1301 bytes} [Sun Jun 5 08:27:23 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:23.087225 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-70db2bf7-b4fd-4ca5-85e1-8e7ce818aee9 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Action: 'update', calling method: .version_select at 0x7f243391a160>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:23.171772 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-70db2bf7-b4fd-4ca5-85e1-8e7ce818aee9 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:23.172467 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-70db2bf7-b4fd-4ca5-85e1-8e7ce818aee9 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:23.173755 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-70db2bf7-b4fd-4ca5-85e1-8e7ce818aee9 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:23.174529 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-70db2bf7-b4fd-4ca5-85e1-8e7ce818aee9 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:23.224679 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-199dbdb2-2d55-4dd4-974e-3a84901ad503 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:23.235982 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-199dbdb2-2d55-4dd4-974e-3a84901ad503 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:23.237623 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-199dbdb2-2d55-4dd4-974e-3a84901ad503 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:23.242023 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-199dbdb2-2d55-4dd4-974e-3a84901ad503 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1740 microversion: 2.20 time: 0.309724 Jun 05 08:27:23.256328 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 621/1284] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:22 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1740 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:23.262102 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d5b2d210-9906-4607-8660-eac88fb0b95e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:23.265522 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d5b2d210-9906-4607-8660-eac88fb0b95e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 1adbf51b-8e22-4283-ad4f-d72b85fc5db7] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:23.282648 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d5b2d210-9906-4607-8660-eac88fb0b95e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:23.286770 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d5b2d210-9906-4607-8660-eac88fb0b95e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:23.287705 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d5b2d210-9906-4607-8660-eac88fb0b95e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:23.288977 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d5b2d210-9906-4607-8660-eac88fb0b95e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:23.294111 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-70db2bf7-b4fd-4ca5-85e1-8e7ce818aee9 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/91fecfc103ed4df3bf30dbf2262559cb" status: 200 len: 328 microversion: 2.1 time: 0.212700 Jun 05 08:27:23.308371 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 664/1285] 10.222.0.33 () {60 vars in 1261 bytes} [Sun Jun 5 08:27:23 2022] PUT /compute/v2.1/os-quota-sets/91fecfc103ed4df3bf30dbf2262559cb => generated 328 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:23.372510 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d5b2d210-9906-4607-8660-eac88fb0b95e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:23.373606 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d5b2d210-9906-4607-8660-eac88fb0b95e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:23.374296 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-d5b2d210-9906-4607-8660-eac88fb0b95e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lazy-loading 'fault' on Instance uuid 1adbf51b-8e22-4283-ad4f-d72b85fc5db7 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:23.381686 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9197625c-8d51-4fcd-8977-0df9854464ae tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:23.385358 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9197625c-8d51-4fcd-8977-0df9854464ae tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:23.403130 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9197625c-8d51-4fcd-8977-0df9854464ae tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:23.406598 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9197625c-8d51-4fcd-8977-0df9854464ae tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:23.407688 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9197625c-8d51-4fcd-8977-0df9854464ae tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:23.409377 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9197625c-8d51-4fcd-8977-0df9854464ae tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:23.498819 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d5b2d210-9906-4607-8660-eac88fb0b95e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:23.500285 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9197625c-8d51-4fcd-8977-0df9854464ae tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:23.500972 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9197625c-8d51-4fcd-8977-0df9854464ae tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:23.501637 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-9197625c-8d51-4fcd-8977-0df9854464ae tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:23.511804 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d5b2d210-9906-4607-8660-eac88fb0b95e tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/1adbf51b-8e22-4283-ad4f-d72b85fc5db7" status: 200 len: 1369 microversion: 2.1 time: 0.253584 Jun 05 08:27:23.522779 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 622/1286] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:23 2022] GET /compute/v2.1/servers/1adbf51b-8e22-4283-ad4f-d72b85fc5db7 => generated 1369 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:23.522779 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a2a07c7e-a522-431b-9351-539889146284 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:23.522779 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a2a07c7e-a522-431b-9351-539889146284 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:23.531188 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a2a07c7e-a522-431b-9351-539889146284 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:23.531716 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a2a07c7e-a522-431b-9351-539889146284 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:23.532558 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a2a07c7e-a522-431b-9351-539889146284 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:23.533059 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a2a07c7e-a522-431b-9351-539889146284 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:23.577991 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9197625c-8d51-4fcd-8977-0df9854464ae tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:23.586041 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9197625c-8d51-4fcd-8977-0df9854464ae tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.208216 Jun 05 08:27:23.587173 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 665/1287] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:23 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:23.694942 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1bde7e2f-f849-4cfd-acc5-212cb783389d tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2035606214", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:23.739351 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a2a07c7e-a522-431b-9351-539889146284 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdc8382bafd49a3877df672d02f8206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76c30c981d4c69b229b6d7415c910c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:23.756581 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a2a07c7e-a522-431b-9351-539889146284 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5" status: 200 len: 1316 microversion: 2.1 time: 0.241680 Jun 05 08:27:23.770359 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 623/1288] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:23 2022] GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5 => generated 1316 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:23.779697 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f7786d1f-0df8-4150-a74e-083d76a1384d tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:23.780446 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-1bde7e2f-f849-4cfd-acc5-212cb783389d tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] validate_networks() for None {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:27:23.782468 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f7786d1f-0df8-4150-a74e-083d76a1384d tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 2725f200-5bb2-4b65-af28-186bfead7f64] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:23.792661 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f7786d1f-0df8-4150-a74e-083d76a1384d tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:23.793394 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f7786d1f-0df8-4150-a74e-083d76a1384d tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:23.794436 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f7786d1f-0df8-4150-a74e-083d76a1384d tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:23.795037 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f7786d1f-0df8-4150-a74e-083d76a1384d tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:23.831804 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f7786d1f-0df8-4150-a74e-083d76a1384d tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:23.832290 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f7786d1f-0df8-4150-a74e-083d76a1384d tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:23.832957 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-f7786d1f-0df8-4150-a74e-083d76a1384d tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lazy-loading 'fault' on Instance uuid 2725f200-5bb2-4b65-af28-186bfead7f64 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:23.936950 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f7786d1f-0df8-4150-a74e-083d76a1384d tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:23.952335 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f7786d1f-0df8-4150-a74e-083d76a1384d tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64" status: 200 len: 1363 microversion: 2.1 time: 0.180785 Jun 05 08:27:23.957191 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 624/1289] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:23 2022] GET /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:23.965399 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-c151fe44-6edc-4d3e-8b27-49967a66b26f req-5b61d3dc-a952-4b1d-861a-83243ae316a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1adbf51b-8e22-4283-ad4f-d72b85fc5db7", "name": "network-vif-deleted", "tag": "1a266bd8-8f0b-477e-b683-06f944fd4f80"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:23.991940 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-c151fe44-6edc-4d3e-8b27-49967a66b26f req-5b61d3dc-a952-4b1d-861a-83243ae316a9 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:23.999515 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-c151fe44-6edc-4d3e-8b27-49967a66b26f req-5b61d3dc-a952-4b1d-861a-83243ae316a9 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:24.017442 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-c151fe44-6edc-4d3e-8b27-49967a66b26f req-5b61d3dc-a952-4b1d-861a-83243ae316a9 service nova] Creating event network-vif-deleted:1a266bd8-8f0b-477e-b683-06f944fd4f80 for instance 1adbf51b-8e22-4283-ad4f-d72b85fc5db7 on n-h1-844739-1 Jun 05 08:27:24.023197 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-c151fe44-6edc-4d3e-8b27-49967a66b26f req-5b61d3dc-a952-4b1d-861a-83243ae316a9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064592 Jun 05 08:27:24.024382 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 625/1290] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:24.031460 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7e2a35df-a083-4ac6-bb9e-5adc1d04e2ce tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:24.032723 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7e2a35df-a083-4ac6-bb9e-5adc1d04e2ce tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 789255b3-7097-4ac9-897d-71da8910700c] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:24.040652 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7e2a35df-a083-4ac6-bb9e-5adc1d04e2ce tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:24.042010 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7e2a35df-a083-4ac6-bb9e-5adc1d04e2ce tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:24.043323 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7e2a35df-a083-4ac6-bb9e-5adc1d04e2ce tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:24.044069 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7e2a35df-a083-4ac6-bb9e-5adc1d04e2ce tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:24.100295 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-1bde7e2f-f849-4cfd-acc5-212cb783389d tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:27:24.101354 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-1bde7e2f-f849-4cfd-acc5-212cb783389d tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:27:24.102050 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-1bde7e2f-f849-4cfd-acc5-212cb783389d tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:27:24.102678 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-1bde7e2f-f849-4cfd-acc5-212cb783389d tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:27:24.103295 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-1bde7e2f-f849-4cfd-acc5-212cb783389d tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:27:24.123579 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1bde7e2f-f849-4cfd-acc5-212cb783389d tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:24.124368 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1bde7e2f-f849-4cfd-acc5-212cb783389d tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:24.125061 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1bde7e2f-f849-4cfd-acc5-212cb783389d tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:24.125501 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1bde7e2f-f849-4cfd-acc5-212cb783389d tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:24.158905 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-1bde7e2f-f849-4cfd-acc5-212cb783389d tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Getting quotas for project 91fecfc103ed4df3bf30dbf2262559cb. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:27:24.163883 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-1bde7e2f-f849-4cfd-acc5-212cb783389d tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Getting quotas for user 14aa5e41d58f4e3391ae20e40ddbaf71 and project 91fecfc103ed4df3bf30dbf2262559cb. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:27:24.176191 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.utils [None req-1bde7e2f-f849-4cfd-acc5-212cb783389d tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] cores quota exceeded for 91fecfc103ed4df3bf30dbf2262559cb, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119049) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1174}} Jun 05 08:27:24.177146 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-1bde7e2f-f849-4cfd-acc5-212cb783389d tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 05 08:27:24.180976 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1bde7e2f-f849-4cfd-acc5-212cb783389d tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Request method failure captured: Jun 05 08:27:24.180976 n-d-844739-1 devstack@n-api.service[119049]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 05 08:27:24.180976 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:27:24.180976 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:27:24.180976 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:27:24.180976 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 145 Jun 05 08:27:24.180976 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:27:24.180976 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:27:24.180976 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:27:24.180976 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:27:24.180976 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGjoMNQ5OVpZcXe2aZ4ExqAs3S5SNpsvHvG0xVPm2J-JXlaYs2KqNn3xYxu_F34hSGqR-iPz2iqhJymmJOkAqwVuoLVM2nljFjVVWeG6pDutCS7W1gXQLYLO3AdWnyAVhJ2dTb5FVFc9hycMcWPmXuAMhvSkYUVD2iK8Ch4TI7vm01s Jun 05 08:27:24.180976 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:27:24.180976 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:27:24.180976 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:27:24.180976 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:27:24.180976 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:27:24.180976 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:27:24.180976 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 91fecfc103ed4df3bf30dbf2262559cb Jun 05 08:27:24.180976 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-QuotasAdminNegativeTest-2138326271 Jun 05 08:27:24.180976 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:27:24.180976 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:27:24.182313 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91fecfc103ed4df3bf30dbf2262559cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91fecfc103ed4df3bf30dbf2262559cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91fecfc103ed4df3bf30dbf2262559cb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91fecfc103ed4df3bf30dbf2262559cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:27:24.182313 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-QuotasAdminNegativeTest-2138326271 Jun 05 08:27:24.182313 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 91fecfc103ed4df3bf30dbf2262559cb Jun 05 08:27:24.182313 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2138326271 Jun 05 08:27:24.182313 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-QuotasAdminNegativeTest-2138326271-project Jun 05 08:27:24.182313 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:27:24.182313 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:27:24.182313 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 14aa5e41d58f4e3391ae20e40ddbaf71 Jun 05 08:27:24.182313 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-QuotasAdminNegativeTest-2138326271-project Jun 05 08:27:24.182313 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:27:24.182313 n-d-844739-1 devstack@n-api.service[119049]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2035606214", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452"}} Jun 05 08:27:24.182313 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:27:24.183616 n-d-844739-1 devstack@n-api.service[119049]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 05 08:27:24.183616 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2035606214', 'imageRef': '1241bde3-ef1f-41a5-b0fa-6f409216229a', 'flavorRef': '452'}}} Jun 05 08:27:24.183616 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:27:24.183616 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:27:24.183616 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1116, in check_num_instances_quota Jun 05 08:27:24.183616 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jun 05 08:27:24.183616 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:27:24.183616 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:27:24.183616 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 05 08:27:24.183616 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc Jun 05 08:27:24.183616 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 05 08:27:24.183616 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 05 08:27:24.183616 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:27:24.183616 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:27:24.183616 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 05 08:27:24.183616 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 05 08:27:24.183616 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 05 08:27:24.183616 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 05 08:27:24.184783 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jun 05 08:27:24.184783 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 05 08:27:24.184783 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jun 05 08:27:24.184783 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:27:24.184783 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:27:24.184783 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:27:24.184783 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:27:24.184783 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 05 08:27:24.184783 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 05 08:27:24.184783 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 05 08:27:24.184783 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 05 08:27:24.184783 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jun 05 08:27:24.184783 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jun 05 08:27:24.184783 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jun 05 08:27:24.184783 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jun 05 08:27:24.184783 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1182, in check_num_instances_quota Jun 05 08:27:24.184783 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 05 08:27:24.184783 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 05 08:27:24.184783 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:27:24.184783 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:27:24.184783 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:27:24.186064 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:27:24.186064 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:27:24.186064 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:27:24.186064 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:27:24.186064 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:27:24.186064 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:27:24.186064 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:27:24.186064 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:27:24.186064 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:27:24.186064 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:27:24.186064 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:27:24.186064 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:27:24.186064 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:27:24.186064 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 05 08:27:24.186064 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 05 08:27:24.186064 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 05 08:27:24.186064 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 05 08:27:24.186064 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:27:24.186064 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:27:24.186064 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:27:24.186064 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:27:24.187319 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:27:24.187319 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:27:24.187319 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:27:24.187319 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:27:24.187319 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 05 08:27:24.187319 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:27:24.187319 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1bde7e2f-f849-4cfd-acc5-212cb783389d tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:27:24.187319 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1bde7e2f-f849-4cfd-acc5-212cb783389d tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.594151 Jun 05 08:27:24.187319 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 666/1291] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:27:23 2022] POST /compute/v2.1/servers => generated 111 bytes in 597 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:27:24.193833 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d8c69954-758f-4090-80d7-5ed5b05d670a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:24.194858 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d8c69954-758f-4090-80d7-5ed5b05d670a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:24.204458 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d8c69954-758f-4090-80d7-5ed5b05d670a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:24.204905 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d8c69954-758f-4090-80d7-5ed5b05d670a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:24.205764 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d8c69954-758f-4090-80d7-5ed5b05d670a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:24.206181 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d8c69954-758f-4090-80d7-5ed5b05d670a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:24.270248 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7e2a35df-a083-4ac6-bb9e-5adc1d04e2ce tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:24.280031 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7e2a35df-a083-4ac6-bb9e-5adc1d04e2ce tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c" status: 200 len: 1316 microversion: 2.1 time: 0.254214 Jun 05 08:27:24.289138 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 626/1292] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:24 2022] GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c => generated 1316 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:24.289138 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-26b26f6d-03b7-4bde-ae33-a1abac4b3ac7 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Action: 'update', calling method: .version_select at 0x7f2433748820>, body: {"quota_set": {"cores": 20}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:24.395992 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-26b26f6d-03b7-4bde-ae33-a1abac4b3ac7 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:24.397557 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-26b26f6d-03b7-4bde-ae33-a1abac4b3ac7 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:24.398722 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-26b26f6d-03b7-4bde-ae33-a1abac4b3ac7 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:24.399432 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-26b26f6d-03b7-4bde-ae33-a1abac4b3ac7 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:24.449312 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d8c69954-758f-4090-80d7-5ed5b05d670a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.259535 Jun 05 08:27:24.450381 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 667/1293] 10.222.0.33 () {58 vars in 1301 bytes} [Sun Jun 5 08:27:24 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments => generated 197 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:24.455245 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-dc9893d9-e0b1-4dea-baaf-93f41c13de74 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:24.456124 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-dc9893d9-e0b1-4dea-baaf-93f41c13de74 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:24.462944 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc9893d9-e0b1-4dea-baaf-93f41c13de74 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:24.463696 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc9893d9-e0b1-4dea-baaf-93f41c13de74 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:24.464956 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc9893d9-e0b1-4dea-baaf-93f41c13de74 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:24.465492 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc9893d9-e0b1-4dea-baaf-93f41c13de74 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:24.487523 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-26b26f6d-03b7-4bde-ae33-a1abac4b3ac7 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/91fecfc103ed4df3bf30dbf2262559cb" status: 200 len: 329 microversion: 2.1 time: 0.205010 Jun 05 08:27:24.488638 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 627/1294] 10.222.0.33 () {60 vars in 1261 bytes} [Sun Jun 5 08:27:24 2022] PUT /compute/v2.1/os-quota-sets/91fecfc103ed4df3bf30dbf2262559cb => generated 329 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:24.502715 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f46180f6-0784-4137-ba47-aab502649e3a tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Calling method '.version_select at 0x7f2433716d30>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:24.620349 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f46180f6-0784-4137-ba47-aab502649e3a tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/91fecfc103ed4df3bf30dbf2262559cb" status: 200 len: 371 microversion: 2.1 time: 0.121011 Jun 05 08:27:24.623952 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 628/1295] 10.222.0.33 () {58 vars in 1241 bytes} [Sun Jun 5 08:27:24 2022] GET /compute/v2.1/os-quota-sets/91fecfc103ed4df3bf30dbf2262559cb => generated 371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:27:24.632363 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4ef43221-c76b-44ca-9353-aa7537fe3d10 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:24.633786 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4ef43221-c76b-44ca-9353-aa7537fe3d10 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:24.645357 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4ef43221-c76b-44ca-9353-aa7537fe3d10 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:24.646066 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4ef43221-c76b-44ca-9353-aa7537fe3d10 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:24.646721 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-dc9893d9-e0b1-4dea-baaf-93f41c13de74 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:24.647645 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4ef43221-c76b-44ca-9353-aa7537fe3d10 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:24.650916 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4ef43221-c76b-44ca-9353-aa7537fe3d10 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:24.658747 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-dc9893d9-e0b1-4dea-baaf-93f41c13de74 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:24.660516 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-dc9893d9-e0b1-4dea-baaf-93f41c13de74 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:24.661871 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-dc9893d9-e0b1-4dea-baaf-93f41c13de74 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1740 microversion: 2.20 time: 0.210224 Jun 05 08:27:24.663562 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 668/1296] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:24 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:24.668704 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-993daec2-61b1-47d2-91a9-2d197e96c7c2 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Action: 'update', calling method: .version_select at 0x7f2445567670>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:24.708994 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4ef43221-c76b-44ca-9353-aa7537fe3d10 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:24.709448 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4ef43221-c76b-44ca-9353-aa7537fe3d10 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:24.709918 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-4ef43221-c76b-44ca-9353-aa7537fe3d10 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:24.780918 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-993daec2-61b1-47d2-91a9-2d197e96c7c2 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:24.781487 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-993daec2-61b1-47d2-91a9-2d197e96c7c2 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:24.782346 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4ef43221-c76b-44ca-9353-aa7537fe3d10 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:24.782525 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-993daec2-61b1-47d2-91a9-2d197e96c7c2 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:24.783069 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-993daec2-61b1-47d2-91a9-2d197e96c7c2 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:24.814221 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4ef43221-c76b-44ca-9353-aa7537fe3d10 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.188940 Jun 05 08:27:24.834631 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 629/1297] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:24 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:24.849653 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ab0ceb4e-3bcc-4034-9362-bca9baae0ad8 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:24.850975 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ab0ceb4e-3bcc-4034-9362-bca9baae0ad8 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:24.859550 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ab0ceb4e-3bcc-4034-9362-bca9baae0ad8 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:24.860907 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ab0ceb4e-3bcc-4034-9362-bca9baae0ad8 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:24.862610 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ab0ceb4e-3bcc-4034-9362-bca9baae0ad8 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:24.865286 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ab0ceb4e-3bcc-4034-9362-bca9baae0ad8 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:24.899510 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-993daec2-61b1-47d2-91a9-2d197e96c7c2 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/91fecfc103ed4df3bf30dbf2262559cb" status: 200 len: 328 microversion: 2.1 time: 0.234429 Jun 05 08:27:24.901281 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 669/1298] 10.222.0.33 () {60 vars in 1261 bytes} [Sun Jun 5 08:27:24 2022] PUT /compute/v2.1/os-quota-sets/91fecfc103ed4df3bf30dbf2262559cb => generated 328 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:24.997931 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2f424da1-4a9c-493e-9c2c-1fc8c9379dad tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:24.998901 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2f424da1-4a9c-493e-9c2c-1fc8c9379dad tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] [instance: 2725f200-5bb2-4b65-af28-186bfead7f64] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:25.020453 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2f424da1-4a9c-493e-9c2c-1fc8c9379dad tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:25.020974 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2f424da1-4a9c-493e-9c2c-1fc8c9379dad tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:25.021835 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2f424da1-4a9c-493e-9c2c-1fc8c9379dad tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:25.022543 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2f424da1-4a9c-493e-9c2c-1fc8c9379dad tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:25.069225 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2f424da1-4a9c-493e-9c2c-1fc8c9379dad tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:25.070052 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2f424da1-4a9c-493e-9c2c-1fc8c9379dad tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:25.071832 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-2f424da1-4a9c-493e-9c2c-1fc8c9379dad tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Lazy-loading 'fault' on Instance uuid 2725f200-5bb2-4b65-af28-186bfead7f64 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:25.136792 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2f424da1-4a9c-493e-9c2c-1fc8c9379dad tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca3243fc2bf41448a184c03df437f8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96dedf15be442108c8d5d5ec1775a88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:25.149690 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2f424da1-4a9c-493e-9c2c-1fc8c9379dad tempest-MultipleCreateTestJSON-2082726224 tempest-MultipleCreateTestJSON-2082726224-project] 10.222.0.33 "GET /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64" status: 200 len: 1363 microversion: 2.1 time: 0.175575 Jun 05 08:27:25.154274 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ab0ceb4e-3bcc-4034-9362-bca9baae0ad8 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdc8382bafd49a3877df672d02f8206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76c30c981d4c69b229b6d7415c910c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:25.156339 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 670/1299] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:24 2022] GET /compute/v2.1/servers/2725f200-5bb2-4b65-af28-186bfead7f64 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:27:25.165653 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ab0ceb4e-3bcc-4034-9362-bca9baae0ad8 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5" status: 200 len: 1316 microversion: 2.1 time: 0.329463 Jun 05 08:27:25.166398 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 630/1300] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:24 2022] GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5 => generated 1316 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:25.190287 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c9484b8b-7d95-4920-aa9b-aa434e8fbe43 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-743751793", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:25.296434 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-c9484b8b-7d95-4920-aa9b-aa434e8fbe43 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] validate_networks() for None {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:27:25.297077 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d2c48f1f-fb4b-49d9-b985-95d58ca87c34 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:25.297698 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d2c48f1f-fb4b-49d9-b985-95d58ca87c34 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 789255b3-7097-4ac9-897d-71da8910700c] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:25.305379 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d2c48f1f-fb4b-49d9-b985-95d58ca87c34 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:25.306512 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d2c48f1f-fb4b-49d9-b985-95d58ca87c34 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:25.307385 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d2c48f1f-fb4b-49d9-b985-95d58ca87c34 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:25.308775 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d2c48f1f-fb4b-49d9-b985-95d58ca87c34 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:25.570535 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d2c48f1f-fb4b-49d9-b985-95d58ca87c34 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:25.580526 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d2c48f1f-fb4b-49d9-b985-95d58ca87c34 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c" status: 200 len: 1316 microversion: 2.1 time: 0.288232 Jun 05 08:27:25.581227 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 631/1301] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:25 2022] GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c => generated 1316 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:27:25.586159 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-21e89894-8729-441b-a9dd-a55de09c47b8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:25.587270 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-21e89894-8729-441b-a9dd-a55de09c47b8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:25.615859 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-21e89894-8729-441b-a9dd-a55de09c47b8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:25.616397 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-21e89894-8729-441b-a9dd-a55de09c47b8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:25.617213 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-21e89894-8729-441b-a9dd-a55de09c47b8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:25.617669 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-21e89894-8729-441b-a9dd-a55de09c47b8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:25.673267 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-c9484b8b-7d95-4920-aa9b-aa434e8fbe43 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:27:25.673900 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-c9484b8b-7d95-4920-aa9b-aa434e8fbe43 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:27:25.676326 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-c9484b8b-7d95-4920-aa9b-aa434e8fbe43 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:27:25.677373 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-c9484b8b-7d95-4920-aa9b-aa434e8fbe43 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:27:25.678225 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-c9484b8b-7d95-4920-aa9b-aa434e8fbe43 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:27:25.710684 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c9484b8b-7d95-4920-aa9b-aa434e8fbe43 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:25.711408 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c9484b8b-7d95-4920-aa9b-aa434e8fbe43 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:25.712294 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-21e89894-8729-441b-a9dd-a55de09c47b8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129718 Jun 05 08:27:25.713392 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c9484b8b-7d95-4920-aa9b-aa434e8fbe43 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:25.714516 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c9484b8b-7d95-4920-aa9b-aa434e8fbe43 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:25.717456 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 632/1302] 10.222.0.33 () {58 vars in 1301 bytes} [Sun Jun 5 08:27:25 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:25.737069 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-daef0a64-40f1-42c1-8176-c1eaaf6e85f7 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:25.737692 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-daef0a64-40f1-42c1-8176-c1eaaf6e85f7 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:25.739392 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-c9484b8b-7d95-4920-aa9b-aa434e8fbe43 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Getting quotas for project 91fecfc103ed4df3bf30dbf2262559cb. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:27:25.745147 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-c9484b8b-7d95-4920-aa9b-aa434e8fbe43 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Getting quotas for user 14aa5e41d58f4e3391ae20e40ddbaf71 and project 91fecfc103ed4df3bf30dbf2262559cb. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:27:25.753854 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-daef0a64-40f1-42c1-8176-c1eaaf6e85f7 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:25.754308 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-daef0a64-40f1-42c1-8176-c1eaaf6e85f7 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:25.755090 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-daef0a64-40f1-42c1-8176-c1eaaf6e85f7 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:25.755531 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-daef0a64-40f1-42c1-8176-c1eaaf6e85f7 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:25.759668 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.utils [None req-c9484b8b-7d95-4920-aa9b-aa434e8fbe43 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] instances quota exceeded for 91fecfc103ed4df3bf30dbf2262559cb, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119049) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1174}} Jun 05 08:27:25.760448 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-c9484b8b-7d95-4920-aa9b-aa434e8fbe43 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 05 08:27:25.764032 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c9484b8b-7d95-4920-aa9b-aa434e8fbe43 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Request method failure captured: Jun 05 08:27:25.764032 n-d-844739-1 devstack@n-api.service[119049]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 05 08:27:25.764032 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:27:25.764032 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:27:25.764032 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:27:25.764032 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 144 Jun 05 08:27:25.764032 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:27:25.764032 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:27:25.764032 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:27:25.764032 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:27:25.764032 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGjoMNQ5OVpZcXe2aZ4ExqAs3S5SNpsvHvG0xVPm2J-JXlaYs2KqNn3xYxu_F34hSGqR-iPz2iqhJymmJOkAqwVuoLVM2nljFjVVWeG6pDutCS7W1gXQLYLO3AdWnyAVhJ2dTb5FVFc9hycMcWPmXuAMhvSkYUVD2iK8Ch4TI7vm01s Jun 05 08:27:25.764032 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:27:25.764032 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:27:25.764032 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:27:25.764032 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:27:25.764032 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:27:25.764032 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:27:25.764032 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 91fecfc103ed4df3bf30dbf2262559cb Jun 05 08:27:25.764032 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-QuotasAdminNegativeTest-2138326271 Jun 05 08:27:25.764032 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:27:25.764032 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:27:25.765471 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91fecfc103ed4df3bf30dbf2262559cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91fecfc103ed4df3bf30dbf2262559cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91fecfc103ed4df3bf30dbf2262559cb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91fecfc103ed4df3bf30dbf2262559cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:27:25.765471 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-QuotasAdminNegativeTest-2138326271 Jun 05 08:27:25.765471 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 91fecfc103ed4df3bf30dbf2262559cb Jun 05 08:27:25.765471 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2138326271 Jun 05 08:27:25.765471 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-QuotasAdminNegativeTest-2138326271-project Jun 05 08:27:25.765471 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:27:25.765471 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:27:25.765471 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 14aa5e41d58f4e3391ae20e40ddbaf71 Jun 05 08:27:25.765471 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-QuotasAdminNegativeTest-2138326271-project Jun 05 08:27:25.765471 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:27:25.765471 n-d-844739-1 devstack@n-api.service[119049]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-743751793", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452"}} Jun 05 08:27:25.765471 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:27:25.766334 n-d-844739-1 devstack@n-api.service[119049]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 05 08:27:25.766334 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-743751793', 'imageRef': '1241bde3-ef1f-41a5-b0fa-6f409216229a', 'flavorRef': '452'}}} Jun 05 08:27:25.766334 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:27:25.766334 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:27:25.766334 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1116, in check_num_instances_quota Jun 05 08:27:25.766334 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jun 05 08:27:25.766334 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:27:25.766334 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:27:25.766334 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 05 08:27:25.766334 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc Jun 05 08:27:25.766334 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 05 08:27:25.766334 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 05 08:27:25.766334 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:27:25.766334 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:27:25.766334 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 05 08:27:25.766334 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 05 08:27:25.766334 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 05 08:27:25.766334 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 05 08:27:25.767930 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jun 05 08:27:25.767930 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 05 08:27:25.767930 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jun 05 08:27:25.767930 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:27:25.767930 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:27:25.767930 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:27:25.767930 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:27:25.767930 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 05 08:27:25.767930 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 05 08:27:25.767930 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 05 08:27:25.767930 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 05 08:27:25.767930 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jun 05 08:27:25.767930 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jun 05 08:27:25.767930 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jun 05 08:27:25.767930 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jun 05 08:27:25.767930 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1182, in check_num_instances_quota Jun 05 08:27:25.767930 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 05 08:27:25.767930 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 05 08:27:25.767930 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:27:25.767930 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:27:25.767930 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:27:25.770970 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:27:25.770970 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:27:25.770970 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:27:25.770970 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:27:25.770970 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:27:25.770970 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:27:25.770970 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:27:25.770970 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:27:25.770970 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:27:25.770970 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:27:25.770970 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:27:25.770970 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:27:25.770970 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:27:25.770970 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 05 08:27:25.770970 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 05 08:27:25.770970 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 05 08:27:25.770970 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 05 08:27:25.770970 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:27:25.770970 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:27:25.770970 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:27:25.770970 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:27:25.772924 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:27:25.772924 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:27:25.772924 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:27:25.772924 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:27:25.772924 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 05 08:27:25.772924 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:27:25.775607 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c9484b8b-7d95-4920-aa9b-aa434e8fbe43 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:27:25.777600 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c9484b8b-7d95-4920-aa9b-aa434e8fbe43 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.618617 Jun 05 08:27:25.780380 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 671/1303] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:27:25 2022] POST /compute/v2.1/servers => generated 119 bytes in 623 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:27:25.796686 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-843d30f4-446f-4f74-9e7f-3d961a8273bc tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Action: 'update', calling method: .version_select at 0x7f243377b280>, body: {"quota_set": {"instances": 10}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:25.913998 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-843d30f4-446f-4f74-9e7f-3d961a8273bc tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:25.915495 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-843d30f4-446f-4f74-9e7f-3d961a8273bc tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:25.918779 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-843d30f4-446f-4f74-9e7f-3d961a8273bc tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:25.919467 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-843d30f4-446f-4f74-9e7f-3d961a8273bc tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:26.012145 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-843d30f4-446f-4f74-9e7f-3d961a8273bc tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/91fecfc103ed4df3bf30dbf2262559cb" status: 200 len: 329 microversion: 2.1 time: 0.224735 Jun 05 08:27:26.024611 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 672/1304] 10.222.0.33 () {60 vars in 1261 bytes} [Sun Jun 5 08:27:25 2022] PUT /compute/v2.1/os-quota-sets/91fecfc103ed4df3bf30dbf2262559cb => generated 329 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:26.030907 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-57ee0eed-1f51-4a8b-9d90-d3a13b737f77 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:26.031568 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-57ee0eed-1f51-4a8b-9d90-d3a13b737f77 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:26.039195 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-57ee0eed-1f51-4a8b-9d90-d3a13b737f77 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:26.039642 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-57ee0eed-1f51-4a8b-9d90-d3a13b737f77 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:26.040444 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-57ee0eed-1f51-4a8b-9d90-d3a13b737f77 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:26.040859 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-57ee0eed-1f51-4a8b-9d90-d3a13b737f77 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:26.077512 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-daef0a64-40f1-42c1-8176-c1eaaf6e85f7 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:26.081153 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=100 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:26.090606 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-daef0a64-40f1-42c1-8176-c1eaaf6e85f7 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:26.092204 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-daef0a64-40f1-42c1-8176-c1eaaf6e85f7 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:26.093423 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-daef0a64-40f1-42c1-8176-c1eaaf6e85f7 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1740 microversion: 2.20 time: 0.374956 Jun 05 08:27:26.099047 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-57ee0eed-1f51-4a8b-9d90-d3a13b737f77 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:26.099514 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-57ee0eed-1f51-4a8b-9d90-d3a13b737f77 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:26.100120 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-57ee0eed-1f51-4a8b-9d90-d3a13b737f77 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:26.102477 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 633/1305] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:25 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1740 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:26.114532 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4cbcc65a-9fdb-4a62-b648-5d009b24bbed tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Calling method '.version_select at 0x7f243386c4c0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:26.188289 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-57ee0eed-1f51-4a8b-9d90-d3a13b737f77 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:26.196635 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-57ee0eed-1f51-4a8b-9d90-d3a13b737f77 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.170915 Jun 05 08:27:26.200498 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 673/1306] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:26 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:26.216919 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-38062afd-1d5d-462d-9490-aaafec8afa9a tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:26.225029 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4cbcc65a-9fdb-4a62-b648-5d009b24bbed tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/91fecfc103ed4df3bf30dbf2262559cb" status: 200 len: 371 microversion: 2.1 time: 0.120281 Jun 05 08:27:26.226178 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-38062afd-1d5d-462d-9490-aaafec8afa9a tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:26.239481 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 634/1307] 10.222.0.33 () {58 vars in 1241 bytes} [Sun Jun 5 08:27:26 2022] GET /compute/v2.1/os-quota-sets/91fecfc103ed4df3bf30dbf2262559cb => generated 371 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:26.246223 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-38062afd-1d5d-462d-9490-aaafec8afa9a tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:26.247785 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-38062afd-1d5d-462d-9490-aaafec8afa9a tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:26.248429 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a05ec2cd-40d3-4280-8b43-3b07e8462896 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Action: 'update', calling method: .version_select at 0x7f243371dca0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:26.249413 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-38062afd-1d5d-462d-9490-aaafec8afa9a tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:26.251410 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-38062afd-1d5d-462d-9490-aaafec8afa9a tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:26.429023 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a05ec2cd-40d3-4280-8b43-3b07e8462896 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:26.430528 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a05ec2cd-40d3-4280-8b43-3b07e8462896 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:26.432402 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a05ec2cd-40d3-4280-8b43-3b07e8462896 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:26.439977 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a05ec2cd-40d3-4280-8b43-3b07e8462896 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:26.530797 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a05ec2cd-40d3-4280-8b43-3b07e8462896 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/91fecfc103ed4df3bf30dbf2262559cb" status: 200 len: 325 microversion: 2.1 time: 0.289795 Jun 05 08:27:26.531698 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 635/1308] 10.222.0.33 () {60 vars in 1261 bytes} [Sun Jun 5 08:27:26 2022] PUT /compute/v2.1/os-quota-sets/91fecfc103ed4df3bf30dbf2262559cb => generated 325 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:26.551241 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-38062afd-1d5d-462d-9490-aaafec8afa9a tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdc8382bafd49a3877df672d02f8206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76c30c981d4c69b229b6d7415c910c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:26.569120 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-38062afd-1d5d-462d-9490-aaafec8afa9a tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5" status: 200 len: 1316 microversion: 2.1 time: 0.367264 Jun 05 08:27:26.584526 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 674/1309] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:26 2022] GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5 => generated 1316 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:26.597902 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b8a7a7b6-dc1d-46aa-9785-2fd0e6fb1670 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:26.598520 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b8a7a7b6-dc1d-46aa-9785-2fd0e6fb1670 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 789255b3-7097-4ac9-897d-71da8910700c] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:26.614433 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b8a7a7b6-dc1d-46aa-9785-2fd0e6fb1670 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:26.614433 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b8a7a7b6-dc1d-46aa-9785-2fd0e6fb1670 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:26.614433 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b8a7a7b6-dc1d-46aa-9785-2fd0e6fb1670 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:26.614433 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b8a7a7b6-dc1d-46aa-9785-2fd0e6fb1670 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:26.622149 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3a5c5d5b-7a1d-48d7-bba2-a12dc92d97a5 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-299719319", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:26.686453 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-3a5c5d5b-7a1d-48d7-bba2-a12dc92d97a5 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] validate_networks() for None {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:27:27.007557 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b8a7a7b6-dc1d-46aa-9785-2fd0e6fb1670 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:27.030958 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b8a7a7b6-dc1d-46aa-9785-2fd0e6fb1670 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c" status: 200 len: 1316 microversion: 2.1 time: 0.436634 Jun 05 08:27:27.031855 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 636/1310] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:26 2022] GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c => generated 1316 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:27.046316 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3b956d37-2a46-44d4-99c2-87cbf58fbfce tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:27.047262 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3b956d37-2a46-44d4-99c2-87cbf58fbfce tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:27.070720 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3b956d37-2a46-44d4-99c2-87cbf58fbfce tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:27.071098 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3b956d37-2a46-44d4-99c2-87cbf58fbfce tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:27.071920 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3b956d37-2a46-44d4-99c2-87cbf58fbfce tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:27.080753 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3b956d37-2a46-44d4-99c2-87cbf58fbfce tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:27.095280 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-3a5c5d5b-7a1d-48d7-bba2-a12dc92d97a5 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:27:27.096145 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-3a5c5d5b-7a1d-48d7-bba2-a12dc92d97a5 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:27:27.096803 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-3a5c5d5b-7a1d-48d7-bba2-a12dc92d97a5 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:27:27.097379 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-3a5c5d5b-7a1d-48d7-bba2-a12dc92d97a5 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:27:27.097980 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-3a5c5d5b-7a1d-48d7-bba2-a12dc92d97a5 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:27:27.117870 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3a5c5d5b-7a1d-48d7-bba2-a12dc92d97a5 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:27.118588 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3a5c5d5b-7a1d-48d7-bba2-a12dc92d97a5 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:27.119594 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3a5c5d5b-7a1d-48d7-bba2-a12dc92d97a5 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:27.120296 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3a5c5d5b-7a1d-48d7-bba2-a12dc92d97a5 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:27.154141 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-3a5c5d5b-7a1d-48d7-bba2-a12dc92d97a5 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Getting quotas for project 91fecfc103ed4df3bf30dbf2262559cb. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:27:27.154754 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3b956d37-2a46-44d4-99c2-87cbf58fbfce tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121746 Jun 05 08:27:27.159941 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 637/1311] 10.222.0.33 () {58 vars in 1301 bytes} [Sun Jun 5 08:27:27 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:27.161532 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-3a5c5d5b-7a1d-48d7-bba2-a12dc92d97a5 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Getting quotas for user 14aa5e41d58f4e3391ae20e40ddbaf71 and project 91fecfc103ed4df3bf30dbf2262559cb. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:27:27.163752 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:27.171989 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6118e530-2709-43df-b354-dd011daf4e46 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:27.173824 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6118e530-2709-43df-b354-dd011daf4e46 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:27.190843 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6118e530-2709-43df-b354-dd011daf4e46 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:27.191302 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6118e530-2709-43df-b354-dd011daf4e46 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:27.194661 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6118e530-2709-43df-b354-dd011daf4e46 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:27.195120 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6118e530-2709-43df-b354-dd011daf4e46 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:27.223721 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.utils [None req-3a5c5d5b-7a1d-48d7-bba2-a12dc92d97a5 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] ram quota exceeded for 91fecfc103ed4df3bf30dbf2262559cb, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119049) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1174}} Jun 05 08:27:27.224978 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-3a5c5d5b-7a1d-48d7-bba2-a12dc92d97a5 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 05 08:27:27.229437 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3a5c5d5b-7a1d-48d7-bba2-a12dc92d97a5 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Request method failure captured: Jun 05 08:27:27.229437 n-d-844739-1 devstack@n-api.service[119049]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 05 08:27:27.229437 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:27:27.229437 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:27:27.229437 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:27:27.229437 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 144 Jun 05 08:27:27.229437 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:27:27.229437 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:27:27.229437 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:27:27.229437 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:27:27.229437 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGjoMNQ5OVpZcXe2aZ4ExqAs3S5SNpsvHvG0xVPm2J-JXlaYs2KqNn3xYxu_F34hSGqR-iPz2iqhJymmJOkAqwVuoLVM2nljFjVVWeG6pDutCS7W1gXQLYLO3AdWnyAVhJ2dTb5FVFc9hycMcWPmXuAMhvSkYUVD2iK8Ch4TI7vm01s Jun 05 08:27:27.229437 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:27:27.229437 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:27:27.229437 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:27:27.229437 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:27:27.229437 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:27:27.229437 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:27:27.229437 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 91fecfc103ed4df3bf30dbf2262559cb Jun 05 08:27:27.229437 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-QuotasAdminNegativeTest-2138326271 Jun 05 08:27:27.229437 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:27:27.229437 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:27:27.231397 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91fecfc103ed4df3bf30dbf2262559cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91fecfc103ed4df3bf30dbf2262559cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91fecfc103ed4df3bf30dbf2262559cb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91fecfc103ed4df3bf30dbf2262559cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:27:27.231397 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-QuotasAdminNegativeTest-2138326271 Jun 05 08:27:27.231397 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 91fecfc103ed4df3bf30dbf2262559cb Jun 05 08:27:27.231397 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2138326271 Jun 05 08:27:27.231397 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-QuotasAdminNegativeTest-2138326271-project Jun 05 08:27:27.231397 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:27:27.231397 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:27:27.231397 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 14aa5e41d58f4e3391ae20e40ddbaf71 Jun 05 08:27:27.231397 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-QuotasAdminNegativeTest-2138326271-project Jun 05 08:27:27.231397 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:27:27.231397 n-d-844739-1 devstack@n-api.service[119049]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-299719319", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452"}} Jun 05 08:27:27.231397 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:27:27.232138 n-d-844739-1 devstack@n-api.service[119049]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 05 08:27:27.232138 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-299719319', 'imageRef': '1241bde3-ef1f-41a5-b0fa-6f409216229a', 'flavorRef': '452'}}} Jun 05 08:27:27.232138 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:27:27.232138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:27:27.232138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1116, in check_num_instances_quota Jun 05 08:27:27.232138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jun 05 08:27:27.232138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:27:27.232138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:27:27.232138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 05 08:27:27.232138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc Jun 05 08:27:27.232138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 05 08:27:27.232138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 05 08:27:27.232138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:27:27.232138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:27:27.232138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 05 08:27:27.232138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 05 08:27:27.232138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 05 08:27:27.232138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 05 08:27:27.233185 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jun 05 08:27:27.233185 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 05 08:27:27.233185 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jun 05 08:27:27.233185 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:27:27.233185 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:27:27.233185 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:27:27.233185 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:27:27.233185 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 05 08:27:27.233185 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 05 08:27:27.233185 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 05 08:27:27.233185 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 05 08:27:27.233185 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jun 05 08:27:27.233185 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jun 05 08:27:27.233185 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jun 05 08:27:27.233185 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jun 05 08:27:27.233185 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1182, in check_num_instances_quota Jun 05 08:27:27.233185 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 05 08:27:27.233185 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 05 08:27:27.233185 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:27:27.233185 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:27:27.233185 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:27:27.234981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:27:27.234981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:27:27.234981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:27:27.234981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:27:27.234981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:27:27.234981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:27:27.234981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:27:27.234981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:27:27.234981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:27:27.234981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:27:27.234981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:27:27.234981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:27:27.234981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:27:27.234981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 05 08:27:27.234981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 05 08:27:27.234981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 05 08:27:27.234981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 05 08:27:27.234981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:27:27.234981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:27:27.234981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:27:27.234981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:27:27.237926 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:27:27.237926 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:27:27.237926 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:27:27.237926 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:27:27.237926 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 05 08:27:27.237926 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:27:27.241879 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3a5c5d5b-7a1d-48d7-bba2-a12dc92d97a5 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:27:27.246627 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3a5c5d5b-7a1d-48d7-bba2-a12dc92d97a5 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.630203 Jun 05 08:27:27.247474 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 675/1312] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:27:26 2022] POST /compute/v2.1/servers => generated 110 bytes in 632 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:27:27.256585 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-50c63e42-894e-43e6-ab7f-63ec30647335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:27.261701 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-50c63e42-894e-43e6-ab7f-63ec30647335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:27.274106 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-50c63e42-894e-43e6-ab7f-63ec30647335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:27.274965 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-50c63e42-894e-43e6-ab7f-63ec30647335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:27.278236 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-50c63e42-894e-43e6-ab7f-63ec30647335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:27.291555 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-50c63e42-894e-43e6-ab7f-63ec30647335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:27.361908 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-50c63e42-894e-43e6-ab7f-63ec30647335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:27.365173 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-50c63e42-894e-43e6-ab7f-63ec30647335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:27.366644 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-50c63e42-894e-43e6-ab7f-63ec30647335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:27.527519 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-50c63e42-894e-43e6-ab7f-63ec30647335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:27.536183 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-50c63e42-894e-43e6-ab7f-63ec30647335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.287324 Jun 05 08:27:27.536963 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 676/1313] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:27 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:27.547628 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6118e530-2709-43df-b354-dd011daf4e46 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:27.555922 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6118e530-2709-43df-b354-dd011daf4e46 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:27.558912 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fbc33310-ccb9-4716-99e9-11cca0947167 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Action: 'update', calling method: .version_select at 0x7f2433752940>, body: {"quota_set": {"ram": 51200}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:27.562978 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6118e530-2709-43df-b354-dd011daf4e46 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:27.564250 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6118e530-2709-43df-b354-dd011daf4e46 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1740 microversion: 2.20 time: 0.403219 Jun 05 08:27:27.576144 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 638/1314] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:27 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1740 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:27.598061 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-bb79fd26-c4dd-4798-9769-7b0a4793ca2e tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:27.598680 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-bb79fd26-c4dd-4798-9769-7b0a4793ca2e tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:27.613898 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bb79fd26-c4dd-4798-9769-7b0a4793ca2e tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:27.616547 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bb79fd26-c4dd-4798-9769-7b0a4793ca2e tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:27.617369 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bb79fd26-c4dd-4798-9769-7b0a4793ca2e tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:27.617813 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bb79fd26-c4dd-4798-9769-7b0a4793ca2e tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:27.915016 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-bb79fd26-c4dd-4798-9769-7b0a4793ca2e tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdc8382bafd49a3877df672d02f8206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76c30c981d4c69b229b6d7415c910c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:27.926724 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-bb79fd26-c4dd-4798-9769-7b0a4793ca2e tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5" status: 200 len: 1466 microversion: 2.1 time: 0.335728 Jun 05 08:27:27.939744 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 639/1315] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:27 2022] GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5 => generated 1466 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:27.949800 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e642ae42-ce13-43f5-9b48-5ff206c2610c tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:27.952110 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e642ae42-ce13-43f5-9b48-5ff206c2610c tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:27.964676 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e642ae42-ce13-43f5-9b48-5ff206c2610c tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:27.966081 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e642ae42-ce13-43f5-9b48-5ff206c2610c tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:27.968871 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e642ae42-ce13-43f5-9b48-5ff206c2610c tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:27.969531 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e642ae42-ce13-43f5-9b48-5ff206c2610c tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:27.981993 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fbc33310-ccb9-4716-99e9-11cca0947167 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:27.982463 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fbc33310-ccb9-4716-99e9-11cca0947167 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:27.983283 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fbc33310-ccb9-4716-99e9-11cca0947167 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:27.983725 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fbc33310-ccb9-4716-99e9-11cca0947167 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:28.013407 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e642ae42-ce13-43f5-9b48-5ff206c2610c tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:27:28.122221 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fbc33310-ccb9-4716-99e9-11cca0947167 tempest-QuotasAdminNegativeTest-1247698241 tempest-QuotasAdminNegativeTest-1247698241-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/91fecfc103ed4df3bf30dbf2262559cb" status: 200 len: 329 microversion: 2.1 time: 0.584384 Jun 05 08:27:28.123367 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 677/1316] 10.222.0.33 () {60 vars in 1261 bytes} [Sun Jun 5 08:27:27 2022] PUT /compute/v2.1/os-quota-sets/91fecfc103ed4df3bf30dbf2262559cb => generated 329 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:28.130119 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-42748a97-f53f-4499-80f4-bbca1420051f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:28.130651 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-42748a97-f53f-4499-80f4-bbca1420051f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 789255b3-7097-4ac9-897d-71da8910700c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:28.139915 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42748a97-f53f-4499-80f4-bbca1420051f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:28.140623 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42748a97-f53f-4499-80f4-bbca1420051f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:28.142090 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42748a97-f53f-4499-80f4-bbca1420051f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:28.142736 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42748a97-f53f-4499-80f4-bbca1420051f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:28.155328 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e642ae42-ce13-43f5-9b48-5ff206c2610c tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5" status: 204 len: 0 microversion: 2.1 time: 0.211126 Jun 05 08:27:28.161412 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 640/1317] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:27:27 2022] DELETE /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:27:28.168324 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d05a9ed9-a839-4959-be07-a3dfee4c9de5 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Action: 'update', calling method: .version_select at 0x7f243362df70>, body: {"quota_set": {"ram": 0}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:28.171243 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d05a9ed9-a839-4959-be07-a3dfee4c9de5 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '14aa5e41d58f4e3391ae20e40ddbaf71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fecfc103ed4df3bf30dbf2262559cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:28.176345 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d05a9ed9-a839-4959-be07-a3dfee4c9de5 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Request method failure captured: Jun 05 08:27:28.176345 n-d-844739-1 devstack@n-api.service[119050]: request: PUT /compute/v2.1/os-quota-sets/91fecfc103ed4df3bf30dbf2262559cb HTTP/1.1 Jun 05 08:27:28.176345 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:27:28.176345 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:27:28.176345 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:27:28.176345 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 25 Jun 05 08:27:28.176345 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:27:28.176345 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:27:28.176345 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:27:28.176345 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:27:28.176345 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGjoMNQ5OVpZcXe2aZ4ExqAs3S5SNpsvHvG0xVPm2J-JXlaYs2KqNn3xYxu_F34hSGqR-iPz2iqhJymmJOkAqwVuoLVM2nljFjVVWeG6pDutCS7W1gXQLYLO3AdWnyAVhJ2dTb5FVFc9hycMcWPmXuAMhvSkYUVD2iK8Ch4TI7vm01s Jun 05 08:27:28.176345 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:27:28.176345 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:27:28.176345 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:27:28.176345 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:27:28.176345 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:27:28.176345 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:27:28.176345 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 91fecfc103ed4df3bf30dbf2262559cb Jun 05 08:27:28.176345 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-QuotasAdminNegativeTest-2138326271 Jun 05 08:27:28.176345 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:27:28.176345 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:27:28.177697 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/91fecfc103ed4df3bf30dbf2262559cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91fecfc103ed4df3bf30dbf2262559cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_91fecfc103ed4df3bf30dbf2262559cb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/91fecfc103ed4df3bf30dbf2262559cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:27:28.177697 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-QuotasAdminNegativeTest-2138326271 Jun 05 08:27:28.177697 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 91fecfc103ed4df3bf30dbf2262559cb Jun 05 08:27:28.177697 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-2138326271 Jun 05 08:27:28.177697 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-QuotasAdminNegativeTest-2138326271-project Jun 05 08:27:28.177697 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:27:28.177697 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:27:28.177697 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 14aa5e41d58f4e3391ae20e40ddbaf71 Jun 05 08:27:28.177697 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-QuotasAdminNegativeTest-2138326271-project Jun 05 08:27:28.177697 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:27:28.177697 n-d-844739-1 devstack@n-api.service[119050]: {"quota_set": {"ram": 0}} Jun 05 08:27:28.177697 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:27:28.177697 n-d-844739-1 devstack@n-api.service[119050]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jun 05 08:27:28.177697 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '91fecfc103ed4df3bf30dbf2262559cb', 'body': {'quota_set': {'ram': 0}}} Jun 05 08:27:28.178546 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:27:28.178546 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:27:28.178546 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:27:28.178546 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:27:28.178546 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:27:28.178546 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:27:28.178546 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:27:28.178546 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:27:28.178546 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:27:28.178546 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:27:28.178546 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:27:28.178546 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:27:28.178546 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jun 05 08:27:28.178546 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jun 05 08:27:28.178546 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 05 08:27:28.178546 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:27:28.178546 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 05 08:27:28.178546 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:27:28.178546 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jun 05 08:27:28.180300 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jun 05 08:27:28.180300 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:27:28.180300 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:27:28.180300 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:27:28.180300 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:27:28.180300 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:27:28.180300 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:27:28.180300 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:27:28.180300 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:27:28.180300 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:27:28.180300 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:27:28.180300 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:27:28.180300 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:27:28.180300 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:27:28.180300 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:27:28.180300 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jun 05 08:27:28.180300 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:27:28.180300 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:27:28.180300 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:27:28.180300 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:27:28.181505 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:27:28.181505 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:27:28.181505 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:27:28.181505 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:27:28.181505 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jun 05 08:27:28.181505 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:27:28.181505 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d05a9ed9-a839-4959-be07-a3dfee4c9de5 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:27:28.181505 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d05a9ed9-a839-4959-be07-a3dfee4c9de5 tempest-QuotasAdminNegativeTest-2138326271 tempest-QuotasAdminNegativeTest-2138326271-project] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/91fecfc103ed4df3bf30dbf2262559cb" status: 403 len: 116 microversion: 2.1 time: 0.014019 Jun 05 08:27:28.181505 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 641/1318] 10.222.0.33 () {60 vars in 1261 bytes} [Sun Jun 5 08:27:28 2022] PUT /compute/v2.1/os-quota-sets/91fecfc103ed4df3bf30dbf2262559cb => generated 116 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:27:28.185730 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-57e975eb-704f-45aa-ac2f-6993f975670d tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:28.186883 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-57e975eb-704f-45aa-ac2f-6993f975670d tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:28.196027 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-57e975eb-704f-45aa-ac2f-6993f975670d tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:28.196534 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-57e975eb-704f-45aa-ac2f-6993f975670d tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:28.197316 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-57e975eb-704f-45aa-ac2f-6993f975670d tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:28.197754 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-57e975eb-704f-45aa-ac2f-6993f975670d tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:28.563563 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-42748a97-f53f-4499-80f4-bbca1420051f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:28.576448 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-42748a97-f53f-4499-80f4-bbca1420051f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c" status: 200 len: 1316 microversion: 2.1 time: 0.447713 Jun 05 08:27:28.577468 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 678/1319] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:28 2022] GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c => generated 1316 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:28.586708 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-57e975eb-704f-45aa-ac2f-6993f975670d tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdc8382bafd49a3877df672d02f8206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76c30c981d4c69b229b6d7415c910c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:28.595311 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3a80fa6f-fe7e-4e59-ad6b-963c027f8539 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:28.598073 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3a80fa6f-fe7e-4e59-ad6b-963c027f8539 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:28.605150 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-57e975eb-704f-45aa-ac2f-6993f975670d tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5" status: 200 len: 1472 microversion: 2.1 time: 0.424394 Jun 05 08:27:28.619763 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 642/1320] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:28 2022] GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5 => generated 1472 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:28.632667 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3a80fa6f-fe7e-4e59-ad6b-963c027f8539 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:28.633265 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3a80fa6f-fe7e-4e59-ad6b-963c027f8539 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:28.635213 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d0707115-34d9-4d14-9954-13c3a665aa25 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:28.637169 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3a80fa6f-fe7e-4e59-ad6b-963c027f8539 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:28.639019 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d0707115-34d9-4d14-9954-13c3a665aa25 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:28.640682 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3a80fa6f-fe7e-4e59-ad6b-963c027f8539 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:28.669446 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d0707115-34d9-4d14-9954-13c3a665aa25 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:28.670082 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d0707115-34d9-4d14-9954-13c3a665aa25 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:28.670994 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d0707115-34d9-4d14-9954-13c3a665aa25 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:28.671651 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d0707115-34d9-4d14-9954-13c3a665aa25 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:28.708309 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3a80fa6f-fe7e-4e59-ad6b-963c027f8539 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129590 Jun 05 08:27:28.716440 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 679/1321] 10.222.0.33 () {58 vars in 1301 bytes} [Sun Jun 5 08:27:28 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:28.723726 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-154883e5-d54b-4e3c-99ba-cb0b275e0a39 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:28.725953 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-154883e5-d54b-4e3c-99ba-cb0b275e0a39 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:28.735678 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d0707115-34d9-4d14-9954-13c3a665aa25 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:28.738412 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d0707115-34d9-4d14-9954-13c3a665aa25 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:28.740301 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-154883e5-d54b-4e3c-99ba-cb0b275e0a39 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:28.740904 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-d0707115-34d9-4d14-9954-13c3a665aa25 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:28.752841 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-154883e5-d54b-4e3c-99ba-cb0b275e0a39 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:28.758571 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-154883e5-d54b-4e3c-99ba-cb0b275e0a39 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:28.759635 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-154883e5-d54b-4e3c-99ba-cb0b275e0a39 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:28.832891 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d0707115-34d9-4d14-9954-13c3a665aa25 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:28.846874 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d0707115-34d9-4d14-9954-13c3a665aa25 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.224461 Jun 05 08:27:28.848636 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 643/1322] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:28 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:29.112371 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-154883e5-d54b-4e3c-99ba-cb0b275e0a39 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:29.124896 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-154883e5-d54b-4e3c-99ba-cb0b275e0a39 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:29.128242 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-154883e5-d54b-4e3c-99ba-cb0b275e0a39 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:29.130692 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-154883e5-d54b-4e3c-99ba-cb0b275e0a39 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1740 microversion: 2.20 time: 0.412999 Jun 05 08:27:29.132113 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 680/1323] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:28 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1740 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:29.595593 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7007d0d3-7f0f-429e-b302-285b327cc963 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:29.596909 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7007d0d3-7f0f-429e-b302-285b327cc963 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 789255b3-7097-4ac9-897d-71da8910700c] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:29.605063 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7007d0d3-7f0f-429e-b302-285b327cc963 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:29.613813 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7007d0d3-7f0f-429e-b302-285b327cc963 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:29.620298 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7007d0d3-7f0f-429e-b302-285b327cc963 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:29.625441 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d5163291-191b-43f1-af83-bc2954baa30a tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:29.626629 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d5163291-191b-43f1-af83-bc2954baa30a tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:29.630205 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7007d0d3-7f0f-429e-b302-285b327cc963 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:29.639235 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d5163291-191b-43f1-af83-bc2954baa30a tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:29.639939 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d5163291-191b-43f1-af83-bc2954baa30a tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:29.640913 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d5163291-191b-43f1-af83-bc2954baa30a tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:29.641521 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d5163291-191b-43f1-af83-bc2954baa30a tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:30.203654 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d5163291-191b-43f1-af83-bc2954baa30a tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdc8382bafd49a3877df672d02f8206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76c30c981d4c69b229b6d7415c910c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:30.219554 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d5163291-191b-43f1-af83-bc2954baa30a tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5" status: 200 len: 1472 microversion: 2.1 time: 0.594851 Jun 05 08:27:30.220418 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 681/1324] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:29 2022] GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5 => generated 1472 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:30.225506 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-dec133a7-80e3-41ac-b400-9e31c00cb3cd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:30.237504 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-dec133a7-80e3-41ac-b400-9e31c00cb3cd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:30.250901 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dec133a7-80e3-41ac-b400-9e31c00cb3cd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:30.251761 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dec133a7-80e3-41ac-b400-9e31c00cb3cd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:30.252780 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dec133a7-80e3-41ac-b400-9e31c00cb3cd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:30.253393 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dec133a7-80e3-41ac-b400-9e31c00cb3cd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:30.280836 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7007d0d3-7f0f-429e-b302-285b327cc963 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:30.297188 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7007d0d3-7f0f-429e-b302-285b327cc963 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c" status: 200 len: 1316 microversion: 2.1 time: 0.706778 Jun 05 08:27:30.298500 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 644/1325] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:29 2022] GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c => generated 1316 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:30.303448 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c4450d25-917f-4e45-ae75-2d37c95d01cb tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:30.310717 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c4450d25-917f-4e45-ae75-2d37c95d01cb tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:30.320366 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=100 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:30.327621 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c4450d25-917f-4e45-ae75-2d37c95d01cb tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:30.339373 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c4450d25-917f-4e45-ae75-2d37c95d01cb tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:30.340583 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c4450d25-917f-4e45-ae75-2d37c95d01cb tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:30.341195 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c4450d25-917f-4e45-ae75-2d37c95d01cb tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:30.371629 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-dec133a7-80e3-41ac-b400-9e31c00cb3cd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149782 Jun 05 08:27:30.372652 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 682/1326] 10.222.0.33 () {58 vars in 1301 bytes} [Sun Jun 5 08:27:30 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:30.379790 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-53299528-4f5a-4770-810a-34a690eddc0c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:30.380459 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-53299528-4f5a-4770-810a-34a690eddc0c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:30.395170 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-53299528-4f5a-4770-810a-34a690eddc0c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:30.395636 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-53299528-4f5a-4770-810a-34a690eddc0c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:30.410944 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-53299528-4f5a-4770-810a-34a690eddc0c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:30.411441 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-53299528-4f5a-4770-810a-34a690eddc0c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:30.431520 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:30.440285 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c4450d25-917f-4e45-ae75-2d37c95d01cb tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:30.446402 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c4450d25-917f-4e45-ae75-2d37c95d01cb tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:30.447682 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-c4450d25-917f-4e45-ae75-2d37c95d01cb tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:30.531766 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c4450d25-917f-4e45-ae75-2d37c95d01cb tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:30.544851 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c4450d25-917f-4e45-ae75-2d37c95d01cb tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.241271 Jun 05 08:27:30.544851 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 645/1327] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:30 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:30.740889 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-53299528-4f5a-4770-810a-34a690eddc0c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:30.751128 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-53299528-4f5a-4770-810a-34a690eddc0c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:30.765775 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-53299528-4f5a-4770-810a-34a690eddc0c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:30.769447 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-53299528-4f5a-4770-810a-34a690eddc0c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1740 microversion: 2.20 time: 0.394551 Jun 05 08:27:30.789616 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 683/1328] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:30 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1740 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:30.950050 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-57d705ac-7f2c-4851-bc6d-65de97455484 req-08c1c21d-2229-4074-bd7e-12f86863ea88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab76465b-2e53-4bf6-8371-6393b1aa99b5", "name": "network-vif-deleted", "tag": "3d68c41c-fd5e-43a4-bd8e-d093440b6f3b"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:30.967180 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-57d705ac-7f2c-4851-bc6d-65de97455484 req-08c1c21d-2229-4074-bd7e-12f86863ea88 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:30.983021 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-57d705ac-7f2c-4851-bc6d-65de97455484 req-08c1c21d-2229-4074-bd7e-12f86863ea88 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:31.021025 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-57d705ac-7f2c-4851-bc6d-65de97455484 req-08c1c21d-2229-4074-bd7e-12f86863ea88 service nova] Creating event network-vif-deleted:3d68c41c-fd5e-43a4-bd8e-d093440b6f3b for instance ab76465b-2e53-4bf6-8371-6393b1aa99b5 on n-h1-844739-1 Jun 05 08:27:31.046550 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-57d705ac-7f2c-4851-bc6d-65de97455484 req-08c1c21d-2229-4074-bd7e-12f86863ea88 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100662 Jun 05 08:27:31.051521 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 646/1329] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:31.241086 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ad663795-d0b5-44f1-8665-57533c0928b0 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:31.242788 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ad663795-d0b5-44f1-8665-57533c0928b0 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:31.282185 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ad663795-d0b5-44f1-8665-57533c0928b0 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:31.288235 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ad663795-d0b5-44f1-8665-57533c0928b0 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:31.315227 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b37b413b-b10b-4aaa-a2e2-cbdf9b3ce6ac tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:31.317038 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b37b413b-b10b-4aaa-a2e2-cbdf9b3ce6ac tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 789255b3-7097-4ac9-897d-71da8910700c] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:31.322528 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ad663795-d0b5-44f1-8665-57533c0928b0 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:31.325697 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ad663795-d0b5-44f1-8665-57533c0928b0 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:31.334836 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b37b413b-b10b-4aaa-a2e2-cbdf9b3ce6ac tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:31.335654 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b37b413b-b10b-4aaa-a2e2-cbdf9b3ce6ac tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:31.336704 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b37b413b-b10b-4aaa-a2e2-cbdf9b3ce6ac tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:31.337324 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b37b413b-b10b-4aaa-a2e2-cbdf9b3ce6ac tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:31.506233 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ad663795-d0b5-44f1-8665-57533c0928b0 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:31.507123 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ad663795-d0b5-44f1-8665-57533c0928b0 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:31.507818 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-ad663795-d0b5-44f1-8665-57533c0928b0 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lazy-loading 'fault' on Instance uuid ab76465b-2e53-4bf6-8371-6393b1aa99b5 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:31.602824 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ad663795-d0b5-44f1-8665-57533c0928b0 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdc8382bafd49a3877df672d02f8206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76c30c981d4c69b229b6d7415c910c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:31.621914 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ad663795-d0b5-44f1-8665-57533c0928b0 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5" status: 200 len: 1361 microversion: 2.1 time: 0.387488 Jun 05 08:27:31.627573 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 684/1330] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:31 2022] GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5 => generated 1361 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:31.648337 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-503b7874-d7ad-4b98-8af6-bb1f42ee5dac tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:31.654857 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-503b7874-d7ad-4b98-8af6-bb1f42ee5dac tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:31.671237 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-503b7874-d7ad-4b98-8af6-bb1f42ee5dac tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:31.672102 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-503b7874-d7ad-4b98-8af6-bb1f42ee5dac tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:31.675692 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-503b7874-d7ad-4b98-8af6-bb1f42ee5dac tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:31.676587 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-503b7874-d7ad-4b98-8af6-bb1f42ee5dac tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:31.722135 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b37b413b-b10b-4aaa-a2e2-cbdf9b3ce6ac tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:31.733107 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b37b413b-b10b-4aaa-a2e2-cbdf9b3ce6ac tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c" status: 200 len: 1316 microversion: 2.1 time: 0.422285 Jun 05 08:27:31.741092 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 647/1331] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:31 2022] GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c => generated 1316 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:31.750038 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1dabde05-f712-4618-950a-69d5abfc094c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:31.750869 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1dabde05-f712-4618-950a-69d5abfc094c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:31.757481 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-503b7874-d7ad-4b98-8af6-bb1f42ee5dac tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122433 Jun 05 08:27:31.758085 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 685/1332] 10.222.0.33 () {58 vars in 1301 bytes} [Sun Jun 5 08:27:31 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:31.770328 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5bbfcd55-db1c-4605-9ef4-71cd6197b9f5 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1187280328", "metadata": {"image_type": "test"}}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:31.771324 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1dabde05-f712-4618-950a-69d5abfc094c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:31.771963 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1dabde05-f712-4618-950a-69d5abfc094c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:31.772912 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1dabde05-f712-4618-950a-69d5abfc094c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:31.773466 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1dabde05-f712-4618-950a-69d5abfc094c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:31.773585 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5bbfcd55-db1c-4605-9ef4-71cd6197b9f5 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Failed to fetch instance by id tempest-invalid-1631547869 {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 05 08:27:31.774069 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-5bbfcd55-db1c-4605-9ef4-71cd6197b9f5 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] HTTP exception thrown: Instance tempest-invalid-1631547869 could not be found. Jun 05 08:27:31.779916 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5bbfcd55-db1c-4605-9ef4-71cd6197b9f5 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Request method failure captured: Jun 05 08:27:31.779916 n-d-844739-1 devstack@n-api.service[119049]: request: POST /compute/v2.1/servers/tempest-invalid-1631547869/action HTTP/1.1 Jun 05 08:27:31.779916 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:27:31.779916 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:27:31.779916 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:27:31.779916 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 112 Jun 05 08:27:31.779916 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:27:31.779916 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:27:31.779916 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:27:31.779916 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:27:31.779916 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGjMUs6ecPmrI6R8TtkQYWAgYy7ShU0RT4wmTlWDnvYgqoI4DkA1VvnJNeUU_bDG-GzXY53bBi4wUUvLm-ymtoug-r2QWxpmaHX8Suv-FFyKH-AjUyEc6jX_jUUSViDnlUeu96GDFAF5oAUWFa3ep0zn5W2b4BWrUaFlvMuTPi1p9Po Jun 05 08:27:31.779916 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:27:31.779916 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:27:31.779916 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:27:31.779916 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:27:31.779916 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:27:31.779916 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:27:31.779916 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: bc76c30c981d4c69b229b6d7415c910c Jun 05 08:27:31.779916 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ImagesNegativeTestJSON-850637503 Jun 05 08:27:31.779916 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:27:31.779916 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:27:31.781677 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bc76c30c981d4c69b229b6d7415c910c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc76c30c981d4c69b229b6d7415c910c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bc76c30c981d4c69b229b6d7415c910c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc76c30c981d4c69b229b6d7415c910c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:27:31.781677 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ImagesNegativeTestJSON-850637503 Jun 05 08:27:31.781677 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: bc76c30c981d4c69b229b6d7415c910c Jun 05 08:27:31.781677 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-850637503 Jun 05 08:27:31.781677 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ImagesNegativeTestJSON-850637503-project Jun 05 08:27:31.781677 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:27:31.781677 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:27:31.781677 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 6cdc8382bafd49a3877df672d02f8206 Jun 05 08:27:31.781677 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ImagesNegativeTestJSON-850637503-project Jun 05 08:27:31.781677 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:27:31.781677 n-d-844739-1 devstack@n-api.service[119049]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1187280328", "metadata": {"image_type": "test"}}} Jun 05 08:27:31.781677 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:27:31.781677 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance tempest-invalid-1631547869 could not be found. Jun 05 08:27:31.782620 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'tempest-invalid-1631547869', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1187280328', 'metadata': {'image_type': 'test'}}}} Jun 05 08:27:31.782620 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:27:31.782620 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:27:31.782620 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:27:31.782620 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:27:31.782620 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 05 08:27:31.782620 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 05 08:27:31.782620 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1631547869 could not be found. Jun 05 08:27:31.782620 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:27:31.782620 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:27:31.782620 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:27:31.782620 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:27:31.782620 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:27:31.782620 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:27:31.782620 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:27:31.782620 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:27:31.782620 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:27:31.782620 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:27:31.782620 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:27:31.782620 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:27:31.784027 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:27:31.784027 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:27:31.784027 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 05 08:27:31.784027 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 05 08:27:31.784027 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:27:31.784027 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:27:31.784027 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:27:31.784027 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:27:31.784027 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1631547869 could not be found. Jun 05 08:27:31.784027 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:27:31.784027 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:27:31.784027 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:27:31.784027 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:27:31.784027 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:27:31.784027 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:27:31.784027 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:27:31.784027 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:27:31.784027 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1631547869 could not be found. Jun 05 08:27:31.784027 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:27:31.788313 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5bbfcd55-db1c-4605-9ef4-71cd6197b9f5 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Returning 404 to user: Instance tempest-invalid-1631547869 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:27:31.791384 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5bbfcd55-db1c-4605-9ef4-71cd6197b9f5 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "POST /compute/v2.1/servers/tempest-invalid-1631547869/action" status: 404 len: 101 microversion: 2.1 time: 0.030833 Jun 05 08:27:31.794428 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 686/1333] 10.222.0.33 () {60 vars in 1248 bytes} [Sun Jun 5 08:27:31 2022] POST /compute/v2.1/servers/tempest-invalid-1631547869/action => generated 101 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:27:31.864683 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1dabde05-f712-4618-950a-69d5abfc094c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:31.865371 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1dabde05-f712-4618-950a-69d5abfc094c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:31.866032 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-1dabde05-f712-4618-950a-69d5abfc094c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:31.969210 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1dabde05-f712-4618-950a-69d5abfc094c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:31.981964 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1dabde05-f712-4618-950a-69d5abfc094c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.235283 Jun 05 08:27:31.982831 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 648/1334] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:31 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:31.994753 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0607021b-9445-4598-b8ae-91338c68b65d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:31.997285 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0607021b-9445-4598-b8ae-91338c68b65d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:32.016590 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0607021b-9445-4598-b8ae-91338c68b65d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:32.017123 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0607021b-9445-4598-b8ae-91338c68b65d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:32.017961 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0607021b-9445-4598-b8ae-91338c68b65d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:32.018402 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0607021b-9445-4598-b8ae-91338c68b65d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:32.074742 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8590939b-6f83-4cc1-80db-275979430c12 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-60481747", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "f64fd73a-a116-4aff-9477-8fcef2963c69"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:32.218646 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-8590939b-6f83-4cc1-80db-275979430c12 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] validate_networks() for [('f64fd73a-a116-4aff-9477-8fcef2963c69', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:27:32.421600 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0607021b-9445-4598-b8ae-91338c68b65d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:32.435470 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0607021b-9445-4598-b8ae-91338c68b65d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:32.445245 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0607021b-9445-4598-b8ae-91338c68b65d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:32.446748 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0607021b-9445-4598-b8ae-91338c68b65d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1740 microversion: 2.20 time: 0.461366 Jun 05 08:27:32.447513 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 649/1335] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:31 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1740 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:32.473893 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ed4e9028-5ddc-4dc9-bb72-46adbb5ace96 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-153271038"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:32.477578 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ed4e9028-5ddc-4dc9-bb72-46adbb5ace96 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 05 08:27:32.478227 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-ed4e9028-5ddc-4dc9-bb72-46adbb5ace96 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 05 08:27:32.485924 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ed4e9028-5ddc-4dc9-bb72-46adbb5ace96 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Request method failure captured: Jun 05 08:27:32.485924 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jun 05 08:27:32.485924 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:27:32.485924 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:27:32.485924 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:27:32.485924 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 56 Jun 05 08:27:32.485924 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:27:32.485924 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:27:32.485924 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:27:32.485924 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:27:32.485924 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGjMUs6ecPmrI6R8TtkQYWAgYy7ShU0RT4wmTlWDnvYgqoI4DkA1VvnJNeUU_bDG-GzXY53bBi4wUUvLm-ymtoug-r2QWxpmaHX8Suv-FFyKH-AjUyEc6jX_jUUSViDnlUeu96GDFAF5oAUWFa3ep0zn5W2b4BWrUaFlvMuTPi1p9Po Jun 05 08:27:32.485924 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:27:32.485924 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:27:32.485924 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:27:32.485924 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:27:32.485924 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:27:32.485924 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:27:32.485924 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: bc76c30c981d4c69b229b6d7415c910c Jun 05 08:27:32.485924 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ImagesNegativeTestJSON-850637503 Jun 05 08:27:32.485924 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:27:32.485924 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:27:32.487500 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bc76c30c981d4c69b229b6d7415c910c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc76c30c981d4c69b229b6d7415c910c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bc76c30c981d4c69b229b6d7415c910c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc76c30c981d4c69b229b6d7415c910c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:27:32.487500 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ImagesNegativeTestJSON-850637503 Jun 05 08:27:32.487500 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: bc76c30c981d4c69b229b6d7415c910c Jun 05 08:27:32.487500 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-850637503 Jun 05 08:27:32.487500 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ImagesNegativeTestJSON-850637503-project Jun 05 08:27:32.487500 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:27:32.487500 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:27:32.487500 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 6cdc8382bafd49a3877df672d02f8206 Jun 05 08:27:32.487500 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ImagesNegativeTestJSON-850637503-project Jun 05 08:27:32.487500 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:27:32.487500 n-d-844739-1 devstack@n-api.service[119050]: {"createImage": {"name": "tempest-test-snap-153271038"}} Jun 05 08:27:32.487500 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:27:32.487500 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 05 08:27:32.488475 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-153271038'}}} Jun 05 08:27:32.488475 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:27:32.488475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:27:32.488475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:27:32.488475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:27:32.488475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 05 08:27:32.488475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 05 08:27:32.488475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 05 08:27:32.488475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:27:32.488475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:27:32.488475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:27:32.488475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:27:32.488475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:27:32.488475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:27:32.488475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:27:32.488475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:27:32.488475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:27:32.488475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:27:32.488475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:27:32.488475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:27:32.489865 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:27:32.489865 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:27:32.489865 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 05 08:27:32.489865 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 05 08:27:32.489865 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:27:32.489865 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:27:32.489865 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:27:32.489865 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:27:32.489865 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 05 08:27:32.489865 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:27:32.489865 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:27:32.489865 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:27:32.489865 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:27:32.489865 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:27:32.489865 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:27:32.489865 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:27:32.489865 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:27:32.489865 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 05 08:27:32.489865 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:27:32.492879 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ed4e9028-5ddc-4dc9-bb72-46adbb5ace96 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:27:32.497201 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ed4e9028-5ddc-4dc9-bb72-46adbb5ace96 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.044038 Jun 05 08:27:32.498889 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 650/1336] 10.222.0.33 () {60 vars in 1274 bytes} [Sun Jun 5 08:27:32 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:27:32.509609 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-74c3fb9b-e375-486f-98fb-a9b7daded735 req-f580037a-ce1b-46e9-ad68-43a7fea22af4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "789255b3-7097-4ac9-897d-71da8910700c", "name": "network-vif-plugged", "status": "completed", "tag": "480f2e74-6e36-4e1f-a0d5-0499a40cd88a"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:32.535987 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-74c3fb9b-e375-486f-98fb-a9b7daded735 req-f580037a-ce1b-46e9-ad68-43a7fea22af4 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:32.537821 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-74c3fb9b-e375-486f-98fb-a9b7daded735 req-f580037a-ce1b-46e9-ad68-43a7fea22af4 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:32.566429 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-74c3fb9b-e375-486f-98fb-a9b7daded735 req-f580037a-ce1b-46e9-ad68-43a7fea22af4 service nova] Creating event network-vif-plugged:480f2e74-6e36-4e1f-a0d5-0499a40cd88a for instance 789255b3-7097-4ac9-897d-71da8910700c on n-h1-844739-1 Jun 05 08:27:32.575088 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-74c3fb9b-e375-486f-98fb-a9b7daded735 req-f580037a-ce1b-46e9-ad68-43a7fea22af4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073742 Jun 05 08:27:32.580155 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 651/1337] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:32.604871 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ab47e0db-ef3b-41dd-b5cf-9928de57096f tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-116631309"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:32.607371 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ab47e0db-ef3b-41dd-b5cf-9928de57096f tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 05 08:27:32.610234 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-ab47e0db-ef3b-41dd-b5cf-9928de57096f tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 05 08:27:32.616441 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ab47e0db-ef3b-41dd-b5cf-9928de57096f tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Request method failure captured: Jun 05 08:27:32.616441 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jun 05 08:27:32.616441 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:27:32.616441 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:27:32.616441 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:27:32.616441 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 56 Jun 05 08:27:32.616441 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:27:32.616441 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:27:32.616441 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:27:32.616441 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:27:32.616441 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGjMUs6ecPmrI6R8TtkQYWAgYy7ShU0RT4wmTlWDnvYgqoI4DkA1VvnJNeUU_bDG-GzXY53bBi4wUUvLm-ymtoug-r2QWxpmaHX8Suv-FFyKH-AjUyEc6jX_jUUSViDnlUeu96GDFAF5oAUWFa3ep0zn5W2b4BWrUaFlvMuTPi1p9Po Jun 05 08:27:32.616441 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:27:32.616441 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:27:32.616441 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:27:32.616441 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:27:32.616441 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:27:32.616441 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:27:32.616441 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: bc76c30c981d4c69b229b6d7415c910c Jun 05 08:27:32.616441 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ImagesNegativeTestJSON-850637503 Jun 05 08:27:32.616441 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:27:32.616441 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:27:32.617834 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bc76c30c981d4c69b229b6d7415c910c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc76c30c981d4c69b229b6d7415c910c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bc76c30c981d4c69b229b6d7415c910c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc76c30c981d4c69b229b6d7415c910c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:27:32.617834 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ImagesNegativeTestJSON-850637503 Jun 05 08:27:32.617834 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: bc76c30c981d4c69b229b6d7415c910c Jun 05 08:27:32.617834 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-850637503 Jun 05 08:27:32.617834 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ImagesNegativeTestJSON-850637503-project Jun 05 08:27:32.617834 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:27:32.617834 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:27:32.617834 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 6cdc8382bafd49a3877df672d02f8206 Jun 05 08:27:32.617834 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ImagesNegativeTestJSON-850637503-project Jun 05 08:27:32.617834 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:27:32.617834 n-d-844739-1 devstack@n-api.service[119050]: {"createImage": {"name": "tempest-test-snap-116631309"}} Jun 05 08:27:32.617834 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:27:32.617834 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 05 08:27:32.618719 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-116631309'}}} Jun 05 08:27:32.618719 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:27:32.618719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:27:32.618719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:27:32.618719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:27:32.618719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 05 08:27:32.618719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 05 08:27:32.618719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 05 08:27:32.618719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:27:32.618719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:27:32.618719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:27:32.618719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:27:32.618719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:27:32.618719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:27:32.618719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:27:32.618719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:27:32.618719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:27:32.618719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:27:32.618719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:27:32.618719 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:27:32.619913 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:27:32.619913 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:27:32.619913 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 05 08:27:32.619913 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 05 08:27:32.619913 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:27:32.619913 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:27:32.619913 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:27:32.619913 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:27:32.619913 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 05 08:27:32.619913 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:27:32.619913 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:27:32.619913 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:27:32.619913 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:27:32.619913 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:27:32.619913 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:27:32.619913 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:27:32.619913 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:27:32.619913 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 05 08:27:32.619913 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:27:32.627606 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ab47e0db-ef3b-41dd-b5cf-9928de57096f tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:27:32.629837 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ab47e0db-ef3b-41dd-b5cf-9928de57096f tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.039602 Jun 05 08:27:32.633601 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 652/1338] 10.222.0.33 () {60 vars in 1280 bytes} [Sun Jun 5 08:27:32 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:27:32.647375 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4ada5cd4-be5e-40e6-84ca-9fab34ae0b49 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:32.649831 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4ada5cd4-be5e-40e6-84ca-9fab34ae0b49 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:32.666739 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4ada5cd4-be5e-40e6-84ca-9fab34ae0b49 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:32.671492 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4ada5cd4-be5e-40e6-84ca-9fab34ae0b49 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:32.672944 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4ada5cd4-be5e-40e6-84ca-9fab34ae0b49 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:32.674629 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4ada5cd4-be5e-40e6-84ca-9fab34ae0b49 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:32.743311 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4ada5cd4-be5e-40e6-84ca-9fab34ae0b49 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:27:32.756018 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:32.878311 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4ada5cd4-be5e-40e6-84ca-9fab34ae0b49 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5" status: 204 len: 0 microversion: 2.1 time: 0.236864 Jun 05 08:27:32.879312 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 653/1339] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:27:32 2022] DELETE /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:27:32.896194 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f6cc8f7e-f53c-4b1e-9ee9-e16114a5803f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:32.896929 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f6cc8f7e-f53c-4b1e-9ee9-e16114a5803f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 789255b3-7097-4ac9-897d-71da8910700c] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:32.914319 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f6cc8f7e-f53c-4b1e-9ee9-e16114a5803f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:32.914779 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f6cc8f7e-f53c-4b1e-9ee9-e16114a5803f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:32.915756 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f6cc8f7e-f53c-4b1e-9ee9-e16114a5803f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:32.916215 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f6cc8f7e-f53c-4b1e-9ee9-e16114a5803f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:32.994268 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-8590939b-6f83-4cc1-80db-275979430c12 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:27:32.995357 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-8590939b-6f83-4cc1-80db-275979430c12 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:27:32.995735 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-8590939b-6f83-4cc1-80db-275979430c12 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:27:32.996182 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-8590939b-6f83-4cc1-80db-275979430c12 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:27:32.996653 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-8590939b-6f83-4cc1-80db-275979430c12 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:27:33.014078 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8590939b-6f83-4cc1-80db-275979430c12 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:33.014553 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8590939b-6f83-4cc1-80db-275979430c12 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:33.015414 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8590939b-6f83-4cc1-80db-275979430c12 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:33.015888 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8590939b-6f83-4cc1-80db-275979430c12 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:33.103699 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-8590939b-6f83-4cc1-80db-275979430c12 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Getting quotas for project 3870297862984ecdab229d5df4df8735. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:27:33.121498 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-8590939b-6f83-4cc1-80db-275979430c12 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Getting quotas for user 1e076b50c396484b9380a66e10f7f3c4 and project 3870297862984ecdab229d5df4df8735. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:27:33.142816 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8590939b-6f83-4cc1-80db-275979430c12 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:27:33.146901 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8590939b-6f83-4cc1-80db-275979430c12 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:27:33.251099 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8590939b-6f83-4cc1-80db-275979430c12 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.453995 Jun 05 08:27:33.255039 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 687/1340] 10.222.0.33 () {62 vars in 1187 bytes} [Sun Jun 5 08:27:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1460 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 05 08:27:33.282420 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1ed70c47-c358-4442-b1f8-3c7758d41a28 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:33.285636 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1ed70c47-c358-4442-b1f8-3c7758d41a28 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:33.290891 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f6cc8f7e-f53c-4b1e-9ee9-e16114a5803f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:33.301301 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ed70c47-c358-4442-b1f8-3c7758d41a28 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:33.301301 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ed70c47-c358-4442-b1f8-3c7758d41a28 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:33.302057 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ed70c47-c358-4442-b1f8-3c7758d41a28 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:33.304217 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ed70c47-c358-4442-b1f8-3c7758d41a28 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:33.310193 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f6cc8f7e-f53c-4b1e-9ee9-e16114a5803f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c" status: 200 len: 1316 microversion: 2.1 time: 0.429082 Jun 05 08:27:33.310794 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 654/1341] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:32 2022] GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c => generated 1316 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:33.323737 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fc09c053-ba37-4dc0-a6f4-b2f9ba63cdd4 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:33.324458 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-fc09c053-ba37-4dc0-a6f4-b2f9ba63cdd4 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:33.338040 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fc09c053-ba37-4dc0-a6f4-b2f9ba63cdd4 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:33.338507 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fc09c053-ba37-4dc0-a6f4-b2f9ba63cdd4 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:33.339522 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fc09c053-ba37-4dc0-a6f4-b2f9ba63cdd4 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:33.339950 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fc09c053-ba37-4dc0-a6f4-b2f9ba63cdd4 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:33.395161 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1ed70c47-c358-4442-b1f8-3c7758d41a28 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138530 Jun 05 08:27:33.396415 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 688/1342] 10.222.0.33 () {58 vars in 1301 bytes} [Sun Jun 5 08:27:33 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:33.414756 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-efa173cf-de00-471a-b609-98eccc9b0bc5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:33.415387 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-efa173cf-de00-471a-b609-98eccc9b0bc5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:33.435774 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-efa173cf-de00-471a-b609-98eccc9b0bc5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:33.436139 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fc09c053-ba37-4dc0-a6f4-b2f9ba63cdd4 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:33.436258 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-efa173cf-de00-471a-b609-98eccc9b0bc5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:33.437088 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-efa173cf-de00-471a-b609-98eccc9b0bc5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:33.437213 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fc09c053-ba37-4dc0-a6f4-b2f9ba63cdd4 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:33.437615 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-efa173cf-de00-471a-b609-98eccc9b0bc5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:33.439361 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-fc09c053-ba37-4dc0-a6f4-b2f9ba63cdd4 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lazy-loading 'fault' on Instance uuid ab76465b-2e53-4bf6-8371-6393b1aa99b5 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:33.536713 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-fc09c053-ba37-4dc0-a6f4-b2f9ba63cdd4 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdc8382bafd49a3877df672d02f8206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76c30c981d4c69b229b6d7415c910c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:33.548360 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-efa173cf-de00-471a-b609-98eccc9b0bc5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:33.555460 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fc09c053-ba37-4dc0-a6f4-b2f9ba63cdd4 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5" status: 200 len: 1367 microversion: 2.1 time: 0.243449 Jun 05 08:27:33.556786 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-efa173cf-de00-471a-b609-98eccc9b0bc5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:33.558602 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-efa173cf-de00-471a-b609-98eccc9b0bc5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:33.561506 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 655/1343] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:33 2022] GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5 => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:33.580343 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-720abeb6-8805-4fd2-9c2e-001aeb1c5491 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:33.584011 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-720abeb6-8805-4fd2-9c2e-001aeb1c5491 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:33.712541 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-720abeb6-8805-4fd2-9c2e-001aeb1c5491 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:33.727629 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-720abeb6-8805-4fd2-9c2e-001aeb1c5491 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:33.730078 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-720abeb6-8805-4fd2-9c2e-001aeb1c5491 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:33.742623 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-720abeb6-8805-4fd2-9c2e-001aeb1c5491 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe" status: 200 len: 1260 microversion: 2.26 time: 0.178987 Jun 05 08:27:33.743803 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 656/1344] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:33 2022] GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:33.766860 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-bf4e4aa1-324d-4f6b-986a-4c0bcf52accd tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:33.768031 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-bf4e4aa1-324d-4f6b-986a-4c0bcf52accd tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:33.771403 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-efa173cf-de00-471a-b609-98eccc9b0bc5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:33.790849 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-efa173cf-de00-471a-b609-98eccc9b0bc5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.392935 Jun 05 08:27:33.793793 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 689/1345] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:33 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:33.813409 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bf4e4aa1-324d-4f6b-986a-4c0bcf52accd tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:33.813878 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bf4e4aa1-324d-4f6b-986a-4c0bcf52accd tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:33.814697 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bf4e4aa1-324d-4f6b-986a-4c0bcf52accd tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:33.815148 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bf4e4aa1-324d-4f6b-986a-4c0bcf52accd tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:34.328977 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a3234a5d-124b-4cf9-8bcb-e041c6196a07 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:34.329723 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a3234a5d-124b-4cf9-8bcb-e041c6196a07 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 789255b3-7097-4ac9-897d-71da8910700c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:34.347898 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-bf4e4aa1-324d-4f6b-986a-4c0bcf52accd tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:34.355779 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a3234a5d-124b-4cf9-8bcb-e041c6196a07 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:34.356316 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a3234a5d-124b-4cf9-8bcb-e041c6196a07 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:34.357421 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a3234a5d-124b-4cf9-8bcb-e041c6196a07 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:34.357997 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a3234a5d-124b-4cf9-8bcb-e041c6196a07 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:34.370465 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-bf4e4aa1-324d-4f6b-986a-4c0bcf52accd tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:34.373037 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-bf4e4aa1-324d-4f6b-986a-4c0bcf52accd tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:34.374515 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-bf4e4aa1-324d-4f6b-986a-4c0bcf52accd tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1740 microversion: 2.20 time: 0.629399 Jun 05 08:27:34.375946 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 657/1346] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:33 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1740 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:34.408533 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6e953854-d075-4845-89ad-6cf7979bcab9 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:34.409632 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6e953854-d075-4845-89ad-6cf7979bcab9 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:34.440511 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6e953854-d075-4845-89ad-6cf7979bcab9 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:34.441028 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6e953854-d075-4845-89ad-6cf7979bcab9 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:34.441889 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6e953854-d075-4845-89ad-6cf7979bcab9 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:34.448670 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6e953854-d075-4845-89ad-6cf7979bcab9 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:34.552056 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6e953854-d075-4845-89ad-6cf7979bcab9 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147732 Jun 05 08:27:34.554455 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 658/1347] 10.222.0.33 () {58 vars in 1301 bytes} [Sun Jun 5 08:27:34 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:34.578028 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9c4842cb-729b-4107-aad5-51f0faffbd17 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:34.585494 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9c4842cb-729b-4107-aad5-51f0faffbd17 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] [instance: ab76465b-2e53-4bf6-8371-6393b1aa99b5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:34.598948 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9c4842cb-729b-4107-aad5-51f0faffbd17 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:34.599697 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9c4842cb-729b-4107-aad5-51f0faffbd17 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:34.600735 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9c4842cb-729b-4107-aad5-51f0faffbd17 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:34.601506 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9c4842cb-729b-4107-aad5-51f0faffbd17 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:34.658312 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9c4842cb-729b-4107-aad5-51f0faffbd17 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:34.659310 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9c4842cb-729b-4107-aad5-51f0faffbd17 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:34.659979 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-9c4842cb-729b-4107-aad5-51f0faffbd17 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Lazy-loading 'fault' on Instance uuid ab76465b-2e53-4bf6-8371-6393b1aa99b5 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:34.764652 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-9c4842cb-729b-4107-aad5-51f0faffbd17 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cdc8382bafd49a3877df672d02f8206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc76c30c981d4c69b229b6d7415c910c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:34.775724 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9c4842cb-729b-4107-aad5-51f0faffbd17 tempest-ImagesNegativeTestJSON-850637503 tempest-ImagesNegativeTestJSON-850637503-project] 10.222.0.33 "GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5" status: 200 len: 1367 microversion: 2.1 time: 0.201564 Jun 05 08:27:34.778035 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 659/1348] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:34 2022] GET /compute/v2.1/servers/ab76465b-2e53-4bf6-8371-6393b1aa99b5 => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:34.801214 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-07b53955-b5b8-4d64-997e-33de7e28429a tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:34.803399 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-07b53955-b5b8-4d64-997e-33de7e28429a tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:34.820963 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a3234a5d-124b-4cf9-8bcb-e041c6196a07 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:34.824611 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-07b53955-b5b8-4d64-997e-33de7e28429a tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:34.831252 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a3234a5d-124b-4cf9-8bcb-e041c6196a07 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c" status: 200 len: 1466 microversion: 2.1 time: 0.507291 Jun 05 08:27:34.833986 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-07b53955-b5b8-4d64-997e-33de7e28429a tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:34.836146 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-07b53955-b5b8-4d64-997e-33de7e28429a tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:34.836972 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 690/1349] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:34 2022] GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c => generated 1466 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:34.839280 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-07b53955-b5b8-4d64-997e-33de7e28429a tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:34.848683 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9a8eaebc-6e57-43a0-9ab1-ad8215e5f06b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:34.850944 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9a8eaebc-6e57-43a0-9ab1-ad8215e5f06b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:34.868842 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9a8eaebc-6e57-43a0-9ab1-ad8215e5f06b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:34.869706 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9a8eaebc-6e57-43a0-9ab1-ad8215e5f06b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:34.870966 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9a8eaebc-6e57-43a0-9ab1-ad8215e5f06b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:34.871583 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9a8eaebc-6e57-43a0-9ab1-ad8215e5f06b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:35.014867 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9a8eaebc-6e57-43a0-9ab1-ad8215e5f06b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:35.016997 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9a8eaebc-6e57-43a0-9ab1-ad8215e5f06b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:35.019235 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-9a8eaebc-6e57-43a0-9ab1-ad8215e5f06b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:35.150003 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9a8eaebc-6e57-43a0-9ab1-ad8215e5f06b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:35.166831 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9a8eaebc-6e57-43a0-9ab1-ad8215e5f06b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.326451 Jun 05 08:27:35.166831 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 691/1350] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:34 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:35.174515 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-528b40a9-1cd4-4015-9e93-98d5a39ea360 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:35.174967 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-528b40a9-1cd4-4015-9e93-98d5a39ea360 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] [instance: 789255b3-7097-4ac9-897d-71da8910700c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:35.235292 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-528b40a9-1cd4-4015-9e93-98d5a39ea360 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:35.236263 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-528b40a9-1cd4-4015-9e93-98d5a39ea360 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:35.237115 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-528b40a9-1cd4-4015-9e93-98d5a39ea360 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:35.237561 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-528b40a9-1cd4-4015-9e93-98d5a39ea360 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:35.391933 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-07b53955-b5b8-4d64-997e-33de7e28429a tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:35.419404 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-07b53955-b5b8-4d64-997e-33de7e28429a tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:35.427215 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-07b53955-b5b8-4d64-997e-33de7e28429a tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:35.428478 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-07b53955-b5b8-4d64-997e-33de7e28429a tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe" status: 200 len: 1312 microversion: 2.26 time: 0.649184 Jun 05 08:27:35.429051 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 660/1351] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:34 2022] GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe => generated 1312 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:35.458715 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e2fb6aba-e051-44ad-a26f-000d4ed4bee1 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:35.467455 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e2fb6aba-e051-44ad-a26f-000d4ed4bee1 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:35.489005 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e2fb6aba-e051-44ad-a26f-000d4ed4bee1 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:35.495781 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e2fb6aba-e051-44ad-a26f-000d4ed4bee1 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:35.498552 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e2fb6aba-e051-44ad-a26f-000d4ed4bee1 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:35.504585 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e2fb6aba-e051-44ad-a26f-000d4ed4bee1 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:36.287476 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-528b40a9-1cd4-4015-9e93-98d5a39ea360 tempest-ServersOnMultiNodesTest-439882668 tempest-ServersOnMultiNodesTest-439882668-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c" status: 200 len: 1617 microversion: 2.1 time: 1.119529 Jun 05 08:27:36.294954 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 692/1352] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:35 2022] GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c => generated 1617 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:36.304585 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-802a7ca8-ccf1-498e-a8e7-4f9e4fe74566 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:36.307533 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-802a7ca8-ccf1-498e-a8e7-4f9e4fe74566 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:36.326381 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-802a7ca8-ccf1-498e-a8e7-4f9e4fe74566 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:36.331239 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-802a7ca8-ccf1-498e-a8e7-4f9e4fe74566 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:36.332222 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-802a7ca8-ccf1-498e-a8e7-4f9e4fe74566 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:36.332683 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-802a7ca8-ccf1-498e-a8e7-4f9e4fe74566 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:36.337437 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e2fb6aba-e051-44ad-a26f-000d4ed4bee1 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:36.356285 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e2fb6aba-e051-44ad-a26f-000d4ed4bee1 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:36.357947 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e2fb6aba-e051-44ad-a26f-000d4ed4bee1 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:36.359251 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e2fb6aba-e051-44ad-a26f-000d4ed4bee1 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1740 microversion: 2.20 time: 0.929250 Jun 05 08:27:36.359810 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 661/1353] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:35 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1740 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:36.373340 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1cf03d17-cac2-4168-bce7-20728fdb6f6e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:36.374003 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1cf03d17-cac2-4168-bce7-20728fdb6f6e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:36.390230 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1cf03d17-cac2-4168-bce7-20728fdb6f6e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:36.390733 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1cf03d17-cac2-4168-bce7-20728fdb6f6e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:36.391586 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1cf03d17-cac2-4168-bce7-20728fdb6f6e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:36.392055 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1cf03d17-cac2-4168-bce7-20728fdb6f6e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:36.437083 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-802a7ca8-ccf1-498e-a8e7-4f9e4fe74566 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.140667 Jun 05 08:27:36.437766 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 693/1354] 10.222.0.33 () {58 vars in 1301 bytes} [Sun Jun 5 08:27:36 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97/os-volume_attachments => generated 25 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:27:36.458792 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=8 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:36.461769 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1cf03d17-cac2-4168-bce7-20728fdb6f6e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:36.461915 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ff44db2d-af60-46cf-ab1c-35727784411f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:36.462511 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ff44db2d-af60-46cf-ab1c-35727784411f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 789255b3-7097-4ac9-897d-71da8910700c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:36.462680 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1cf03d17-cac2-4168-bce7-20728fdb6f6e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:36.467479 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-1cf03d17-cac2-4168-bce7-20728fdb6f6e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:36.491592 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ff44db2d-af60-46cf-ab1c-35727784411f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:36.492097 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ff44db2d-af60-46cf-ab1c-35727784411f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:36.500087 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ff44db2d-af60-46cf-ab1c-35727784411f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:36.502320 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ff44db2d-af60-46cf-ab1c-35727784411f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:36.585078 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1cf03d17-cac2-4168-bce7-20728fdb6f6e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:36.597306 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1cf03d17-cac2-4168-bce7-20728fdb6f6e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.232740 Jun 05 08:27:36.597927 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 662/1355] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:36 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:36.625472 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b5aa45d0-0343-4425-a110-8d5fdbfa5170 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:36.626340 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b5aa45d0-0343-4425-a110-8d5fdbfa5170 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:36.644770 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b5aa45d0-0343-4425-a110-8d5fdbfa5170 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:36.645234 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b5aa45d0-0343-4425-a110-8d5fdbfa5170 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:36.646051 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b5aa45d0-0343-4425-a110-8d5fdbfa5170 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:36.646478 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b5aa45d0-0343-4425-a110-8d5fdbfa5170 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:36.647402 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ff44db2d-af60-46cf-ab1c-35727784411f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 789255b3-7097-4ac9-897d-71da8910700c] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:27:36.817996 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b5aa45d0-0343-4425-a110-8d5fdbfa5170 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:36.859074 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b5aa45d0-0343-4425-a110-8d5fdbfa5170 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:36.866534 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ff44db2d-af60-46cf-ab1c-35727784411f tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "DELETE /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c" status: 204 len: 0 microversion: 2.1 time: 0.426876 Jun 05 08:27:36.867476 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b5aa45d0-0343-4425-a110-8d5fdbfa5170 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:36.870838 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 694/1356] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:27:36 2022] DELETE /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:27:36.871149 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b5aa45d0-0343-4425-a110-8d5fdbfa5170 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe" status: 200 len: 1318 microversion: 2.26 time: 0.256774 Jun 05 08:27:36.871894 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 663/1357] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:36 2022] GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:36.891712 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8f4de2e9-6f62-4ea6-8e2a-abf4fcefdc76 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:36.894832 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8f4de2e9-6f62-4ea6-8e2a-abf4fcefdc76 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 789255b3-7097-4ac9-897d-71da8910700c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:36.916471 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8f4de2e9-6f62-4ea6-8e2a-abf4fcefdc76 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:36.917474 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8f4de2e9-6f62-4ea6-8e2a-abf4fcefdc76 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:36.918296 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8f4de2e9-6f62-4ea6-8e2a-abf4fcefdc76 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:36.918742 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8f4de2e9-6f62-4ea6-8e2a-abf4fcefdc76 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:37.315467 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8f4de2e9-6f62-4ea6-8e2a-abf4fcefdc76 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:37.333483 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8f4de2e9-6f62-4ea6-8e2a-abf4fcefdc76 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c" status: 200 len: 1472 microversion: 2.1 time: 0.457924 Jun 05 08:27:37.352868 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 695/1358] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:36 2022] GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c => generated 1472 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:37.386028 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-68805a07-4473-4f70-90c0-0a1bd072a752 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:37.386842 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-68805a07-4473-4f70-90c0-0a1bd072a752 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:37.421538 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-68805a07-4473-4f70-90c0-0a1bd072a752 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:37.422234 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-68805a07-4473-4f70-90c0-0a1bd072a752 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:37.424254 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-68805a07-4473-4f70-90c0-0a1bd072a752 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:37.424712 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-68805a07-4473-4f70-90c0-0a1bd072a752 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:37.623172 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a561fd4b-7842-4530-8e04-51137f4544ee tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:37.623801 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a561fd4b-7842-4530-8e04-51137f4544ee tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:37.641760 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a561fd4b-7842-4530-8e04-51137f4544ee tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:37.642342 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a561fd4b-7842-4530-8e04-51137f4544ee tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:37.643129 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a561fd4b-7842-4530-8e04-51137f4544ee tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:37.643564 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a561fd4b-7842-4530-8e04-51137f4544ee tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:37.741738 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a561fd4b-7842-4530-8e04-51137f4544ee tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:37.745819 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a561fd4b-7842-4530-8e04-51137f4544ee tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:37.746498 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-a561fd4b-7842-4530-8e04-51137f4544ee tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:37.829730 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a561fd4b-7842-4530-8e04-51137f4544ee tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:37.847565 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-68805a07-4473-4f70-90c0-0a1bd072a752 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:37.861868 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a561fd4b-7842-4530-8e04-51137f4544ee tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.238696 Jun 05 08:27:37.863320 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 696/1359] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:37 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:37.865459 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-68805a07-4473-4f70-90c0-0a1bd072a752 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:37.867996 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-68805a07-4473-4f70-90c0-0a1bd072a752 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:37.870371 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-68805a07-4473-4f70-90c0-0a1bd072a752 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1740 microversion: 2.20 time: 0.495493 Jun 05 08:27:37.872497 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 664/1360] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:37 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1740 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:37.893744 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9adf800c-2bf2-476b-aab5-c7fe06264812 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:37.894581 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9adf800c-2bf2-476b-aab5-c7fe06264812 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:37.907548 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9adf800c-2bf2-476b-aab5-c7fe06264812 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:37.908953 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9adf800c-2bf2-476b-aab5-c7fe06264812 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:37.910849 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9adf800c-2bf2-476b-aab5-c7fe06264812 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:37.911473 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9adf800c-2bf2-476b-aab5-c7fe06264812 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:38.351265 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5303092b-c6b7-4dd4-b728-6ed6e70e8169 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:38.352225 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5303092b-c6b7-4dd4-b728-6ed6e70e8169 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 789255b3-7097-4ac9-897d-71da8910700c] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:38.366602 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5303092b-c6b7-4dd4-b728-6ed6e70e8169 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:38.382267 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5303092b-c6b7-4dd4-b728-6ed6e70e8169 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:38.387823 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5303092b-c6b7-4dd4-b728-6ed6e70e8169 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:38.390441 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5303092b-c6b7-4dd4-b728-6ed6e70e8169 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:38.408006 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9adf800c-2bf2-476b-aab5-c7fe06264812 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:38.412645 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:38.434918 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9adf800c-2bf2-476b-aab5-c7fe06264812 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:38.444075 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9adf800c-2bf2-476b-aab5-c7fe06264812 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:38.455107 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9adf800c-2bf2-476b-aab5-c7fe06264812 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe" status: 200 len: 1360 microversion: 2.26 time: 0.566719 Jun 05 08:27:38.456455 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 697/1361] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:37 2022] GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe => generated 1360 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:38.701280 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5303092b-c6b7-4dd4-b728-6ed6e70e8169 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:38.710777 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5303092b-c6b7-4dd4-b728-6ed6e70e8169 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c" status: 200 len: 1472 microversion: 2.1 time: 0.363919 Jun 05 08:27:38.711376 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 665/1362] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:38 2022] GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c => generated 1472 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:27:38.878877 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-219f3123-8d01-408c-810b-ddea056e2c05 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:38.879500 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-219f3123-8d01-408c-810b-ddea056e2c05 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:38.891581 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4768e13f-c813-4120-9bf6-079d83d66fb3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:38.892155 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4768e13f-c813-4120-9bf6-079d83d66fb3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:38.914165 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4768e13f-c813-4120-9bf6-079d83d66fb3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:38.914592 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4768e13f-c813-4120-9bf6-079d83d66fb3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:38.915404 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4768e13f-c813-4120-9bf6-079d83d66fb3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:38.915850 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4768e13f-c813-4120-9bf6-079d83d66fb3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:38.923346 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-219f3123-8d01-408c-810b-ddea056e2c05 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:38.923804 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-219f3123-8d01-408c-810b-ddea056e2c05 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:38.924653 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-219f3123-8d01-408c-810b-ddea056e2c05 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:38.925114 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-219f3123-8d01-408c-810b-ddea056e2c05 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:39.070361 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-219f3123-8d01-408c-810b-ddea056e2c05 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:39.071106 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-219f3123-8d01-408c-810b-ddea056e2c05 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:39.075227 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-219f3123-8d01-408c-810b-ddea056e2c05 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:39.179344 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-219f3123-8d01-408c-810b-ddea056e2c05 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:39.194116 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-219f3123-8d01-408c-810b-ddea056e2c05 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.318967 Jun 05 08:27:39.207797 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 698/1363] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:38 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:39.516517 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4768e13f-c813-4120-9bf6-079d83d66fb3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:39.548888 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4768e13f-c813-4120-9bf6-079d83d66fb3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:39.559490 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4768e13f-c813-4120-9bf6-079d83d66fb3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:39.573927 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4768e13f-c813-4120-9bf6-079d83d66fb3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1740 microversion: 2.20 time: 0.673864 Jun 05 08:27:39.574898 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 666/1364] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:38 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1740 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:27:39.586735 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-58cf76cd-bb70-4f0a-bec1-898ddb60b9c7 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:39.601575 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-58cf76cd-bb70-4f0a-bec1-898ddb60b9c7 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:39.621856 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-58cf76cd-bb70-4f0a-bec1-898ddb60b9c7 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:39.629480 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-58cf76cd-bb70-4f0a-bec1-898ddb60b9c7 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:39.631786 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-58cf76cd-bb70-4f0a-bec1-898ddb60b9c7 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:39.637766 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-58cf76cd-bb70-4f0a-bec1-898ddb60b9c7 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:39.893978 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-427a0f94-4c2d-49e6-bd0c-045716cc89c5 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Action: 'create', calling method: .version_select at 0x7f243378d310>, body: {"keypair": {"name": "tempest-keypair-1527906457", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNbdq6mBl1xg4b1EuOCNa1YHhzf8z/Npo+pBEB+FQPBXXFM/hHZFe76olLFM/kd/22bfqj/ZXiIGnks3+qLqffBoEtk660Q3HLxVmBivZ6CmvnMv+oA4XlSChdPg5FGAA=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:39.943505 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=83 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:39.947440 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-58cf76cd-bb70-4f0a-bec1-898ddb60b9c7 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:39.961344 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-58cf76cd-bb70-4f0a-bec1-898ddb60b9c7 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:39.964933 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-58cf76cd-bb70-4f0a-bec1-898ddb60b9c7 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:39.966368 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-58cf76cd-bb70-4f0a-bec1-898ddb60b9c7 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe" status: 200 len: 1360 microversion: 2.26 time: 0.389311 Jun 05 08:27:39.967812 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 667/1365] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:39 2022] GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe => generated 1360 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:39.973181 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-427a0f94-4c2d-49e6-bd0c-045716cc89c5 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Getting quotas for project 2365775e7b2643479810036e8794df9e. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:27:39.978050 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b85fbf91-e61e-4f1a-b515-31d2de0374c6 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:39.978674 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b85fbf91-e61e-4f1a-b515-31d2de0374c6 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 789255b3-7097-4ac9-897d-71da8910700c] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:39.987144 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-427a0f94-4c2d-49e6-bd0c-045716cc89c5 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Getting quotas for user 4feb28d5c0a64216b2a8b77572da0506 and project 2365775e7b2643479810036e8794df9e. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:27:39.992242 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b85fbf91-e61e-4f1a-b515-31d2de0374c6 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:39.993259 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b85fbf91-e61e-4f1a-b515-31d2de0374c6 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:39.994452 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b85fbf91-e61e-4f1a-b515-31d2de0374c6 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:39.995775 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b85fbf91-e61e-4f1a-b515-31d2de0374c6 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:39.997123 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:40.045715 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-427a0f94-4c2d-49e6-bd0c-045716cc89c5 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.582943 Jun 05 08:27:40.047373 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 699/1366] 10.222.0.33 () {62 vars in 1198 bytes} [Sun Jun 5 08:27:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 586 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 05 08:27:40.061817 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b1fe71ef-10e1-474f-87d4-74d80d6137c2 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Calling method '.version_select at 0x7f24337c69d0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:40.092810 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b1fe71ef-10e1-474f-87d4-74d80d6137c2 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-1527906457" status: 200 len: 513 microversion: 2.2 time: 0.038427 Jun 05 08:27:40.095229 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 700/1367] 10.222.0.33 () {60 vars in 1257 bytes} [Sun Jun 5 08:27:40 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1527906457 => generated 513 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:27:40.107674 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-df3863fa-265b-4fca-8034-c78ce354d80f tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Calling method '.version_select at 0x7f24337c6670>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:40.183430 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-df3863fa-265b-4fca-8034-c78ce354d80f tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1527906457" status: 204 len: 0 microversion: 2.2 time: 0.082218 Jun 05 08:27:40.184029 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 701/1368] 10.222.0.33 () {60 vars in 1260 bytes} [Sun Jun 5 08:27:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1527906457 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 05 08:27:40.203847 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fc4ce8f0-de86-4dc8-831b-aabf2876516c tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Action: 'create', calling method: .version_select at 0x7f2445567f70>, body: {"keypair": {"name": "tempest-keypair-1046546757", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1FVcVNUBgJ5holDXWM3u+yhgHcajY3ArlYYLFB43rLp7mcrDrm4MWSj92MJ2DIum7L6nOTtXzykrel7wpaHEvHiO3WJ9iXNtimpc/AJl9UB4U/IJajW4ooZYjw5ifbAw=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:40.223080 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-fc4ce8f0-de86-4dc8-831b-aabf2876516c tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Getting quotas for project 2365775e7b2643479810036e8794df9e. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:27:40.229461 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-fc4ce8f0-de86-4dc8-831b-aabf2876516c tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Getting quotas for user 4feb28d5c0a64216b2a8b77572da0506 and project 2365775e7b2643479810036e8794df9e. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:27:40.282266 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fc4ce8f0-de86-4dc8-831b-aabf2876516c tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.087704 Jun 05 08:27:40.288604 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 702/1369] 10.222.0.33 () {62 vars in 1198 bytes} [Sun Jun 5 08:27:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 94 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 05 08:27:40.299113 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9daeaa08-9907-499c-879e-0db7f09562db tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:40.299678 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9daeaa08-9907-499c-879e-0db7f09562db tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:40.320439 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9daeaa08-9907-499c-879e-0db7f09562db tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:40.320895 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9daeaa08-9907-499c-879e-0db7f09562db tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:40.321682 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9daeaa08-9907-499c-879e-0db7f09562db tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:40.323717 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9daeaa08-9907-499c-879e-0db7f09562db tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:40.374676 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b85fbf91-e61e-4f1a-b515-31d2de0374c6 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:40.382610 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:40.394830 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9daeaa08-9907-499c-879e-0db7f09562db tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:40.395282 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9daeaa08-9907-499c-879e-0db7f09562db tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:40.395689 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-9daeaa08-9907-499c-879e-0db7f09562db tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:40.399131 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b85fbf91-e61e-4f1a-b515-31d2de0374c6 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c" status: 200 len: 1472 microversion: 2.1 time: 0.430026 Jun 05 08:27:40.418173 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 668/1370] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:39 2022] GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c => generated 1472 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:40.432911 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c2a3cd7c-77a2-4ff8-bb14-1fa44817acc0 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Calling method '.version_select at 0x7f2433969040>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:40.497608 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9daeaa08-9907-499c-879e-0db7f09562db tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:40.501614 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c2a3cd7c-77a2-4ff8-bb14-1fa44817acc0 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1046546757" status: 204 len: 0 microversion: 2.2 time: 0.081998 Jun 05 08:27:40.502739 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 669/1371] 10.222.0.33 () {60 vars in 1260 bytes} [Sun Jun 5 08:27:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1046546757 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:27:40.514728 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2e6f7f2b-dcf1-4a64-a023-40b00c8a42b4 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Action: 'create', calling method: .version_select at 0x7f243386caf0>, body: {"keypair": {"name": "tempest-keypair-372018337", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:40.527576 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9daeaa08-9907-499c-879e-0db7f09562db tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.235759 Jun 05 08:27:40.529239 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 703/1372] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:40 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:40.546951 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=41 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:40.555270 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-2e6f7f2b-dcf1-4a64-a023-40b00c8a42b4 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Getting quotas for project 2365775e7b2643479810036e8794df9e. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:27:40.571050 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-2e6f7f2b-dcf1-4a64-a023-40b00c8a42b4 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Getting quotas for user 4feb28d5c0a64216b2a8b77572da0506 and project 2365775e7b2643479810036e8794df9e. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:27:40.606402 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5a15f6c5-e780-468e-8d38-16b6a86d502f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:40.607680 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5a15f6c5-e780-468e-8d38-16b6a86d502f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:40.626005 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a15f6c5-e780-468e-8d38-16b6a86d502f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:40.627060 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a15f6c5-e780-468e-8d38-16b6a86d502f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:40.628260 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a15f6c5-e780-468e-8d38-16b6a86d502f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:40.628757 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2e6f7f2b-dcf1-4a64-a023-40b00c8a42b4 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.118806 Jun 05 08:27:40.629118 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a15f6c5-e780-468e-8d38-16b6a86d502f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:40.630361 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 670/1373] 10.222.0.33 () {62 vars in 1198 bytes} [Sun Jun 5 08:27:40 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 121 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Jun 05 08:27:40.648382 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-965aad96-541a-4c8d-9442-085634bc681a tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Calling method '.version_select at 0x7f243386c4c0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:40.678824 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-965aad96-541a-4c8d-9442-085634bc681a tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-372018337" status: 204 len: 0 microversion: 2.2 time: 0.040508 Jun 05 08:27:40.681322 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 671/1374] 10.222.0.33 () {60 vars in 1257 bytes} [Sun Jun 5 08:27:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-372018337 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:27:40.704416 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c449e644-1526-44fc-83ec-635bf1b09fb9 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Action: 'create', calling method: .version_select at 0x7f2433969550>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-963177855", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5+PyBHTjDIda/a2v/aoc6azAn65XskDPqSP2mm6cPRP94Hrb9JkpD/R/85A50TLjXxSuyu3bnAKRX4tcwb8YebmN6t8JbGEaoEzDp4Br9QV89pSVzLRWx/pb4e2KfkmQ=="}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:40.738862 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-c449e644-1526-44fc-83ec-635bf1b09fb9 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Getting quotas for project 2365775e7b2643479810036e8794df9e. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:27:40.751571 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-c449e644-1526-44fc-83ec-635bf1b09fb9 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Getting quotas for user 4feb28d5c0a64216b2a8b77572da0506 and project 2365775e7b2643479810036e8794df9e. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:27:40.804687 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c449e644-1526-44fc-83ec-635bf1b09fb9 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.114645 Jun 05 08:27:40.814594 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 672/1375] 10.222.0.33 () {62 vars in 1198 bytes} [Sun Jun 5 08:27:40 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 05 08:27:40.820778 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4ade3bc4-f7cb-4e1f-bb09-003c21a925fc tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Action: 'create', calling method: .version_select at 0x7f2433873040>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1897529370", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRt3vS/LAnlHixwXmZnI5/rj7rJsZElQRotJklW7FLlMnLKXn+jJUWMUYr0EtehuF0WzvFamGdXVFv59+2yaBY1hOXgfqUBjm8anczRAwks5Y8G/bN1G5onX6JLr7K1Gg=="}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:40.859671 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-4ade3bc4-f7cb-4e1f-bb09-003c21a925fc tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Getting quotas for project 2365775e7b2643479810036e8794df9e. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:27:40.879760 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-4ade3bc4-f7cb-4e1f-bb09-003c21a925fc tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Getting quotas for user 4feb28d5c0a64216b2a8b77572da0506 and project 2365775e7b2643479810036e8794df9e. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:27:40.926484 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:40.945125 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4ade3bc4-f7cb-4e1f-bb09-003c21a925fc tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.129095 Jun 05 08:27:40.949036 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 673/1376] 10.222.0.33 () {62 vars in 1198 bytes} [Sun Jun 5 08:27:40 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 132 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 05 08:27:40.971796 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fddc6ef3-c6a8-4fb1-acbd-4047a00dbcbb tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Action: 'create', calling method: .version_select at 0x7f2433873af0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-255422147", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAe1Gsnk7twrX+iChvgCYrMhzuWb4gUh1mptKg/pfkZ2FpDTs/QoellR11m0J/mVW9ImGoQeKHgCKESXGjpYgeTVu7G+BIpjKttsac8Jp+MBX+8cuqKEjJYsuYxvTF1sw=="}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:40.999171 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-fddc6ef3-c6a8-4fb1-acbd-4047a00dbcbb tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Getting quotas for project 2365775e7b2643479810036e8794df9e. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:27:41.006042 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-fddc6ef3-c6a8-4fb1-acbd-4047a00dbcbb tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Getting quotas for user 4feb28d5c0a64216b2a8b77572da0506 and project 2365775e7b2643479810036e8794df9e. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:27:41.019555 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5a15f6c5-e780-468e-8d38-16b6a86d502f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:41.029586 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5a15f6c5-e780-468e-8d38-16b6a86d502f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:41.034532 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5a15f6c5-e780-468e-8d38-16b6a86d502f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:41.039558 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5a15f6c5-e780-468e-8d38-16b6a86d502f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1740 microversion: 2.20 time: 0.438666 Jun 05 08:27:41.044455 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 704/1377] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:40 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1740 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:27:41.053767 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fddc6ef3-c6a8-4fb1-acbd-4047a00dbcbb tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.096066 Jun 05 08:27:41.054933 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 674/1378] 10.222.0.33 () {62 vars in 1198 bytes} [Sun Jun 5 08:27:40 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 98 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 05 08:27:41.059409 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d6e388ec-c1f6-4249-98bc-bbb20670023f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:41.064831 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d6e388ec-c1f6-4249-98bc-bbb20670023f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:41.071875 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1fcea6df-3596-4917-bd38-cd4bc032f152 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Calling method '.version_select at 0x7f24339a9d30>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:41.084861 n-d-844739-1 devstack@n-api.service[119050]: WARNING oslo_db.sqlalchemy.utils [None req-1fcea6df-3596-4917-bd38-cd4bc032f152 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 05 08:27:41.087685 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d6e388ec-c1f6-4249-98bc-bbb20670023f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:41.088727 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d6e388ec-c1f6-4249-98bc-bbb20670023f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:41.090447 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d6e388ec-c1f6-4249-98bc-bbb20670023f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:41.091091 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d6e388ec-c1f6-4249-98bc-bbb20670023f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:41.097367 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1fcea6df-3596-4917-bd38-cd4bc032f152 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.035361 Jun 05 08:27:41.107627 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 675/1379] 10.222.0.33 () {60 vars in 1176 bytes} [Sun Jun 5 08:27:41 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:41.112672 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-279fbc22-238f-4ee8-bda0-734ce463c865 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Calling method '.version_select at 0x7f2433bca1f0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:41.159875 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-279fbc22-238f-4ee8-bda0-734ce463c865 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-255422147" status: 204 len: 0 microversion: 2.2 time: 0.050990 Jun 05 08:27:41.160696 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 676/1380] 10.222.0.33 () {60 vars in 1317 bytes} [Sun Jun 5 08:27:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-255422147 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:27:41.173653 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-daae367b-11e9-41a7-95b8-38fa5e35a642 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Calling method '.version_select at 0x7f2433861160>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:41.215802 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-daae367b-11e9-41a7-95b8-38fa5e35a642 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1897529370" status: 204 len: 0 microversion: 2.2 time: 0.046014 Jun 05 08:27:41.222585 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 677/1381] 10.222.0.33 () {60 vars in 1320 bytes} [Sun Jun 5 08:27:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1897529370 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:27:41.233959 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1af564f4-2279-47ac-9013-19de83cb2cc7 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Calling method '.version_select at 0x7f243396ddc0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:41.278721 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1af564f4-2279-47ac-9013-19de83cb2cc7 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-963177855" status: 204 len: 0 microversion: 2.2 time: 0.048585 Jun 05 08:27:41.281148 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 678/1382] 10.222.0.33 () {60 vars in 1317 bytes} [Sun Jun 5 08:27:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-963177855 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:27:41.299106 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2fb1b4ae-9e46-4e77-8355-781df69a9a92 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Action: 'create', calling method: .version_select at 0x7f24336c2af0>, body: {"keypair": {"name": "tempest-keypair-997886334", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPC0QFXf9jV+cQgC+/gLb4GnFZpI1ktQta6/ciOlb/OfTkVY7cPujoXHrv0ZqgWkJVwqDO0WDAQCWq0ozfn2iCW2oetgQZViio1kiK/mlrWMYtLg8tG/8QXE3+0XTaIdBA=="}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:41.318881 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-2fb1b4ae-9e46-4e77-8355-781df69a9a92 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Getting quotas for project 2365775e7b2643479810036e8794df9e. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:27:41.328128 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-2fb1b4ae-9e46-4e77-8355-781df69a9a92 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Getting quotas for user 4feb28d5c0a64216b2a8b77572da0506 and project 2365775e7b2643479810036e8794df9e. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:27:41.361733 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2fb1b4ae-9e46-4e77-8355-781df69a9a92 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.070273 Jun 05 08:27:41.361733 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 679/1383] 10.222.0.33 () {62 vars in 1198 bytes} [Sun Jun 5 08:27:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Jun 05 08:27:41.374736 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-815ab5c6-e296-418c-87ce-56d7dd6fd664 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Calling method '.version_select at 0x7f2433592e50>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:41.385068 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-815ab5c6-e296-418c-87ce-56d7dd6fd664 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-997886334" status: 200 len: 512 microversion: 2.2 time: 0.015394 Jun 05 08:27:41.386628 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 680/1384] 10.222.0.33 () {60 vars in 1254 bytes} [Sun Jun 5 08:27:41 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-997886334 => generated 512 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:41.405671 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d6e388ec-c1f6-4249-98bc-bbb20670023f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:41.406849 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-603619b0-304e-443f-8893-d10b428d019b tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Calling method '.version_select at 0x7f2433873c10>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:41.418936 n-d-844739-1 devstack@n-api.service[119050]: WARNING oslo_db.sqlalchemy.utils [None req-603619b0-304e-443f-8893-d10b428d019b tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 05 08:27:41.420154 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d6e388ec-c1f6-4249-98bc-bbb20670023f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:41.422164 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d6e388ec-c1f6-4249-98bc-bbb20670023f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:41.423586 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d6e388ec-c1f6-4249-98bc-bbb20670023f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe" status: 200 len: 1360 microversion: 2.26 time: 0.377687 Jun 05 08:27:41.424735 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 705/1385] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:41 2022] GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe => generated 1360 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:41.436169 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-41f3de4e-a14d-4c46-854f-1e4b9c4b8b7c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:41.441640 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-41f3de4e-a14d-4c46-854f-1e4b9c4b8b7c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 789255b3-7097-4ac9-897d-71da8910700c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:41.448650 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-603619b0-304e-443f-8893-d10b428d019b tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.054763 Jun 05 08:27:41.455356 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 681/1386] 10.222.0.33 () {60 vars in 1176 bytes} [Sun Jun 5 08:27:41 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:41.458838 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-41f3de4e-a14d-4c46-854f-1e4b9c4b8b7c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:41.459488 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-41f3de4e-a14d-4c46-854f-1e4b9c4b8b7c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:41.461477 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-41f3de4e-a14d-4c46-854f-1e4b9c4b8b7c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:41.466106 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-41f3de4e-a14d-4c46-854f-1e4b9c4b8b7c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:41.478620 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b9327eb7-96e3-4e52-bc50-b2dcc9643fb7 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Calling method '.version_select at 0x7f24339a93a0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:41.524922 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b9327eb7-96e3-4e52-bc50-b2dcc9643fb7 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-997886334" status: 204 len: 0 microversion: 2.2 time: 0.060602 Jun 05 08:27:41.524922 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 682/1387] 10.222.0.33 () {60 vars in 1257 bytes} [Sun Jun 5 08:27:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-997886334 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:27:41.553466 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-46b2b653-60fc-4fb3-be49-28e72fb78682 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Action: 'create', calling method: .version_select at 0x7f2433bca1f0>, body: {"keypair": {"name": "tempest-keypair-832194003", "type": "x509"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:41.590176 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-46b2b653-60fc-4fb3-be49-28e72fb78682 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Getting quotas for project 2365775e7b2643479810036e8794df9e. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:27:41.602964 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-46b2b653-60fc-4fb3-be49-28e72fb78682 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Getting quotas for user 4feb28d5c0a64216b2a8b77572da0506 and project 2365775e7b2643479810036e8794df9e. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:27:41.658451 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.processutils [None req-46b2b653-60fc-4fb3-be49-28e72fb78682 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpi0ka0v6l/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpi0ka0v6l/temp.key -subj /CN=4feb28d5c0a64216b2a8b77572da0506 -extensions v3_req_client {{(pid=119050) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 05 08:27:41.899516 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-41f3de4e-a14d-4c46-854f-1e4b9c4b8b7c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:41.921830 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-41f3de4e-a14d-4c46-854f-1e4b9c4b8b7c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c" status: 200 len: 1472 microversion: 2.1 time: 0.495777 Jun 05 08:27:41.931406 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 706/1388] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:41 2022] GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c => generated 1472 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:41.935153 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-813766c1-7c25-4c1f-8a09-7d0f912066c5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:41.935771 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-813766c1-7c25-4c1f-8a09-7d0f912066c5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:41.963671 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-813766c1-7c25-4c1f-8a09-7d0f912066c5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:41.977923 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-813766c1-7c25-4c1f-8a09-7d0f912066c5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:41.983790 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-813766c1-7c25-4c1f-8a09-7d0f912066c5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:41.986360 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-813766c1-7c25-4c1f-8a09-7d0f912066c5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:42.090035 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-813766c1-7c25-4c1f-8a09-7d0f912066c5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:42.094850 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-813766c1-7c25-4c1f-8a09-7d0f912066c5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:42.096643 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-813766c1-7c25-4c1f-8a09-7d0f912066c5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:42.179290 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-813766c1-7c25-4c1f-8a09-7d0f912066c5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:42.204384 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-813766c1-7c25-4c1f-8a09-7d0f912066c5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.271525 Jun 05 08:27:42.217604 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 707/1389] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:41 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:42.255511 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9aede2f3-b8ec-4ab3-87dd-be204b2fa52f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:42.257077 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9aede2f3-b8ec-4ab3-87dd-be204b2fa52f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:42.280694 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9aede2f3-b8ec-4ab3-87dd-be204b2fa52f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:42.281180 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9aede2f3-b8ec-4ab3-87dd-be204b2fa52f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:42.282033 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9aede2f3-b8ec-4ab3-87dd-be204b2fa52f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:42.282480 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9aede2f3-b8ec-4ab3-87dd-be204b2fa52f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:42.538482 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.processutils [None req-46b2b653-60fc-4fb3-be49-28e72fb78682 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpi0ka0v6l/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpi0ka0v6l/temp.key -subj /CN=4feb28d5c0a64216b2a8b77572da0506 -extensions v3_req_client" returned: 0 in 0.880s {{(pid=119050) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 05 08:27:42.540025 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.processutils [None req-46b2b653-60fc-4fb3-be49-28e72fb78682 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpi0ka0v6l/temp.key -password pass: {{(pid=119050) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 05 08:27:42.598382 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.processutils [None req-46b2b653-60fc-4fb3-be49-28e72fb78682 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpi0ka0v6l/temp.key -password pass:" returned: 0 in 0.058s {{(pid=119050) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 05 08:27:42.688561 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-46b2b653-60fc-4fb3-be49-28e72fb78682 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Getting quotas for project 2365775e7b2643479810036e8794df9e. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:27:42.697619 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-46b2b653-60fc-4fb3-be49-28e72fb78682 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Getting quotas for user 4feb28d5c0a64216b2a8b77572da0506 and project 2365775e7b2643479810036e8794df9e. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:27:42.742171 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-46b2b653-60fc-4fb3-be49-28e72fb78682 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 1.203048 Jun 05 08:27:42.752705 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 683/1390] 10.222.0.33 () {62 vars in 1197 bytes} [Sun Jun 5 08:27:41 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 1220 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:27:42.767449 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-e57a59d7-3d15-4ac3-9688-38c99ca3d549 req-f178d3b6-80e8-44da-b7d2-a8473775ec0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "789255b3-7097-4ac9-897d-71da8910700c", "name": "network-vif-deleted", "tag": "480f2e74-6e36-4e1f-a0d5-0499a40cd88a"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:42.802098 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-e57a59d7-3d15-4ac3-9688-38c99ca3d549 req-f178d3b6-80e8-44da-b7d2-a8473775ec0d service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:42.802590 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-e57a59d7-3d15-4ac3-9688-38c99ca3d549 req-f178d3b6-80e8-44da-b7d2-a8473775ec0d service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:42.809587 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9aede2f3-b8ec-4ab3-87dd-be204b2fa52f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:42.832199 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9aede2f3-b8ec-4ab3-87dd-be204b2fa52f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:42.833906 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9aede2f3-b8ec-4ab3-87dd-be204b2fa52f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:42.835208 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9aede2f3-b8ec-4ab3-87dd-be204b2fa52f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1740 microversion: 2.20 time: 0.613900 Jun 05 08:27:42.862307 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 708/1391] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:42 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1740 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:42.867785 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bff3681b-ad8a-48e3-b3e5-a917ba476a9e tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:42.873684 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-e57a59d7-3d15-4ac3-9688-38c99ca3d549 req-f178d3b6-80e8-44da-b7d2-a8473775ec0d service nova] Creating event network-vif-deleted:480f2e74-6e36-4e1f-a0d5-0499a40cd88a for instance 789255b3-7097-4ac9-897d-71da8910700c on n-h1-844739-1 Jun 05 08:27:42.874667 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-bff3681b-ad8a-48e3-b3e5-a917ba476a9e tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:42.886633 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-e57a59d7-3d15-4ac3-9688-38c99ca3d549 req-f178d3b6-80e8-44da-b7d2-a8473775ec0d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132204 Jun 05 08:27:42.890939 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bff3681b-ad8a-48e3-b3e5-a917ba476a9e tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:42.892163 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 684/1392] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:42.896693 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bff3681b-ad8a-48e3-b3e5-a917ba476a9e tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:42.898457 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bff3681b-ad8a-48e3-b3e5-a917ba476a9e tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:42.899115 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bff3681b-ad8a-48e3-b3e5-a917ba476a9e tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:42.905097 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-43045e7f-bb21-42e8-833d-d36299f192ac tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Calling method '.version_select at 0x7f24339691f0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:42.931672 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-43045e7f-bb21-42e8-833d-d36299f192ac tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-832194003" status: 200 len: 1533 microversion: 2.2 time: 0.037877 Jun 05 08:27:42.937950 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 685/1393] 10.222.0.33 () {60 vars in 1254 bytes} [Sun Jun 5 08:27:42 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-832194003 => generated 1533 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:42.939022 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4e0e9a16-839b-4ebb-b8dc-06e1945cf329 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:42.939829 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4e0e9a16-839b-4ebb-b8dc-06e1945cf329 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 789255b3-7097-4ac9-897d-71da8910700c] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:42.957067 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4e0e9a16-839b-4ebb-b8dc-06e1945cf329 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:42.957558 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4e0e9a16-839b-4ebb-b8dc-06e1945cf329 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:42.958370 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4e0e9a16-839b-4ebb-b8dc-06e1945cf329 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:42.958816 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4e0e9a16-839b-4ebb-b8dc-06e1945cf329 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:43.035250 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=23 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:43.038963 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4e0e9a16-839b-4ebb-b8dc-06e1945cf329 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:43.039427 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4e0e9a16-839b-4ebb-b8dc-06e1945cf329 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:43.040530 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-4e0e9a16-839b-4ebb-b8dc-06e1945cf329 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lazy-loading 'fault' on Instance uuid 789255b3-7097-4ac9-897d-71da8910700c {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:43.277884 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4e0e9a16-839b-4ebb-b8dc-06e1945cf329 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:43.287476 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4e0e9a16-839b-4ebb-b8dc-06e1945cf329 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c" status: 200 len: 1361 microversion: 2.1 time: 0.352362 Jun 05 08:27:43.292938 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 686/1394] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:42 2022] GET /compute/v2.1/servers/789255b3-7097-4ac9-897d-71da8910700c => generated 1361 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:43.305127 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2dccbf2b-b0d5-426b-9cb1-04cdf663a95b tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Calling method '.version_select at 0x7f2433861940>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:43.310599 n-d-844739-1 devstack@n-api.service[119050]: WARNING oslo_db.sqlalchemy.utils [None req-2dccbf2b-b0d5-426b-9cb1-04cdf663a95b tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 05 08:27:43.343724 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2dccbf2b-b0d5-426b-9cb1-04cdf663a95b tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.042210 Jun 05 08:27:43.349757 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 687/1395] 10.222.0.33 () {60 vars in 1176 bytes} [Sun Jun 5 08:27:43 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:43.364051 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-bd603fce-da90-4840-b0b3-b1fab7e32a79 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:43.366760 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-bd603fce-da90-4840-b0b3-b1fab7e32a79 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:43.383004 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bd603fce-da90-4840-b0b3-b1fab7e32a79 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:43.383465 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bd603fce-da90-4840-b0b3-b1fab7e32a79 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:43.386614 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-bff3681b-ad8a-48e3-b3e5-a917ba476a9e tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:43.391552 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bd603fce-da90-4840-b0b3-b1fab7e32a79 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:43.392058 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bd603fce-da90-4840-b0b3-b1fab7e32a79 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:43.402780 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-bff3681b-ad8a-48e3-b3e5-a917ba476a9e tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:43.404887 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-bff3681b-ad8a-48e3-b3e5-a917ba476a9e tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:43.412400 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bff3681b-ad8a-48e3-b3e5-a917ba476a9e tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe" status: 200 len: 1360 microversion: 2.26 time: 0.548481 Jun 05 08:27:43.413653 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 709/1396] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:42 2022] GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe => generated 1360 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:43.476271 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1ec2ce7f-cb75-4f4e-a0bd-8d7d3117e352 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:43.477154 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1ec2ce7f-cb75-4f4e-a0bd-8d7d3117e352 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 4210ab7f-0e7d-4e20-ba9b-9869c01c92ae] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:43.492067 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bd603fce-da90-4840-b0b3-b1fab7e32a79 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:43.496691 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bd603fce-da90-4840-b0b3-b1fab7e32a79 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:43.497245 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-bd603fce-da90-4840-b0b3-b1fab7e32a79 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:43.535748 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ec2ce7f-cb75-4f4e-a0bd-8d7d3117e352 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:43.536468 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ec2ce7f-cb75-4f4e-a0bd-8d7d3117e352 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:43.537625 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ec2ce7f-cb75-4f4e-a0bd-8d7d3117e352 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:43.541814 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ec2ce7f-cb75-4f4e-a0bd-8d7d3117e352 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:43.603106 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-bd603fce-da90-4840-b0b3-b1fab7e32a79 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:43.613443 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-bd603fce-da90-4840-b0b3-b1fab7e32a79 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.266540 Jun 05 08:27:43.621603 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 688/1397] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:43 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:43.623374 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1ec2ce7f-cb75-4f4e-a0bd-8d7d3117e352 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 4210ab7f-0e7d-4e20-ba9b-9869c01c92ae] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:27:43.628194 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-735f5bec-1bba-43bb-995e-7c35a2f07e96 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] Calling method '.version_select at 0x7f243396d8b0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:43.706500 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-735f5bec-1bba-43bb-995e-7c35a2f07e96 tempest-KeyPairsV22TestJSON-1677662681 tempest-KeyPairsV22TestJSON-1677662681-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-832194003" status: 204 len: 0 microversion: 2.2 time: 0.081439 Jun 05 08:27:43.710622 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 689/1398] 10.222.0.33 () {60 vars in 1257 bytes} [Sun Jun 5 08:27:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-832194003 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:27:43.817346 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1ec2ce7f-cb75-4f4e-a0bd-8d7d3117e352 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae" status: 204 len: 0 microversion: 2.1 time: 0.401423 Jun 05 08:27:43.824664 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 710/1399] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:27:43 2022] DELETE /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:27:43.832267 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b1d82d74-83a5-4e54-a481-3c6bacad9f2c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:43.832906 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b1d82d74-83a5-4e54-a481-3c6bacad9f2c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 4210ab7f-0e7d-4e20-ba9b-9869c01c92ae] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:43.843058 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b1d82d74-83a5-4e54-a481-3c6bacad9f2c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:43.843959 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b1d82d74-83a5-4e54-a481-3c6bacad9f2c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:43.844333 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b1d82d74-83a5-4e54-a481-3c6bacad9f2c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:43.844904 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b1d82d74-83a5-4e54-a481-3c6bacad9f2c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:43.872180 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-163c621c-9515-40ee-a123-e5b2dd030c2e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:43.873826 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-163c621c-9515-40ee-a123-e5b2dd030c2e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:43.902966 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-163c621c-9515-40ee-a123-e5b2dd030c2e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:43.905380 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-163c621c-9515-40ee-a123-e5b2dd030c2e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:43.908461 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-163c621c-9515-40ee-a123-e5b2dd030c2e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:43.910474 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-163c621c-9515-40ee-a123-e5b2dd030c2e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:44.192619 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b1d82d74-83a5-4e54-a481-3c6bacad9f2c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:44.209883 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b1d82d74-83a5-4e54-a481-3c6bacad9f2c tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae" status: 200 len: 1472 microversion: 2.1 time: 0.384888 Jun 05 08:27:44.219904 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 690/1400] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:43 2022] GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae => generated 1472 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:44.286541 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-163c621c-9515-40ee-a123-e5b2dd030c2e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:44.300371 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-163c621c-9515-40ee-a123-e5b2dd030c2e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:44.303754 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-163c621c-9515-40ee-a123-e5b2dd030c2e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:44.305578 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-163c621c-9515-40ee-a123-e5b2dd030c2e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1740 microversion: 2.20 time: 0.439839 Jun 05 08:27:44.307227 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 711/1401] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:43 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1740 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:27:44.437554 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cf9732ca-f474-4a64-a055-884c81becbaf tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:44.438268 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-cf9732ca-f474-4a64-a055-884c81becbaf tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:44.466647 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cf9732ca-f474-4a64-a055-884c81becbaf tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:44.468316 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cf9732ca-f474-4a64-a055-884c81becbaf tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:44.474700 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cf9732ca-f474-4a64-a055-884c81becbaf tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:44.476490 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cf9732ca-f474-4a64-a055-884c81becbaf tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:44.631057 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b8298b51-fa5a-4d1f-ba18-eb48f1c0234c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:44.631790 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b8298b51-fa5a-4d1f-ba18-eb48f1c0234c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:44.642620 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b8298b51-fa5a-4d1f-ba18-eb48f1c0234c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:44.643384 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b8298b51-fa5a-4d1f-ba18-eb48f1c0234c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:44.645066 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b8298b51-fa5a-4d1f-ba18-eb48f1c0234c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:44.645717 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b8298b51-fa5a-4d1f-ba18-eb48f1c0234c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:44.714093 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b8298b51-fa5a-4d1f-ba18-eb48f1c0234c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:44.716179 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b8298b51-fa5a-4d1f-ba18-eb48f1c0234c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:44.719132 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-b8298b51-fa5a-4d1f-ba18-eb48f1c0234c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:44.812802 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b8298b51-fa5a-4d1f-ba18-eb48f1c0234c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:44.822250 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b8298b51-fa5a-4d1f-ba18-eb48f1c0234c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.195393 Jun 05 08:27:44.825975 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 712/1402] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:44 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:27:44.854634 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-cf9732ca-f474-4a64-a055-884c81becbaf tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:44.865712 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-cf9732ca-f474-4a64-a055-884c81becbaf tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:44.868400 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-cf9732ca-f474-4a64-a055-884c81becbaf tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:44.870472 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-cf9732ca-f474-4a64-a055-884c81becbaf tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe" status: 200 len: 1360 microversion: 2.26 time: 0.443646 Jun 05 08:27:44.871268 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 691/1403] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:44 2022] GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe => generated 1360 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:44.925319 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-a82df31a-a60f-48b3-b5d4-caf1f28b36bc req-c45cd255-7f7b-425e-91a5-328226e7cb57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b642042-766c-4ca0-beda-ff29645bc2fe", "tag": "5cda64e7-f7fd-4236-8aea-356b93e7253d"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:44.939576 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-a82df31a-a60f-48b3-b5d4-caf1f28b36bc req-c45cd255-7f7b-425e-91a5-328226e7cb57 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:44.946096 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-a82df31a-a60f-48b3-b5d4-caf1f28b36bc req-c45cd255-7f7b-425e-91a5-328226e7cb57 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:45.001673 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-a82df31a-a60f-48b3-b5d4-caf1f28b36bc req-c45cd255-7f7b-425e-91a5-328226e7cb57 service nova] Creating event network-changed:5cda64e7-f7fd-4236-8aea-356b93e7253d for instance 6b642042-766c-4ca0-beda-ff29645bc2fe on n-h1-844739-1 Jun 05 08:27:45.009674 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-a82df31a-a60f-48b3-b5d4-caf1f28b36bc req-c45cd255-7f7b-425e-91a5-328226e7cb57 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091046 Jun 05 08:27:45.011068 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 713/1404] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:45.228611 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-93683f06-fc54-40cc-a3e2-d67eee2b5413 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:45.230197 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-93683f06-fc54-40cc-a3e2-d67eee2b5413 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 4210ab7f-0e7d-4e20-ba9b-9869c01c92ae] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:45.237816 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-93683f06-fc54-40cc-a3e2-d67eee2b5413 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:45.250333 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-93683f06-fc54-40cc-a3e2-d67eee2b5413 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:45.253091 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-93683f06-fc54-40cc-a3e2-d67eee2b5413 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:45.253640 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-93683f06-fc54-40cc-a3e2-d67eee2b5413 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:45.330952 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1f71a4dd-4383-4802-a518-1a23d7a699a2 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:45.332227 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1f71a4dd-4383-4802-a518-1a23d7a699a2 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:45.364295 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1f71a4dd-4383-4802-a518-1a23d7a699a2 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:45.367803 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1f71a4dd-4383-4802-a518-1a23d7a699a2 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:45.370286 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1f71a4dd-4383-4802-a518-1a23d7a699a2 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:45.374322 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1f71a4dd-4383-4802-a518-1a23d7a699a2 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:45.752766 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-1f71a4dd-4383-4802-a518-1a23d7a699a2 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:45.761405 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-1f71a4dd-4383-4802-a518-1a23d7a699a2 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:45.762918 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-1f71a4dd-4383-4802-a518-1a23d7a699a2 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:45.768595 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1f71a4dd-4383-4802-a518-1a23d7a699a2 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1722 microversion: 2.20 time: 0.442319 Jun 05 08:27:45.786093 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 714/1405] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:45 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1722 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:45.868515 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-125fd964-081b-4aa9-8307-f212140be7b6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:45.877840 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-125fd964-081b-4aa9-8307-f212140be7b6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:45.892713 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-125fd964-081b-4aa9-8307-f212140be7b6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:45.893440 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-125fd964-081b-4aa9-8307-f212140be7b6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:45.894375 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-125fd964-081b-4aa9-8307-f212140be7b6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:45.895104 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-125fd964-081b-4aa9-8307-f212140be7b6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:45.971251 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-93683f06-fc54-40cc-a3e2-d67eee2b5413 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:45.982902 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-93683f06-fc54-40cc-a3e2-d67eee2b5413 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae" status: 200 len: 1472 microversion: 2.1 time: 0.759786 Jun 05 08:27:45.993051 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 692/1406] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:45 2022] GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae => generated 1472 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:46.027655 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-63116ccc-af6e-404e-9d26-fb0369fdb0d9 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:46.033283 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-63116ccc-af6e-404e-9d26-fb0369fdb0d9 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:46.063121 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-63116ccc-af6e-404e-9d26-fb0369fdb0d9 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:46.065378 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-63116ccc-af6e-404e-9d26-fb0369fdb0d9 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:46.067185 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-63116ccc-af6e-404e-9d26-fb0369fdb0d9 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:46.071799 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-125fd964-081b-4aa9-8307-f212140be7b6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:46.072911 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-63116ccc-af6e-404e-9d26-fb0369fdb0d9 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:46.082192 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-125fd964-081b-4aa9-8307-f212140be7b6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:46.089814 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-125fd964-081b-4aa9-8307-f212140be7b6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:46.347171 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-125fd964-081b-4aa9-8307-f212140be7b6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:46.360763 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:46.364646 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-125fd964-081b-4aa9-8307-f212140be7b6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.522421 Jun 05 08:27:46.370247 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 715/1407] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:45 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:46.787995 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c353e660-62a0-4737-9895-22d7dbb5537d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:46.788662 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c353e660-62a0-4737-9895-22d7dbb5537d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:46.809000 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-63116ccc-af6e-404e-9d26-fb0369fdb0d9 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:46.817171 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c353e660-62a0-4737-9895-22d7dbb5537d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:46.817653 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c353e660-62a0-4737-9895-22d7dbb5537d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:46.818500 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c353e660-62a0-4737-9895-22d7dbb5537d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:46.818946 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c353e660-62a0-4737-9895-22d7dbb5537d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:46.821760 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-63116ccc-af6e-404e-9d26-fb0369fdb0d9 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:46.823866 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-63116ccc-af6e-404e-9d26-fb0369fdb0d9 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:46.838980 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-63116ccc-af6e-404e-9d26-fb0369fdb0d9 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe" status: 200 len: 1360 microversion: 2.26 time: 0.843718 Jun 05 08:27:46.841160 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 693/1408] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:45 2022] GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe => generated 1360 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:47.143129 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-242caa59-a64c-4d7e-92db-37203fa4032a tempest-AbsoluteLimitsNegativeTestJSON-1800561669 tempest-AbsoluteLimitsNegativeTestJSON-1800561669-project] Calling method '.version_select at 0x7f2433969670>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:47.170231 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-242caa59-a64c-4d7e-92db-37203fa4032a tempest-AbsoluteLimitsNegativeTestJSON-1800561669 tempest-AbsoluteLimitsNegativeTestJSON-1800561669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:47.170939 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-242caa59-a64c-4d7e-92db-37203fa4032a tempest-AbsoluteLimitsNegativeTestJSON-1800561669 tempest-AbsoluteLimitsNegativeTestJSON-1800561669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:47.172346 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-242caa59-a64c-4d7e-92db-37203fa4032a tempest-AbsoluteLimitsNegativeTestJSON-1800561669 tempest-AbsoluteLimitsNegativeTestJSON-1800561669-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:47.172986 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-242caa59-a64c-4d7e-92db-37203fa4032a tempest-AbsoluteLimitsNegativeTestJSON-1800561669 tempest-AbsoluteLimitsNegativeTestJSON-1800561669-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:47.219892 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=91,nova_api:DELETE=5 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:47.223674 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-242caa59-a64c-4d7e-92db-37203fa4032a tempest-AbsoluteLimitsNegativeTestJSON-1800561669 tempest-AbsoluteLimitsNegativeTestJSON-1800561669-project] 10.222.0.33 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.379690 Jun 05 08:27:47.224812 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 694/1409] 10.222.0.33 () {58 vars in 1121 bytes} [Sun Jun 5 08:27:46 2022] GET /compute/v2.1/limits => generated 511 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:47.233920 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-258b7256-6598-4670-b1c2-117c0e0280a2 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:47.235135 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-258b7256-6598-4670-b1c2-117c0e0280a2 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 4210ab7f-0e7d-4e20-ba9b-9869c01c92ae] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:47.247441 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-258b7256-6598-4670-b1c2-117c0e0280a2 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:47.248161 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-258b7256-6598-4670-b1c2-117c0e0280a2 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:47.249444 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-258b7256-6598-4670-b1c2-117c0e0280a2 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:47.250050 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-258b7256-6598-4670-b1c2-117c0e0280a2 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:47.479647 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-258b7256-6598-4670-b1c2-117c0e0280a2 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:47.493787 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-258b7256-6598-4670-b1c2-117c0e0280a2 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae" status: 200 len: 1430 microversion: 2.1 time: 0.267176 Jun 05 08:27:47.506055 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 695/1410] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:47 2022] GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae => generated 1430 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:47.517091 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-abf5a465-cb02-4f22-b422-3bb200050d5c tempest-AbsoluteLimitsNegativeTestJSON-1800561669 tempest-AbsoluteLimitsNegativeTestJSON-1800561669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1967198848", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:47.602111 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-abf5a465-cb02-4f22-b422-3bb200050d5c tempest-AbsoluteLimitsNegativeTestJSON-1800561669 tempest-AbsoluteLimitsNegativeTestJSON-1800561669-project] validate_networks() for None {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:27:47.715542 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c353e660-62a0-4737-9895-22d7dbb5537d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:47.731650 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c353e660-62a0-4737-9895-22d7dbb5537d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:47.731998 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c353e660-62a0-4737-9895-22d7dbb5537d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:47.733172 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c353e660-62a0-4737-9895-22d7dbb5537d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1722 microversion: 2.20 time: 0.949219 Jun 05 08:27:47.740192 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 716/1411] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:46 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1722 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:47.751322 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4a352e1e-dcc9-4c60-9727-67c6879704fd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:47.752012 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4a352e1e-dcc9-4c60-9727-67c6879704fd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:47.762443 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4a352e1e-dcc9-4c60-9727-67c6879704fd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:47.764675 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4a352e1e-dcc9-4c60-9727-67c6879704fd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:47.768752 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4a352e1e-dcc9-4c60-9727-67c6879704fd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:47.770325 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4a352e1e-dcc9-4c60-9727-67c6879704fd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:47.812716 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4a352e1e-dcc9-4c60-9727-67c6879704fd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:47.814199 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4a352e1e-dcc9-4c60-9727-67c6879704fd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:47.814666 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-4a352e1e-dcc9-4c60-9727-67c6879704fd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:48.020860 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4a352e1e-dcc9-4c60-9727-67c6879704fd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:48.051160 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4a352e1e-dcc9-4c60-9727-67c6879704fd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.309471 Jun 05 08:27:48.057707 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 717/1412] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:47 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:48.148661 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-abf5a465-cb02-4f22-b422-3bb200050d5c tempest-AbsoluteLimitsNegativeTestJSON-1800561669 tempest-AbsoluteLimitsNegativeTestJSON-1800561669-project] Getting quotas for project 68f13eca84fa4042b679652c6dc6176b. Resources: dict_keys(['metadata_items']) {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:27:48.158281 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-abf5a465-cb02-4f22-b422-3bb200050d5c tempest-AbsoluteLimitsNegativeTestJSON-1800561669 tempest-AbsoluteLimitsNegativeTestJSON-1800561669-project] Getting quotas for user 49ccc9fd21aa424f922bc24f646046d9 and project 68f13eca84fa4042b679652c6dc6176b. Resources: dict_keys(['metadata_items']) {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:27:48.185837 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-abf5a465-cb02-4f22-b422-3bb200050d5c tempest-AbsoluteLimitsNegativeTestJSON-1800561669 tempest-AbsoluteLimitsNegativeTestJSON-1800561669-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-abf5a465-cb02-4f22-b422-3bb200050d5c tempest-AbsoluteLimitsNegativeTestJSON-1800561669 tempest-AbsoluteLimitsNegativeTestJSON-1800561669-project] Request method failure captured: Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 1752 Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGkCB18O5KL5_2gzle5orNbyzS7HDRNzEzDE_UKI97P9oGTvrrImdtm4GpGk2RPynS_nPNRe_z8RSQE8jHd2v9LzcsbrcUw5or_zPP4BA296bvlWFNTZTNtuBPMkAWshTbWYpklo892wIs15qGvMxEZpi243eNl09bc3paWTLZvfTl0 Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 68f13eca84fa4042b679652c6dc6176b Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1800561669 Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/68f13eca84fa4042b679652c6dc6176b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/68f13eca84fa4042b679652c6dc6176b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_68f13eca84fa4042b679652c6dc6176b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/68f13eca84fa4042b679652c6dc6176b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1800561669 Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 68f13eca84fa4042b679652c6dc6176b Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1800561669 Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1800561669-project Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 49ccc9fd21aa424f922bc24f646046d9 Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1800561669-project Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1967198848", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:27:48.194979 n-d-844739-1 devstack@n-api.service[119050]: exception: Maximum number of metadata items exceeds 128 Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1967198848', 'imageRef': '1241bde3-ef1f-41a5-b0fa-6f409216229a', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:27:48.197418 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:27:48.202306 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:27:48.202306 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 05 08:27:48.202306 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 05 08:27:48.202306 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 05 08:27:48.202306 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jun 05 08:27:48.202306 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:27:48.202306 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:27:48.202306 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:27:48.202306 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:27:48.202306 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:27:48.202306 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:27:48.202306 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:27:48.202306 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:27:48.202306 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jun 05 08:27:48.202306 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:27:48.209725 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-abf5a465-cb02-4f22-b422-3bb200050d5c tempest-AbsoluteLimitsNegativeTestJSON-1800561669 tempest-AbsoluteLimitsNegativeTestJSON-1800561669-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:27:48.212579 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-abf5a465-cb02-4f22-b422-3bb200050d5c tempest-AbsoluteLimitsNegativeTestJSON-1800561669 tempest-AbsoluteLimitsNegativeTestJSON-1800561669-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.704867 Jun 05 08:27:48.215460 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 696/1413] 10.222.0.33 () {60 vars in 1147 bytes} [Sun Jun 5 08:27:47 2022] POST /compute/v2.1/servers => generated 87 bytes in 708 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:27:48.229488 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-f191b582-2ac3-4b69-9f99-109bab63371a req-849fe92d-c083-411c-b98c-4c659bfe9119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4210ab7f-0e7d-4e20-ba9b-9869c01c92ae", "name": "network-vif-deleted", "tag": "c96022c4-72c8-4057-ae15-32029528ca3e"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:48.232579 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-190f2c64-ba37-40b3-8a82-7dd5a74034e1 tempest-FloatingIPsTestJSON-211719245 tempest-FloatingIPsTestJSON-211719245-project] Action: 'create', calling method: .version_select at 0x7f243379daf0>, body: {"pool": null} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:48.245790 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-f191b582-2ac3-4b69-9f99-109bab63371a req-849fe92d-c083-411c-b98c-4c659bfe9119 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:48.246432 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-f191b582-2ac3-4b69-9f99-109bab63371a req-849fe92d-c083-411c-b98c-4c659bfe9119 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:48.257873 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-f191b582-2ac3-4b69-9f99-109bab63371a req-849fe92d-c083-411c-b98c-4c659bfe9119 service nova] Creating event network-vif-deleted:c96022c4-72c8-4057-ae15-32029528ca3e for instance 4210ab7f-0e7d-4e20-ba9b-9869c01c92ae on n-h2-844739-1 Jun 05 08:27:48.266787 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-f191b582-2ac3-4b69-9f99-109bab63371a req-849fe92d-c083-411c-b98c-4c659bfe9119 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045688 Jun 05 08:27:48.268332 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 697/1414] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:48.274886 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-bf1b3538-e238-47d5-99bc-e91356f2271f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:48.277160 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-bf1b3538-e238-47d5-99bc-e91356f2271f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:48.284207 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bf1b3538-e238-47d5-99bc-e91356f2271f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:48.284853 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bf1b3538-e238-47d5-99bc-e91356f2271f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:48.285794 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bf1b3538-e238-47d5-99bc-e91356f2271f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:48.286710 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bf1b3538-e238-47d5-99bc-e91356f2271f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:48.596258 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-bf1b3538-e238-47d5-99bc-e91356f2271f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:48.607478 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-bf1b3538-e238-47d5-99bc-e91356f2271f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:48.611846 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-bf1b3538-e238-47d5-99bc-e91356f2271f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:48.616766 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-bf1b3538-e238-47d5-99bc-e91356f2271f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe" status: 200 len: 1360 microversion: 2.26 time: 0.345539 Jun 05 08:27:48.618421 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 698/1415] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:48 2022] GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe => generated 1360 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:48.626461 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-442a9121-6ea7-4048-be03-320b393e662b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:48.627295 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-442a9121-6ea7-4048-be03-320b393e662b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 4210ab7f-0e7d-4e20-ba9b-9869c01c92ae] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:48.644072 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-442a9121-6ea7-4048-be03-320b393e662b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:48.648079 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-442a9121-6ea7-4048-be03-320b393e662b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:48.653327 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-442a9121-6ea7-4048-be03-320b393e662b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:48.656793 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-442a9121-6ea7-4048-be03-320b393e662b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:48.706361 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-442a9121-6ea7-4048-be03-320b393e662b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:48.707285 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-442a9121-6ea7-4048-be03-320b393e662b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:48.708788 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-442a9121-6ea7-4048-be03-320b393e662b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lazy-loading 'fault' on Instance uuid 4210ab7f-0e7d-4e20-ba9b-9869c01c92ae {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:48.769176 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-442a9121-6ea7-4048-be03-320b393e662b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:48.778440 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-442a9121-6ea7-4048-be03-320b393e662b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae" status: 200 len: 1362 microversion: 2.1 time: 0.158501 Jun 05 08:27:48.791813 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 699/1416] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:48 2022] GET /compute/v2.1/servers/4210ab7f-0e7d-4e20-ba9b-9869c01c92ae => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:48.798625 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a7de8eb7-8920-4222-860d-ef3531defd27 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:48.799681 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a7de8eb7-8920-4222-860d-ef3531defd27 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:48.807494 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a7de8eb7-8920-4222-860d-ef3531defd27 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:48.808158 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a7de8eb7-8920-4222-860d-ef3531defd27 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:48.809390 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a7de8eb7-8920-4222-860d-ef3531defd27 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:48.811795 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a7de8eb7-8920-4222-860d-ef3531defd27 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:49.091079 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a7de8eb7-8920-4222-860d-ef3531defd27 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:49.104654 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a7de8eb7-8920-4222-860d-ef3531defd27 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:49.106936 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a7de8eb7-8920-4222-860d-ef3531defd27 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:49.108451 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a7de8eb7-8920-4222-860d-ef3531defd27 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1722 microversion: 2.20 time: 0.315293 Jun 05 08:27:49.115353 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 700/1417] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:48 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1722 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:49.122660 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-be1a0fe4-30ae-4f06-98ed-575845f098ae tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:49.123190 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-be1a0fe4-30ae-4f06-98ed-575845f098ae tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 698ff3cb-adbd-40f3-92e8-5106c2ef6268] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:49.129650 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-be1a0fe4-30ae-4f06-98ed-575845f098ae tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:49.130455 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-be1a0fe4-30ae-4f06-98ed-575845f098ae tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:49.131656 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-be1a0fe4-30ae-4f06-98ed-575845f098ae tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:49.132498 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-be1a0fe4-30ae-4f06-98ed-575845f098ae tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:49.164683 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-be1a0fe4-30ae-4f06-98ed-575845f098ae tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 698ff3cb-adbd-40f3-92e8-5106c2ef6268] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:27:49.364999 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-be1a0fe4-30ae-4f06-98ed-575845f098ae tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "DELETE /compute/v2.1/servers/698ff3cb-adbd-40f3-92e8-5106c2ef6268" status: 204 len: 0 microversion: 2.1 time: 0.246973 Jun 05 08:27:49.366279 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 701/1418] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:27:49 2022] DELETE /compute/v2.1/servers/698ff3cb-adbd-40f3-92e8-5106c2ef6268 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:27:49.381995 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-05be8aeb-aca4-4692-b97e-4f8fb6aad5c7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:49.384677 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-05be8aeb-aca4-4692-b97e-4f8fb6aad5c7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:49.398617 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-05be8aeb-aca4-4692-b97e-4f8fb6aad5c7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:49.399083 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-05be8aeb-aca4-4692-b97e-4f8fb6aad5c7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:49.402324 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-05be8aeb-aca4-4692-b97e-4f8fb6aad5c7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:49.402784 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-05be8aeb-aca4-4692-b97e-4f8fb6aad5c7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:49.459063 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-05be8aeb-aca4-4692-b97e-4f8fb6aad5c7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:49.459563 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-05be8aeb-aca4-4692-b97e-4f8fb6aad5c7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:49.460023 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-05be8aeb-aca4-4692-b97e-4f8fb6aad5c7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:49.534237 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-05be8aeb-aca4-4692-b97e-4f8fb6aad5c7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:49.547417 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-05be8aeb-aca4-4692-b97e-4f8fb6aad5c7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.178701 Jun 05 08:27:49.548033 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 702/1419] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:49 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:49.557092 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f647bad3-a886-401c-b285-b67ac5ae9693 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:49.557247 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f647bad3-a886-401c-b285-b67ac5ae9693 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 698ff3cb-adbd-40f3-92e8-5106c2ef6268] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:49.564031 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f647bad3-a886-401c-b285-b67ac5ae9693 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:49.564650 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f647bad3-a886-401c-b285-b67ac5ae9693 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:49.565796 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f647bad3-a886-401c-b285-b67ac5ae9693 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:49.566833 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f647bad3-a886-401c-b285-b67ac5ae9693 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:49.607783 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:49.852793 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f647bad3-a886-401c-b285-b67ac5ae9693 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:49.874187 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f647bad3-a886-401c-b285-b67ac5ae9693 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/698ff3cb-adbd-40f3-92e8-5106c2ef6268" status: 200 len: 1473 microversion: 2.1 time: 0.319715 Jun 05 08:27:49.880411 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 703/1420] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:49 2022] GET /compute/v2.1/servers/698ff3cb-adbd-40f3-92e8-5106c2ef6268 => generated 1473 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:49.888354 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f4bfac70-f176-4fd6-b3f1-8f0031a9cc1b tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:49.889286 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f4bfac70-f176-4fd6-b3f1-8f0031a9cc1b tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:49.896868 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f4bfac70-f176-4fd6-b3f1-8f0031a9cc1b tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:49.897763 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f4bfac70-f176-4fd6-b3f1-8f0031a9cc1b tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:49.898763 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f4bfac70-f176-4fd6-b3f1-8f0031a9cc1b tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:49.899315 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f4bfac70-f176-4fd6-b3f1-8f0031a9cc1b tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:50.210064 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f4bfac70-f176-4fd6-b3f1-8f0031a9cc1b tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:50.229751 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f4bfac70-f176-4fd6-b3f1-8f0031a9cc1b tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:50.233670 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f4bfac70-f176-4fd6-b3f1-8f0031a9cc1b tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:50.237880 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f4bfac70-f176-4fd6-b3f1-8f0031a9cc1b tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe" status: 200 len: 1360 microversion: 2.26 time: 0.354569 Jun 05 08:27:50.238738 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=7 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:50.239262 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 704/1421] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:49 2022] GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe => generated 1360 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:50.254071 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1f1cc8ad-4612-46b5-b067-5225d7c91973 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:50.256910 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1f1cc8ad-4612-46b5-b067-5225d7c91973 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:50.267032 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1f1cc8ad-4612-46b5-b067-5225d7c91973 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:50.267758 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1f1cc8ad-4612-46b5-b067-5225d7c91973 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:50.268840 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1f1cc8ad-4612-46b5-b067-5225d7c91973 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:50.269508 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1f1cc8ad-4612-46b5-b067-5225d7c91973 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:50.357846 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-190f2c64-ba37-40b3-8a82-7dd5a74034e1 tempest-FloatingIPsTestJSON-211719245 tempest-FloatingIPsTestJSON-211719245-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.298876 Jun 05 08:27:50.359065 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 718/1422] 10.222.0.33 () {60 vars in 1169 bytes} [Sun Jun 5 08:27:48 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:50.365109 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-df0e6447-484c-4f4f-ba6a-84661c109159 req-7df432ce-5485-414b-9f07-30dfc0918843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b271002d-4613-405c-aeed-7c06b205a045", "name": "network-vif-unplugged", "status": "completed", "tag": "642e2803-a706-408c-b7c4-6157cb18ee50"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:50.399257 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-df0e6447-484c-4f4f-ba6a-84661c109159 req-7df432ce-5485-414b-9f07-30dfc0918843 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:50.399700 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-df0e6447-484c-4f4f-ba6a-84661c109159 req-7df432ce-5485-414b-9f07-30dfc0918843 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:50.426221 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-df0e6447-484c-4f4f-ba6a-84661c109159 req-7df432ce-5485-414b-9f07-30dfc0918843 service nova] Creating event network-vif-unplugged:642e2803-a706-408c-b7c4-6157cb18ee50 for instance b271002d-4613-405c-aeed-7c06b205a045 on n-h2-844739-1 Jun 05 08:27:50.435812 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-df0e6447-484c-4f4f-ba6a-84661c109159 req-7df432ce-5485-414b-9f07-30dfc0918843 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074904 Jun 05 08:27:50.437067 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 719/1423] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:50.443381 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e3ba4781-af60-4f8f-bdd8-6c11941c2401 tempest-FloatingIPsTestJSON-211719245 tempest-FloatingIPsTestJSON-211719245-project] Calling method '.version_select at 0x7f24337d2c10>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:50.990542 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1f1cc8ad-4612-46b5-b067-5225d7c91973 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:51.001284 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1f1cc8ad-4612-46b5-b067-5225d7c91973 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:51.002107 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1f1cc8ad-4612-46b5-b067-5225d7c91973 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:51.003310 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1f1cc8ad-4612-46b5-b067-5225d7c91973 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1722 microversion: 2.20 time: 0.761271 Jun 05 08:27:51.019834 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 705/1424] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:50 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1722 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:51.038527 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-72ffdb5e-71a9-49c6-9bfa-aaa24e6c6d85 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:51.040433 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-72ffdb5e-71a9-49c6-9bfa-aaa24e6c6d85 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:51.070095 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-72ffdb5e-71a9-49c6-9bfa-aaa24e6c6d85 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:51.080405 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-72ffdb5e-71a9-49c6-9bfa-aaa24e6c6d85 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:51.082540 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-72ffdb5e-71a9-49c6-9bfa-aaa24e6c6d85 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:51.083187 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-72ffdb5e-71a9-49c6-9bfa-aaa24e6c6d85 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:51.133622 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-72ffdb5e-71a9-49c6-9bfa-aaa24e6c6d85 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:51.134355 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-72ffdb5e-71a9-49c6-9bfa-aaa24e6c6d85 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:51.138855 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-72ffdb5e-71a9-49c6-9bfa-aaa24e6c6d85 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:51.426493 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e3ba4781-af60-4f8f-bdd8-6c11941c2401 tempest-FloatingIPsTestJSON-211719245 tempest-FloatingIPsTestJSON-211719245-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/21dc9e26-8120-4812-93d6-c628369ab7a2" status: 200 len: 141 microversion: 2.1 time: 0.987767 Jun 05 08:27:51.427820 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-72ffdb5e-71a9-49c6-9bfa-aaa24e6c6d85 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:51.429061 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 720/1425] 10.222.0.33 () {58 vars in 1259 bytes} [Sun Jun 5 08:27:50 2022] GET /compute/v2.1/os-floating-ips/21dc9e26-8120-4812-93d6-c628369ab7a2 => generated 141 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:51.434927 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e4e24c24-b69b-4855-b795-5f65145a7f07 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:51.439462 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e4e24c24-b69b-4855-b795-5f65145a7f07 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 698ff3cb-adbd-40f3-92e8-5106c2ef6268] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:51.441700 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-72ffdb5e-71a9-49c6-9bfa-aaa24e6c6d85 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.419849 Jun 05 08:27:51.451981 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 706/1426] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:51 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:51.455297 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e4e24c24-b69b-4855-b795-5f65145a7f07 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:51.455977 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e4e24c24-b69b-4855-b795-5f65145a7f07 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:51.456984 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e4e24c24-b69b-4855-b795-5f65145a7f07 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:51.457726 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e4e24c24-b69b-4855-b795-5f65145a7f07 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:51.461902 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ab287b93-bbb6-4b82-841c-d7d1454c4a66 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:51.462931 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ab287b93-bbb6-4b82-841c-d7d1454c4a66 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:51.471870 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ab287b93-bbb6-4b82-841c-d7d1454c4a66 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:51.472997 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ab287b93-bbb6-4b82-841c-d7d1454c4a66 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:51.474580 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ab287b93-bbb6-4b82-841c-d7d1454c4a66 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:51.475526 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ab287b93-bbb6-4b82-841c-d7d1454c4a66 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:52.043944 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e4e24c24-b69b-4855-b795-5f65145a7f07 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:52.051347 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ab287b93-bbb6-4b82-841c-d7d1454c4a66 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:52.052970 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e4e24c24-b69b-4855-b795-5f65145a7f07 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/698ff3cb-adbd-40f3-92e8-5106c2ef6268" status: 200 len: 1473 microversion: 2.1 time: 0.622842 Jun 05 08:27:52.053558 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 721/1427] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:51 2022] GET /compute/v2.1/servers/698ff3cb-adbd-40f3-92e8-5106c2ef6268 => generated 1473 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:52.064661 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8d691acc-8cec-4266-a895-24242c9c4cf2 tempest-FloatingIPsTestJSON-211719245 tempest-FloatingIPsTestJSON-211719245-project] Calling method '.version_select at 0x7f24337d23a0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:52.078518 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ab287b93-bbb6-4b82-841c-d7d1454c4a66 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:52.084117 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ab287b93-bbb6-4b82-841c-d7d1454c4a66 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:52.085595 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ab287b93-bbb6-4b82-841c-d7d1454c4a66 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe" status: 200 len: 1360 microversion: 2.26 time: 0.632286 Jun 05 08:27:52.087757 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 707/1428] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:51 2022] GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe => generated 1360 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:52.093602 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0f5cddf7-df55-41fe-83c9-57e5833bdc69 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:52.094425 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0f5cddf7-df55-41fe-83c9-57e5833bdc69 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:52.104910 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0f5cddf7-df55-41fe-83c9-57e5833bdc69 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:52.105646 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0f5cddf7-df55-41fe-83c9-57e5833bdc69 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:52.106784 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0f5cddf7-df55-41fe-83c9-57e5833bdc69 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:52.107565 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0f5cddf7-df55-41fe-83c9-57e5833bdc69 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:52.643272 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0f5cddf7-df55-41fe-83c9-57e5833bdc69 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:52.661158 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0f5cddf7-df55-41fe-83c9-57e5833bdc69 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:52.662670 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0f5cddf7-df55-41fe-83c9-57e5833bdc69 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:52.663859 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0f5cddf7-df55-41fe-83c9-57e5833bdc69 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1665 microversion: 2.20 time: 0.574800 Jun 05 08:27:52.676070 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 708/1429] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:52 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1665 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:52.676070 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e445aafe-f8fc-40e6-9228-3aaa4d49251b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:52.676070 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e445aafe-f8fc-40e6-9228-3aaa4d49251b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:52.702512 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8d691acc-8cec-4266-a895-24242c9c4cf2 tempest-FloatingIPsTestJSON-211719245 tempest-FloatingIPsTestJSON-211719245-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.647611 Jun 05 08:27:52.709051 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 722/1430] 10.222.0.33 () {58 vars in 1148 bytes} [Sun Jun 5 08:27:52 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:52.709051 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-34ff3007-cad0-44d7-a5a3-111c6331709d req-bba5df62-2d82-4e54-b3da-18cc67673e83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b642042-766c-4ca0-beda-ff29645bc2fe", "name": "network-vif-plugged", "status": "completed", "tag": "5cda64e7-f7fd-4236-8aea-356b93e7253d"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:52.712251 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e445aafe-f8fc-40e6-9228-3aaa4d49251b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:52.713237 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e445aafe-f8fc-40e6-9228-3aaa4d49251b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:52.714032 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e445aafe-f8fc-40e6-9228-3aaa4d49251b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:52.714467 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e445aafe-f8fc-40e6-9228-3aaa4d49251b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:52.723928 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-34ff3007-cad0-44d7-a5a3-111c6331709d req-bba5df62-2d82-4e54-b3da-18cc67673e83 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:52.724779 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-34ff3007-cad0-44d7-a5a3-111c6331709d req-bba5df62-2d82-4e54-b3da-18cc67673e83 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:52.738311 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-34ff3007-cad0-44d7-a5a3-111c6331709d req-bba5df62-2d82-4e54-b3da-18cc67673e83 service nova] Creating event network-vif-plugged:5cda64e7-f7fd-4236-8aea-356b93e7253d for instance 6b642042-766c-4ca0-beda-ff29645bc2fe on n-h1-844739-1 Jun 05 08:27:52.744880 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-34ff3007-cad0-44d7-a5a3-111c6331709d req-bba5df62-2d82-4e54-b3da-18cc67673e83 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040190 Jun 05 08:27:52.746012 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 723/1431] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:52.754421 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2cd07d00-dc26-46ad-a68b-5bbb03c6a62b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a0352fb-91e0-46a6-8586-9d9e3a766056"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:52.755973 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2cd07d00-dc26-46ad-a68b-5bbb03c6a62b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:52.765301 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2cd07d00-dc26-46ad-a68b-5bbb03c6a62b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:52.766008 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2cd07d00-dc26-46ad-a68b-5bbb03c6a62b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:52.767029 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2cd07d00-dc26-46ad-a68b-5bbb03c6a62b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:52.767688 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2cd07d00-dc26-46ad-a68b-5bbb03c6a62b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:52.782355 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e445aafe-f8fc-40e6-9228-3aaa4d49251b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:52.782805 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e445aafe-f8fc-40e6-9228-3aaa4d49251b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:52.783270 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-e445aafe-f8fc-40e6-9228-3aaa4d49251b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:52.878507 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e445aafe-f8fc-40e6-9228-3aaa4d49251b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:52.890239 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e445aafe-f8fc-40e6-9228-3aaa4d49251b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.224384 Jun 05 08:27:52.905371 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 709/1432] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:52 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:52.936468 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d09f54d8-662c-41c8-98ea-de560a88413a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:52.937302 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d09f54d8-662c-41c8-98ea-de560a88413a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:52.974716 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d09f54d8-662c-41c8-98ea-de560a88413a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:52.976832 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d09f54d8-662c-41c8-98ea-de560a88413a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:52.979902 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d09f54d8-662c-41c8-98ea-de560a88413a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:52.980686 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d09f54d8-662c-41c8-98ea-de560a88413a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:53.378821 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-d09f54d8-662c-41c8-98ea-de560a88413a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lazy-loading 'services' on Instance uuid 5d031b21-37d5-4454-bed7-db50a225bce5 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:53.400631 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d09f54d8-662c-41c8-98ea-de560a88413a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 2128 microversion: 2.25 time: 0.492899 Jun 05 08:27:53.402514 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 710/1433] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:52 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 2128 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:53.418884 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2fa41c64-bc3a-400a-8494-273bd0483857 tempest-FloatingIPsTestJSON-211719245 tempest-FloatingIPsTestJSON-211719245-project] Calling method '.version_select at 0x7f2433a22e50>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:53.487487 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2cd07d00-dc26-46ad-a68b-5bbb03c6a62b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "POST /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.738779 Jun 05 08:27:53.490643 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 724/1434] 10.222.0.33 () {62 vars in 1363 bytes} [Sun Jun 5 08:27:52 2022] POST /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments => generated 188 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:27:53.504720 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5158e4b8-1029-4b6e-abd6-d41cbdb8a887 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:53.506159 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5158e4b8-1029-4b6e-abd6-d41cbdb8a887 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 698ff3cb-adbd-40f3-92e8-5106c2ef6268] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:53.537844 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5158e4b8-1029-4b6e-abd6-d41cbdb8a887 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:53.539528 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5158e4b8-1029-4b6e-abd6-d41cbdb8a887 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:53.542065 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5158e4b8-1029-4b6e-abd6-d41cbdb8a887 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:53.543478 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5158e4b8-1029-4b6e-abd6-d41cbdb8a887 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:53.699272 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5158e4b8-1029-4b6e-abd6-d41cbdb8a887 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:53.701565 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5158e4b8-1029-4b6e-abd6-d41cbdb8a887 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:53.702821 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-5158e4b8-1029-4b6e-abd6-d41cbdb8a887 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lazy-loading 'fault' on Instance uuid 698ff3cb-adbd-40f3-92e8-5106c2ef6268 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:53.822482 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5158e4b8-1029-4b6e-abd6-d41cbdb8a887 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:53.841741 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5158e4b8-1029-4b6e-abd6-d41cbdb8a887 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/698ff3cb-adbd-40f3-92e8-5106c2ef6268" status: 200 len: 1368 microversion: 2.1 time: 0.348744 Jun 05 08:27:53.843695 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 725/1435] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:53 2022] GET /compute/v2.1/servers/698ff3cb-adbd-40f3-92e8-5106c2ef6268 => generated 1368 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:53.861862 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7259d956-3b8b-4cfb-a160-47313e7e35d7 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:53.862767 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7259d956-3b8b-4cfb-a160-47313e7e35d7 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:53.899647 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7259d956-3b8b-4cfb-a160-47313e7e35d7 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:53.902021 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7259d956-3b8b-4cfb-a160-47313e7e35d7 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:53.903217 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7259d956-3b8b-4cfb-a160-47313e7e35d7 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:53.903676 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7259d956-3b8b-4cfb-a160-47313e7e35d7 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:54.251114 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7259d956-3b8b-4cfb-a160-47313e7e35d7 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:54.269633 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7259d956-3b8b-4cfb-a160-47313e7e35d7 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:54.278100 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7259d956-3b8b-4cfb-a160-47313e7e35d7 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:54.281063 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7259d956-3b8b-4cfb-a160-47313e7e35d7 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe" status: 200 len: 1360 microversion: 2.26 time: 0.435081 Jun 05 08:27:54.283332 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 726/1436] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:53 2022] GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe => generated 1360 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:54.292498 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-a0552f6d-c07e-4c71-9304-6eba5a61b4ef req-40649d2a-482a-42b2-829f-b1dd4819c202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698ff3cb-adbd-40f3-92e8-5106c2ef6268", "name": "network-vif-deleted", "tag": "b97f6282-a66c-4ac6-a237-2d0f246eb96f"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:54.340475 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-a0552f6d-c07e-4c71-9304-6eba5a61b4ef req-40649d2a-482a-42b2-829f-b1dd4819c202 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:54.343472 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-a0552f6d-c07e-4c71-9304-6eba5a61b4ef req-40649d2a-482a-42b2-829f-b1dd4819c202 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:54.399936 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-a0552f6d-c07e-4c71-9304-6eba5a61b4ef req-40649d2a-482a-42b2-829f-b1dd4819c202 service nova] Creating event network-vif-deleted:b97f6282-a66c-4ac6-a237-2d0f246eb96f for instance 698ff3cb-adbd-40f3-92e8-5106c2ef6268 on n-h2-844739-1 Jun 05 08:27:54.407486 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-a0552f6d-c07e-4c71-9304-6eba5a61b4ef req-40649d2a-482a-42b2-829f-b1dd4819c202 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121235 Jun 05 08:27:54.409067 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 727/1437] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:54.419875 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-df1b491c-0168-452c-a133-51c9742ae866 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-844739-1", "block_migration": "auto"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:54.425286 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-df1b491c-0168-452c-a133-51c9742ae866 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:54.451857 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-df1b491c-0168-452c-a133-51c9742ae866 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:54.452332 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-df1b491c-0168-452c-a133-51c9742ae866 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:54.453111 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-df1b491c-0168-452c-a133-51c9742ae866 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:54.453549 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-df1b491c-0168-452c-a133-51c9742ae866 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:54.512676 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-df1b491c-0168-452c-a133-51c9742ae866 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lazy-loading 'flavor' on Instance uuid 5d031b21-37d5-4454-bed7-db50a225bce5 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:54.549832 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-df1b491c-0168-452c-a133-51c9742ae866 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Going to try to live migrate instance to n-h2-844739-1 {{(pid=119049) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 05 08:27:54.974651 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2fa41c64-bc3a-400a-8494-273bd0483857 tempest-FloatingIPsTestJSON-211719245 tempest-FloatingIPsTestJSON-211719245-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/21dc9e26-8120-4812-93d6-c628369ab7a2" status: 202 len: 0 microversion: 2.1 time: 1.569658 Jun 05 08:27:54.975301 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 711/1438] 10.222.0.33 () {58 vars in 1262 bytes} [Sun Jun 5 08:27:53 2022] DELETE /compute/v2.1/os-floating-ips/21dc9e26-8120-4812-93d6-c628369ab7a2 => generated 0 bytes in 1572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:27:54.998296 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4c8f0c7d-8712-40ee-97ab-886ce36837f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:54.998900 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4c8f0c7d-8712-40ee-97ab-886ce36837f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:55.015310 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4c8f0c7d-8712-40ee-97ab-886ce36837f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:55.015719 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4c8f0c7d-8712-40ee-97ab-886ce36837f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:55.016545 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4c8f0c7d-8712-40ee-97ab-886ce36837f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:55.016993 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4c8f0c7d-8712-40ee-97ab-886ce36837f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:55.206092 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4c8f0c7d-8712-40ee-97ab-886ce36837f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "POST /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/action" status: 202 len: 0 microversion: 2.20 time: 0.220396 Jun 05 08:27:55.211730 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 712/1439] 10.222.0.33 () {62 vars in 1318 bytes} [Sun Jun 5 08:27:54 2022] POST /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:27:55.234621 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c9e2a3aa-08ba-4438-95c3-6a2a01ba55dd tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:55.235846 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c9e2a3aa-08ba-4438-95c3-6a2a01ba55dd tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 5d6c0691-aa2b-4d7f-b424-2a9129f285bb] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:55.310709 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c9e2a3aa-08ba-4438-95c3-6a2a01ba55dd tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:55.312955 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c9e2a3aa-08ba-4438-95c3-6a2a01ba55dd tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:55.314457 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c9e2a3aa-08ba-4438-95c3-6a2a01ba55dd tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:55.315136 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c9e2a3aa-08ba-4438-95c3-6a2a01ba55dd tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:55.373106 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c9e2a3aa-08ba-4438-95c3-6a2a01ba55dd tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 5d6c0691-aa2b-4d7f-b424-2a9129f285bb] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:27:55.582587 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c9e2a3aa-08ba-4438-95c3-6a2a01ba55dd tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5d6c0691-aa2b-4d7f-b424-2a9129f285bb" status: 204 len: 0 microversion: 2.1 time: 0.366725 Jun 05 08:27:55.583584 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 713/1440] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:27:55 2022] DELETE /compute/v2.1/servers/5d6c0691-aa2b-4d7f-b424-2a9129f285bb => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:27:55.594647 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-be1db72b-691a-44be-be25-6c225469a9d4 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:55.596083 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-be1db72b-691a-44be-be25-6c225469a9d4 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:55.605726 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-be1db72b-691a-44be-be25-6c225469a9d4 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:55.606347 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-be1db72b-691a-44be-be25-6c225469a9d4 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:55.607515 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-be1db72b-691a-44be-be25-6c225469a9d4 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:55.609194 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-be1db72b-691a-44be-be25-6c225469a9d4 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:55.730791 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-be1db72b-691a-44be-be25-6c225469a9d4 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:55.732696 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-be1db72b-691a-44be-be25-6c225469a9d4 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:55.734474 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-be1db72b-691a-44be-be25-6c225469a9d4 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:55.801423 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-be1db72b-691a-44be-be25-6c225469a9d4 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:55.812255 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-be1db72b-691a-44be-be25-6c225469a9d4 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.226536 Jun 05 08:27:55.821684 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 714/1441] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:55 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:27:55.829163 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d569812a-a82b-41af-b835-b11cbea5788b tempest-FloatingIPsTestJSON-211719245 tempest-FloatingIPsTestJSON-211719245-project] Action: 'create', calling method: .version_select at 0x7f244048fdc0>, body: {"pool": null} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:57.188902 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:58.169639 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=33 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:58.257739 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-df1b491c-0168-452c-a133-51c9742ae866 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5/action" status: 202 len: 0 microversion: 2.25 time: 3.846501 Jun 05 08:27:58.259554 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 728/1442] 10.222.0.33 () {62 vars in 1318 bytes} [Sun Jun 5 08:27:54 2022] POST /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5/action => generated 0 bytes in 3850 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:27:58.266119 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-755b614a-87eb-448f-acaa-e39c80269b45 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:58.267021 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-755b614a-87eb-448f-acaa-e39c80269b45 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:58.287072 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-755b614a-87eb-448f-acaa-e39c80269b45 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:58.287893 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-755b614a-87eb-448f-acaa-e39c80269b45 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:58.289005 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-755b614a-87eb-448f-acaa-e39c80269b45 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:58.293468 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-755b614a-87eb-448f-acaa-e39c80269b45 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:59.029901 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d569812a-a82b-41af-b835-b11cbea5788b tempest-FloatingIPsTestJSON-211719245 tempest-FloatingIPsTestJSON-211719245-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.208000 Jun 05 08:27:59.032325 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 715/1443] 10.222.0.33 () {60 vars in 1169 bytes} [Sun Jun 5 08:27:55 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:59.037433 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-11d27a25-dc5e-4d18-a3be-87bdc37ff58e tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:59.038279 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-11d27a25-dc5e-4d18-a3be-87bdc37ff58e tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:59.079327 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-11d27a25-dc5e-4d18-a3be-87bdc37ff58e tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:59.080219 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-11d27a25-dc5e-4d18-a3be-87bdc37ff58e tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:59.104840 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-11d27a25-dc5e-4d18-a3be-87bdc37ff58e tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:59.105337 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-11d27a25-dc5e-4d18-a3be-87bdc37ff58e tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:59.535422 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-11d27a25-dc5e-4d18-a3be-87bdc37ff58e tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:59.549690 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-11d27a25-dc5e-4d18-a3be-87bdc37ff58e tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:59.553136 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-11d27a25-dc5e-4d18-a3be-87bdc37ff58e tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:59.559127 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-11d27a25-dc5e-4d18-a3be-87bdc37ff58e tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe" status: 200 len: 1543 microversion: 2.26 time: 0.526400 Jun 05 08:27:59.560175 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 716/1444] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:59 2022] GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe => generated 1543 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:59.569121 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-75e0cd57-6534-419e-ab4f-6368bebf2223 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:59.578840 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-75e0cd57-6534-419e-ab4f-6368bebf2223 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: fedc49cc-1b5e-4c16-ab6d-da3afb5e567d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:59.592359 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-75e0cd57-6534-419e-ab4f-6368bebf2223 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:59.593722 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-75e0cd57-6534-419e-ab4f-6368bebf2223 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:59.594734 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-75e0cd57-6534-419e-ab4f-6368bebf2223 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:59.596025 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-75e0cd57-6534-419e-ab4f-6368bebf2223 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:59.676311 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-755b614a-87eb-448f-acaa-e39c80269b45 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:59.689667 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-75e0cd57-6534-419e-ab4f-6368bebf2223 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: fedc49cc-1b5e-4c16-ab6d-da3afb5e567d] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:27:59.693271 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-755b614a-87eb-448f-acaa-e39c80269b45 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:59.695022 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-755b614a-87eb-448f-acaa-e39c80269b45 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:27:59.701621 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-755b614a-87eb-448f-acaa-e39c80269b45 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1753 microversion: 2.20 time: 1.437073 Jun 05 08:27:59.701621 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 729/1445] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:58 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1753 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:27:59.725339 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-189e54f5-2fee-4ae0-acb6-350b9b0cfb28 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:59.735998 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-189e54f5-2fee-4ae0-acb6-350b9b0cfb28 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:59.741340 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:27:59.765708 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-189e54f5-2fee-4ae0-acb6-350b9b0cfb28 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:59.766190 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-189e54f5-2fee-4ae0-acb6-350b9b0cfb28 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:59.767148 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-189e54f5-2fee-4ae0-acb6-350b9b0cfb28 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:59.771187 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-189e54f5-2fee-4ae0-acb6-350b9b0cfb28 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:59.861655 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-189e54f5-2fee-4ae0-acb6-350b9b0cfb28 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:59.862678 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-189e54f5-2fee-4ae0-acb6-350b9b0cfb28 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:59.863446 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-189e54f5-2fee-4ae0-acb6-350b9b0cfb28 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:27:59.893788 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-75e0cd57-6534-419e-ab4f-6368bebf2223 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d" status: 204 len: 0 microversion: 2.1 time: 0.331391 Jun 05 08:27:59.895133 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 717/1446] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:27:59 2022] DELETE /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:27:59.903912 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-87975b46-8ef2-4317-af24-db9a66abda23 req-f01c4fe6-ad95-4f04-becc-79614fa8bef8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d6c0691-aa2b-4d7f-b424-2a9129f285bb", "name": "network-vif-deleted", "tag": "53d0d855-1312-418f-bb21-a68f6df44657"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:27:59.913678 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-87975b46-8ef2-4317-af24-db9a66abda23 req-f01c4fe6-ad95-4f04-becc-79614fa8bef8 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:59.914382 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-87975b46-8ef2-4317-af24-db9a66abda23 req-f01c4fe6-ad95-4f04-becc-79614fa8bef8 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:59.928708 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-87975b46-8ef2-4317-af24-db9a66abda23 req-f01c4fe6-ad95-4f04-becc-79614fa8bef8 service nova] Creating event network-vif-deleted:53d0d855-1312-418f-bb21-a68f6df44657 for instance 5d6c0691-aa2b-4d7f-b424-2a9129f285bb on n-h1-844739-1 Jun 05 08:27:59.934673 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-87975b46-8ef2-4317-af24-db9a66abda23 req-f01c4fe6-ad95-4f04-becc-79614fa8bef8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037875 Jun 05 08:27:59.936325 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 718/1447] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:27:59.942573 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2099ee1e-65fb-464c-ba95-05dd34459459 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:27:59.943571 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2099ee1e-65fb-464c-ba95-05dd34459459 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:27:59.959172 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2099ee1e-65fb-464c-ba95-05dd34459459 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:59.959628 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2099ee1e-65fb-464c-ba95-05dd34459459 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:27:59.960602 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2099ee1e-65fb-464c-ba95-05dd34459459 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:27:59.961060 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2099ee1e-65fb-464c-ba95-05dd34459459 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:00.000148 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-189e54f5-2fee-4ae0-acb6-350b9b0cfb28 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:00.013873 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-189e54f5-2fee-4ae0-acb6-350b9b0cfb28 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.313110 Jun 05 08:28:00.014647 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 730/1448] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:27:59 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:00.045937 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fb8d1335-3611-4c34-8561-9fb7d8a6cccc tempest-FloatingIPsTestJSON-211719245 tempest-FloatingIPsTestJSON-211719245-project] Calling method '.version_select at 0x7f243378d790>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:01.021109 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2099ee1e-65fb-464c-ba95-05dd34459459 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:01.037057 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2099ee1e-65fb-464c-ba95-05dd34459459 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:01.040227 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2099ee1e-65fb-464c-ba95-05dd34459459 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:01.042973 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2099ee1e-65fb-464c-ba95-05dd34459459 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 1.105354 Jun 05 08:28:01.046593 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 719/1449] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:27:59 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:01.059670 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-304cb57f-a6b1-420b-b50c-2f57118400ec tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '.version_select at 0x7f2433a22a60>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:01.080833 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-304cb57f-a6b1-420b-b50c-2f57118400ec tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:01.081661 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-304cb57f-a6b1-420b-b50c-2f57118400ec tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:01.082654 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-304cb57f-a6b1-420b-b50c-2f57118400ec tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:01.091053 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-304cb57f-a6b1-420b-b50c-2f57118400ec tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:01.091864 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-304cb57f-a6b1-420b-b50c-2f57118400ec tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:01.092943 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-304cb57f-a6b1-420b-b50c-2f57118400ec tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:01.093611 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-304cb57f-a6b1-420b-b50c-2f57118400ec tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:01.137716 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-304cb57f-a6b1-420b-b50c-2f57118400ec tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:01.138755 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-304cb57f-a6b1-420b-b50c-2f57118400ec tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:01.166206 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-304cb57f-a6b1-420b-b50c-2f57118400ec tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:01.167023 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-304cb57f-a6b1-420b-b50c-2f57118400ec tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:01.219156 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-304cb57f-a6b1-420b-b50c-2f57118400ec tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lazy-loading 'flavor' on Instance uuid 6b642042-766c-4ca0-beda-ff29645bc2fe {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:01.254689 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-304cb57f-a6b1-420b-b50c-2f57118400ec tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "PUT /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags/tempest-tag-1935029504" status: 201 len: 0 microversion: 2.26 time: 0.205242 Jun 05 08:28:01.258815 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 720/1450] 10.222.0.33 () {62 vars in 1379 bytes} [Sun Jun 5 08:28:01 2022] PUT /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags/tempest-tag-1935029504 => generated 0 bytes in 210 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jun 05 08:28:01.273278 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ead967a6-7446-4ea2-8938-f4c6d70d2bb0 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:01.276198 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ead967a6-7446-4ea2-8938-f4c6d70d2bb0 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 5d6c0691-aa2b-4d7f-b424-2a9129f285bb] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:01.292609 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ead967a6-7446-4ea2-8938-f4c6d70d2bb0 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:01.293704 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ead967a6-7446-4ea2-8938-f4c6d70d2bb0 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:01.294753 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ead967a6-7446-4ea2-8938-f4c6d70d2bb0 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:01.295275 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ead967a6-7446-4ea2-8938-f4c6d70d2bb0 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:01.362114 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ead967a6-7446-4ea2-8938-f4c6d70d2bb0 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:01.365301 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ead967a6-7446-4ea2-8938-f4c6d70d2bb0 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:01.366680 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-ead967a6-7446-4ea2-8938-f4c6d70d2bb0 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lazy-loading 'fault' on Instance uuid 5d6c0691-aa2b-4d7f-b424-2a9129f285bb {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:01.676933 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ead967a6-7446-4ea2-8938-f4c6d70d2bb0 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:01.706386 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ead967a6-7446-4ea2-8938-f4c6d70d2bb0 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/5d6c0691-aa2b-4d7f-b424-2a9129f285bb" status: 200 len: 1363 microversion: 2.1 time: 0.445151 Jun 05 08:28:01.710561 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 721/1451] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:01 2022] GET /compute/v2.1/servers/5d6c0691-aa2b-4d7f-b424-2a9129f285bb => generated 1363 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:01.724730 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2b773d38-4645-4e9f-8f60-02f7067fc34a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:01.725897 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2b773d38-4645-4e9f-8f60-02f7067fc34a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:01.733507 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2b773d38-4645-4e9f-8f60-02f7067fc34a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:01.734050 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2b773d38-4645-4e9f-8f60-02f7067fc34a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:01.735255 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2b773d38-4645-4e9f-8f60-02f7067fc34a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:01.735766 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2b773d38-4645-4e9f-8f60-02f7067fc34a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:02.146906 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2b773d38-4645-4e9f-8f60-02f7067fc34a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:02.157224 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2b773d38-4645-4e9f-8f60-02f7067fc34a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:02.158758 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2b773d38-4645-4e9f-8f60-02f7067fc34a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:02.159960 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2b773d38-4645-4e9f-8f60-02f7067fc34a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1753 microversion: 2.20 time: 0.446283 Jun 05 08:28:02.168811 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 722/1452] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:01 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1753 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:02.173914 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-84db2626-0c2e-49b4-98e0-3ed1adc93b30 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:02.174547 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-84db2626-0c2e-49b4-98e0-3ed1adc93b30 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:02.196301 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-84db2626-0c2e-49b4-98e0-3ed1adc93b30 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:02.196809 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-84db2626-0c2e-49b4-98e0-3ed1adc93b30 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:02.197819 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-84db2626-0c2e-49b4-98e0-3ed1adc93b30 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:02.198308 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-84db2626-0c2e-49b4-98e0-3ed1adc93b30 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:02.259748 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-84db2626-0c2e-49b4-98e0-3ed1adc93b30 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:02.260245 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-84db2626-0c2e-49b4-98e0-3ed1adc93b30 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:02.260713 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-84db2626-0c2e-49b4-98e0-3ed1adc93b30 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:02.367583 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-84db2626-0c2e-49b4-98e0-3ed1adc93b30 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:02.384643 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-84db2626-0c2e-49b4-98e0-3ed1adc93b30 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.214472 Jun 05 08:28:02.393958 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 723/1453] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:02 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:02.402018 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6d509c30-c4ca-4d08-b1c8-bf7d2761f680 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '.version_select at 0x7f2433aebf70>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:02.404434 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:28:02.414523 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6d509c30-c4ca-4d08-b1c8-bf7d2761f680 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:02.414987 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6d509c30-c4ca-4d08-b1c8-bf7d2761f680 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:02.445102 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6d509c30-c4ca-4d08-b1c8-bf7d2761f680 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags/tempest-tag-1935029504" status: 204 len: 0 microversion: 2.26 time: 0.058032 Jun 05 08:28:02.454120 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 724/1454] 10.222.0.33 () {60 vars in 1360 bytes} [Sun Jun 5 08:28:02 2022] GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags/tempest-tag-1935029504 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:28:02.470177 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c8ea5207-a0d8-4b1f-8f97-3569ee9c5d54 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:02.470813 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c8ea5207-a0d8-4b1f-8f97-3569ee9c5d54 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:02.477932 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c8ea5207-a0d8-4b1f-8f97-3569ee9c5d54 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:02.478829 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c8ea5207-a0d8-4b1f-8f97-3569ee9c5d54 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:02.479756 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c8ea5207-a0d8-4b1f-8f97-3569ee9c5d54 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:02.480244 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c8ea5207-a0d8-4b1f-8f97-3569ee9c5d54 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:03.298993 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c8ea5207-a0d8-4b1f-8f97-3569ee9c5d54 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:03.315994 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c8ea5207-a0d8-4b1f-8f97-3569ee9c5d54 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:03.319267 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c8ea5207-a0d8-4b1f-8f97-3569ee9c5d54 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:03.323091 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c8ea5207-a0d8-4b1f-8f97-3569ee9c5d54 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 0.870016 Jun 05 08:28:03.325184 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 725/1455] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:02 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:03.340168 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5072c402-a7b2-410e-8284-7036b9a19ad4 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '.version_select at 0x7f2433873ee0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:03.357042 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5072c402-a7b2-410e-8284-7036b9a19ad4 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:03.357796 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5072c402-a7b2-410e-8284-7036b9a19ad4 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:03.358555 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5072c402-a7b2-410e-8284-7036b9a19ad4 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:03.378537 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5072c402-a7b2-410e-8284-7036b9a19ad4 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:03.379973 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5072c402-a7b2-410e-8284-7036b9a19ad4 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:03.382229 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5072c402-a7b2-410e-8284-7036b9a19ad4 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:03.383474 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5072c402-a7b2-410e-8284-7036b9a19ad4 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:03.430658 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5072c402-a7b2-410e-8284-7036b9a19ad4 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:03.431385 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5072c402-a7b2-410e-8284-7036b9a19ad4 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:03.459249 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-5072c402-a7b2-410e-8284-7036b9a19ad4 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lazy-loading 'flavor' on Instance uuid 6b642042-766c-4ca0-beda-ff29645bc2fe {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:03.497076 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5072c402-a7b2-410e-8284-7036b9a19ad4 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags" status: 204 len: 0 microversion: 2.26 time: 0.169840 Jun 05 08:28:03.500290 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 726/1456] 10.222.0.33 () {60 vars in 1294 bytes} [Sun Jun 5 08:28:03 2022] DELETE /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:28:03.519272 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-16484322-71f1-4c35-8e8e-c013fb7a47ed tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:03.520021 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-16484322-71f1-4c35-8e8e-c013fb7a47ed tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 5d6c0691-aa2b-4d7f-b424-2a9129f285bb] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:03.551622 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-16484322-71f1-4c35-8e8e-c013fb7a47ed tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:03.552369 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-16484322-71f1-4c35-8e8e-c013fb7a47ed tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:03.553821 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-16484322-71f1-4c35-8e8e-c013fb7a47ed tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:03.554496 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-16484322-71f1-4c35-8e8e-c013fb7a47ed tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:03.661834 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-16484322-71f1-4c35-8e8e-c013fb7a47ed tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:03.662306 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-16484322-71f1-4c35-8e8e-c013fb7a47ed tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:03.662783 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-16484322-71f1-4c35-8e8e-c013fb7a47ed tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lazy-loading 'fault' on Instance uuid 5d6c0691-aa2b-4d7f-b424-2a9129f285bb {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:03.746464 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fb8d1335-3611-4c34-8561-9fb7d8a6cccc tempest-FloatingIPsTestJSON-211719245 tempest-FloatingIPsTestJSON-211719245-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/0fde7ae5-41fe-4ea1-851e-06a87ef8b99b" status: 202 len: 0 microversion: 2.1 time: 3.708873 Jun 05 08:28:03.747211 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 731/1457] 10.222.0.33 () {58 vars in 1262 bytes} [Sun Jun 5 08:28:00 2022] DELETE /compute/v2.1/os-floating-ips/0fde7ae5-41fe-4ea1-851e-06a87ef8b99b => generated 0 bytes in 3721 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:28:03.756528 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e2543bc6-be3a-4421-8d06-d369766db406 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:03.765818 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e2543bc6-be3a-4421-8d06-d369766db406 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:03.775685 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e2543bc6-be3a-4421-8d06-d369766db406 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:03.777016 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e2543bc6-be3a-4421-8d06-d369766db406 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:03.778064 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e2543bc6-be3a-4421-8d06-d369766db406 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:03.778856 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e2543bc6-be3a-4421-8d06-d369766db406 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:03.861860 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-16484322-71f1-4c35-8e8e-c013fb7a47ed tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:03.876347 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-16484322-71f1-4c35-8e8e-c013fb7a47ed tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/5d6c0691-aa2b-4d7f-b424-2a9129f285bb" status: 200 len: 1363 microversion: 2.1 time: 0.374497 Jun 05 08:28:03.890183 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 727/1458] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:03 2022] GET /compute/v2.1/servers/5d6c0691-aa2b-4d7f-b424-2a9129f285bb => generated 1363 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:03.894172 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-ce5f5960-7219-4f22-aba3-e389af390076 req-c53b6194-5ad5-496e-9dcd-9ec9a885b5b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fedc49cc-1b5e-4c16-ab6d-da3afb5e567d", "name": "network-vif-deleted", "tag": "cb2b2764-b1e0-4358-bc3b-4a0b8b4f76b9"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:28:03.937225 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-ce5f5960-7219-4f22-aba3-e389af390076 req-c53b6194-5ad5-496e-9dcd-9ec9a885b5b2 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:03.939204 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-ce5f5960-7219-4f22-aba3-e389af390076 req-c53b6194-5ad5-496e-9dcd-9ec9a885b5b2 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:03.967444 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-ce5f5960-7219-4f22-aba3-e389af390076 req-c53b6194-5ad5-496e-9dcd-9ec9a885b5b2 service nova] Creating event network-vif-deleted:cb2b2764-b1e0-4358-bc3b-4a0b8b4f76b9 for instance fedc49cc-1b5e-4c16-ab6d-da3afb5e567d on n-h2-844739-1 Jun 05 08:28:03.976965 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-ce5f5960-7219-4f22-aba3-e389af390076 req-c53b6194-5ad5-496e-9dcd-9ec9a885b5b2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094219 Jun 05 08:28:03.979081 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 728/1459] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:28:03.990720 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-64167386-9dac-47ae-a835-0e9c94d6b081 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:03.991430 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-64167386-9dac-47ae-a835-0e9c94d6b081 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:04.018678 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-64167386-9dac-47ae-a835-0e9c94d6b081 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:04.019136 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-64167386-9dac-47ae-a835-0e9c94d6b081 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:04.019936 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-64167386-9dac-47ae-a835-0e9c94d6b081 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:04.020492 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-64167386-9dac-47ae-a835-0e9c94d6b081 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:04.082576 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-64167386-9dac-47ae-a835-0e9c94d6b081 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:04.082941 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-64167386-9dac-47ae-a835-0e9c94d6b081 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:04.083448 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-64167386-9dac-47ae-a835-0e9c94d6b081 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:04.226640 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e2543bc6-be3a-4421-8d06-d369766db406 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:04.236231 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:28:04.248734 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e2543bc6-be3a-4421-8d06-d369766db406 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:04.250688 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e2543bc6-be3a-4421-8d06-d369766db406 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:04.254709 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e2543bc6-be3a-4421-8d06-d369766db406 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1753 microversion: 2.20 time: 0.505095 Jun 05 08:28:04.268412 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 732/1460] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:03 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1753 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:04.300684 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-272f1aeb-2c0e-4488-8c65-6c82dc048ddf tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '.version_select at 0x7f2433752700>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:04.316253 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-272f1aeb-2c0e-4488-8c65-6c82dc048ddf tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:04.317933 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-272f1aeb-2c0e-4488-8c65-6c82dc048ddf tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:04.341881 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-272f1aeb-2c0e-4488-8c65-6c82dc048ddf tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags" status: 200 len: 12 microversion: 2.26 time: 0.066714 Jun 05 08:28:04.343792 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 733/1461] 10.222.0.33 () {60 vars in 1291 bytes} [Sun Jun 5 08:28:04 2022] GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags => generated 12 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:04.350748 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-38d0cb7d-1165-4a80-b6c9-f54ffc09292a tempest-FloatingIPsTestJSON-211719245 tempest-FloatingIPsTestJSON-211719245-project] Calling method '.version_select at 0x7f24338de670>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:04.350930 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-64167386-9dac-47ae-a835-0e9c94d6b081 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:04.360232 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-64167386-9dac-47ae-a835-0e9c94d6b081 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.379892 Jun 05 08:28:04.370749 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 729/1462] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:03 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:04.387947 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-05075cbd-2367-4a70-98d5-afd11bed505b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:04.388907 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-05075cbd-2367-4a70-98d5-afd11bed505b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: fedc49cc-1b5e-4c16-ab6d-da3afb5e567d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:04.397625 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-05075cbd-2367-4a70-98d5-afd11bed505b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:04.398656 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-05075cbd-2367-4a70-98d5-afd11bed505b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:04.402115 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-05075cbd-2367-4a70-98d5-afd11bed505b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:04.403002 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-05075cbd-2367-4a70-98d5-afd11bed505b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:04.466476 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-05075cbd-2367-4a70-98d5-afd11bed505b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:04.467612 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-05075cbd-2367-4a70-98d5-afd11bed505b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:04.468449 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-05075cbd-2367-4a70-98d5-afd11bed505b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lazy-loading 'fault' on Instance uuid fedc49cc-1b5e-4c16-ab6d-da3afb5e567d {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:04.470032 n-d-844739-1 devstack@n-api.service[119049]: DEBUG neutronclient.v2_0.client [None req-38d0cb7d-1165-4a80-b6c9-f54ffc09292a tempest-FloatingIPsTestJSON-211719245 tempest-FloatingIPsTestJSON-211719245-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 0fde7ae5-41fe-4ea1-851e-06a87ef8b99b could not be found", "detail": ""}} {{(pid=119049) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 05 08:28:04.470742 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-38d0cb7d-1165-4a80-b6c9-f54ffc09292a tempest-FloatingIPsTestJSON-211719245 tempest-FloatingIPsTestJSON-211719245-project] HTTP exception thrown: Floating IP not found for ID 0fde7ae5-41fe-4ea1-851e-06a87ef8b99b Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-38d0cb7d-1165-4a80-b6c9-f54ffc09292a tempest-FloatingIPsTestJSON-211719245 tempest-FloatingIPsTestJSON-211719245-project] Request method failure captured: Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/os-floating-ips/0fde7ae5-41fe-4ea1-851e-06a87ef8b99b HTTP/1.1 Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGkD7PU0jfkbOzFu4B6R9_yxar_OXQVY8a0DfBO56ghbJk7LKbxJPYvEhBtp8FFXVnkKIV_GhCRa0nlqskuDKdk7WWCwjeuuG2YjJJ8vwnDZ9X1xJAm7eHnh9j2_JZ_9IfTLbpAG57h6YcfcY9_fN1Vgm_rNVi1Ou-j0wMgNSBjp9M4 Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: a6be1628ac614ab6a29126bf244aeb63 Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-FloatingIPsTestJSON-211719245 Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a6be1628ac614ab6a29126bf244aeb63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a6be1628ac614ab6a29126bf244aeb63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a6be1628ac614ab6a29126bf244aeb63", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a6be1628ac614ab6a29126bf244aeb63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-FloatingIPsTestJSON-211719245 Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: a6be1628ac614ab6a29126bf244aeb63 Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-FloatingIPsTestJSON-211719245 Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-FloatingIPsTestJSON-211719245-project Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 17079d7b788b498eaa4ca093880e3ab1 Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-FloatingIPsTestJSON-211719245-project Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: exception: Floating IP not found for ID 0fde7ae5-41fe-4ea1-851e-06a87ef8b99b Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '0fde7ae5-41fe-4ea1-851e-06a87ef8b99b'} Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2810, in get_floating_ip Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 0fde7ae5-41fe-4ea1-851e-06a87ef8b99b could not be found Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ba081a8-81ff-4e5b-94d1-5a3db5b62242'] Jun 05 08:28:04.472975 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2813, in get_floating_ip Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 0fde7ae5-41fe-4ea1-851e-06a87ef8b99b. Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 0fde7ae5-41fe-4ea1-851e-06a87ef8b99b Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 0fde7ae5-41fe-4ea1-851e-06a87ef8b99b Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-38d0cb7d-1165-4a80-b6c9-f54ffc09292a tempest-FloatingIPsTestJSON-211719245 tempest-FloatingIPsTestJSON-211719245-project] Returning 404 to user: Floating IP not found for ID 0fde7ae5-41fe-4ea1-851e-06a87ef8b99b {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-38d0cb7d-1165-4a80-b6c9-f54ffc09292a tempest-FloatingIPsTestJSON-211719245 tempest-FloatingIPsTestJSON-211719245-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/0fde7ae5-41fe-4ea1-851e-06a87ef8b99b" status: 404 len: 111 microversion: 2.1 time: 0.129346 Jun 05 08:28:04.476998 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 734/1463] 10.222.0.33 () {58 vars in 1259 bytes} [Sun Jun 5 08:28:04 2022] GET /compute/v2.1/os-floating-ips/0fde7ae5-41fe-4ea1-851e-06a87ef8b99b => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:28:04.484293 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-dac3b28e-5595-4f2d-895c-84f14ce4b884 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:04.484917 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-dac3b28e-5595-4f2d-895c-84f14ce4b884 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:04.495399 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:28:04.512595 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dac3b28e-5595-4f2d-895c-84f14ce4b884 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:04.513083 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dac3b28e-5595-4f2d-895c-84f14ce4b884 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:04.513890 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dac3b28e-5595-4f2d-895c-84f14ce4b884 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:04.514337 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dac3b28e-5595-4f2d-895c-84f14ce4b884 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:04.559232 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-05075cbd-2367-4a70-98d5-afd11bed505b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:04.576821 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-05075cbd-2367-4a70-98d5-afd11bed505b tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d" status: 200 len: 1363 microversion: 2.1 time: 0.202674 Jun 05 08:28:04.577851 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 730/1464] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:04 2022] GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:04.601099 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cb49633b-4770-465e-8edf-c4ca95018f4a tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '.version_select at 0x7f2433a22d30>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:04.613551 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cb49633b-4770-465e-8edf-c4ca95018f4a tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:04.619019 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cb49633b-4770-465e-8edf-c4ca95018f4a tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:04.623311 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-cb49633b-4770-465e-8edf-c4ca95018f4a tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:04.640361 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cb49633b-4770-465e-8edf-c4ca95018f4a tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:04.642444 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cb49633b-4770-465e-8edf-c4ca95018f4a tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:04.643477 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cb49633b-4770-465e-8edf-c4ca95018f4a tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:04.647454 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cb49633b-4770-465e-8edf-c4ca95018f4a tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:04.653083 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:28:04.703931 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cb49633b-4770-465e-8edf-c4ca95018f4a tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:04.710303 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cb49633b-4770-465e-8edf-c4ca95018f4a tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:04.822290 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cb49633b-4770-465e-8edf-c4ca95018f4a tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:04.822759 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cb49633b-4770-465e-8edf-c4ca95018f4a tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:04.841384 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-dac3b28e-5595-4f2d-895c-84f14ce4b884 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:04.855952 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-dac3b28e-5595-4f2d-895c-84f14ce4b884 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:04.857532 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-dac3b28e-5595-4f2d-895c-84f14ce4b884 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:04.859212 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-dac3b28e-5595-4f2d-895c-84f14ce4b884 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 0.379576 Jun 05 08:28:04.868110 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 735/1465] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:04 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:04.887978 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f3d94da3-bd53-47a6-9bd4-6b17cbbf80e8 tempest-FloatingIPsTestJSON-211719245 tempest-FloatingIPsTestJSON-211719245-project] Calling method '.version_select at 0x7f24338def70>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:04.907189 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-cb49633b-4770-465e-8edf-c4ca95018f4a tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lazy-loading 'flavor' on Instance uuid 6b642042-766c-4ca0-beda-ff29645bc2fe {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:04.966471 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-cb49633b-4770-465e-8edf-c4ca95018f4a tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "PUT /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags/tempest-tag-1455210641" status: 201 len: 0 microversion: 2.26 time: 0.379396 Jun 05 08:28:04.966471 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 731/1466] 10.222.0.33 () {62 vars in 1379 bytes} [Sun Jun 5 08:28:04 2022] PUT /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags/tempest-tag-1455210641 => generated 0 bytes in 382 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jun 05 08:28:04.971831 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-756d18f2-07e6-4e8b-892e-87b1af0e6daf tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '.version_select at 0x7f2433861160>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:04.993047 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-756d18f2-07e6-4e8b-892e-87b1af0e6daf tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:04.994148 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-756d18f2-07e6-4e8b-892e-87b1af0e6daf tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:05.001002 n-d-844739-1 devstack@n-api.service[119049]: DEBUG neutronclient.v2_0.client [None req-f3d94da3-bd53-47a6-9bd4-6b17cbbf80e8 tempest-FloatingIPsTestJSON-211719245 tempest-FloatingIPsTestJSON-211719245-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 0fde7ae5-41fe-4ea1-851e-06a87ef8b99b could not be found", "detail": ""}} {{(pid=119049) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 05 08:28:05.001711 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-f3d94da3-bd53-47a6-9bd4-6b17cbbf80e8 tempest-FloatingIPsTestJSON-211719245 tempest-FloatingIPsTestJSON-211719245-project] HTTP exception thrown: Floating IP not found for ID 0fde7ae5-41fe-4ea1-851e-06a87ef8b99b Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f3d94da3-bd53-47a6-9bd4-6b17cbbf80e8 tempest-FloatingIPsTestJSON-211719245 tempest-FloatingIPsTestJSON-211719245-project] Request method failure captured: Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: request: DELETE /compute/v2.1/os-floating-ips/0fde7ae5-41fe-4ea1-851e-06a87ef8b99b HTTP/1.1 Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGkD7PU0jfkbOzFu4B6R9_yxar_OXQVY8a0DfBO56ghbJk7LKbxJPYvEhBtp8FFXVnkKIV_GhCRa0nlqskuDKdk7WWCwjeuuG2YjJJ8vwnDZ9X1xJAm7eHnh9j2_JZ_9IfTLbpAG57h6YcfcY9_fN1Vgm_rNVi1Ou-j0wMgNSBjp9M4 Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: a6be1628ac614ab6a29126bf244aeb63 Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-FloatingIPsTestJSON-211719245 Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a6be1628ac614ab6a29126bf244aeb63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a6be1628ac614ab6a29126bf244aeb63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a6be1628ac614ab6a29126bf244aeb63", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a6be1628ac614ab6a29126bf244aeb63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-FloatingIPsTestJSON-211719245 Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: a6be1628ac614ab6a29126bf244aeb63 Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-FloatingIPsTestJSON-211719245 Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-FloatingIPsTestJSON-211719245-project Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 17079d7b788b498eaa4ca093880e3ab1 Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-FloatingIPsTestJSON-211719245-project Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: exception: Floating IP not found for ID 0fde7ae5-41fe-4ea1-851e-06a87ef8b99b Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '0fde7ae5-41fe-4ea1-851e-06a87ef8b99b'} Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2810, in get_floating_ip Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 0fde7ae5-41fe-4ea1-851e-06a87ef8b99b could not be found Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9a6774b-3468-4dcb-8a34-1bb9ff36a816'] Jun 05 08:28:05.003537 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2813, in get_floating_ip Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 0fde7ae5-41fe-4ea1-851e-06a87ef8b99b. Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 0fde7ae5-41fe-4ea1-851e-06a87ef8b99b Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 0fde7ae5-41fe-4ea1-851e-06a87ef8b99b Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f3d94da3-bd53-47a6-9bd4-6b17cbbf80e8 tempest-FloatingIPsTestJSON-211719245 tempest-FloatingIPsTestJSON-211719245-project] Returning 404 to user: Floating IP not found for ID 0fde7ae5-41fe-4ea1-851e-06a87ef8b99b {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f3d94da3-bd53-47a6-9bd4-6b17cbbf80e8 tempest-FloatingIPsTestJSON-211719245 tempest-FloatingIPsTestJSON-211719245-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/0fde7ae5-41fe-4ea1-851e-06a87ef8b99b" status: 404 len: 111 microversion: 2.1 time: 0.133503 Jun 05 08:28:05.007705 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 736/1467] 10.222.0.33 () {58 vars in 1262 bytes} [Sun Jun 5 08:28:04 2022] DELETE /compute/v2.1/os-floating-ips/0fde7ae5-41fe-4ea1-851e-06a87ef8b99b => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:28:05.023373 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-756d18f2-07e6-4e8b-892e-87b1af0e6daf tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags" status: 200 len: 36 microversion: 2.26 time: 0.055550 Jun 05 08:28:05.032797 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 732/1468] 10.222.0.33 () {60 vars in 1291 bytes} [Sun Jun 5 08:28:04 2022] GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags => generated 36 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:28:05.038071 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f8041e6a-78d1-4795-aa0a-8efb65a3db9c tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '.version_select at 0x7f2433992ca0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:05.051446 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f8041e6a-78d1-4795-aa0a-8efb65a3db9c tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:05.051828 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f8041e6a-78d1-4795-aa0a-8efb65a3db9c tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:05.063201 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f8041e6a-78d1-4795-aa0a-8efb65a3db9c tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:05.087324 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f8041e6a-78d1-4795-aa0a-8efb65a3db9c tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:05.087914 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f8041e6a-78d1-4795-aa0a-8efb65a3db9c tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:05.088717 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f8041e6a-78d1-4795-aa0a-8efb65a3db9c tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:05.089167 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f8041e6a-78d1-4795-aa0a-8efb65a3db9c tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:05.163402 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f8041e6a-78d1-4795-aa0a-8efb65a3db9c tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:05.163887 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f8041e6a-78d1-4795-aa0a-8efb65a3db9c tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:05.222669 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-f8041e6a-78d1-4795-aa0a-8efb65a3db9c tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lazy-loading 'flavor' on Instance uuid 6b642042-766c-4ca0-beda-ff29645bc2fe {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:05.273431 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a50000fa-81dc-45eb-b442-7a90d05ccb3b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:05.274093 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a50000fa-81dc-45eb-b442-7a90d05ccb3b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:05.296293 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a50000fa-81dc-45eb-b442-7a90d05ccb3b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:05.296881 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a50000fa-81dc-45eb-b442-7a90d05ccb3b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:05.297917 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a50000fa-81dc-45eb-b442-7a90d05ccb3b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:05.298373 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a50000fa-81dc-45eb-b442-7a90d05ccb3b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:05.386663 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f8041e6a-78d1-4795-aa0a-8efb65a3db9c tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags/tempest-tag-1455210641" status: 204 len: 0 microversion: 2.26 time: 0.352583 Jun 05 08:28:05.390248 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 737/1469] 10.222.0.33 () {60 vars in 1363 bytes} [Sun Jun 5 08:28:05 2022] DELETE /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags/tempest-tag-1455210641 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:28:05.401447 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ce37a908-397c-4ce5-bc66-bf6d0aa9957f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:05.402627 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ce37a908-397c-4ce5-bc66-bf6d0aa9957f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:05.423769 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ce37a908-397c-4ce5-bc66-bf6d0aa9957f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:05.424661 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ce37a908-397c-4ce5-bc66-bf6d0aa9957f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:05.425633 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ce37a908-397c-4ce5-bc66-bf6d0aa9957f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:05.427321 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ce37a908-397c-4ce5-bc66-bf6d0aa9957f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:05.500120 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ce37a908-397c-4ce5-bc66-bf6d0aa9957f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:05.501735 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ce37a908-397c-4ce5-bc66-bf6d0aa9957f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:05.503359 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-ce37a908-397c-4ce5-bc66-bf6d0aa9957f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:05.629275 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ce37a908-397c-4ce5-bc66-bf6d0aa9957f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:05.641951 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ce37a908-397c-4ce5-bc66-bf6d0aa9957f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.253018 Jun 05 08:28:05.643966 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 738/1470] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:05 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:05.652220 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3a6d1f48-f6ff-41f0-9a45-d20b129b19d2 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '.version_select at 0x7f243395c310>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:05.677380 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3a6d1f48-f6ff-41f0-9a45-d20b129b19d2 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:05.680609 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3a6d1f48-f6ff-41f0-9a45-d20b129b19d2 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:05.708872 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3a6d1f48-f6ff-41f0-9a45-d20b129b19d2 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags" status: 200 len: 12 microversion: 2.26 time: 0.063515 Jun 05 08:28:05.716485 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 739/1471] 10.222.0.33 () {60 vars in 1291 bytes} [Sun Jun 5 08:28:05 2022] GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags => generated 12 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:05.721065 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a50000fa-81dc-45eb-b442-7a90d05ccb3b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:05.721660 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c7558214-3c27-42cf-8da5-5dceca313ada tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:05.722221 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c7558214-3c27-42cf-8da5-5dceca313ada tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: fedc49cc-1b5e-4c16-ab6d-da3afb5e567d] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:05.728907 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c7558214-3c27-42cf-8da5-5dceca313ada tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:05.729741 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c7558214-3c27-42cf-8da5-5dceca313ada tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:05.730285 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a50000fa-81dc-45eb-b442-7a90d05ccb3b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:05.731030 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c7558214-3c27-42cf-8da5-5dceca313ada tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:05.731676 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c7558214-3c27-42cf-8da5-5dceca313ada tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:05.731791 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a50000fa-81dc-45eb-b442-7a90d05ccb3b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:05.733032 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a50000fa-81dc-45eb-b442-7a90d05ccb3b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1753 microversion: 2.20 time: 0.463596 Jun 05 08:28:05.733799 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 733/1472] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:05 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1753 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:28:05.766641 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c7558214-3c27-42cf-8da5-5dceca313ada tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:05.767158 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c84ede79-cc6c-4efd-b93d-9fcd9a21ca14 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '.version_select at 0x7f2433687820>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:05.767703 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c7558214-3c27-42cf-8da5-5dceca313ada tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:05.768419 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-c7558214-3c27-42cf-8da5-5dceca313ada tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lazy-loading 'fault' on Instance uuid fedc49cc-1b5e-4c16-ab6d-da3afb5e567d {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:05.794212 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c84ede79-cc6c-4efd-b93d-9fcd9a21ca14 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:05.794672 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c84ede79-cc6c-4efd-b93d-9fcd9a21ca14 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:05.795165 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c84ede79-cc6c-4efd-b93d-9fcd9a21ca14 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:05.816910 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c84ede79-cc6c-4efd-b93d-9fcd9a21ca14 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:05.817369 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c84ede79-cc6c-4efd-b93d-9fcd9a21ca14 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:05.818166 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c84ede79-cc6c-4efd-b93d-9fcd9a21ca14 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:05.818610 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c84ede79-cc6c-4efd-b93d-9fcd9a21ca14 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:05.878420 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c84ede79-cc6c-4efd-b93d-9fcd9a21ca14 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:05.881445 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c84ede79-cc6c-4efd-b93d-9fcd9a21ca14 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:05.911770 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-c84ede79-cc6c-4efd-b93d-9fcd9a21ca14 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lazy-loading 'flavor' on Instance uuid 6b642042-766c-4ca0-beda-ff29645bc2fe {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:05.950151 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c84ede79-cc6c-4efd-b93d-9fcd9a21ca14 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags" status: 204 len: 0 microversion: 2.26 time: 0.215412 Jun 05 08:28:05.951755 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 734/1473] 10.222.0.33 () {60 vars in 1294 bytes} [Sun Jun 5 08:28:05 2022] DELETE /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:28:05.969172 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f57aca7b-3ba1-4313-b485-173eaf5038d8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:05.971186 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f57aca7b-3ba1-4313-b485-173eaf5038d8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:05.988289 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f57aca7b-3ba1-4313-b485-173eaf5038d8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:05.988762 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f57aca7b-3ba1-4313-b485-173eaf5038d8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:05.992070 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f57aca7b-3ba1-4313-b485-173eaf5038d8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:05.992547 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f57aca7b-3ba1-4313-b485-173eaf5038d8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:06.007179 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c7558214-3c27-42cf-8da5-5dceca313ada tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:06.036228 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c7558214-3c27-42cf-8da5-5dceca313ada tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d" status: 200 len: 1363 microversion: 2.1 time: 0.297887 Jun 05 08:28:06.037470 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 740/1474] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:05 2022] GET /compute/v2.1/servers/fedc49cc-1b5e-4c16-ab6d-da3afb5e567d => generated 1363 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:06.044960 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-552bc3d6-97a7-4099-abc8-dfa7f3d462fe tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '.version_select at 0x7f24337d2310>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:06.069709 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-552bc3d6-97a7-4099-abc8-dfa7f3d462fe tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:06.071946 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-552bc3d6-97a7-4099-abc8-dfa7f3d462fe tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:06.076727 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-552bc3d6-97a7-4099-abc8-dfa7f3d462fe tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:06.097381 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-552bc3d6-97a7-4099-abc8-dfa7f3d462fe tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:06.098216 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-552bc3d6-97a7-4099-abc8-dfa7f3d462fe tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:06.099297 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-552bc3d6-97a7-4099-abc8-dfa7f3d462fe tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:06.099954 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-552bc3d6-97a7-4099-abc8-dfa7f3d462fe tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:06.146476 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-552bc3d6-97a7-4099-abc8-dfa7f3d462fe tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:06.147287 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-552bc3d6-97a7-4099-abc8-dfa7f3d462fe tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:06.158354 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-552bc3d6-97a7-4099-abc8-dfa7f3d462fe tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:06.159169 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-552bc3d6-97a7-4099-abc8-dfa7f3d462fe tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:06.191285 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-552bc3d6-97a7-4099-abc8-dfa7f3d462fe tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lazy-loading 'flavor' on Instance uuid 6b642042-766c-4ca0-beda-ff29645bc2fe {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:06.219383 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-552bc3d6-97a7-4099-abc8-dfa7f3d462fe tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "PUT /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags/tempest-tag-127110971" status: 201 len: 0 microversion: 2.26 time: 0.180499 Jun 05 08:28:06.224958 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 741/1475] 10.222.0.33 () {62 vars in 1376 bytes} [Sun Jun 5 08:28:06 2022] PUT /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags/tempest-tag-127110971 => generated 0 bytes in 187 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jun 05 08:28:06.231417 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9800ffeb-6377-4afb-90e4-8075119fdca0 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:06.310476 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9800ffeb-6377-4afb-90e4-8075119fdca0 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/c495f782-f724-4f9f-829f-175dec3e3807" status: 204 len: 0 microversion: 2.1 time: 0.084023 Jun 05 08:28:06.311871 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 742/1476] 10.222.0.33 () {58 vars in 1265 bytes} [Sun Jun 5 08:28:06 2022] DELETE /compute/v2.1/os-server-groups/c495f782-f724-4f9f-829f-175dec3e3807 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:28:06.317528 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bd1b1e2a-d830-4683-b489-6b0b8ed4a800 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '.version_select at 0x7f243392a940>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:06.340525 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bd1b1e2a-d830-4683-b489-6b0b8ed4a800 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:06.345242 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bd1b1e2a-d830-4683-b489-6b0b8ed4a800 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:06.351854 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-bd1b1e2a-d830-4683-b489-6b0b8ed4a800 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:06.359294 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bd1b1e2a-d830-4683-b489-6b0b8ed4a800 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:06.364258 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bd1b1e2a-d830-4683-b489-6b0b8ed4a800 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:06.365364 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bd1b1e2a-d830-4683-b489-6b0b8ed4a800 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:06.368017 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bd1b1e2a-d830-4683-b489-6b0b8ed4a800 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:06.394219 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f57aca7b-3ba1-4313-b485-173eaf5038d8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:06.408112 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f57aca7b-3ba1-4313-b485-173eaf5038d8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:06.412323 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f57aca7b-3ba1-4313-b485-173eaf5038d8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:06.415906 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f57aca7b-3ba1-4313-b485-173eaf5038d8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 0.459500 Jun 05 08:28:06.419484 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 735/1477] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:05 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:06.425447 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bd1b1e2a-d830-4683-b489-6b0b8ed4a800 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:06.430758 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bd1b1e2a-d830-4683-b489-6b0b8ed4a800 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:06.432451 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a5420753-52f5-4ca7-a0be-660fc0794034 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:06.433257 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a5420753-52f5-4ca7-a0be-660fc0794034 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 15fff300-f7b6-4336-a143-1e5687af979b] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:06.450389 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a5420753-52f5-4ca7-a0be-660fc0794034 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:06.453123 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bd1b1e2a-d830-4683-b489-6b0b8ed4a800 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:06.453597 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a5420753-52f5-4ca7-a0be-660fc0794034 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:06.454152 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bd1b1e2a-d830-4683-b489-6b0b8ed4a800 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:06.455093 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a5420753-52f5-4ca7-a0be-660fc0794034 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:06.455763 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a5420753-52f5-4ca7-a0be-660fc0794034 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:06.503909 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-bd1b1e2a-d830-4683-b489-6b0b8ed4a800 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lazy-loading 'flavor' on Instance uuid 6b642042-766c-4ca0-beda-ff29645bc2fe {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:06.531936 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a5420753-52f5-4ca7-a0be-660fc0794034 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 15fff300-f7b6-4336-a143-1e5687af979b] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:28:06.554597 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bd1b1e2a-d830-4683-b489-6b0b8ed4a800 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "PUT /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags/tempest-tag-1544806537" status: 201 len: 0 microversion: 2.26 time: 0.241235 Jun 05 08:28:06.560126 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 743/1478] 10.222.0.33 () {62 vars in 1379 bytes} [Sun Jun 5 08:28:06 2022] PUT /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags/tempest-tag-1544806537 => generated 0 bytes in 247 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jun 05 08:28:06.565716 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b1a76d1b-9f6b-44a1-88e7-f1c13cbf236b tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '.version_select at 0x7f2445567ee0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:06.587608 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b1a76d1b-9f6b-44a1-88e7-f1c13cbf236b tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:06.588948 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b1a76d1b-9f6b-44a1-88e7-f1c13cbf236b tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:06.594559 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b1a76d1b-9f6b-44a1-88e7-f1c13cbf236b tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:06.605294 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b1a76d1b-9f6b-44a1-88e7-f1c13cbf236b tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:06.609963 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b1a76d1b-9f6b-44a1-88e7-f1c13cbf236b tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:06.611172 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b1a76d1b-9f6b-44a1-88e7-f1c13cbf236b tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:06.611886 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b1a76d1b-9f6b-44a1-88e7-f1c13cbf236b tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:06.673832 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b1a76d1b-9f6b-44a1-88e7-f1c13cbf236b tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:06.674625 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b1a76d1b-9f6b-44a1-88e7-f1c13cbf236b tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:06.731132 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-b1a76d1b-9f6b-44a1-88e7-f1c13cbf236b tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lazy-loading 'flavor' on Instance uuid 6b642042-766c-4ca0-beda-ff29645bc2fe {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:06.732007 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a5420753-52f5-4ca7-a0be-660fc0794034 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "DELETE /compute/v2.1/servers/15fff300-f7b6-4336-a143-1e5687af979b" status: 204 len: 0 microversion: 2.1 time: 0.310442 Jun 05 08:28:06.732993 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 736/1479] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:28:06 2022] DELETE /compute/v2.1/servers/15fff300-f7b6-4336-a143-1e5687af979b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:28:06.743132 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-bda38aa9-e81c-444e-8d92-ae1e81968310 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:06.749422 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-bda38aa9-e81c-444e-8d92-ae1e81968310 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:06.769111 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b1a76d1b-9f6b-44a1-88e7-f1c13cbf236b tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags" status: 204 len: 0 microversion: 2.26 time: 0.207292 Jun 05 08:28:06.769330 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bda38aa9-e81c-444e-8d92-ae1e81968310 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:06.769577 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bda38aa9-e81c-444e-8d92-ae1e81968310 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:06.770434 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 744/1480] 10.222.0.33 () {60 vars in 1294 bytes} [Sun Jun 5 08:28:06 2022] DELETE /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:28:06.773581 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bda38aa9-e81c-444e-8d92-ae1e81968310 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:06.774050 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bda38aa9-e81c-444e-8d92-ae1e81968310 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:06.783588 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bde0cf1b-273b-4339-b3cb-d7dbc6a065bb tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:06.785446 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-bde0cf1b-273b-4339-b3cb-d7dbc6a065bb tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 35db623e-15e3-4238-8c0f-ce05bc679787] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:06.796688 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bde0cf1b-273b-4339-b3cb-d7dbc6a065bb tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:06.804816 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bde0cf1b-273b-4339-b3cb-d7dbc6a065bb tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:06.806825 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bde0cf1b-273b-4339-b3cb-d7dbc6a065bb tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:06.807986 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bde0cf1b-273b-4339-b3cb-d7dbc6a065bb tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:06.857273 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bda38aa9-e81c-444e-8d92-ae1e81968310 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:06.858046 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bda38aa9-e81c-444e-8d92-ae1e81968310 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:06.858633 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-bda38aa9-e81c-444e-8d92-ae1e81968310 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:06.881304 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-bde0cf1b-273b-4339-b3cb-d7dbc6a065bb tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 35db623e-15e3-4238-8c0f-ce05bc679787] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:28:07.088571 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bde0cf1b-273b-4339-b3cb-d7dbc6a065bb tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "DELETE /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787" status: 204 len: 0 microversion: 2.1 time: 0.316318 Jun 05 08:28:07.090001 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 745/1481] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:28:06 2022] DELETE /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:28:07.107171 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bd84a250-d6a7-4976-a480-bbb0746eee33 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:07.109390 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-bd84a250-d6a7-4976-a480-bbb0746eee33 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:07.130907 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bd84a250-d6a7-4976-a480-bbb0746eee33 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:07.133114 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bd84a250-d6a7-4976-a480-bbb0746eee33 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:07.136233 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bd84a250-d6a7-4976-a480-bbb0746eee33 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:07.137582 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bd84a250-d6a7-4976-a480-bbb0746eee33 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:07.177179 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=90,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:UPDATE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:28:07.351883 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-bda38aa9-e81c-444e-8d92-ae1e81968310 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:07.374008 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-bda38aa9-e81c-444e-8d92-ae1e81968310 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.637800 Jun 05 08:28:07.384345 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 737/1482] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:06 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:07.390057 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ca866276-b28a-4f37-b4e6-c29f1c7d70be tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '.version_select at 0x7f24404f3790>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:07.414789 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ca866276-b28a-4f37-b4e6-c29f1c7d70be tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:07.418281 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ca866276-b28a-4f37-b4e6-c29f1c7d70be tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:07.447354 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ca866276-b28a-4f37-b4e6-c29f1c7d70be tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags" status: 200 len: 12 microversion: 2.26 time: 0.060259 Jun 05 08:28:07.448018 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 738/1483] 10.222.0.33 () {60 vars in 1291 bytes} [Sun Jun 5 08:28:07 2022] GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags => generated 12 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:07.464447 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d6892838-96a9-4604-bf25-038691620b2d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:07.465499 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d6892838-96a9-4604-bf25-038691620b2d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 15fff300-f7b6-4336-a143-1e5687af979b] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:07.473916 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d6892838-96a9-4604-bf25-038691620b2d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:07.474784 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d6892838-96a9-4604-bf25-038691620b2d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:07.475766 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d6892838-96a9-4604-bf25-038691620b2d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:07.476434 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d6892838-96a9-4604-bf25-038691620b2d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:07.971148 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-bd84a250-d6a7-4976-a480-bbb0746eee33 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:07.983968 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-bd84a250-d6a7-4976-a480-bbb0746eee33 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:07.989475 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-bd84a250-d6a7-4976-a480-bbb0746eee33 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:07.990971 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bd84a250-d6a7-4976-a480-bbb0746eee33 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1753 microversion: 2.20 time: 0.897275 Jun 05 08:28:07.999070 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 746/1484] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:07 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1753 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:08.008635 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-75fdaba5-849d-4a5f-95ca-f97349b1582f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:08.009811 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-75fdaba5-849d-4a5f-95ca-f97349b1582f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:08.024321 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-75fdaba5-849d-4a5f-95ca-f97349b1582f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:08.025555 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-75fdaba5-849d-4a5f-95ca-f97349b1582f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:08.026337 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-75fdaba5-849d-4a5f-95ca-f97349b1582f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:08.027074 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-75fdaba5-849d-4a5f-95ca-f97349b1582f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:08.047672 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d6892838-96a9-4604-bf25-038691620b2d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:08.056511 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d6892838-96a9-4604-bf25-038691620b2d tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/15fff300-f7b6-4336-a143-1e5687af979b" status: 200 len: 1475 microversion: 2.1 time: 0.603220 Jun 05 08:28:08.064617 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 739/1485] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:07 2022] GET /compute/v2.1/servers/15fff300-f7b6-4336-a143-1e5687af979b => generated 1475 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:08.069888 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9821cab4-9736-4d30-a6ab-1aebc1fc5dd6 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '.version_select at 0x7f2441784820>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:08.096395 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9821cab4-9736-4d30-a6ab-1aebc1fc5dd6 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:08.097049 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9821cab4-9736-4d30-a6ab-1aebc1fc5dd6 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:08.097700 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9821cab4-9736-4d30-a6ab-1aebc1fc5dd6 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:08.118745 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9821cab4-9736-4d30-a6ab-1aebc1fc5dd6 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:08.119732 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9821cab4-9736-4d30-a6ab-1aebc1fc5dd6 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:08.120726 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9821cab4-9736-4d30-a6ab-1aebc1fc5dd6 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:08.121358 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9821cab4-9736-4d30-a6ab-1aebc1fc5dd6 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:08.168522 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9821cab4-9736-4d30-a6ab-1aebc1fc5dd6 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:08.172670 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9821cab4-9736-4d30-a6ab-1aebc1fc5dd6 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:08.201493 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-9821cab4-9736-4d30-a6ab-1aebc1fc5dd6 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lazy-loading 'flavor' on Instance uuid 6b642042-766c-4ca0-beda-ff29645bc2fe {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:08.231667 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9821cab4-9736-4d30-a6ab-1aebc1fc5dd6 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags" status: 204 len: 0 microversion: 2.26 time: 0.165571 Jun 05 08:28:08.232624 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 740/1486] 10.222.0.33 () {60 vars in 1294 bytes} [Sun Jun 5 08:28:08 2022] DELETE /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:28:08.246923 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-bcb8677f-daeb-4589-b24b-c95f51d47a1d tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '.version_select at 0x7f2433c68e50>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:08.264072 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bcb8677f-daeb-4589-b24b-c95f51d47a1d tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:08.264072 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bcb8677f-daeb-4589-b24b-c95f51d47a1d tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:08.264417 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-bcb8677f-daeb-4589-b24b-c95f51d47a1d tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:08.285528 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bcb8677f-daeb-4589-b24b-c95f51d47a1d tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:08.285986 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bcb8677f-daeb-4589-b24b-c95f51d47a1d tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:08.286798 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bcb8677f-daeb-4589-b24b-c95f51d47a1d tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:08.287223 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bcb8677f-daeb-4589-b24b-c95f51d47a1d tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:08.341269 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bcb8677f-daeb-4589-b24b-c95f51d47a1d tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:08.341724 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bcb8677f-daeb-4589-b24b-c95f51d47a1d tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:08.364025 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bcb8677f-daeb-4589-b24b-c95f51d47a1d tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:08.364511 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bcb8677f-daeb-4589-b24b-c95f51d47a1d tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:08.417977 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-bcb8677f-daeb-4589-b24b-c95f51d47a1d tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lazy-loading 'flavor' on Instance uuid 6b642042-766c-4ca0-beda-ff29645bc2fe {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:08.458232 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-bcb8677f-daeb-4589-b24b-c95f51d47a1d tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "PUT /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags/tempest-tag-1421357497" status: 201 len: 0 microversion: 2.26 time: 0.217161 Jun 05 08:28:08.461436 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 741/1487] 10.222.0.33 () {62 vars in 1379 bytes} [Sun Jun 5 08:28:08 2022] PUT /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags/tempest-tag-1421357497 => generated 0 bytes in 220 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Jun 05 08:28:08.465683 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-75fdaba5-849d-4a5f-95ca-f97349b1582f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:08.474128 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-136b12b3-8130-44ae-a8c1-9bc4909c0c8a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:08.476650 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-136b12b3-8130-44ae-a8c1-9bc4909c0c8a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:08.487519 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-75fdaba5-849d-4a5f-95ca-f97349b1582f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:08.489079 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-75fdaba5-849d-4a5f-95ca-f97349b1582f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:08.494205 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-136b12b3-8130-44ae-a8c1-9bc4909c0c8a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:08.494933 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-136b12b3-8130-44ae-a8c1-9bc4909c0c8a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:08.495361 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-75fdaba5-849d-4a5f-95ca-f97349b1582f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 0.494998 Jun 05 08:28:08.496159 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-136b12b3-8130-44ae-a8c1-9bc4909c0c8a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:08.496763 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-136b12b3-8130-44ae-a8c1-9bc4909c0c8a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:08.500179 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 747/1488] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:07 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:08.510469 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4bd11ef8-753a-4dcb-9d9e-59f411b82647 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '.version_select at 0x7f24337c6c10>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:08.538131 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4bd11ef8-753a-4dcb-9d9e-59f411b82647 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:08.543836 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4bd11ef8-753a-4dcb-9d9e-59f411b82647 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:08.543836 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4bd11ef8-753a-4dcb-9d9e-59f411b82647 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:08.551966 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:28:08.564713 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4bd11ef8-753a-4dcb-9d9e-59f411b82647 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:08.565432 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4bd11ef8-753a-4dcb-9d9e-59f411b82647 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:08.566232 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4bd11ef8-753a-4dcb-9d9e-59f411b82647 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:08.566672 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4bd11ef8-753a-4dcb-9d9e-59f411b82647 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:08.585095 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-136b12b3-8130-44ae-a8c1-9bc4909c0c8a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:08.588179 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-136b12b3-8130-44ae-a8c1-9bc4909c0c8a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:08.589012 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-136b12b3-8130-44ae-a8c1-9bc4909c0c8a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:08.641753 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4bd11ef8-753a-4dcb-9d9e-59f411b82647 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:08.642211 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4bd11ef8-753a-4dcb-9d9e-59f411b82647 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:08.682949 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4bd11ef8-753a-4dcb-9d9e-59f411b82647 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:08.683057 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4bd11ef8-753a-4dcb-9d9e-59f411b82647 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:08.738380 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-4bd11ef8-753a-4dcb-9d9e-59f411b82647 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lazy-loading 'flavor' on Instance uuid 6b642042-766c-4ca0-beda-ff29645bc2fe {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:08.785803 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4bd11ef8-753a-4dcb-9d9e-59f411b82647 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "PUT /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags/tempest-tag-451483654" status: 201 len: 0 microversion: 2.26 time: 0.284270 Jun 05 08:28:08.788212 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 748/1489] 10.222.0.33 () {62 vars in 1376 bytes} [Sun Jun 5 08:28:08 2022] PUT /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags/tempest-tag-451483654 => generated 0 bytes in 287 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jun 05 08:28:08.805212 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a30930b1-65e3-46a0-b3dc-f4adcd846b6f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Action: 'update_all', calling method: .version_select at 0x7f243392ae50>, body: {"tags": ["tempest-tag-358035369", "tempest-tag-1816837247"]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:28:08.849289 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a30930b1-65e3-46a0-b3dc-f4adcd846b6f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:08.851782 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a30930b1-65e3-46a0-b3dc-f4adcd846b6f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:08.852625 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a30930b1-65e3-46a0-b3dc-f4adcd846b6f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:08.885845 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a30930b1-65e3-46a0-b3dc-f4adcd846b6f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:08.891963 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a30930b1-65e3-46a0-b3dc-f4adcd846b6f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:08.893235 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a30930b1-65e3-46a0-b3dc-f4adcd846b6f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:08.897269 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a30930b1-65e3-46a0-b3dc-f4adcd846b6f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:08.985208 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a30930b1-65e3-46a0-b3dc-f4adcd846b6f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:08.985675 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a30930b1-65e3-46a0-b3dc-f4adcd846b6f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:09.026401 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-a30930b1-65e3-46a0-b3dc-f4adcd846b6f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lazy-loading 'flavor' on Instance uuid 6b642042-766c-4ca0-beda-ff29645bc2fe {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:09.061019 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a30930b1-65e3-46a0-b3dc-f4adcd846b6f tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "PUT /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags" status: 200 len: 61 microversion: 2.26 time: 0.264164 Jun 05 08:28:09.062161 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 749/1490] 10.222.0.33 () {62 vars in 1311 bytes} [Sun Jun 5 08:28:08 2022] PUT /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags => generated 61 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:09.072295 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f4f59065-ab47-4d45-9895-d69afe2f82f8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:09.077002 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f4f59065-ab47-4d45-9895-d69afe2f82f8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:09.091290 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f4f59065-ab47-4d45-9895-d69afe2f82f8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:09.091756 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f4f59065-ab47-4d45-9895-d69afe2f82f8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:09.092590 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f4f59065-ab47-4d45-9895-d69afe2f82f8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:09.093033 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f4f59065-ab47-4d45-9895-d69afe2f82f8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:09.425830 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-136b12b3-8130-44ae-a8c1-9bc4909c0c8a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:09.455283 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-136b12b3-8130-44ae-a8c1-9bc4909c0c8a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.991379 Jun 05 08:28:09.458489 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 742/1491] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:08 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:09.478902 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fcfd2ad2-bd0e-4ef3-89b5-6c4a759f0db7 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '.version_select at 0x7f2433a22160>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:09.499153 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fcfd2ad2-bd0e-4ef3-89b5-6c4a759f0db7 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:09.499615 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fcfd2ad2-bd0e-4ef3-89b5-6c4a759f0db7 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:09.550632 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fcfd2ad2-bd0e-4ef3-89b5-6c4a759f0db7 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags" status: 200 len: 61 microversion: 2.26 time: 0.090709 Jun 05 08:28:09.554747 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 743/1492] 10.222.0.33 () {60 vars in 1291 bytes} [Sun Jun 5 08:28:09 2022] GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags => generated 61 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:09.566954 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-70dff0db-acf0-4045-bb9f-ade01fdc0430 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:09.580381 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-70dff0db-acf0-4045-bb9f-ade01fdc0430 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 15fff300-f7b6-4336-a143-1e5687af979b] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:09.589713 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-70dff0db-acf0-4045-bb9f-ade01fdc0430 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:09.590537 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-70dff0db-acf0-4045-bb9f-ade01fdc0430 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:09.602190 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-70dff0db-acf0-4045-bb9f-ade01fdc0430 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:09.604486 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-70dff0db-acf0-4045-bb9f-ade01fdc0430 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:10.178877 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-70dff0db-acf0-4045-bb9f-ade01fdc0430 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:10.199117 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-70dff0db-acf0-4045-bb9f-ade01fdc0430 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/15fff300-f7b6-4336-a143-1e5687af979b" status: 200 len: 1475 microversion: 2.1 time: 0.642056 Jun 05 08:28:10.216897 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 744/1493] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:09 2022] GET /compute/v2.1/servers/15fff300-f7b6-4336-a143-1e5687af979b => generated 1475 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:10.222976 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d5f27efb-b3a9-4bf8-938c-82210029938f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:10.223829 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d5f27efb-b3a9-4bf8-938c-82210029938f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:10.240737 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d5f27efb-b3a9-4bf8-938c-82210029938f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:10.241529 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d5f27efb-b3a9-4bf8-938c-82210029938f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:10.246405 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d5f27efb-b3a9-4bf8-938c-82210029938f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:10.248532 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d5f27efb-b3a9-4bf8-938c-82210029938f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:10.475032 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f4f59065-ab47-4d45-9895-d69afe2f82f8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:10.487980 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f4f59065-ab47-4d45-9895-d69afe2f82f8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:10.496471 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f4f59065-ab47-4d45-9895-d69afe2f82f8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:10.503575 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f4f59065-ab47-4d45-9895-d69afe2f82f8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1753 microversion: 2.20 time: 1.436646 Jun 05 08:28:10.519610 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 750/1494] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:09 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1753 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:10.532842 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-266efd8d-d537-45e4-9ae5-8405bdef4025 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '.version_select at 0x7f24339e2e50>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:10.556894 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-266efd8d-d537-45e4-9ae5-8405bdef4025 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:10.558680 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-266efd8d-d537-45e4-9ae5-8405bdef4025 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:10.559414 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-266efd8d-d537-45e4-9ae5-8405bdef4025 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:10.577799 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-266efd8d-d537-45e4-9ae5-8405bdef4025 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:10.581562 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-266efd8d-d537-45e4-9ae5-8405bdef4025 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:10.583455 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-266efd8d-d537-45e4-9ae5-8405bdef4025 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:10.586333 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-266efd8d-d537-45e4-9ae5-8405bdef4025 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:10.673242 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-266efd8d-d537-45e4-9ae5-8405bdef4025 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:10.674292 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-266efd8d-d537-45e4-9ae5-8405bdef4025 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:10.732295 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-266efd8d-d537-45e4-9ae5-8405bdef4025 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lazy-loading 'flavor' on Instance uuid 6b642042-766c-4ca0-beda-ff29645bc2fe {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:10.809500 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-266efd8d-d537-45e4-9ae5-8405bdef4025 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags" status: 204 len: 0 microversion: 2.26 time: 0.282499 Jun 05 08:28:10.811988 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 751/1495] 10.222.0.33 () {60 vars in 1294 bytes} [Sun Jun 5 08:28:10 2022] DELETE /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe/tags => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:28:10.835175 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f35213ac-a77e-440e-b434-ddeea224d779 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:10.838638 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f35213ac-a77e-440e-b434-ddeea224d779 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:10.869857 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f35213ac-a77e-440e-b434-ddeea224d779 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:10.871046 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f35213ac-a77e-440e-b434-ddeea224d779 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:10.874239 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f35213ac-a77e-440e-b434-ddeea224d779 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:10.875997 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f35213ac-a77e-440e-b434-ddeea224d779 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:10.995377 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f35213ac-a77e-440e-b434-ddeea224d779 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:10.996889 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f35213ac-a77e-440e-b434-ddeea224d779 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:11.001392 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-f35213ac-a77e-440e-b434-ddeea224d779 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:11.327584 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d5f27efb-b3a9-4bf8-938c-82210029938f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:11.334307 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f35213ac-a77e-440e-b434-ddeea224d779 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:11.346335 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f35213ac-a77e-440e-b434-ddeea224d779 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.532459 Jun 05 08:28:11.349052 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d5f27efb-b3a9-4bf8-938c-82210029938f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:11.351419 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d5f27efb-b3a9-4bf8-938c-82210029938f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:11.353273 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 752/1496] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:10 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:11.353500 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d5f27efb-b3a9-4bf8-938c-82210029938f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 1.133887 Jun 05 08:28:11.372142 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-a1b62126-861a-4711-8800-90cafcc6f9f7 req-aa73c37d-5054-491a-b853-af2ab2e76da7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15fff300-f7b6-4336-a143-1e5687af979b", "name": "network-vif-deleted", "tag": "c8ecaf2e-cdf3-4a90-bea7-af64a1c7bc7b"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:28:11.379152 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 745/1497] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:10 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:11.402886 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-a1b62126-861a-4711-8800-90cafcc6f9f7 req-aa73c37d-5054-491a-b853-af2ab2e76da7 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:11.404502 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b7c35206-52c6-495e-a2b9-0a133526bcba tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:11.408541 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b7c35206-52c6-495e-a2b9-0a133526bcba tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:11.410637 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-a1b62126-861a-4711-8800-90cafcc6f9f7 req-aa73c37d-5054-491a-b853-af2ab2e76da7 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:11.432181 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b7c35206-52c6-495e-a2b9-0a133526bcba tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:11.435183 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b7c35206-52c6-495e-a2b9-0a133526bcba tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:11.438147 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b7c35206-52c6-495e-a2b9-0a133526bcba tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:11.439183 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b7c35206-52c6-495e-a2b9-0a133526bcba tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:11.445656 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-a1b62126-861a-4711-8800-90cafcc6f9f7 req-aa73c37d-5054-491a-b853-af2ab2e76da7 service nova] Creating event network-vif-deleted:c8ecaf2e-cdf3-4a90-bea7-af64a1c7bc7b for instance 15fff300-f7b6-4336-a143-1e5687af979b on n-h1-844739-1 Jun 05 08:28:11.469394 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-a1b62126-861a-4711-8800-90cafcc6f9f7 req-aa73c37d-5054-491a-b853-af2ab2e76da7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114476 Jun 05 08:28:11.478866 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 753/1498] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:28:11.485654 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b403629e-1cbf-4b4b-a4b0-88ea80773bce tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:11.486528 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b403629e-1cbf-4b4b-a4b0-88ea80773bce tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 15fff300-f7b6-4336-a143-1e5687af979b] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:11.506977 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b403629e-1cbf-4b4b-a4b0-88ea80773bce tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:11.513307 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b403629e-1cbf-4b4b-a4b0-88ea80773bce tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:11.513423 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b7c35206-52c6-495e-a2b9-0a133526bcba tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:28:11.515012 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b403629e-1cbf-4b4b-a4b0-88ea80773bce tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:11.519234 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b403629e-1cbf-4b4b-a4b0-88ea80773bce tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:11.636770 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b403629e-1cbf-4b4b-a4b0-88ea80773bce tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:11.637564 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b403629e-1cbf-4b4b-a4b0-88ea80773bce tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:11.642020 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-b403629e-1cbf-4b4b-a4b0-88ea80773bce tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lazy-loading 'fault' on Instance uuid 15fff300-f7b6-4336-a143-1e5687af979b {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:11.740998 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b7c35206-52c6-495e-a2b9-0a133526bcba tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe" status: 204 len: 0 microversion: 2.26 time: 0.360169 Jun 05 08:28:11.746041 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 746/1499] 10.222.0.33 () {60 vars in 1279 bytes} [Sun Jun 5 08:28:11 2022] DELETE /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:28:11.754369 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3983f6fc-d067-44a8-95e4-9cf6f5525ac5 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:11.755091 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3983f6fc-d067-44a8-95e4-9cf6f5525ac5 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:11.774319 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3983f6fc-d067-44a8-95e4-9cf6f5525ac5 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:11.775576 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3983f6fc-d067-44a8-95e4-9cf6f5525ac5 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:11.776863 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3983f6fc-d067-44a8-95e4-9cf6f5525ac5 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:11.777468 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3983f6fc-d067-44a8-95e4-9cf6f5525ac5 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:12.027363 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b403629e-1cbf-4b4b-a4b0-88ea80773bce tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:12.045266 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b403629e-1cbf-4b4b-a4b0-88ea80773bce tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/15fff300-f7b6-4336-a143-1e5687af979b" status: 200 len: 1364 microversion: 2.1 time: 0.563757 Jun 05 08:28:12.061225 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 754/1500] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:11 2022] GET /compute/v2.1/servers/15fff300-f7b6-4336-a143-1e5687af979b => generated 1364 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:12.066365 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ee2867d5-d0d8-4bd6-b51b-393dc1a64e82 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:12.067163 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ee2867d5-d0d8-4bd6-b51b-393dc1a64e82 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:12.081054 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ee2867d5-d0d8-4bd6-b51b-393dc1a64e82 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:12.081518 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ee2867d5-d0d8-4bd6-b51b-393dc1a64e82 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:12.085005 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ee2867d5-d0d8-4bd6-b51b-393dc1a64e82 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:12.085468 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ee2867d5-d0d8-4bd6-b51b-393dc1a64e82 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:12.297221 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3983f6fc-d067-44a8-95e4-9cf6f5525ac5 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:12.308863 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3983f6fc-d067-44a8-95e4-9cf6f5525ac5 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:12.313984 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3983f6fc-d067-44a8-95e4-9cf6f5525ac5 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:12.319125 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3983f6fc-d067-44a8-95e4-9cf6f5525ac5 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1753 microversion: 2.20 time: 0.571665 Jun 05 08:28:12.338418 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 747/1501] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:11 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1753 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:12.346615 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1bcc14c2-4d80-4301-8cf9-0deca15d86e9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:12.353616 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1bcc14c2-4d80-4301-8cf9-0deca15d86e9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 35db623e-15e3-4238-8c0f-ce05bc679787] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:12.369940 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1bcc14c2-4d80-4301-8cf9-0deca15d86e9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:12.370696 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1bcc14c2-4d80-4301-8cf9-0deca15d86e9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:12.371696 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1bcc14c2-4d80-4301-8cf9-0deca15d86e9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:12.375446 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1bcc14c2-4d80-4301-8cf9-0deca15d86e9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:12.459812 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ee2867d5-d0d8-4bd6-b51b-393dc1a64e82 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:12.465565 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1bcc14c2-4d80-4301-8cf9-0deca15d86e9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:12.466028 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1bcc14c2-4d80-4301-8cf9-0deca15d86e9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:12.466502 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-1bcc14c2-4d80-4301-8cf9-0deca15d86e9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lazy-loading 'fault' on Instance uuid 35db623e-15e3-4238-8c0f-ce05bc679787 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:12.473008 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ee2867d5-d0d8-4bd6-b51b-393dc1a64e82 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:12.475490 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ee2867d5-d0d8-4bd6-b51b-393dc1a64e82 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:12.477064 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ee2867d5-d0d8-4bd6-b51b-393dc1a64e82 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe" status: 200 len: 1549 microversion: 2.26 time: 0.414685 Jun 05 08:28:12.483559 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 755/1502] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:12 2022] GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe => generated 1549 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:12.490506 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a35adbba-c9fd-43d5-a86f-8461a56746d8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:12.506824 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a35adbba-c9fd-43d5-a86f-8461a56746d8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:12.513588 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a35adbba-c9fd-43d5-a86f-8461a56746d8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:12.519501 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a35adbba-c9fd-43d5-a86f-8461a56746d8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:12.520526 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a35adbba-c9fd-43d5-a86f-8461a56746d8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:12.520990 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a35adbba-c9fd-43d5-a86f-8461a56746d8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:12.588795 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1bcc14c2-4d80-4301-8cf9-0deca15d86e9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:12.599188 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1bcc14c2-4d80-4301-8cf9-0deca15d86e9 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787" status: 200 len: 1287 microversion: 2.1 time: 0.258906 Jun 05 08:28:12.615007 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a35adbba-c9fd-43d5-a86f-8461a56746d8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:12.615571 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 748/1503] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:12 2022] GET /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787 => generated 1287 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:12.621375 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-47997873-ed18-4744-a506-1c9a4518e30a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:12.622299 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a35adbba-c9fd-43d5-a86f-8461a56746d8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:12.622960 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-a35adbba-c9fd-43d5-a86f-8461a56746d8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:12.627203 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-47997873-ed18-4744-a506-1c9a4518e30a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:12.643328 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-47997873-ed18-4744-a506-1c9a4518e30a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:12.644086 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-47997873-ed18-4744-a506-1c9a4518e30a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:12.645070 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-47997873-ed18-4744-a506-1c9a4518e30a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:12.645681 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-47997873-ed18-4744-a506-1c9a4518e30a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:12.921118 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a35adbba-c9fd-43d5-a86f-8461a56746d8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:12.933939 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a35adbba-c9fd-43d5-a86f-8461a56746d8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.448498 Jun 05 08:28:12.945540 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 756/1504] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:12 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:13.155361 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-47997873-ed18-4744-a506-1c9a4518e30a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:13.173799 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-47997873-ed18-4744-a506-1c9a4518e30a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:13.175259 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-47997873-ed18-4744-a506-1c9a4518e30a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:13.176495 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-47997873-ed18-4744-a506-1c9a4518e30a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 0.559640 Jun 05 08:28:13.187119 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 749/1505] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:12 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:13.345065 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b3eccb33-ee0d-47fc-a93f-f48f4722ea30 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:13.346046 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b3eccb33-ee0d-47fc-a93f-f48f4722ea30 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:13.365472 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b3eccb33-ee0d-47fc-a93f-f48f4722ea30 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:13.366356 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b3eccb33-ee0d-47fc-a93f-f48f4722ea30 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:13.367412 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b3eccb33-ee0d-47fc-a93f-f48f4722ea30 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:13.373732 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b3eccb33-ee0d-47fc-a93f-f48f4722ea30 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:13.499919 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9ccf6322-f286-4924-9df9-5990c9e81269 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:13.500589 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9ccf6322-f286-4924-9df9-5990c9e81269 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:13.510159 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9ccf6322-f286-4924-9df9-5990c9e81269 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:13.510620 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9ccf6322-f286-4924-9df9-5990c9e81269 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:13.511420 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9ccf6322-f286-4924-9df9-5990c9e81269 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:13.511865 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9ccf6322-f286-4924-9df9-5990c9e81269 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:14.032926 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b3eccb33-ee0d-47fc-a93f-f48f4722ea30 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:14.053280 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b3eccb33-ee0d-47fc-a93f-f48f4722ea30 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:14.055033 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b3eccb33-ee0d-47fc-a93f-f48f4722ea30 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:14.061469 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b3eccb33-ee0d-47fc-a93f-f48f4722ea30 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1753 microversion: 2.20 time: 0.726805 Jun 05 08:28:14.062617 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 757/1506] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:13 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1753 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:14.077938 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-8023fb34-d203-4e21-949c-bcdde02ec694 req-42cc5196-b86f-4fdd-ab7b-48294c5bc0e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35db623e-15e3-4238-8c0f-ce05bc679787", "name": "network-vif-deleted", "tag": "dd3c5ea6-c469-401f-afb5-9474a9c0d5dc"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:28:14.104135 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-8023fb34-d203-4e21-949c-bcdde02ec694 req-42cc5196-b86f-4fdd-ab7b-48294c5bc0e7 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:14.107919 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-8023fb34-d203-4e21-949c-bcdde02ec694 req-42cc5196-b86f-4fdd-ab7b-48294c5bc0e7 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:14.154005 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-9ccf6322-f286-4924-9df9-5990c9e81269 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:14.171119 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-8023fb34-d203-4e21-949c-bcdde02ec694 req-42cc5196-b86f-4fdd-ab7b-48294c5bc0e7 service nova] Creating event network-vif-deleted:dd3c5ea6-c469-401f-afb5-9474a9c0d5dc for instance 35db623e-15e3-4238-8c0f-ce05bc679787 on n-h1-844739-1 Jun 05 08:28:14.177163 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-9ccf6322-f286-4924-9df9-5990c9e81269 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:14.185248 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-9ccf6322-f286-4924-9df9-5990c9e81269 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:14.204613 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-8023fb34-d203-4e21-949c-bcdde02ec694 req-42cc5196-b86f-4fdd-ab7b-48294c5bc0e7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127916 Jun 05 08:28:14.205367 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9ccf6322-f286-4924-9df9-5990c9e81269 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe" status: 200 len: 1549 microversion: 2.26 time: 0.698315 Jun 05 08:28:14.206975 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 750/1507] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:13 2022] GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe => generated 1549 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:28:14.218425 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 758/1508] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:28:14.230872 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5df9e287-faea-48a8-82cd-3381b736bfe3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:14.234212 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e053790d-021c-4e5e-9185-7a1f5e5596e8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:14.235360 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e053790d-021c-4e5e-9185-7a1f5e5596e8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:14.236378 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5df9e287-faea-48a8-82cd-3381b736bfe3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 35db623e-15e3-4238-8c0f-ce05bc679787] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:14.259160 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e053790d-021c-4e5e-9185-7a1f5e5596e8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:14.261348 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5df9e287-faea-48a8-82cd-3381b736bfe3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:14.263885 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5df9e287-faea-48a8-82cd-3381b736bfe3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:14.264556 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e053790d-021c-4e5e-9185-7a1f5e5596e8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:14.265568 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5df9e287-faea-48a8-82cd-3381b736bfe3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:14.266584 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e053790d-021c-4e5e-9185-7a1f5e5596e8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:14.272221 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5df9e287-faea-48a8-82cd-3381b736bfe3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:14.273014 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e053790d-021c-4e5e-9185-7a1f5e5596e8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:14.359661 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5df9e287-faea-48a8-82cd-3381b736bfe3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:14.363794 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e053790d-021c-4e5e-9185-7a1f5e5596e8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:14.364592 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5df9e287-faea-48a8-82cd-3381b736bfe3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:14.365262 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-5df9e287-faea-48a8-82cd-3381b736bfe3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lazy-loading 'fault' on Instance uuid 35db623e-15e3-4238-8c0f-ce05bc679787 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:14.367612 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:28:14.368460 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e053790d-021c-4e5e-9185-7a1f5e5596e8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:14.369093 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-e053790d-021c-4e5e-9185-7a1f5e5596e8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:14.481684 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e053790d-021c-4e5e-9185-7a1f5e5596e8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:14.496167 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e053790d-021c-4e5e-9185-7a1f5e5596e8 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.274678 Jun 05 08:28:14.506808 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 751/1509] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:14 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:14.519644 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-84da69e6-3d6e-458c-a012-1d5e4f2f3749 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:14.520547 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-84da69e6-3d6e-458c-a012-1d5e4f2f3749 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:14.533012 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-84da69e6-3d6e-458c-a012-1d5e4f2f3749 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:14.534502 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-84da69e6-3d6e-458c-a012-1d5e4f2f3749 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:14.537043 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-84da69e6-3d6e-458c-a012-1d5e4f2f3749 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:14.540392 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-84da69e6-3d6e-458c-a012-1d5e4f2f3749 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:15.143912 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5df9e287-faea-48a8-82cd-3381b736bfe3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:15.159239 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5df9e287-faea-48a8-82cd-3381b736bfe3 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787" status: 200 len: 1364 microversion: 2.1 time: 0.937896 Jun 05 08:28:15.161017 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 759/1510] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:14 2022] GET /compute/v2.1/servers/35db623e-15e3-4238-8c0f-ce05bc679787 => generated 1364 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:15.167659 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1a54328c-0b7d-4df1-bc47-e149794a2624 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:15.171952 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1a54328c-0b7d-4df1-bc47-e149794a2624 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:15.185956 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1a54328c-0b7d-4df1-bc47-e149794a2624 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:15.186427 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1a54328c-0b7d-4df1-bc47-e149794a2624 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:15.190468 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1a54328c-0b7d-4df1-bc47-e149794a2624 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:15.190937 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1a54328c-0b7d-4df1-bc47-e149794a2624 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:15.543516 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-84da69e6-3d6e-458c-a012-1d5e4f2f3749 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:15.566924 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-84da69e6-3d6e-458c-a012-1d5e4f2f3749 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:15.573172 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-84da69e6-3d6e-458c-a012-1d5e4f2f3749 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:15.574744 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-84da69e6-3d6e-458c-a012-1d5e4f2f3749 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 1.066236 Jun 05 08:28:15.578670 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 752/1511] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:14 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:15.598398 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-1a54328c-0b7d-4df1-bc47-e149794a2624 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:15.599915 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e8f01190-d78b-45d7-a1d4-d34ef35a5bd6 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:15.612514 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-1a54328c-0b7d-4df1-bc47-e149794a2624 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:15.614124 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-1a54328c-0b7d-4df1-bc47-e149794a2624 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:15.615340 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1a54328c-0b7d-4df1-bc47-e149794a2624 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1753 microversion: 2.20 time: 0.453033 Jun 05 08:28:15.627225 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 760/1512] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:15 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1753 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:15.637044 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-670deb4a-7087-4a8d-940c-8d1b48680c08 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:15.646809 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-670deb4a-7087-4a8d-940c-8d1b48680c08 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] [instance: 6b642042-766c-4ca0-beda-ff29645bc2fe] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:15.662035 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-670deb4a-7087-4a8d-940c-8d1b48680c08 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:15.663722 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-670deb4a-7087-4a8d-940c-8d1b48680c08 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:15.663722 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-670deb4a-7087-4a8d-940c-8d1b48680c08 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:15.665687 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-670deb4a-7087-4a8d-940c-8d1b48680c08 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:15.671211 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:28:15.706043 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e8f01190-d78b-45d7-a1d4-d34ef35a5bd6 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/68b27b6f-877f-4ac6-be8b-cf2d0ed80d2a" status: 204 len: 0 microversion: 2.1 time: 0.110864 Jun 05 08:28:15.706947 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 753/1513] 10.222.0.33 () {58 vars in 1265 bytes} [Sun Jun 5 08:28:15 2022] DELETE /compute/v2.1/os-server-groups/68b27b6f-877f-4ac6-be8b-cf2d0ed80d2a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:28:15.721776 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c3a55cf9-b5ab-47aa-bd42-548b359e0d70 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:15.722408 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c3a55cf9-b5ab-47aa-bd42-548b359e0d70 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:15.751973 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c3a55cf9-b5ab-47aa-bd42-548b359e0d70 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:15.754063 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-670deb4a-7087-4a8d-940c-8d1b48680c08 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:15.754761 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-670deb4a-7087-4a8d-940c-8d1b48680c08 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:15.755097 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c3a55cf9-b5ab-47aa-bd42-548b359e0d70 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:15.756023 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c3a55cf9-b5ab-47aa-bd42-548b359e0d70 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:15.756512 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c3a55cf9-b5ab-47aa-bd42-548b359e0d70 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:15.757287 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-670deb4a-7087-4a8d-940c-8d1b48680c08 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Lazy-loading 'fault' on Instance uuid 6b642042-766c-4ca0-beda-ff29645bc2fe {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:15.845108 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c3a55cf9-b5ab-47aa-bd42-548b359e0d70 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:15.845557 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c3a55cf9-b5ab-47aa-bd42-548b359e0d70 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:15.846197 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-c3a55cf9-b5ab-47aa-bd42-548b359e0d70 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:15.895320 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-670deb4a-7087-4a8d-940c-8d1b48680c08 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:15.920211 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-670deb4a-7087-4a8d-940c-8d1b48680c08 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:15.922067 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-670deb4a-7087-4a8d-940c-8d1b48680c08 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e076b50c396484b9380a66e10f7f3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3870297862984ecdab229d5df4df8735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:15.923486 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-670deb4a-7087-4a8d-940c-8d1b48680c08 tempest-ServerTagsTestJSON-1850561840 tempest-ServerTagsTestJSON-1850561840-project] 10.222.0.33 "GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe" status: 200 len: 1405 microversion: 2.26 time: 0.297733 Jun 05 08:28:15.924609 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 761/1514] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:15 2022] GET /compute/v2.1/servers/6b642042-766c-4ca0-beda-ff29645bc2fe => generated 1405 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:15.929569 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c3a55cf9-b5ab-47aa-bd42-548b359e0d70 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:15.943026 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c3a55cf9-b5ab-47aa-bd42-548b359e0d70 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.232193 Jun 05 08:28:15.943906 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 754/1515] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:15 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:15.945488 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8d6fdb96-c315-4988-a2c4-3f9fb86dd38a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:15.951391 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8d6fdb96-c315-4988-a2c4-3f9fb86dd38a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 8719f86c-4f4f-4c65-b580-c5d526d05175] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:15.959783 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8d6fdb96-c315-4988-a2c4-3f9fb86dd38a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:15.962737 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8d6fdb96-c315-4988-a2c4-3f9fb86dd38a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:15.963812 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8d6fdb96-c315-4988-a2c4-3f9fb86dd38a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:15.964456 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8d6fdb96-c315-4988-a2c4-3f9fb86dd38a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:15.999519 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8d6fdb96-c315-4988-a2c4-3f9fb86dd38a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 8719f86c-4f4f-4c65-b580-c5d526d05175] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:28:16.200741 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8d6fdb96-c315-4988-a2c4-3f9fb86dd38a tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175" status: 204 len: 0 microversion: 2.1 time: 0.264931 Jun 05 08:28:16.204708 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 762/1516] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:28:15 2022] DELETE /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:28:16.209963 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c808e7ce-a1e9-4a9f-8339-20fa3d27ac74 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:16.210580 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c808e7ce-a1e9-4a9f-8339-20fa3d27ac74 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 8719f86c-4f4f-4c65-b580-c5d526d05175] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:16.229905 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c808e7ce-a1e9-4a9f-8339-20fa3d27ac74 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:16.230373 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c808e7ce-a1e9-4a9f-8339-20fa3d27ac74 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:16.231210 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c808e7ce-a1e9-4a9f-8339-20fa3d27ac74 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:16.231650 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c808e7ce-a1e9-4a9f-8339-20fa3d27ac74 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:16.309138 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-3dcbebfe-ec66-4ff1-94dd-1217e0060241 req-f1b82263-6eb7-49ee-949e-3a0c8c59d6ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b642042-766c-4ca0-beda-ff29645bc2fe", "name": "network-vif-deleted", "tag": "5cda64e7-f7fd-4236-8aea-356b93e7253d"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:28:16.322950 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:28:16.329526 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-3dcbebfe-ec66-4ff1-94dd-1217e0060241 req-f1b82263-6eb7-49ee-949e-3a0c8c59d6ca service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:16.331003 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-3dcbebfe-ec66-4ff1-94dd-1217e0060241 req-f1b82263-6eb7-49ee-949e-3a0c8c59d6ca service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:16.358412 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-3dcbebfe-ec66-4ff1-94dd-1217e0060241 req-f1b82263-6eb7-49ee-949e-3a0c8c59d6ca service nova] Creating event network-vif-deleted:5cda64e7-f7fd-4236-8aea-356b93e7253d for instance 6b642042-766c-4ca0-beda-ff29645bc2fe on n-h1-844739-1 Jun 05 08:28:16.365783 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-3dcbebfe-ec66-4ff1-94dd-1217e0060241 req-f1b82263-6eb7-49ee-949e-3a0c8c59d6ca service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062182 Jun 05 08:28:16.369703 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 763/1517] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:28:16.597622 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6ad8db67-39fb-4092-813c-c64537a41c0d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:16.598582 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6ad8db67-39fb-4092-813c-c64537a41c0d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:16.616096 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6ad8db67-39fb-4092-813c-c64537a41c0d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:16.616699 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6ad8db67-39fb-4092-813c-c64537a41c0d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:16.618253 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6ad8db67-39fb-4092-813c-c64537a41c0d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:16.619289 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6ad8db67-39fb-4092-813c-c64537a41c0d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:16.874137 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c808e7ce-a1e9-4a9f-8339-20fa3d27ac74 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:16.887897 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c808e7ce-a1e9-4a9f-8339-20fa3d27ac74 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175" status: 200 len: 1471 microversion: 2.1 time: 0.681926 Jun 05 08:28:16.889925 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 755/1518] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:16 2022] GET /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175 => generated 1471 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:16.909755 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ae512d0e-a31b-4ae2-84c4-da394457eaf8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:16.910793 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ae512d0e-a31b-4ae2-84c4-da394457eaf8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:16.926750 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ae512d0e-a31b-4ae2-84c4-da394457eaf8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:16.928677 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ae512d0e-a31b-4ae2-84c4-da394457eaf8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:16.931915 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ae512d0e-a31b-4ae2-84c4-da394457eaf8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:16.935623 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ae512d0e-a31b-4ae2-84c4-da394457eaf8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:17.298011 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6ad8db67-39fb-4092-813c-c64537a41c0d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:17.310120 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6ad8db67-39fb-4092-813c-c64537a41c0d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:17.312917 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6ad8db67-39fb-4092-813c-c64537a41c0d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:17.315859 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6ad8db67-39fb-4092-813c-c64537a41c0d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 0.723115 Jun 05 08:28:17.317179 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 764/1519] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:16 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:17.580129 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ae512d0e-a31b-4ae2-84c4-da394457eaf8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:17.595358 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ae512d0e-a31b-4ae2-84c4-da394457eaf8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:17.597203 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ae512d0e-a31b-4ae2-84c4-da394457eaf8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:17.601589 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ae512d0e-a31b-4ae2-84c4-da394457eaf8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1753 microversion: 2.20 time: 0.705535 Jun 05 08:28:17.605627 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 756/1520] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:16 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1753 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:17.851285 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-355e3177-b642-4ddb-a66c-7b623b260d93 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:17.851908 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-355e3177-b642-4ddb-a66c-7b623b260d93 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:17.858488 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-355e3177-b642-4ddb-a66c-7b623b260d93 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:17.858949 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-355e3177-b642-4ddb-a66c-7b623b260d93 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:17.859730 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-355e3177-b642-4ddb-a66c-7b623b260d93 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:17.860204 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-355e3177-b642-4ddb-a66c-7b623b260d93 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:17.907238 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-22151295-fc40-4726-bb3e-9647311613f5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:17.909202 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-22151295-fc40-4726-bb3e-9647311613f5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 8719f86c-4f4f-4c65-b580-c5d526d05175] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:17.929012 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-355e3177-b642-4ddb-a66c-7b623b260d93 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:17.929486 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-355e3177-b642-4ddb-a66c-7b623b260d93 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:17.929949 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-355e3177-b642-4ddb-a66c-7b623b260d93 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:17.933197 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-22151295-fc40-4726-bb3e-9647311613f5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:17.933901 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-22151295-fc40-4726-bb3e-9647311613f5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:17.934902 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-22151295-fc40-4726-bb3e-9647311613f5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:17.935554 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-22151295-fc40-4726-bb3e-9647311613f5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:17.948635 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:28:18.353472 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-355e3177-b642-4ddb-a66c-7b623b260d93 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:18.375628 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-355e3177-b642-4ddb-a66c-7b623b260d93 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 1.057106 Jun 05 08:28:18.390662 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 765/1521] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:17 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:18.404012 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1ceabefb-b21b-46be-a242-f9f456d7a3f6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:18.405331 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1ceabefb-b21b-46be-a242-f9f456d7a3f6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:18.417746 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ceabefb-b21b-46be-a242-f9f456d7a3f6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:18.418611 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ceabefb-b21b-46be-a242-f9f456d7a3f6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:18.420582 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ceabefb-b21b-46be-a242-f9f456d7a3f6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:18.422198 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ceabefb-b21b-46be-a242-f9f456d7a3f6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:18.469216 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-22151295-fc40-4726-bb3e-9647311613f5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:18.483635 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-22151295-fc40-4726-bb3e-9647311613f5 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175" status: 200 len: 1471 microversion: 2.1 time: 0.574291 Jun 05 08:28:18.484340 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 757/1522] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:17 2022] GET /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175 => generated 1471 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:28:18.623540 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-03116469-cce6-4bfa-b44a-91cb6009f990 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:18.624233 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-03116469-cce6-4bfa-b44a-91cb6009f990 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:18.651145 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-03116469-cce6-4bfa-b44a-91cb6009f990 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:18.652958 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-03116469-cce6-4bfa-b44a-91cb6009f990 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:18.652958 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-03116469-cce6-4bfa-b44a-91cb6009f990 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:18.654758 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-03116469-cce6-4bfa-b44a-91cb6009f990 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:18.771239 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-1ceabefb-b21b-46be-a242-f9f456d7a3f6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:18.786136 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-1ceabefb-b21b-46be-a242-f9f456d7a3f6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:18.787789 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-1ceabefb-b21b-46be-a242-f9f456d7a3f6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:18.795460 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1ceabefb-b21b-46be-a242-f9f456d7a3f6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 0.401379 Jun 05 08:28:18.799068 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 766/1523] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:18 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:19.037444 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-03116469-cce6-4bfa-b44a-91cb6009f990 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:19.051323 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-03116469-cce6-4bfa-b44a-91cb6009f990 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:19.053276 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-03116469-cce6-4bfa-b44a-91cb6009f990 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:19.062334 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-03116469-cce6-4bfa-b44a-91cb6009f990 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1753 microversion: 2.20 time: 0.443422 Jun 05 08:28:19.063573 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 758/1524] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:18 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1753 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:28:19.397917 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-15ff69a4-0edb-4dec-b9ba-cb4d3d24beb7 req-edc7996c-3ffd-4041-877e-812404ee8d5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8719f86c-4f4f-4c65-b580-c5d526d05175", "name": "network-vif-deleted", "tag": "5b4dce05-9412-45a0-ac85-62098ec0ca15"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:28:19.410196 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8a1a3c68-1027-4fc3-ac57-f66e297f7ec5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:19.410904 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8a1a3c68-1027-4fc3-ac57-f66e297f7ec5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:19.447226 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-15ff69a4-0edb-4dec-b9ba-cb4d3d24beb7 req-edc7996c-3ffd-4041-877e-812404ee8d5d service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:19.447841 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-15ff69a4-0edb-4dec-b9ba-cb4d3d24beb7 req-edc7996c-3ffd-4041-877e-812404ee8d5d service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:19.448703 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8a1a3c68-1027-4fc3-ac57-f66e297f7ec5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:19.450136 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8a1a3c68-1027-4fc3-ac57-f66e297f7ec5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:19.454477 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8a1a3c68-1027-4fc3-ac57-f66e297f7ec5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:19.455935 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8a1a3c68-1027-4fc3-ac57-f66e297f7ec5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:19.497706 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-15ff69a4-0edb-4dec-b9ba-cb4d3d24beb7 req-edc7996c-3ffd-4041-877e-812404ee8d5d service nova] Creating event network-vif-deleted:5b4dce05-9412-45a0-ac85-62098ec0ca15 for instance 8719f86c-4f4f-4c65-b580-c5d526d05175 on n-h1-844739-1 Jun 05 08:28:19.515917 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-15ff69a4-0edb-4dec-b9ba-cb4d3d24beb7 req-edc7996c-3ffd-4041-877e-812404ee8d5d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121779 Jun 05 08:28:19.521264 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 759/1525] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:28:19.537520 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3c99087a-bb98-4271-99dc-4e124d79c818 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:19.546335 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3c99087a-bb98-4271-99dc-4e124d79c818 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] [instance: 8719f86c-4f4f-4c65-b580-c5d526d05175] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:19.547443 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8a1a3c68-1027-4fc3-ac57-f66e297f7ec5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:19.549544 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8a1a3c68-1027-4fc3-ac57-f66e297f7ec5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:19.550619 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-8a1a3c68-1027-4fc3-ac57-f66e297f7ec5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:19.567930 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3c99087a-bb98-4271-99dc-4e124d79c818 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:19.572300 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3c99087a-bb98-4271-99dc-4e124d79c818 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:19.578859 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3c99087a-bb98-4271-99dc-4e124d79c818 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:19.579321 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3c99087a-bb98-4271-99dc-4e124d79c818 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:19.629648 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8a1a3c68-1027-4fc3-ac57-f66e297f7ec5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:19.639070 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8a1a3c68-1027-4fc3-ac57-f66e297f7ec5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.248274 Jun 05 08:28:19.643167 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 767/1526] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:19 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:19.711014 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3c99087a-bb98-4271-99dc-4e124d79c818 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:19.716883 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3c99087a-bb98-4271-99dc-4e124d79c818 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:19.718690 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-3c99087a-bb98-4271-99dc-4e124d79c818 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Lazy-loading 'fault' on Instance uuid 8719f86c-4f4f-4c65-b580-c5d526d05175 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:19.817332 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-228c46b1-9efe-403b-ae91-aba0124dda88 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:19.818000 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-228c46b1-9efe-403b-ae91-aba0124dda88 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:19.826295 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-228c46b1-9efe-403b-ae91-aba0124dda88 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:19.827084 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-228c46b1-9efe-403b-ae91-aba0124dda88 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:19.827629 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-228c46b1-9efe-403b-ae91-aba0124dda88 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:19.828083 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-228c46b1-9efe-403b-ae91-aba0124dda88 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:19.910838 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3c99087a-bb98-4271-99dc-4e124d79c818 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27beb829232e464092b06d904b9d6ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241947581244d30ba1528e6d5fad743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:19.922462 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3c99087a-bb98-4271-99dc-4e124d79c818 tempest-ServersOnMultiNodesTest-583633124 tempest-ServersOnMultiNodesTest-583633124-project] 10.222.0.33 "GET /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175" status: 200 len: 1367 microversion: 2.1 time: 0.398773 Jun 05 08:28:19.922917 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 760/1527] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:19 2022] GET /compute/v2.1/servers/8719f86c-4f4f-4c65-b580-c5d526d05175 => generated 1367 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:20.081865 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-756b1748-b7cc-4cd5-9c26-452042365507 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:20.083372 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-756b1748-b7cc-4cd5-9c26-452042365507 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:20.100126 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-756b1748-b7cc-4cd5-9c26-452042365507 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:20.113253 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-756b1748-b7cc-4cd5-9c26-452042365507 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:20.117021 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-756b1748-b7cc-4cd5-9c26-452042365507 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:20.120849 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-756b1748-b7cc-4cd5-9c26-452042365507 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:20.381083 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-228c46b1-9efe-403b-ae91-aba0124dda88 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:20.396982 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-228c46b1-9efe-403b-ae91-aba0124dda88 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:20.398710 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-228c46b1-9efe-403b-ae91-aba0124dda88 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:20.400441 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-228c46b1-9efe-403b-ae91-aba0124dda88 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 0.587608 Jun 05 08:28:20.401020 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 768/1528] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:19 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:28:20.514843 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-756b1748-b7cc-4cd5-9c26-452042365507 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:20.536668 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-756b1748-b7cc-4cd5-9c26-452042365507 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:20.540109 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-756b1748-b7cc-4cd5-9c26-452042365507 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:20.542152 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-756b1748-b7cc-4cd5-9c26-452042365507 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1753 microversion: 2.20 time: 0.464732 Jun 05 08:28:20.545463 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 761/1529] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:20 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1753 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:20.661350 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1cf7fc2d-d42e-4fcb-8c1a-0331fefc23d0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:20.662124 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1cf7fc2d-d42e-4fcb-8c1a-0331fefc23d0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:20.675864 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1cf7fc2d-d42e-4fcb-8c1a-0331fefc23d0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:20.676354 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1cf7fc2d-d42e-4fcb-8c1a-0331fefc23d0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:20.677147 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1cf7fc2d-d42e-4fcb-8c1a-0331fefc23d0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:20.681773 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1cf7fc2d-d42e-4fcb-8c1a-0331fefc23d0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:20.766482 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1cf7fc2d-d42e-4fcb-8c1a-0331fefc23d0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:20.767370 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1cf7fc2d-d42e-4fcb-8c1a-0331fefc23d0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:20.768207 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-1cf7fc2d-d42e-4fcb-8c1a-0331fefc23d0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:20.831591 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1cf7fc2d-d42e-4fcb-8c1a-0331fefc23d0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:20.848965 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1cf7fc2d-d42e-4fcb-8c1a-0331fefc23d0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.192548 Jun 05 08:28:20.850995 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 762/1530] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:20 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:20.922436 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-67359159-0e3e-4200-aeff-b0d9a1aecf0e tempest-ImagesDeleteNegativeTestJSON-778108640 tempest-ImagesDeleteNegativeTestJSON-778108640-project] 10.222.0.33 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.497183 Jun 05 08:28:20.926912 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 769/1531] 10.222.0.33 () {58 vars in 1127 bytes} [Sun Jun 5 08:28:20 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 522 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 05 08:28:20.932525 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-50ee4c98-c339-4026-b596-1bed39562905 tempest-ImagesDeleteNegativeTestJSON-778108640 tempest-ImagesDeleteNegativeTestJSON-778108640-project] Calling method '.version_select at 0x7f24403c59d0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:21.031352 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-50ee4c98-c339-4026-b596-1bed39562905 tempest-ImagesDeleteNegativeTestJSON-778108640 tempest-ImagesDeleteNegativeTestJSON-778108640-project] HTTP exception thrown: Image not found. Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-50ee4c98-c339-4026-b596-1bed39562905 tempest-ImagesDeleteNegativeTestJSON-778108640 tempest-ImagesDeleteNegativeTestJSON-778108640-project] Request method failure captured: Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGkjbNTtzPHW7ZRAKVDzMizA6TdVSRdLCkECecEyuIWDZAko8OqfdOK0nV9YnRf3jS3O19biWN_2LkORHhmTI6VKwhERPtdW_XCQf0ctJNe1_PYj7VwCcKOcmkW4zo9cKa4ug-UsP9oCXOimHg8AHHQDJ6fC-EL5juaSH2l_N3JufnM Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: d15ba8df42cb46ca8a229af46a5ed620 Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-778108640 Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d15ba8df42cb46ca8a229af46a5ed620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d15ba8df42cb46ca8a229af46a5ed620"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d15ba8df42cb46ca8a229af46a5ed620", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d15ba8df42cb46ca8a229af46a5ed620"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-778108640 Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: d15ba8df42cb46ca8a229af46a5ed620 Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-778108640 Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ImagesDeleteNegativeTestJSON-778108640-project Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 32ae103b36374493b808243c33957890 Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-778108640-project Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: exception: Image not found. Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '-1'} Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.033547 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:28:21.038569 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:28:21.038569 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:28:21.038569 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:28:21.038569 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:28:21.038569 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:28:21.038569 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:28:21.038569 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:28:21.038569 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:28:21.038569 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 05 08:28:21.038569 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 05 08:28:21.038569 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 05 08:28:21.038569 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.038569 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:28:21.038569 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.038569 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:28:21.038569 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:28:21.038569 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:28:21.038569 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:28:21.038569 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:28:21.038569 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 05 08:28:21.038569 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.038569 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-50ee4c98-c339-4026-b596-1bed39562905 tempest-ImagesDeleteNegativeTestJSON-778108640 tempest-ImagesDeleteNegativeTestJSON-778108640-project] Returning 404 to user: Image not found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:28:21.038569 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-50ee4c98-c339-4026-b596-1bed39562905 tempest-ImagesDeleteNegativeTestJSON-778108640 tempest-ImagesDeleteNegativeTestJSON-778108640-project] 10.222.0.33 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.106782 Jun 05 08:28:21.038569 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 763/1532] 10.222.0.33 () {58 vars in 1133 bytes} [Sun Jun 5 08:28:20 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:28:21.049021 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3c539e32-11a7-440f-bf98-b7263cf8f95c tempest-ImagesDeleteNegativeTestJSON-778108640 tempest-ImagesDeleteNegativeTestJSON-778108640-project] Calling method '.version_select at 0x7f2433992550>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:21.091847 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-3c539e32-11a7-440f-bf98-b7263cf8f95c tempest-ImagesDeleteNegativeTestJSON-778108640 tempest-ImagesDeleteNegativeTestJSON-778108640-project] HTTP exception thrown: Image not found. Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3c539e32-11a7-440f-bf98-b7263cf8f95c tempest-ImagesDeleteNegativeTestJSON-778108640 tempest-ImagesDeleteNegativeTestJSON-778108640-project] Request method failure captured: Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: request: DELETE /compute/v2.1/images/0785a2cd-2953-4a04-8b12-728f06017dfj HTTP/1.1 Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGkjbNTtzPHW7ZRAKVDzMizA6TdVSRdLCkECecEyuIWDZAko8OqfdOK0nV9YnRf3jS3O19biWN_2LkORHhmTI6VKwhERPtdW_XCQf0ctJNe1_PYj7VwCcKOcmkW4zo9cKa4ug-UsP9oCXOimHg8AHHQDJ6fC-EL5juaSH2l_N3JufnM Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: d15ba8df42cb46ca8a229af46a5ed620 Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-778108640 Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d15ba8df42cb46ca8a229af46a5ed620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d15ba8df42cb46ca8a229af46a5ed620"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d15ba8df42cb46ca8a229af46a5ed620", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d15ba8df42cb46ca8a229af46a5ed620"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-778108640 Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: d15ba8df42cb46ca8a229af46a5ed620 Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-778108640 Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ImagesDeleteNegativeTestJSON-778108640-project Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 32ae103b36374493b808243c33957890 Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-778108640-project Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: exception: Image not found. Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '0785a2cd-2953-4a04-8b12-728f06017dfj'} Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0785a2cd-2953-4a04-8b12-728f06017dfj to delete Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0785a2cd-2953-4a04-8b12-728f06017dfj could not be found. Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:28:21.094662 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.104471 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:28:21.104471 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:28:21.104471 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:28:21.104471 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:28:21.104471 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:28:21.104471 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:28:21.104471 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:28:21.104471 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:28:21.104471 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:28:21.104471 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 05 08:28:21.104471 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 05 08:28:21.104471 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 05 08:28:21.104471 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.104471 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:28:21.104471 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.104471 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:28:21.104471 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:28:21.104471 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:28:21.104471 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:28:21.104471 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:28:21.104471 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 05 08:28:21.104471 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.104471 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3c539e32-11a7-440f-bf98-b7263cf8f95c tempest-ImagesDeleteNegativeTestJSON-778108640 tempest-ImagesDeleteNegativeTestJSON-778108640-project] Returning 404 to user: Image not found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:28:21.104471 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3c539e32-11a7-440f-bf98-b7263cf8f95c tempest-ImagesDeleteNegativeTestJSON-778108640 tempest-ImagesDeleteNegativeTestJSON-778108640-project] 10.222.0.33 "DELETE /compute/v2.1/images/0785a2cd-2953-4a04-8b12-728f06017dfj" status: 404 len: 62 microversion: 2.1 time: 0.053962 Jun 05 08:28:21.104471 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 770/1533] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:21 2022] DELETE /compute/v2.1/images/0785a2cd-2953-4a04-8b12-728f06017dfj => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:28:21.107776 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-045924d6-c29e-4ec2-9926-b3d38428650a tempest-ImagesDeleteNegativeTestJSON-778108640 tempest-ImagesDeleteNegativeTestJSON-778108640-project] Calling method '.version_select at 0x7f2433c51430>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:21.139234 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-045924d6-c29e-4ec2-9926-b3d38428650a tempest-ImagesDeleteNegativeTestJSON-778108640 tempest-ImagesDeleteNegativeTestJSON-778108640-project] HTTP exception thrown: Image not found. Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-045924d6-c29e-4ec2-9926-b3d38428650a tempest-ImagesDeleteNegativeTestJSON-778108640 tempest-ImagesDeleteNegativeTestJSON-778108640-project] Request method failure captured: Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: request: DELETE /compute/v2.1/images/42464eb5-b2e8-468f-aaba-cc3d1717f79c1 HTTP/1.1 Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGkjbNTtzPHW7ZRAKVDzMizA6TdVSRdLCkECecEyuIWDZAko8OqfdOK0nV9YnRf3jS3O19biWN_2LkORHhmTI6VKwhERPtdW_XCQf0ctJNe1_PYj7VwCcKOcmkW4zo9cKa4ug-UsP9oCXOimHg8AHHQDJ6fC-EL5juaSH2l_N3JufnM Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: d15ba8df42cb46ca8a229af46a5ed620 Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-778108640 Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d15ba8df42cb46ca8a229af46a5ed620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d15ba8df42cb46ca8a229af46a5ed620"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d15ba8df42cb46ca8a229af46a5ed620", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d15ba8df42cb46ca8a229af46a5ed620"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-778108640 Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: d15ba8df42cb46ca8a229af46a5ed620 Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-778108640 Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ImagesDeleteNegativeTestJSON-778108640-project Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 32ae103b36374493b808243c33957890 Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-778108640-project Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: exception: Image not found. Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '42464eb5-b2e8-468f-aaba-cc3d1717f79c1'} Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 42464eb5-b2e8-468f-aaba-cc3d1717f79c1 to delete Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 42464eb5-b2e8-468f-aaba-cc3d1717f79c1 could not be found. Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:28:21.144591 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.150645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:28:21.150645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:28:21.150645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:28:21.150645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:28:21.150645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:28:21.150645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:28:21.150645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:28:21.150645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:28:21.150645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:28:21.150645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 05 08:28:21.150645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 05 08:28:21.150645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 05 08:28:21.150645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.150645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:28:21.150645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.150645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:28:21.150645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:28:21.150645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:28:21.150645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:28:21.150645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:28:21.150645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 05 08:28:21.150645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.150645 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-045924d6-c29e-4ec2-9926-b3d38428650a tempest-ImagesDeleteNegativeTestJSON-778108640 tempest-ImagesDeleteNegativeTestJSON-778108640-project] Returning 404 to user: Image not found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:28:21.150645 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-045924d6-c29e-4ec2-9926-b3d38428650a tempest-ImagesDeleteNegativeTestJSON-778108640 tempest-ImagesDeleteNegativeTestJSON-778108640-project] 10.222.0.33 "DELETE /compute/v2.1/images/42464eb5-b2e8-468f-aaba-cc3d1717f79c1" status: 404 len: 62 microversion: 2.1 time: 0.046966 Jun 05 08:28:21.156679 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 764/1534] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:28:21 2022] DELETE /compute/v2.1/images/42464eb5-b2e8-468f-aaba-cc3d1717f79c1 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:28:21.161082 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f040399f-650a-4814-844f-51dd169fc495 tempest-ImagesDeleteNegativeTestJSON-778108640 tempest-ImagesDeleteNegativeTestJSON-778108640-project] Calling method '.version_select at 0x7f243395c310>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:21.190688 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-f040399f-650a-4814-844f-51dd169fc495 tempest-ImagesDeleteNegativeTestJSON-778108640 tempest-ImagesDeleteNegativeTestJSON-778108640-project] HTTP exception thrown: Image not found. Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f040399f-650a-4814-844f-51dd169fc495 tempest-ImagesDeleteNegativeTestJSON-778108640 tempest-ImagesDeleteNegativeTestJSON-778108640-project] Request method failure captured: Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: request: DELETE /compute/v2.1/images/tempest-invalid-1572600002 HTTP/1.1 Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGkjbNTtzPHW7ZRAKVDzMizA6TdVSRdLCkECecEyuIWDZAko8OqfdOK0nV9YnRf3jS3O19biWN_2LkORHhmTI6VKwhERPtdW_XCQf0ctJNe1_PYj7VwCcKOcmkW4zo9cKa4ug-UsP9oCXOimHg8AHHQDJ6fC-EL5juaSH2l_N3JufnM Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: d15ba8df42cb46ca8a229af46a5ed620 Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-778108640 Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d15ba8df42cb46ca8a229af46a5ed620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d15ba8df42cb46ca8a229af46a5ed620"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d15ba8df42cb46ca8a229af46a5ed620", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d15ba8df42cb46ca8a229af46a5ed620"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-778108640 Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: d15ba8df42cb46ca8a229af46a5ed620 Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-778108640 Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ImagesDeleteNegativeTestJSON-778108640-project Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 32ae103b36374493b808243c33957890 Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-778108640-project Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: exception: Image not found. Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'tempest-invalid-1572600002'} Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1572600002 to delete Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1572600002 could not be found. Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.192485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:28:21.197183 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:28:21.197183 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:28:21.197183 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:28:21.197183 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:28:21.197183 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:28:21.197183 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:28:21.197183 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:28:21.197183 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:28:21.197183 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 05 08:28:21.197183 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 05 08:28:21.197183 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 05 08:28:21.197183 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.197183 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:28:21.197183 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.197183 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:28:21.197183 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:28:21.197183 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:28:21.197183 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:28:21.197183 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:28:21.197183 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 05 08:28:21.197183 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.197183 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f040399f-650a-4814-844f-51dd169fc495 tempest-ImagesDeleteNegativeTestJSON-778108640 tempest-ImagesDeleteNegativeTestJSON-778108640-project] Returning 404 to user: Image not found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:28:21.197183 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f040399f-650a-4814-844f-51dd169fc495 tempest-ImagesDeleteNegativeTestJSON-778108640 tempest-ImagesDeleteNegativeTestJSON-778108640-project] 10.222.0.33 "DELETE /compute/v2.1/images/tempest-invalid-1572600002" status: 404 len: 62 microversion: 2.1 time: 0.037542 Jun 05 08:28:21.197183 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 771/1535] 10.222.0.33 () {58 vars in 1205 bytes} [Sun Jun 5 08:28:21 2022] DELETE /compute/v2.1/images/tempest-invalid-1572600002 => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:28:21.204400 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-132badff-8913-4012-8463-e423e8f211ff tempest-ImagesDeleteNegativeTestJSON-778108640 tempest-ImagesDeleteNegativeTestJSON-778108640-project] Calling method '.version_select at 0x7f2433eb4160>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:21.241011 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-132badff-8913-4012-8463-e423e8f211ff tempest-ImagesDeleteNegativeTestJSON-778108640 tempest-ImagesDeleteNegativeTestJSON-778108640-project] HTTP exception thrown: Image not found. Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-132badff-8913-4012-8463-e423e8f211ff tempest-ImagesDeleteNegativeTestJSON-778108640 tempest-ImagesDeleteNegativeTestJSON-778108640-project] Request method failure captured: Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: request: DELETE /compute/v2.1/images/438c8258-e04e-406d-8157-6237c81e8fdb HTTP/1.1 Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGkjbNTtzPHW7ZRAKVDzMizA6TdVSRdLCkECecEyuIWDZAko8OqfdOK0nV9YnRf3jS3O19biWN_2LkORHhmTI6VKwhERPtdW_XCQf0ctJNe1_PYj7VwCcKOcmkW4zo9cKa4ug-UsP9oCXOimHg8AHHQDJ6fC-EL5juaSH2l_N3JufnM Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: d15ba8df42cb46ca8a229af46a5ed620 Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-778108640 Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d15ba8df42cb46ca8a229af46a5ed620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d15ba8df42cb46ca8a229af46a5ed620"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d15ba8df42cb46ca8a229af46a5ed620", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d15ba8df42cb46ca8a229af46a5ed620"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-778108640 Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: d15ba8df42cb46ca8a229af46a5ed620 Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-778108640 Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ImagesDeleteNegativeTestJSON-778108640-project Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 32ae103b36374493b808243c33957890 Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-778108640-project Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: exception: Image not found. Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '438c8258-e04e-406d-8157-6237c81e8fdb'} Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 438c8258-e04e-406d-8157-6237c81e8fdb to delete Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 438c8258-e04e-406d-8157-6237c81e8fdb could not be found. Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:28:21.243658 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.247769 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:28:21.247769 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:28:21.247769 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:28:21.247769 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:28:21.247769 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:28:21.247769 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:28:21.247769 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:28:21.247769 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:28:21.247769 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:28:21.247769 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 05 08:28:21.247769 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 05 08:28:21.247769 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 05 08:28:21.247769 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.247769 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:28:21.247769 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.247769 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:28:21.247769 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:28:21.247769 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:28:21.247769 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:28:21.247769 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:28:21.247769 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 05 08:28:21.247769 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:28:21.251323 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-132badff-8913-4012-8463-e423e8f211ff tempest-ImagesDeleteNegativeTestJSON-778108640 tempest-ImagesDeleteNegativeTestJSON-778108640-project] Returning 404 to user: Image not found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:28:21.252404 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-132badff-8913-4012-8463-e423e8f211ff tempest-ImagesDeleteNegativeTestJSON-778108640 tempest-ImagesDeleteNegativeTestJSON-778108640-project] 10.222.0.33 "DELETE /compute/v2.1/images/438c8258-e04e-406d-8157-6237c81e8fdb" status: 404 len: 62 microversion: 2.1 time: 0.052285 Jun 05 08:28:21.257285 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 765/1536] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:21 2022] DELETE /compute/v2.1/images/438c8258-e04e-406d-8157-6237c81e8fdb => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:28:21.420689 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-aadf81ce-df60-4f61-a69e-0641fd33ec59 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:21.421302 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-aadf81ce-df60-4f61-a69e-0641fd33ec59 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:21.428459 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aadf81ce-df60-4f61-a69e-0641fd33ec59 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:21.428911 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aadf81ce-df60-4f61-a69e-0641fd33ec59 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:21.429682 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aadf81ce-df60-4f61-a69e-0641fd33ec59 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:21.430167 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aadf81ce-df60-4f61-a69e-0641fd33ec59 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:21.564118 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7bb2e808-04cf-40f2-990a-93ae754a5c70 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:21.565055 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7bb2e808-04cf-40f2-990a-93ae754a5c70 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:21.579053 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7bb2e808-04cf-40f2-990a-93ae754a5c70 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:21.579786 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7bb2e808-04cf-40f2-990a-93ae754a5c70 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:21.581237 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7bb2e808-04cf-40f2-990a-93ae754a5c70 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:21.582016 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7bb2e808-04cf-40f2-990a-93ae754a5c70 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:21.776677 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-aadf81ce-df60-4f61-a69e-0641fd33ec59 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:21.822170 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-aadf81ce-df60-4f61-a69e-0641fd33ec59 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:21.833766 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-aadf81ce-df60-4f61-a69e-0641fd33ec59 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:21.836690 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7bb2e808-04cf-40f2-990a-93ae754a5c70 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:21.837750 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-aadf81ce-df60-4f61-a69e-0641fd33ec59 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 0.422954 Jun 05 08:28:21.838384 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 772/1537] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:21 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:21.847331 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7bb2e808-04cf-40f2-990a-93ae754a5c70 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:21.850397 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7bb2e808-04cf-40f2-990a-93ae754a5c70 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:21.852254 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7bb2e808-04cf-40f2-990a-93ae754a5c70 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1753 microversion: 2.20 time: 0.292775 Jun 05 08:28:21.863375 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 766/1538] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:21 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1753 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:21.873499 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-dc1b1057-0ee7-463e-a869-f5943bc2d6b3 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:21.881978 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-dc1b1057-0ee7-463e-a869-f5943bc2d6b3 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:21.889848 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc1b1057-0ee7-463e-a869-f5943bc2d6b3 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:21.890238 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc1b1057-0ee7-463e-a869-f5943bc2d6b3 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:21.891663 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc1b1057-0ee7-463e-a869-f5943bc2d6b3 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:21.892024 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc1b1057-0ee7-463e-a869-f5943bc2d6b3 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:21.937444 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc1b1057-0ee7-463e-a869-f5943bc2d6b3 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:21.938620 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc1b1057-0ee7-463e-a869-f5943bc2d6b3 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:21.939252 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-dc1b1057-0ee7-463e-a869-f5943bc2d6b3 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:21.998316 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-dc1b1057-0ee7-463e-a869-f5943bc2d6b3 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:22.007807 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-dc1b1057-0ee7-463e-a869-f5943bc2d6b3 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.141463 Jun 05 08:28:22.019804 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 773/1539] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:21 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:22.856614 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d3661be1-0371-4b15-95a2-f3b2605a1731 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:22.857865 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d3661be1-0371-4b15-95a2-f3b2605a1731 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:22.871712 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-86b6a68b-542b-477e-9f06-cf135853fe02 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:22.872369 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-86b6a68b-542b-477e-9f06-cf135853fe02 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:22.887550 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d3661be1-0371-4b15-95a2-f3b2605a1731 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:22.888420 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d3661be1-0371-4b15-95a2-f3b2605a1731 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:22.891470 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d3661be1-0371-4b15-95a2-f3b2605a1731 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:22.891802 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-86b6a68b-542b-477e-9f06-cf135853fe02 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:22.892485 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-86b6a68b-542b-477e-9f06-cf135853fe02 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:22.893135 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d3661be1-0371-4b15-95a2-f3b2605a1731 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:22.899355 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-86b6a68b-542b-477e-9f06-cf135853fe02 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:22.900080 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-86b6a68b-542b-477e-9f06-cf135853fe02 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:23.128837 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-86b6a68b-542b-477e-9f06-cf135853fe02 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:23.138542 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-86b6a68b-542b-477e-9f06-cf135853fe02 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:23.141346 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-86b6a68b-542b-477e-9f06-cf135853fe02 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:23.142855 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-86b6a68b-542b-477e-9f06-cf135853fe02 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1753 microversion: 2.20 time: 0.276012 Jun 05 08:28:23.156149 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 774/1540] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:22 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1753 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:23.169822 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e1959293-c210-4b2e-a028-ceb51592fe20 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:23.170806 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e1959293-c210-4b2e-a028-ceb51592fe20 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:23.177578 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e1959293-c210-4b2e-a028-ceb51592fe20 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:23.178300 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e1959293-c210-4b2e-a028-ceb51592fe20 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:23.179650 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e1959293-c210-4b2e-a028-ceb51592fe20 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:23.180309 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e1959293-c210-4b2e-a028-ceb51592fe20 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:23.218239 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e1959293-c210-4b2e-a028-ceb51592fe20 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:23.218993 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e1959293-c210-4b2e-a028-ceb51592fe20 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:23.219607 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-e1959293-c210-4b2e-a028-ceb51592fe20 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:23.265984 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e1959293-c210-4b2e-a028-ceb51592fe20 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:23.276080 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e1959293-c210-4b2e-a028-ceb51592fe20 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.118163 Jun 05 08:28:23.286410 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 775/1541] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:23 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:23.593354 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d3661be1-0371-4b15-95a2-f3b2605a1731 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:23.604809 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d3661be1-0371-4b15-95a2-f3b2605a1731 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:23.606344 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d3661be1-0371-4b15-95a2-f3b2605a1731 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:23.608030 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d3661be1-0371-4b15-95a2-f3b2605a1731 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 0.756505 Jun 05 08:28:23.608911 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 767/1542] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:22 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:24.162711 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-df2e9f20-9b79-4e3a-9fcb-67fde54c00cf tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:24.164389 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-df2e9f20-9b79-4e3a-9fcb-67fde54c00cf tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:24.173543 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-df2e9f20-9b79-4e3a-9fcb-67fde54c00cf tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:24.174362 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-df2e9f20-9b79-4e3a-9fcb-67fde54c00cf tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:24.175413 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-df2e9f20-9b79-4e3a-9fcb-67fde54c00cf tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:24.176104 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-df2e9f20-9b79-4e3a-9fcb-67fde54c00cf tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:24.197856 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:28:24.294822 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-305d8746-8480-4912-9943-e2c41f8d8fe0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:24.296175 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-305d8746-8480-4912-9943-e2c41f8d8fe0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:24.311224 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-305d8746-8480-4912-9943-e2c41f8d8fe0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:24.325243 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-305d8746-8480-4912-9943-e2c41f8d8fe0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:24.326720 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-305d8746-8480-4912-9943-e2c41f8d8fe0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:24.327387 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-305d8746-8480-4912-9943-e2c41f8d8fe0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:24.395135 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-305d8746-8480-4912-9943-e2c41f8d8fe0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:24.395685 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-305d8746-8480-4912-9943-e2c41f8d8fe0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:24.396254 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-305d8746-8480-4912-9943-e2c41f8d8fe0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:24.429885 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-df2e9f20-9b79-4e3a-9fcb-67fde54c00cf tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:24.440123 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-df2e9f20-9b79-4e3a-9fcb-67fde54c00cf tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:24.441814 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-df2e9f20-9b79-4e3a-9fcb-67fde54c00cf tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:24.442995 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-df2e9f20-9b79-4e3a-9fcb-67fde54c00cf tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1753 microversion: 2.20 time: 0.284234 Jun 05 08:28:24.443546 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 776/1543] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:24 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1753 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:28:24.462522 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-305d8746-8480-4912-9943-e2c41f8d8fe0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:24.471357 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-305d8746-8480-4912-9943-e2c41f8d8fe0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.182017 Jun 05 08:28:24.472013 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 768/1544] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:24 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:28:24.627302 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1d70ec1e-df05-4c92-beee-07f834e45a68 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:24.627961 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1d70ec1e-df05-4c92-beee-07f834e45a68 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:24.635056 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1d70ec1e-df05-4c92-beee-07f834e45a68 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:24.635867 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1d70ec1e-df05-4c92-beee-07f834e45a68 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:24.637019 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1d70ec1e-df05-4c92-beee-07f834e45a68 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:24.637691 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1d70ec1e-df05-4c92-beee-07f834e45a68 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:24.860153 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1d70ec1e-df05-4c92-beee-07f834e45a68 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:24.870325 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1d70ec1e-df05-4c92-beee-07f834e45a68 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:24.872882 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1d70ec1e-df05-4c92-beee-07f834e45a68 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:24.875046 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1d70ec1e-df05-4c92-beee-07f834e45a68 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 0.253086 Jun 05 08:28:24.876400 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0c35071b-88e1-4213-ac83-9277e63cb272 tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:24.887064 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0c35071b-88e1-4213-ac83-9277e63cb272 tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.439129 Jun 05 08:28:24.888446 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 777/1545] 10.222.0.33 () {58 vars in 1136 bytes} [Sun Jun 5 08:28:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:28:24.888770 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 769/1546] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:24 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:24.905483 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f979ab8d-f139-4ace-95aa-7e1b54795cbd tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:24.933860 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f979ab8d-f139-4ace-95aa-7e1b54795cbd tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] 10.222.0.33 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.032493 Jun 05 08:28:24.935441 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 778/1547] 10.222.0.33 () {58 vars in 1124 bytes} [Sun Jun 5 08:28:24 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:24.948997 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-41d8312e-87dd-4771-ae61-bc042b8f3340 tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:24.959900 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-41d8312e-87dd-4771-ae61-bc042b8f3340 tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015721 Jun 05 08:28:24.961800 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 779/1548] 10.222.0.33 () {58 vars in 1136 bytes} [Sun Jun 5 08:28:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:28:24.973725 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a72a5372-f078-4b9c-9ab8-56a6e974b6b3 tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:24.991263 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0797a295-2f03-4bf3-bcbb-c65909779bfe tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1146476687", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:28:25.000972 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a72a5372-f078-4b9c-9ab8-56a6e974b6b3 tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031707 Jun 05 08:28:25.001567 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 780/1549] 10.222.0.33 () {58 vars in 1136 bytes} [Sun Jun 5 08:28:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:28:25.013533 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-68d89551-f043-46de-b3b9-046a7accfee7 tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:25.043594 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-68d89551-f043-46de-b3b9-046a7accfee7 tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.035311 Jun 05 08:28:25.048183 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 781/1550] 10.222.0.33 () {58 vars in 1164 bytes} [Sun Jun 5 08:28:25 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:28:25.058511 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-0797a295-2f03-4bf3-bcbb-c65909779bfe tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] validate_networks() for None {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:28:25.061149 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7f6e2b73-9905-4881-9a2a-bd6d9b3c9cf3 tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:25.074670 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7f6e2b73-9905-4881-9a2a-bd6d9b3c9cf3 tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018694 Jun 05 08:28:25.075749 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 782/1551] 10.222.0.33 () {58 vars in 1136 bytes} [Sun Jun 5 08:28:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:28:25.092365 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0333ac46-7f49-41e9-a118-4a1c2f5b08d6 tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:25.124696 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0333ac46-7f49-41e9-a118-4a1c2f5b08d6 tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.039257 Jun 05 08:28:25.125321 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 783/1552] 10.222.0.33 () {58 vars in 1168 bytes} [Sun Jun 5 08:28:25 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:25.140657 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-cc379c5d-63ec-45c8-8cbe-59133afcd629 tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:25.156422 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-cc379c5d-63ec-45c8-8cbe-59133afcd629 tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.020051 Jun 05 08:28:25.163351 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 784/1553] 10.222.0.33 () {58 vars in 1160 bytes} [Sun Jun 5 08:28:25 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:28:25.170624 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-45fb24b9-327e-4009-a4c5-32a6583676aa tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:25.184366 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-45fb24b9-327e-4009-a4c5-32a6583676aa tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018888 Jun 05 08:28:25.191684 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 785/1554] 10.222.0.33 () {58 vars in 1136 bytes} [Sun Jun 5 08:28:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:28:25.197603 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4d0137e6-347a-4301-8361-76c0eaa64c6b tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:25.237832 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4d0137e6-347a-4301-8361-76c0eaa64c6b tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.044997 Jun 05 08:28:25.247316 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 786/1555] 10.222.0.33 () {58 vars in 1166 bytes} [Sun Jun 5 08:28:25 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:25.257446 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5270e869-ecc5-4914-aecd-0c1a37f31021 tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:25.269790 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5270e869-ecc5-4914-aecd-0c1a37f31021 tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016250 Jun 05 08:28:25.271459 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 787/1556] 10.222.0.33 () {58 vars in 1136 bytes} [Sun Jun 5 08:28:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:28:25.286226 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d89444b5-2606-4b8f-b3af-b72c24c62f1d tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:25.312573 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d89444b5-2606-4b8f-b3af-b72c24c62f1d tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] 10.222.0.33 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.029916 Jun 05 08:28:25.316206 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 788/1557] 10.222.0.33 () {58 vars in 1143 bytes} [Sun Jun 5 08:28:25 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:25.318115 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-0797a295-2f03-4bf3-bcbb-c65909779bfe tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:28:25.318538 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-0797a295-2f03-4bf3-bcbb-c65909779bfe tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:28:25.319059 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-0797a295-2f03-4bf3-bcbb-c65909779bfe tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:28:25.321097 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-0797a295-2f03-4bf3-bcbb-c65909779bfe tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:28:25.323239 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-0797a295-2f03-4bf3-bcbb-c65909779bfe tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:28:25.328320 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-de492a03-3417-43b1-9ccb-2945733ddac9 tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:25.339193 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-de492a03-3417-43b1-9ccb-2945733ddac9 tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016209 Jun 05 08:28:25.345144 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 789/1558] 10.222.0.33 () {58 vars in 1136 bytes} [Sun Jun 5 08:28:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:28:25.345304 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0797a295-2f03-4bf3-bcbb-c65909779bfe tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:25.345304 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0797a295-2f03-4bf3-bcbb-c65909779bfe tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:25.346206 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0797a295-2f03-4bf3-bcbb-c65909779bfe tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:25.346752 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0797a295-2f03-4bf3-bcbb-c65909779bfe tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:25.350121 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2c0ba0c7-1856-417b-974a-17230052cd82 tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:25.365638 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2c0ba0c7-1856-417b-974a-17230052cd82 tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] 10.222.0.33 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.019144 Jun 05 08:28:25.367166 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 790/1559] 10.222.0.33 () {58 vars in 1147 bytes} [Sun Jun 5 08:28:25 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:25.369352 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-0797a295-2f03-4bf3-bcbb-c65909779bfe tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Getting quotas for project bc14eff36af743bc94180fe1e24da809. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:28:25.374828 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-0797a295-2f03-4bf3-bcbb-c65909779bfe tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Getting quotas for user bd54c03d9a244d21b13f7ba4d914d2a9 and project bc14eff36af743bc94180fe1e24da809. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:28:25.378717 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5f2c604d-2dc6-4a34-a69f-61ef0efe1cbc tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:25.391027 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0797a295-2f03-4bf3-bcbb-c65909779bfe tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:28:25.391261 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5f2c604d-2dc6-4a34-a69f-61ef0efe1cbc tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] 10.222.0.33 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.016118 Jun 05 08:28:25.392060 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 791/1560] 10.222.0.33 () {58 vars in 1139 bytes} [Sun Jun 5 08:28:25 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:28:25.395580 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0797a295-2f03-4bf3-bcbb-c65909779bfe tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] [instance: d14db277-eb47-4014-b054-beb64ba573ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:28:25.405403 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-cacd14e8-44c8-47a1-b374-48f5a6b3cf7f tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:25.415529 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-cacd14e8-44c8-47a1-b374-48f5a6b3cf7f tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014272 Jun 05 08:28:25.416147 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 792/1561] 10.222.0.33 () {58 vars in 1136 bytes} [Sun Jun 5 08:28:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:28:25.433873 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-37dff58e-d8a0-4fc7-b5ff-0e2c3d3ec74a tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:25.459188 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-37dff58e-d8a0-4fc7-b5ff-0e2c3d3ec74a tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] 10.222.0.33 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.035837 Jun 05 08:28:25.460067 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 793/1562] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:28:25 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:28:25.471468 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9300c7ad-f4dd-4934-984f-9f908ac8b72e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:25.472287 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9300c7ad-f4dd-4934-984f-9f908ac8b72e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:25.480453 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9300c7ad-f4dd-4934-984f-9f908ac8b72e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:25.480939 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0797a295-2f03-4bf3-bcbb-c65909779bfe tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.565419 Jun 05 08:28:25.481237 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9300c7ad-f4dd-4934-984f-9f908ac8b72e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:25.483909 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9300c7ad-f4dd-4934-984f-9f908ac8b72e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:25.484504 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9300c7ad-f4dd-4934-984f-9f908ac8b72e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:25.490431 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 770/1563] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:28:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:28:25.498153 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-398b976d-e2d1-4caf-9daf-541c5af383de tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:25.520244 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-398b976d-e2d1-4caf-9daf-541c5af383de tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028268 Jun 05 08:28:25.521442 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 771/1564] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:28:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:25.534873 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f24bec99-2c2c-4e03-bc40-ff542a2a8571 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:25.535775 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f24bec99-2c2c-4e03-bc40-ff542a2a8571 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:25.555320 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f24bec99-2c2c-4e03-bc40-ff542a2a8571 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:25.555794 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f24bec99-2c2c-4e03-bc40-ff542a2a8571 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:25.556621 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f24bec99-2c2c-4e03-bc40-ff542a2a8571 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:25.557246 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f24bec99-2c2c-4e03-bc40-ff542a2a8571 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:25.598233 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f24bec99-2c2c-4e03-bc40-ff542a2a8571 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:25.600970 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f24bec99-2c2c-4e03-bc40-ff542a2a8571 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:25.602193 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-f24bec99-2c2c-4e03-bc40-ff542a2a8571 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:25.666506 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f24bec99-2c2c-4e03-bc40-ff542a2a8571 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:25.681937 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f24bec99-2c2c-4e03-bc40-ff542a2a8571 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.159234 Jun 05 08:28:25.683826 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 772/1565] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:25 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:25.706161 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-bb002ddb-2763-4a64-8d56-6b1b820a2f79 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:25.709071 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-bb002ddb-2763-4a64-8d56-6b1b820a2f79 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] [instance: d14db277-eb47-4014-b054-beb64ba573ed] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:25.763918 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9300c7ad-f4dd-4934-984f-9f908ac8b72e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:25.784526 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9300c7ad-f4dd-4934-984f-9f908ac8b72e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:25.786429 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9300c7ad-f4dd-4934-984f-9f908ac8b72e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:25.787659 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9300c7ad-f4dd-4934-984f-9f908ac8b72e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1753 microversion: 2.20 time: 0.326655 Jun 05 08:28:25.790476 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 794/1566] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:25 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1753 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:25.797203 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3b0bde18-2d77-43c1-811f-a3aa538182ef tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:25.808072 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3b0bde18-2d77-43c1-811f-a3aa538182ef tempest-FlavorsV2TestJSON-1828262379 tempest-FlavorsV2TestJSON-1828262379-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017691 Jun 05 08:28:25.809406 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 795/1567] 10.222.0.33 () {58 vars in 1136 bytes} [Sun Jun 5 08:28:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:28:25.817024 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-bb002ddb-2763-4a64-8d56-6b1b820a2f79 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd54c03d9a244d21b13f7ba4d914d2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc14eff36af743bc94180fe1e24da809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:25.828323 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-bb002ddb-2763-4a64-8d56-6b1b820a2f79 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed" status: 200 len: 1217 microversion: 2.1 time: 0.141237 Jun 05 08:28:25.830757 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 773/1568] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:25 2022] GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed => generated 1217 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:25.895118 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a43a4fd4-8fd5-409e-9873-6554be464e74 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:25.895953 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a43a4fd4-8fd5-409e-9873-6554be464e74 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:25.903746 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a43a4fd4-8fd5-409e-9873-6554be464e74 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:25.904662 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a43a4fd4-8fd5-409e-9873-6554be464e74 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:25.911681 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a43a4fd4-8fd5-409e-9873-6554be464e74 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:25.912776 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a43a4fd4-8fd5-409e-9873-6554be464e74 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:26.109062 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a43a4fd4-8fd5-409e-9873-6554be464e74 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:26.125214 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a43a4fd4-8fd5-409e-9873-6554be464e74 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:26.130235 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a43a4fd4-8fd5-409e-9873-6554be464e74 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:26.135005 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a43a4fd4-8fd5-409e-9873-6554be464e74 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 0.244996 Jun 05 08:28:26.138614 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 796/1569] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:25 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:26.705910 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-110de04c-e129-46cd-a50e-1337bf370044 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:26.706756 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-110de04c-e129-46cd-a50e-1337bf370044 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:26.717251 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-110de04c-e129-46cd-a50e-1337bf370044 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:26.717978 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-110de04c-e129-46cd-a50e-1337bf370044 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:26.719000 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-110de04c-e129-46cd-a50e-1337bf370044 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:26.719649 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-110de04c-e129-46cd-a50e-1337bf370044 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:26.764413 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-110de04c-e129-46cd-a50e-1337bf370044 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:26.765112 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-110de04c-e129-46cd-a50e-1337bf370044 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:26.765782 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-110de04c-e129-46cd-a50e-1337bf370044 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:26.823917 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7fb64193-16c8-4646-a0e5-84e66cb16e72 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:26.824593 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7fb64193-16c8-4646-a0e5-84e66cb16e72 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:26.853834 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7fb64193-16c8-4646-a0e5-84e66cb16e72 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:26.855105 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7fb64193-16c8-4646-a0e5-84e66cb16e72 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:26.861151 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7fb64193-16c8-4646-a0e5-84e66cb16e72 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:26.864072 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7fb64193-16c8-4646-a0e5-84e66cb16e72 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:26.873886 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-110de04c-e129-46cd-a50e-1337bf370044 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:26.924223 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-110de04c-e129-46cd-a50e-1337bf370044 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.226063 Jun 05 08:28:26.941428 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 774/1570] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:26 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:26.953659 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-453447d0-c153-468b-b497-91f77596b851 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:26.956495 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-453447d0-c153-468b-b497-91f77596b851 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] [instance: d14db277-eb47-4014-b054-beb64ba573ed] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:26.973003 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-453447d0-c153-468b-b497-91f77596b851 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:26.974065 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-453447d0-c153-468b-b497-91f77596b851 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:26.975080 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-453447d0-c153-468b-b497-91f77596b851 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:26.975798 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-453447d0-c153-468b-b497-91f77596b851 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:27.105462 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-453447d0-c153-468b-b497-91f77596b851 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd54c03d9a244d21b13f7ba4d914d2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc14eff36af743bc94180fe1e24da809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:27.118812 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-453447d0-c153-468b-b497-91f77596b851 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed" status: 200 len: 1277 microversion: 2.1 time: 0.175780 Jun 05 08:28:27.123245 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 775/1571] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:26 2022] GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:27.158615 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ff01735a-0e8e-485b-9b24-d243bf70e2ce tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:27.159854 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ff01735a-0e8e-485b-9b24-d243bf70e2ce tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:27.169985 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ff01735a-0e8e-485b-9b24-d243bf70e2ce tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:27.170390 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ff01735a-0e8e-485b-9b24-d243bf70e2ce tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:27.171228 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ff01735a-0e8e-485b-9b24-d243bf70e2ce tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:27.171726 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ff01735a-0e8e-485b-9b24-d243bf70e2ce tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:27.500844 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7fb64193-16c8-4646-a0e5-84e66cb16e72 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:27.511733 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7fb64193-16c8-4646-a0e5-84e66cb16e72 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:27.514978 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7fb64193-16c8-4646-a0e5-84e66cb16e72 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:27.516817 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7fb64193-16c8-4646-a0e5-84e66cb16e72 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1753 microversion: 2.20 time: 0.710219 Jun 05 08:28:27.528846 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 797/1572] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:26 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1753 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:27.537736 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e3920c4e-60a4-4179-94ec-88dc0180cdfe tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-928231905", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "d6fc5636-9c8b-4238-8a2c-cf51a213fbbf"}], "block_device_mapping_v2": [{"uuid": "41b57217-4d95-4d57-bc51-db288e29e18b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:28:27.600716 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ff01735a-0e8e-485b-9b24-d243bf70e2ce tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:27.611125 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ff01735a-0e8e-485b-9b24-d243bf70e2ce tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:27.615664 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ff01735a-0e8e-485b-9b24-d243bf70e2ce tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:27.619803 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ff01735a-0e8e-485b-9b24-d243bf70e2ce tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 0.466050 Jun 05 08:28:27.622913 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 776/1573] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:27 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:28:27.945488 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9a276664-754a-42fa-a187-27c75b79aa46 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:27.946855 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9a276664-754a-42fa-a187-27c75b79aa46 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:27.961588 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9a276664-754a-42fa-a187-27c75b79aa46 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:27.962584 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9a276664-754a-42fa-a187-27c75b79aa46 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:27.964993 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9a276664-754a-42fa-a187-27c75b79aa46 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:27.966212 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9a276664-754a-42fa-a187-27c75b79aa46 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:28.042175 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9a276664-754a-42fa-a187-27c75b79aa46 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:28.042546 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9a276664-754a-42fa-a187-27c75b79aa46 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:28.043023 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-9a276664-754a-42fa-a187-27c75b79aa46 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:28.141523 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-9a276664-754a-42fa-a187-27c75b79aa46 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:28.154483 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9a276664-754a-42fa-a187-27c75b79aa46 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.213296 Jun 05 08:28:28.155708 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 777/1574] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:27 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:28.162055 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5ea76b34-ae3a-4eef-a11c-dc9ade41459f tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:28.162685 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5ea76b34-ae3a-4eef-a11c-dc9ade41459f tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] [instance: d14db277-eb47-4014-b054-beb64ba573ed] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:28.179795 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5ea76b34-ae3a-4eef-a11c-dc9ade41459f tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:28.180346 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5ea76b34-ae3a-4eef-a11c-dc9ade41459f tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:28.181152 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5ea76b34-ae3a-4eef-a11c-dc9ade41459f tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:28.181597 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5ea76b34-ae3a-4eef-a11c-dc9ade41459f tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:28.196647 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=100 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:28:28.828715 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-e3920c4e-60a4-4179-94ec-88dc0180cdfe tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] validate_networks() for [('d6fc5636-9c8b-4238-8a2c-cf51a213fbbf', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:28:28.972004 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5ea76b34-ae3a-4eef-a11c-dc9ade41459f tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd54c03d9a244d21b13f7ba4d914d2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc14eff36af743bc94180fe1e24da809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:28.997212 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5ea76b34-ae3a-4eef-a11c-dc9ade41459f tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed" status: 200 len: 1317 microversion: 2.1 time: 0.839982 Jun 05 08:28:28.998732 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 778/1575] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:28 2022] GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed => generated 1317 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:29.010985 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a3cadb16-0797-467b-9091-8cba40e7514b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:29.011997 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a3cadb16-0797-467b-9091-8cba40e7514b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:29.032983 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a3cadb16-0797-467b-9091-8cba40e7514b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:29.040778 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a3cadb16-0797-467b-9091-8cba40e7514b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:29.042040 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a3cadb16-0797-467b-9091-8cba40e7514b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:29.042655 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a3cadb16-0797-467b-9091-8cba40e7514b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:30.316710 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a3cadb16-0797-467b-9091-8cba40e7514b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:30.340671 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a3cadb16-0797-467b-9091-8cba40e7514b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:30.342979 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a3cadb16-0797-467b-9091-8cba40e7514b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:30.344418 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a3cadb16-0797-467b-9091-8cba40e7514b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1753 microversion: 2.20 time: 1.344502 Jun 05 08:28:30.345466 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 779/1576] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:28 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1753 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:30.351771 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-82573f55-b7b3-4043-9386-59e04e6f1f2d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:30.352859 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-82573f55-b7b3-4043-9386-59e04e6f1f2d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:30.373783 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-82573f55-b7b3-4043-9386-59e04e6f1f2d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:30.374235 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-82573f55-b7b3-4043-9386-59e04e6f1f2d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:30.375011 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-82573f55-b7b3-4043-9386-59e04e6f1f2d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:30.375451 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-82573f55-b7b3-4043-9386-59e04e6f1f2d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:30.727240 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-e3920c4e-60a4-4179-94ec-88dc0180cdfe tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:28:30.727718 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-e3920c4e-60a4-4179-94ec-88dc0180cdfe tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:28:30.728174 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-e3920c4e-60a4-4179-94ec-88dc0180cdfe tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:28:30.728589 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-e3920c4e-60a4-4179-94ec-88dc0180cdfe tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:28:30.729014 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-e3920c4e-60a4-4179-94ec-88dc0180cdfe tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:28:30.746545 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e3920c4e-60a4-4179-94ec-88dc0180cdfe tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:30.749566 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e3920c4e-60a4-4179-94ec-88dc0180cdfe tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:30.752009 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e3920c4e-60a4-4179-94ec-88dc0180cdfe tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:30.753425 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e3920c4e-60a4-4179-94ec-88dc0180cdfe tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:30.822369 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-e3920c4e-60a4-4179-94ec-88dc0180cdfe tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Getting quotas for project 4d03f2fd71b942c58157558bc37213b2. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:28:30.832645 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-82573f55-b7b3-4043-9386-59e04e6f1f2d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:30.839092 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-e3920c4e-60a4-4179-94ec-88dc0180cdfe tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Getting quotas for user 63a93651985b4efaa4b0b2fde0f91010 and project 4d03f2fd71b942c58157558bc37213b2. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:28:30.844174 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-82573f55-b7b3-4043-9386-59e04e6f1f2d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:30.853094 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-82573f55-b7b3-4043-9386-59e04e6f1f2d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:30.854558 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-82573f55-b7b3-4043-9386-59e04e6f1f2d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 0.506651 Jun 05 08:28:30.855283 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 780/1577] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:30 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:30.860028 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ebd7fbc0-387e-49d4-a6ce-c5eb86716537 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:30.876982 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ebd7fbc0-387e-49d4-a6ce-c5eb86716537 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:30.885375 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ebd7fbc0-387e-49d4-a6ce-c5eb86716537 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:30.886062 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ebd7fbc0-387e-49d4-a6ce-c5eb86716537 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:30.887061 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ebd7fbc0-387e-49d4-a6ce-c5eb86716537 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:30.887721 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ebd7fbc0-387e-49d4-a6ce-c5eb86716537 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:30.946805 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ebd7fbc0-387e-49d4-a6ce-c5eb86716537 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:30.949169 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ebd7fbc0-387e-49d4-a6ce-c5eb86716537 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:30.949858 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-ebd7fbc0-387e-49d4-a6ce-c5eb86716537 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:30.987334 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e3920c4e-60a4-4179-94ec-88dc0180cdfe tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:28:30.990225 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e3920c4e-60a4-4179-94ec-88dc0180cdfe tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='41b57217-4d95-4d57-bc51-db288e29e18b',volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:28:31.084529 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ebd7fbc0-387e-49d4-a6ce-c5eb86716537 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:31.097141 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ebd7fbc0-387e-49d4-a6ce-c5eb86716537 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.240529 Jun 05 08:28:31.099826 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 781/1578] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:30 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:31.118578 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-377c2332-6284-42ad-baca-5a748eec6e94 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:31.119264 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-377c2332-6284-42ad-baca-5a748eec6e94 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] [instance: d14db277-eb47-4014-b054-beb64ba573ed] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:31.136239 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-377c2332-6284-42ad-baca-5a748eec6e94 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:31.137514 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-377c2332-6284-42ad-baca-5a748eec6e94 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:31.139231 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-377c2332-6284-42ad-baca-5a748eec6e94 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:31.147595 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-377c2332-6284-42ad-baca-5a748eec6e94 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:31.296464 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e3920c4e-60a4-4179-94ec-88dc0180cdfe tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.765658 Jun 05 08:28:31.297121 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 798/1579] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:28:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:28:31.638653 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-28b5f65c-94bc-4b27-934a-80ce6ab65d67 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-419481008", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "78ad483b-a47a-44a2-8bc0-8789288467d5"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:28:31.683355 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-377c2332-6284-42ad-baca-5a748eec6e94 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd54c03d9a244d21b13f7ba4d914d2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc14eff36af743bc94180fe1e24da809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:31.699839 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-377c2332-6284-42ad-baca-5a748eec6e94 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed" status: 200 len: 1317 microversion: 2.1 time: 0.598217 Jun 05 08:28:31.700560 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 782/1580] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:31 2022] GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed => generated 1317 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:31.709165 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3801274d-9c22-4c12-a049-8dc053cb0102 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:31.709165 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3801274d-9c22-4c12-a049-8dc053cb0102 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:31.789424 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-28b5f65c-94bc-4b27-934a-80ce6ab65d67 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] validate_networks() for [('78ad483b-a47a-44a2-8bc0-8789288467d5', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:28:31.932345 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3801274d-9c22-4c12-a049-8dc053cb0102 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:31.948279 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3801274d-9c22-4c12-a049-8dc053cb0102 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1052 microversion: 2.1 time: 0.246554 Jun 05 08:28:31.948877 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 783/1581] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:31 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1052 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:31.953398 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1906616b-8c03-4948-8aa5-a702387d71c8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:31.953999 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1906616b-8c03-4948-8aa5-a702387d71c8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:31.975724 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1906616b-8c03-4948-8aa5-a702387d71c8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:31.988717 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1906616b-8c03-4948-8aa5-a702387d71c8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:31.990108 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1906616b-8c03-4948-8aa5-a702387d71c8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:31.990847 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1906616b-8c03-4948-8aa5-a702387d71c8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:32.389971 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1906616b-8c03-4948-8aa5-a702387d71c8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:32.402425 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1906616b-8c03-4948-8aa5-a702387d71c8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:32.405203 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1906616b-8c03-4948-8aa5-a702387d71c8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:32.409040 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1906616b-8c03-4948-8aa5-a702387d71c8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1809 microversion: 2.20 time: 0.458473 Jun 05 08:28:32.413689 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 784/1582] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:31 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1809 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:32.426554 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ee4c6770-97fe-4aac-a35b-605cc068060d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:32.430043 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ee4c6770-97fe-4aac-a35b-605cc068060d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:32.454937 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ee4c6770-97fe-4aac-a35b-605cc068060d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:32.455490 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ee4c6770-97fe-4aac-a35b-605cc068060d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:32.460544 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ee4c6770-97fe-4aac-a35b-605cc068060d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:32.462165 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ee4c6770-97fe-4aac-a35b-605cc068060d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:33.426607 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ee4c6770-97fe-4aac-a35b-605cc068060d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:33.473273 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ee4c6770-97fe-4aac-a35b-605cc068060d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:33.496932 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ee4c6770-97fe-4aac-a35b-605cc068060d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:33.503810 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ee4c6770-97fe-4aac-a35b-605cc068060d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 1.085149 Jun 05 08:28:33.505736 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 785/1583] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:32 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:33.541507 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ec8e2207-b87f-4645-b2ed-8a698a49b5ba tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:33.547018 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ec8e2207-b87f-4645-b2ed-8a698a49b5ba tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:33.583187 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ec8e2207-b87f-4645-b2ed-8a698a49b5ba tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:33.588993 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ec8e2207-b87f-4645-b2ed-8a698a49b5ba tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:33.593929 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ec8e2207-b87f-4645-b2ed-8a698a49b5ba tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:33.596462 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ec8e2207-b87f-4645-b2ed-8a698a49b5ba tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:33.730205 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-28b5f65c-94bc-4b27-934a-80ce6ab65d67 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:28:33.731684 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-28b5f65c-94bc-4b27-934a-80ce6ab65d67 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:28:33.732819 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-28b5f65c-94bc-4b27-934a-80ce6ab65d67 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:28:33.733592 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-28b5f65c-94bc-4b27-934a-80ce6ab65d67 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:28:33.734174 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-28b5f65c-94bc-4b27-934a-80ce6ab65d67 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:28:33.737916 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ec8e2207-b87f-4645-b2ed-8a698a49b5ba tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:33.738825 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ec8e2207-b87f-4645-b2ed-8a698a49b5ba tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:33.739621 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-ec8e2207-b87f-4645-b2ed-8a698a49b5ba tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:33.779194 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-28b5f65c-94bc-4b27-934a-80ce6ab65d67 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:33.780930 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-28b5f65c-94bc-4b27-934a-80ce6ab65d67 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:33.785325 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-28b5f65c-94bc-4b27-934a-80ce6ab65d67 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:33.785996 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-28b5f65c-94bc-4b27-934a-80ce6ab65d67 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:33.855976 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-28b5f65c-94bc-4b27-934a-80ce6ab65d67 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Getting quotas for project d7e0706485194d6ab0cf41ea0f651074. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:28:33.893560 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-28b5f65c-94bc-4b27-934a-80ce6ab65d67 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Getting quotas for user 41b99bee0b35400281da332533850481 and project d7e0706485194d6ab0cf41ea0f651074. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:28:33.924849 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:28:33.958710 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-28b5f65c-94bc-4b27-934a-80ce6ab65d67 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:28:33.961872 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-28b5f65c-94bc-4b27-934a-80ce6ab65d67 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 54c464ac-f10b-4558-a1ef-24c9319d7364] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:28:33.991452 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ec8e2207-b87f-4645-b2ed-8a698a49b5ba tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:34.000661 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ec8e2207-b87f-4645-b2ed-8a698a49b5ba tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.469431 Jun 05 08:28:34.021448 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 786/1584] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:33 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:34.036491 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-4e437983-e8d1-41e2-b0ed-fdcf06e30096 req-45620a1d-1690-42be-acf3-194f3b9d332b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d14db277-eb47-4014-b054-beb64ba573ed", "tag": "04bb4de3-61a0-4a52-934f-f6f853fe61f9"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:28:34.053412 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-4e437983-e8d1-41e2-b0ed-fdcf06e30096 req-45620a1d-1690-42be-acf3-194f3b9d332b service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:34.054111 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-4e437983-e8d1-41e2-b0ed-fdcf06e30096 req-45620a1d-1690-42be-acf3-194f3b9d332b service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:34.086972 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-4e437983-e8d1-41e2-b0ed-fdcf06e30096 req-45620a1d-1690-42be-acf3-194f3b9d332b service nova] Creating event network-changed:04bb4de3-61a0-4a52-934f-f6f853fe61f9 for instance d14db277-eb47-4014-b054-beb64ba573ed on n-h2-844739-1 Jun 05 08:28:34.122567 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-4e437983-e8d1-41e2-b0ed-fdcf06e30096 req-45620a1d-1690-42be-acf3-194f3b9d332b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089528 Jun 05 08:28:34.127110 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 787/1585] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:28:34.153412 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cc0b8945-2a07-4688-a697-751a8ba1a8c9 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:34.158487 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-cc0b8945-2a07-4688-a697-751a8ba1a8c9 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] [instance: d14db277-eb47-4014-b054-beb64ba573ed] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:34.171672 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:28:34.200440 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-28b5f65c-94bc-4b27-934a-80ce6ab65d67 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.901764 Jun 05 08:28:34.201648 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 799/1586] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:28:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:28:34.213961 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-33b86be6-1619-451d-86cd-5e0cc5c0649f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:34.220856 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cc0b8945-2a07-4688-a697-751a8ba1a8c9 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:34.225391 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cc0b8945-2a07-4688-a697-751a8ba1a8c9 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:34.227654 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cc0b8945-2a07-4688-a697-751a8ba1a8c9 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:34.228339 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cc0b8945-2a07-4688-a697-751a8ba1a8c9 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:34.229477 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-33b86be6-1619-451d-86cd-5e0cc5c0649f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:34.284547 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-33b86be6-1619-451d-86cd-5e0cc5c0649f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:34.285359 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-33b86be6-1619-451d-86cd-5e0cc5c0649f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:34.311024 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-33b86be6-1619-451d-86cd-5e0cc5c0649f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:34.312193 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-33b86be6-1619-451d-86cd-5e0cc5c0649f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:34.713065 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-33b86be6-1619-451d-86cd-5e0cc5c0649f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:34.726789 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-33b86be6-1619-451d-86cd-5e0cc5c0649f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1168 microversion: 2.1 time: 0.516827 Jun 05 08:28:34.727741 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 800/1587] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:34 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1168 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:34.756193 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-07167de4-e540-4e40-8b9c-a3585d316d0e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:34.756865 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-07167de4-e540-4e40-8b9c-a3585d316d0e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:34.777440 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-07167de4-e540-4e40-8b9c-a3585d316d0e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:34.778214 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-07167de4-e540-4e40-8b9c-a3585d316d0e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:34.779162 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-07167de4-e540-4e40-8b9c-a3585d316d0e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:34.779756 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-07167de4-e540-4e40-8b9c-a3585d316d0e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:34.907306 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-cc0b8945-2a07-4688-a697-751a8ba1a8c9 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd54c03d9a244d21b13f7ba4d914d2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc14eff36af743bc94180fe1e24da809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:34.922864 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-cc0b8945-2a07-4688-a697-751a8ba1a8c9 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed" status: 200 len: 1317 microversion: 2.1 time: 0.790728 Jun 05 08:28:34.926651 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 788/1588] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:34 2022] GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed => generated 1317 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:34.943350 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f328bfa2-6ecb-4460-9362-b273d012dfd6 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:34.944002 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f328bfa2-6ecb-4460-9362-b273d012dfd6 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 54c464ac-f10b-4558-a1ef-24c9319d7364] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:35.243967 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-07167de4-e540-4e40-8b9c-a3585d316d0e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:35.246477 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f328bfa2-6ecb-4460-9362-b273d012dfd6 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:35.254500 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f328bfa2-6ecb-4460-9362-b273d012dfd6 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364" status: 200 len: 1207 microversion: 2.1 time: 0.326750 Jun 05 08:28:35.262725 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 789/1589] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:34 2022] GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364 => generated 1207 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:35.264027 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-07167de4-e540-4e40-8b9c-a3585d316d0e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:35.265747 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-07167de4-e540-4e40-8b9c-a3585d316d0e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:35.276701 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-07167de4-e540-4e40-8b9c-a3585d316d0e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1809 microversion: 2.20 time: 0.545473 Jun 05 08:28:35.277985 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 801/1590] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:34 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1809 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:35.279436 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-33afdcef-2821-49d1-8df5-9f2197e5f76e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:35.280466 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-33afdcef-2821-49d1-8df5-9f2197e5f76e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:35.294029 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8431a8cd-1e1f-4353-80d7-4bd1ae7c8453 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:35.297012 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8431a8cd-1e1f-4353-80d7-4bd1ae7c8453 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:35.302537 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-33afdcef-2821-49d1-8df5-9f2197e5f76e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:35.303558 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-33afdcef-2821-49d1-8df5-9f2197e5f76e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:35.325075 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-33afdcef-2821-49d1-8df5-9f2197e5f76e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:35.325957 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8431a8cd-1e1f-4353-80d7-4bd1ae7c8453 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:35.326410 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8431a8cd-1e1f-4353-80d7-4bd1ae7c8453 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:35.327190 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8431a8cd-1e1f-4353-80d7-4bd1ae7c8453 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:35.327624 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8431a8cd-1e1f-4353-80d7-4bd1ae7c8453 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:35.332186 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-33afdcef-2821-49d1-8df5-9f2197e5f76e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:35.379778 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:28:35.386797 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8431a8cd-1e1f-4353-80d7-4bd1ae7c8453 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:35.387948 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8431a8cd-1e1f-4353-80d7-4bd1ae7c8453 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:35.388683 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-8431a8cd-1e1f-4353-80d7-4bd1ae7c8453 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:35.489590 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8431a8cd-1e1f-4353-80d7-4bd1ae7c8453 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:35.502381 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8431a8cd-1e1f-4353-80d7-4bd1ae7c8453 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.220762 Jun 05 08:28:35.504443 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 802/1591] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:35 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:35.710101 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-33afdcef-2821-49d1-8df5-9f2197e5f76e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:35.727443 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-33afdcef-2821-49d1-8df5-9f2197e5f76e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:35.729736 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-33afdcef-2821-49d1-8df5-9f2197e5f76e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:35.731615 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-33afdcef-2821-49d1-8df5-9f2197e5f76e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 0.465695 Jun 05 08:28:35.745242 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 790/1592] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:35 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:35.750935 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3b316413-b615-4f59-a227-135486bc4755 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:35.751642 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3b316413-b615-4f59-a227-135486bc4755 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:35.780774 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3b316413-b615-4f59-a227-135486bc4755 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:35.782813 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3b316413-b615-4f59-a227-135486bc4755 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:35.786005 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3b316413-b615-4f59-a227-135486bc4755 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:35.787054 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3b316413-b615-4f59-a227-135486bc4755 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:35.944317 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2ad30aa2-2bd4-4a9d-b510-3294a9c4e06c tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:35.945201 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2ad30aa2-2bd4-4a9d-b510-3294a9c4e06c tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] [instance: d14db277-eb47-4014-b054-beb64ba573ed] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:35.954604 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2ad30aa2-2bd4-4a9d-b510-3294a9c4e06c tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:35.956558 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2ad30aa2-2bd4-4a9d-b510-3294a9c4e06c tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:35.959827 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2ad30aa2-2bd4-4a9d-b510-3294a9c4e06c tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:35.962466 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2ad30aa2-2bd4-4a9d-b510-3294a9c4e06c tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:35.987135 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3b316413-b615-4f59-a227-135486bc4755 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:35.997287 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3b316413-b615-4f59-a227-135486bc4755 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1210 microversion: 2.1 time: 0.257345 Jun 05 08:28:36.025137 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 803/1593] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:35 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1210 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:36.154565 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2ad30aa2-2bd4-4a9d-b510-3294a9c4e06c tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd54c03d9a244d21b13f7ba4d914d2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc14eff36af743bc94180fe1e24da809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:36.164273 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2ad30aa2-2bd4-4a9d-b510-3294a9c4e06c tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed" status: 200 len: 1317 microversion: 2.1 time: 0.223515 Jun 05 08:28:36.169623 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 791/1594] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:35 2022] GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:36.281554 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1e427c7b-83d0-462a-9c39-dd8d5f1728c8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:36.285520 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1e427c7b-83d0-462a-9c39-dd8d5f1728c8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 54c464ac-f10b-4558-a1ef-24c9319d7364] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:36.298542 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-abd37882-f29b-4d2f-9218-fac6e1d2504c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:36.299593 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-abd37882-f29b-4d2f-9218-fac6e1d2504c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:36.309071 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1e427c7b-83d0-462a-9c39-dd8d5f1728c8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:36.309886 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1e427c7b-83d0-462a-9c39-dd8d5f1728c8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:36.310999 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1e427c7b-83d0-462a-9c39-dd8d5f1728c8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:36.311663 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1e427c7b-83d0-462a-9c39-dd8d5f1728c8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:36.329171 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-abd37882-f29b-4d2f-9218-fac6e1d2504c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:36.332338 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-abd37882-f29b-4d2f-9218-fac6e1d2504c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:36.333191 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-abd37882-f29b-4d2f-9218-fac6e1d2504c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:36.333647 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-abd37882-f29b-4d2f-9218-fac6e1d2504c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:36.594811 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-1e427c7b-83d0-462a-9c39-dd8d5f1728c8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:36.605314 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1e427c7b-83d0-462a-9c39-dd8d5f1728c8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364" status: 200 len: 1211 microversion: 2.1 time: 0.329211 Jun 05 08:28:36.622533 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 804/1595] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:36 2022] GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364 => generated 1211 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:36.640357 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-42bfaf50-978d-4dba-9735-b1bab1378354 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:36.650919 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-42bfaf50-978d-4dba-9735-b1bab1378354 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:36.694592 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42bfaf50-978d-4dba-9735-b1bab1378354 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:36.695266 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42bfaf50-978d-4dba-9735-b1bab1378354 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:36.698044 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42bfaf50-978d-4dba-9735-b1bab1378354 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:36.700576 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42bfaf50-978d-4dba-9735-b1bab1378354 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:36.908269 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42bfaf50-978d-4dba-9735-b1bab1378354 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:36.908931 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42bfaf50-978d-4dba-9735-b1bab1378354 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:36.911492 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-42bfaf50-978d-4dba-9735-b1bab1378354 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:37.198589 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-42bfaf50-978d-4dba-9735-b1bab1378354 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:37.216807 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-abd37882-f29b-4d2f-9218-fac6e1d2504c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:37.230235 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-42bfaf50-978d-4dba-9735-b1bab1378354 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.604527 Jun 05 08:28:37.234090 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-abd37882-f29b-4d2f-9218-fac6e1d2504c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:37.240547 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-abd37882-f29b-4d2f-9218-fac6e1d2504c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:37.249835 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-abd37882-f29b-4d2f-9218-fac6e1d2504c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1809 microversion: 2.20 time: 0.952369 Jun 05 08:28:37.250496 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 792/1596] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:36 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1809 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:37.265252 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 805/1597] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:36 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:37.270138 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-75f6b7f4-47b7-4de2-9344-ccbfcb807d7a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:37.272836 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-75f6b7f4-47b7-4de2-9344-ccbfcb807d7a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:37.278074 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f24e2f11-49d0-4900-8c65-06874dc3729a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:37.280482 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f24e2f11-49d0-4900-8c65-06874dc3729a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:37.304351 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-75f6b7f4-47b7-4de2-9344-ccbfcb807d7a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:37.304994 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-75f6b7f4-47b7-4de2-9344-ccbfcb807d7a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:37.310238 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f24e2f11-49d0-4900-8c65-06874dc3729a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:37.316491 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-75f6b7f4-47b7-4de2-9344-ccbfcb807d7a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:37.317283 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-75f6b7f4-47b7-4de2-9344-ccbfcb807d7a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:37.322123 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f24e2f11-49d0-4900-8c65-06874dc3729a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:37.323346 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f24e2f11-49d0-4900-8c65-06874dc3729a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:37.324028 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f24e2f11-49d0-4900-8c65-06874dc3729a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:37.816907 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-75f6b7f4-47b7-4de2-9344-ccbfcb807d7a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:37.836529 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-75f6b7f4-47b7-4de2-9344-ccbfcb807d7a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:37.842893 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f24e2f11-49d0-4900-8c65-06874dc3729a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:37.852491 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f24e2f11-49d0-4900-8c65-06874dc3729a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1210 microversion: 2.1 time: 0.585242 Jun 05 08:28:37.854417 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-75f6b7f4-47b7-4de2-9344-ccbfcb807d7a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:37.855987 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-75f6b7f4-47b7-4de2-9344-ccbfcb807d7a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 0.604541 Jun 05 08:28:37.856878 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 806/1598] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:37 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1210 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:37.861483 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 793/1599] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:37 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:37.894411 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7ba48be4-d691-4378-949d-8255fddd7b91 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:37.908820 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7ba48be4-d691-4378-949d-8255fddd7b91 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] [instance: d14db277-eb47-4014-b054-beb64ba573ed] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:37.909469 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-43057c75-a805-475a-9df5-7e5ba25e221a req-de2dbb6f-6ae9-4f8b-8c1b-988213d78903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b732c5a-d12e-4ca7-aa45-dbe571de1c37", "tag": "cec071fd-e740-4058-b029-ed9348ba5833"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:28:37.942982 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7ba48be4-d691-4378-949d-8255fddd7b91 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:37.945002 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7ba48be4-d691-4378-949d-8255fddd7b91 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:37.949184 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7ba48be4-d691-4378-949d-8255fddd7b91 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:37.951176 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7ba48be4-d691-4378-949d-8255fddd7b91 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:37.951568 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-43057c75-a805-475a-9df5-7e5ba25e221a req-de2dbb6f-6ae9-4f8b-8c1b-988213d78903 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:37.953453 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-43057c75-a805-475a-9df5-7e5ba25e221a req-de2dbb6f-6ae9-4f8b-8c1b-988213d78903 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:38.009005 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-43057c75-a805-475a-9df5-7e5ba25e221a req-de2dbb6f-6ae9-4f8b-8c1b-988213d78903 service nova] Creating event network-changed:cec071fd-e740-4058-b029-ed9348ba5833 for instance 0b732c5a-d12e-4ca7-aa45-dbe571de1c37 on n-h1-844739-1 Jun 05 08:28:38.030780 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-43057c75-a805-475a-9df5-7e5ba25e221a req-de2dbb6f-6ae9-4f8b-8c1b-988213d78903 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160074 Jun 05 08:28:38.046627 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 794/1600] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:28:38.061784 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8aa1158d-16c3-41e2-ad4a-5f21e1645ad8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:38.064839 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8aa1158d-16c3-41e2-ad4a-5f21e1645ad8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 54c464ac-f10b-4558-a1ef-24c9319d7364] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:38.078632 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8aa1158d-16c3-41e2-ad4a-5f21e1645ad8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:38.079454 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8aa1158d-16c3-41e2-ad4a-5f21e1645ad8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:38.080527 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8aa1158d-16c3-41e2-ad4a-5f21e1645ad8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:38.081396 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8aa1158d-16c3-41e2-ad4a-5f21e1645ad8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:38.576785 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8aa1158d-16c3-41e2-ad4a-5f21e1645ad8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:38.595811 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8aa1158d-16c3-41e2-ad4a-5f21e1645ad8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364" status: 200 len: 1259 microversion: 2.1 time: 0.547057 Jun 05 08:28:38.598149 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 795/1601] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:38 2022] GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364 => generated 1259 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:38.627452 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-effc7562-7d32-4fc6-bc94-e062ad0a035b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:38.629043 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-effc7562-7d32-4fc6-bc94-e062ad0a035b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:38.658774 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-effc7562-7d32-4fc6-bc94-e062ad0a035b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:38.664421 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-effc7562-7d32-4fc6-bc94-e062ad0a035b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:38.667986 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-effc7562-7d32-4fc6-bc94-e062ad0a035b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:38.675164 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-effc7562-7d32-4fc6-bc94-e062ad0a035b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:39.561279 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7ba48be4-d691-4378-949d-8255fddd7b91 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd54c03d9a244d21b13f7ba4d914d2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc14eff36af743bc94180fe1e24da809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:39.569271 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7ba48be4-d691-4378-949d-8255fddd7b91 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed" status: 200 len: 1317 microversion: 2.1 time: 1.708499 Jun 05 08:28:39.581243 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 807/1602] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:37 2022] GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed => generated 1317 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:39.590593 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2b4f954e-7679-412e-9f92-576adcfbdbf5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:39.593793 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2b4f954e-7679-412e-9f92-576adcfbdbf5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:39.607555 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2b4f954e-7679-412e-9f92-576adcfbdbf5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:39.608407 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2b4f954e-7679-412e-9f92-576adcfbdbf5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:39.610542 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2b4f954e-7679-412e-9f92-576adcfbdbf5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:39.611765 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2b4f954e-7679-412e-9f92-576adcfbdbf5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:39.671120 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-effc7562-7d32-4fc6-bc94-e062ad0a035b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:39.691351 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-effc7562-7d32-4fc6-bc94-e062ad0a035b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:39.693182 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-effc7562-7d32-4fc6-bc94-e062ad0a035b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:39.697112 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-effc7562-7d32-4fc6-bc94-e062ad0a035b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1809 microversion: 2.20 time: 1.097769 Jun 05 08:28:39.701903 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 796/1603] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:38 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1809 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:39.708354 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2b4f954e-7679-412e-9f92-576adcfbdbf5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:39.709141 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2b4f954e-7679-412e-9f92-576adcfbdbf5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:39.709853 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-2b4f954e-7679-412e-9f92-576adcfbdbf5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:39.713425 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-52520da0-ab60-41ff-96dc-39ac3e5105fa tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:39.715027 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-52520da0-ab60-41ff-96dc-39ac3e5105fa tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:39.748737 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-52520da0-ab60-41ff-96dc-39ac3e5105fa tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:39.752262 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-52520da0-ab60-41ff-96dc-39ac3e5105fa tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:39.753383 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-52520da0-ab60-41ff-96dc-39ac3e5105fa tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:39.762570 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-52520da0-ab60-41ff-96dc-39ac3e5105fa tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:39.850282 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=100 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:28:39.889838 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2b4f954e-7679-412e-9f92-576adcfbdbf5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:39.898461 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2b4f954e-7679-412e-9f92-576adcfbdbf5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.315703 Jun 05 08:28:39.916479 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 808/1604] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:39 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:39.930340 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-010f2fcf-7d4b-462f-aeb8-03b8ae0203b8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:39.930974 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-010f2fcf-7d4b-462f-aeb8-03b8ae0203b8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:39.938402 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-010f2fcf-7d4b-462f-aeb8-03b8ae0203b8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:39.938866 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-010f2fcf-7d4b-462f-aeb8-03b8ae0203b8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:39.939645 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-010f2fcf-7d4b-462f-aeb8-03b8ae0203b8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:39.940145 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-010f2fcf-7d4b-462f-aeb8-03b8ae0203b8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:40.614778 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-52520da0-ab60-41ff-96dc-39ac3e5105fa tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:40.639152 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-010f2fcf-7d4b-462f-aeb8-03b8ae0203b8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:40.640785 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-52520da0-ab60-41ff-96dc-39ac3e5105fa tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1210 microversion: 2.1 time: 0.935211 Jun 05 08:28:40.641408 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 797/1605] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:39 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1210 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:40.653796 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-010f2fcf-7d4b-462f-aeb8-03b8ae0203b8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:40.663256 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-010f2fcf-7d4b-462f-aeb8-03b8ae0203b8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:40.666686 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-010f2fcf-7d4b-462f-aeb8-03b8ae0203b8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 0.748703 Jun 05 08:28:40.672738 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 809/1606] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:39 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:40.676161 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-050be9f6-b4af-430d-882f-a9730f07bec4 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:40.688787 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-050be9f6-b4af-430d-882f-a9730f07bec4 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 54c464ac-f10b-4558-a1ef-24c9319d7364] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:40.692354 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-a8b9c314-3950-4d25-91c1-d99f7b796b31 req-42d9f843-0127-4368-be30-ae7a75624689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d14db277-eb47-4014-b054-beb64ba573ed", "name": "network-vif-plugged", "status": "completed", "tag": "04bb4de3-61a0-4a52-934f-f6f853fe61f9"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:28:40.706860 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-050be9f6-b4af-430d-882f-a9730f07bec4 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:40.714732 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-a8b9c314-3950-4d25-91c1-d99f7b796b31 req-42d9f843-0127-4368-be30-ae7a75624689 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:40.715664 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-a8b9c314-3950-4d25-91c1-d99f7b796b31 req-42d9f843-0127-4368-be30-ae7a75624689 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:40.717929 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-050be9f6-b4af-430d-882f-a9730f07bec4 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:40.721436 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-050be9f6-b4af-430d-882f-a9730f07bec4 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:40.725862 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-050be9f6-b4af-430d-882f-a9730f07bec4 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:40.756222 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-a8b9c314-3950-4d25-91c1-d99f7b796b31 req-42d9f843-0127-4368-be30-ae7a75624689 service nova] Creating event network-vif-plugged:04bb4de3-61a0-4a52-934f-f6f853fe61f9 for instance d14db277-eb47-4014-b054-beb64ba573ed on n-h2-844739-1 Jun 05 08:28:40.782128 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-a8b9c314-3950-4d25-91c1-d99f7b796b31 req-42d9f843-0127-4368-be30-ae7a75624689 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107056 Jun 05 08:28:40.783455 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 810/1607] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:28:40.797100 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a4cd9751-6a9a-4666-8bf5-dfb85ace6122 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:40.798441 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a4cd9751-6a9a-4666-8bf5-dfb85ace6122 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] [instance: d14db277-eb47-4014-b054-beb64ba573ed] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:40.815430 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a4cd9751-6a9a-4666-8bf5-dfb85ace6122 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:40.822473 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a4cd9751-6a9a-4666-8bf5-dfb85ace6122 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:40.824310 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a4cd9751-6a9a-4666-8bf5-dfb85ace6122 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:40.828222 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a4cd9751-6a9a-4666-8bf5-dfb85ace6122 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:40.964301 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-050be9f6-b4af-430d-882f-a9730f07bec4 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:40.980849 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-050be9f6-b4af-430d-882f-a9730f07bec4 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364" status: 200 len: 1265 microversion: 2.1 time: 0.338367 Jun 05 08:28:40.998573 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 798/1608] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:40 2022] GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364 => generated 1265 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:41.005597 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-bfed2ebc-c1a2-4994-8dd4-2fb04afe24df tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:41.015864 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-bfed2ebc-c1a2-4994-8dd4-2fb04afe24df tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:41.047240 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bfed2ebc-c1a2-4994-8dd4-2fb04afe24df tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:41.054044 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bfed2ebc-c1a2-4994-8dd4-2fb04afe24df tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:41.057373 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bfed2ebc-c1a2-4994-8dd4-2fb04afe24df tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:41.058837 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bfed2ebc-c1a2-4994-8dd4-2fb04afe24df tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:41.433697 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a4cd9751-6a9a-4666-8bf5-dfb85ace6122 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd54c03d9a244d21b13f7ba4d914d2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc14eff36af743bc94180fe1e24da809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:41.443768 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a4cd9751-6a9a-4666-8bf5-dfb85ace6122 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed" status: 200 len: 1317 microversion: 2.1 time: 0.658721 Jun 05 08:28:41.457550 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 811/1609] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:40 2022] GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed => generated 1317 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:41.468232 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-952e2142-bb44-41c7-af24-b75aae931a6e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:41.468727 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-952e2142-bb44-41c7-af24-b75aae931a6e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:41.490735 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-952e2142-bb44-41c7-af24-b75aae931a6e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:41.491379 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-952e2142-bb44-41c7-af24-b75aae931a6e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:41.492347 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-952e2142-bb44-41c7-af24-b75aae931a6e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:41.493240 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-952e2142-bb44-41c7-af24-b75aae931a6e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:41.505624 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=100 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:28:41.620704 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-952e2142-bb44-41c7-af24-b75aae931a6e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:41.621198 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-952e2142-bb44-41c7-af24-b75aae931a6e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:41.621640 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-952e2142-bb44-41c7-af24-b75aae931a6e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:41.764320 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-bfed2ebc-c1a2-4994-8dd4-2fb04afe24df tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:41.794636 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-bfed2ebc-c1a2-4994-8dd4-2fb04afe24df tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:41.797730 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-bfed2ebc-c1a2-4994-8dd4-2fb04afe24df tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:41.803058 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-bfed2ebc-c1a2-4994-8dd4-2fb04afe24df tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1809 microversion: 2.20 time: 0.802552 Jun 05 08:28:41.805659 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 799/1610] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:40 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1809 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:41.815760 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-67526f74-16dc-40f5-a545-5bf81391498f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:41.826797 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-67526f74-16dc-40f5-a545-5bf81391498f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:41.856757 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-67526f74-16dc-40f5-a545-5bf81391498f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:41.858129 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-67526f74-16dc-40f5-a545-5bf81391498f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:41.859815 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-67526f74-16dc-40f5-a545-5bf81391498f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:41.864256 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-67526f74-16dc-40f5-a545-5bf81391498f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:41.915453 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-952e2142-bb44-41c7-af24-b75aae931a6e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:41.925015 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-952e2142-bb44-41c7-af24-b75aae931a6e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.466012 Jun 05 08:28:41.934216 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 812/1611] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:41 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:41.943760 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-cae74533-f41e-4226-8599-d42567ea65e5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:41.959580 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-cae74533-f41e-4226-8599-d42567ea65e5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:41.988946 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cae74533-f41e-4226-8599-d42567ea65e5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:41.990973 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cae74533-f41e-4226-8599-d42567ea65e5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:41.998107 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cae74533-f41e-4226-8599-d42567ea65e5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:41.999003 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cae74533-f41e-4226-8599-d42567ea65e5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:42.668173 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-67526f74-16dc-40f5-a545-5bf81391498f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:42.686645 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-67526f74-16dc-40f5-a545-5bf81391498f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1210 microversion: 2.1 time: 0.878851 Jun 05 08:28:42.688485 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 800/1612] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:41 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1210 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:42.702802 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-938420f5-4027-45a0-85f5-866bb0514a39 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:42.703674 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-938420f5-4027-45a0-85f5-866bb0514a39 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 54c464ac-f10b-4558-a1ef-24c9319d7364] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:42.746290 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-938420f5-4027-45a0-85f5-866bb0514a39 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:42.746892 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-938420f5-4027-45a0-85f5-866bb0514a39 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:42.747766 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-938420f5-4027-45a0-85f5-866bb0514a39 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:42.750349 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-938420f5-4027-45a0-85f5-866bb0514a39 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:42.804607 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-cae74533-f41e-4226-8599-d42567ea65e5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:42.818975 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-cae74533-f41e-4226-8599-d42567ea65e5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:42.832376 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-cae74533-f41e-4226-8599-d42567ea65e5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:42.836024 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-cae74533-f41e-4226-8599-d42567ea65e5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 0.899025 Jun 05 08:28:42.838274 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 813/1613] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:41 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:42.848707 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-ea8752ce-7bd2-435b-ae19-e48af3b73ffe req-1dc0b225-256a-4e16-b43a-536cda66bad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d031b21-37d5-4454-bed7-db50a225bce5", "name": "network-vif-unplugged", "status": "completed", "tag": "8d0bec8a-b955-48a2-b49c-95afe47c2245"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:28:42.875628 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-ea8752ce-7bd2-435b-ae19-e48af3b73ffe req-1dc0b225-256a-4e16-b43a-536cda66bad1 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:42.876455 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-ea8752ce-7bd2-435b-ae19-e48af3b73ffe req-1dc0b225-256a-4e16-b43a-536cda66bad1 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:42.919397 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-ea8752ce-7bd2-435b-ae19-e48af3b73ffe req-1dc0b225-256a-4e16-b43a-536cda66bad1 service nova] Creating event network-vif-unplugged:8d0bec8a-b955-48a2-b49c-95afe47c2245 for instance 5d031b21-37d5-4454-bed7-db50a225bce5 on n-h1-844739-1 Jun 05 08:28:42.958925 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-ea8752ce-7bd2-435b-ae19-e48af3b73ffe req-1dc0b225-256a-4e16-b43a-536cda66bad1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116723 Jun 05 08:28:42.959902 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 814/1614] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:28:42.967537 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7a054e53-2976-47b2-af38-1bdac118af19 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:42.969446 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7a054e53-2976-47b2-af38-1bdac118af19 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] [instance: d14db277-eb47-4014-b054-beb64ba573ed] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:42.988112 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7a054e53-2976-47b2-af38-1bdac118af19 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:42.988605 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7a054e53-2976-47b2-af38-1bdac118af19 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:42.989359 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7a054e53-2976-47b2-af38-1bdac118af19 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:42.990284 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7a054e53-2976-47b2-af38-1bdac118af19 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:43.040197 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-938420f5-4027-45a0-85f5-866bb0514a39 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:43.048902 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-938420f5-4027-45a0-85f5-866bb0514a39 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364" status: 200 len: 1265 microversion: 2.1 time: 0.359105 Jun 05 08:28:43.054658 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 801/1615] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:42 2022] GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364 => generated 1265 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:43.064172 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-60adf279-a7da-430b-845c-7b333c23588b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:43.067423 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-60adf279-a7da-430b-845c-7b333c23588b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:43.083014 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-60adf279-a7da-430b-845c-7b333c23588b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:43.083757 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-60adf279-a7da-430b-845c-7b333c23588b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:43.084828 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-60adf279-a7da-430b-845c-7b333c23588b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:43.085808 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-60adf279-a7da-430b-845c-7b333c23588b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:43.828705 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=4 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:28:43.904917 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=12 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:28:43.936297 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7a054e53-2976-47b2-af38-1bdac118af19 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd54c03d9a244d21b13f7ba4d914d2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc14eff36af743bc94180fe1e24da809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:43.986022 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7a054e53-2976-47b2-af38-1bdac118af19 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed" status: 200 len: 1317 microversion: 2.1 time: 1.022030 Jun 05 08:28:43.988253 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 815/1616] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:42 2022] GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed => generated 1317 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:43.997498 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ed589435-bdf4-4db0-a99d-508374003f42 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:43.999155 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ed589435-bdf4-4db0-a99d-508374003f42 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:44.017486 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ed589435-bdf4-4db0-a99d-508374003f42 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:44.018284 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ed589435-bdf4-4db0-a99d-508374003f42 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:44.019589 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ed589435-bdf4-4db0-a99d-508374003f42 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:44.020348 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ed589435-bdf4-4db0-a99d-508374003f42 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:44.092603 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ed589435-bdf4-4db0-a99d-508374003f42 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:44.094265 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ed589435-bdf4-4db0-a99d-508374003f42 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:44.095609 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-ed589435-bdf4-4db0-a99d-508374003f42 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:44.250967 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ed589435-bdf4-4db0-a99d-508374003f42 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:44.281608 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ed589435-bdf4-4db0-a99d-508374003f42 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.286645 Jun 05 08:28:44.283007 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 816/1617] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:43 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:44.324105 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-60adf279-a7da-430b-845c-7b333c23588b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:44.356829 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-60adf279-a7da-430b-845c-7b333c23588b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:44.366586 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-60adf279-a7da-430b-845c-7b333c23588b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:44.370861 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-60adf279-a7da-430b-845c-7b333c23588b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1809 microversion: 2.20 time: 1.314909 Jun 05 08:28:44.392394 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 802/1618] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:43 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1809 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:44.404748 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7a26bf07-1189-4a93-94cb-f7457f14066a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:44.410579 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7a26bf07-1189-4a93-94cb-f7457f14066a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:44.432021 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7a26bf07-1189-4a93-94cb-f7457f14066a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:44.433633 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7a26bf07-1189-4a93-94cb-f7457f14066a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:44.436721 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7a26bf07-1189-4a93-94cb-f7457f14066a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:44.438452 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7a26bf07-1189-4a93-94cb-f7457f14066a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:44.867627 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7807891c-95ec-4d24-a0ff-7b1d4621f687 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:44.868281 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7807891c-95ec-4d24-a0ff-7b1d4621f687 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:44.886279 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7807891c-95ec-4d24-a0ff-7b1d4621f687 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:44.887823 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7807891c-95ec-4d24-a0ff-7b1d4621f687 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:44.889774 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7807891c-95ec-4d24-a0ff-7b1d4621f687 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:44.892390 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7807891c-95ec-4d24-a0ff-7b1d4621f687 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:45.211827 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7a26bf07-1189-4a93-94cb-f7457f14066a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:45.226069 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7a26bf07-1189-4a93-94cb-f7457f14066a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:45.227902 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7a26bf07-1189-4a93-94cb-f7457f14066a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:45.232228 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7a26bf07-1189-4a93-94cb-f7457f14066a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 0.836563 Jun 05 08:28:45.241159 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 803/1619] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:44 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:45.253190 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6f6ddf0d-6b4f-4b1c-86bf-05cf2690caa1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:45.254089 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6f6ddf0d-6b4f-4b1c-86bf-05cf2690caa1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 54c464ac-f10b-4558-a1ef-24c9319d7364] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:45.276812 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=12 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:28:45.283047 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6f6ddf0d-6b4f-4b1c-86bf-05cf2690caa1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:45.283815 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6f6ddf0d-6b4f-4b1c-86bf-05cf2690caa1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:45.286740 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6f6ddf0d-6b4f-4b1c-86bf-05cf2690caa1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:45.290409 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6f6ddf0d-6b4f-4b1c-86bf-05cf2690caa1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:45.706520 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7807891c-95ec-4d24-a0ff-7b1d4621f687 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:45.721141 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7807891c-95ec-4d24-a0ff-7b1d4621f687 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1210 microversion: 2.1 time: 1.422136 Jun 05 08:28:45.721787 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 817/1620] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:44 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1210 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:45.734846 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c44d1cb3-c083-46f5-ab23-d10c882818d8 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:45.735517 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c44d1cb3-c083-46f5-ab23-d10c882818d8 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] [instance: d14db277-eb47-4014-b054-beb64ba573ed] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:45.757689 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c44d1cb3-c083-46f5-ab23-d10c882818d8 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:45.759372 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c44d1cb3-c083-46f5-ab23-d10c882818d8 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:45.762092 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c44d1cb3-c083-46f5-ab23-d10c882818d8 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:45.764672 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c44d1cb3-c083-46f5-ab23-d10c882818d8 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:45.765706 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6f6ddf0d-6b4f-4b1c-86bf-05cf2690caa1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:45.778297 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6f6ddf0d-6b4f-4b1c-86bf-05cf2690caa1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364" status: 200 len: 1307 microversion: 2.1 time: 0.529061 Jun 05 08:28:45.790749 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 804/1621] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:45 2022] GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364 => generated 1307 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:45.795680 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-e83b6ce3-1390-48d6-b320-dde645a1c9d3 req-53b43c10-4c71-47c9-918a-b80f2350670e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d031b21-37d5-4454-bed7-db50a225bce5", "tag": "8d0bec8a-b955-48a2-b49c-95afe47c2245"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:28:45.816333 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-e83b6ce3-1390-48d6-b320-dde645a1c9d3 req-53b43c10-4c71-47c9-918a-b80f2350670e service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:45.816767 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-e83b6ce3-1390-48d6-b320-dde645a1c9d3 req-53b43c10-4c71-47c9-918a-b80f2350670e service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:45.838360 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-e83b6ce3-1390-48d6-b320-dde645a1c9d3 req-53b43c10-4c71-47c9-918a-b80f2350670e service nova] Creating event network-changed:8d0bec8a-b955-48a2-b49c-95afe47c2245 for instance 5d031b21-37d5-4454-bed7-db50a225bce5 on n-h1-844739-1 Jun 05 08:28:45.851282 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-e83b6ce3-1390-48d6-b320-dde645a1c9d3 req-53b43c10-4c71-47c9-918a-b80f2350670e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058937 Jun 05 08:28:45.855509 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 805/1622] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:28:45.864788 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0037f4fc-ad8b-4298-89f0-a25224a391a3 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:45.873488 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0037f4fc-ad8b-4298-89f0-a25224a391a3 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:45.888087 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0037f4fc-ad8b-4298-89f0-a25224a391a3 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:45.888825 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0037f4fc-ad8b-4298-89f0-a25224a391a3 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:45.889805 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0037f4fc-ad8b-4298-89f0-a25224a391a3 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:45.890412 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0037f4fc-ad8b-4298-89f0-a25224a391a3 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:45.957827 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0037f4fc-ad8b-4298-89f0-a25224a391a3 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:45.958565 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0037f4fc-ad8b-4298-89f0-a25224a391a3 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:45.959189 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-0037f4fc-ad8b-4298-89f0-a25224a391a3 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:46.009132 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0037f4fc-ad8b-4298-89f0-a25224a391a3 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:46.018238 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0037f4fc-ad8b-4298-89f0-a25224a391a3 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.157885 Jun 05 08:28:46.024656 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 806/1623] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:45 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:46.038860 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-74725d77-0e9e-4b41-8967-024daa61d6fb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:46.039805 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-74725d77-0e9e-4b41-8967-024daa61d6fb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:46.050555 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-74725d77-0e9e-4b41-8967-024daa61d6fb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:46.052353 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-74725d77-0e9e-4b41-8967-024daa61d6fb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:46.055268 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-74725d77-0e9e-4b41-8967-024daa61d6fb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:46.055915 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-74725d77-0e9e-4b41-8967-024daa61d6fb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:46.823040 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c44d1cb3-c083-46f5-ab23-d10c882818d8 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd54c03d9a244d21b13f7ba4d914d2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc14eff36af743bc94180fe1e24da809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:46.844501 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c44d1cb3-c083-46f5-ab23-d10c882818d8 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed" status: 200 len: 1467 microversion: 2.1 time: 1.112297 Jun 05 08:28:46.855235 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 818/1624] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:45 2022] GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed => generated 1467 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:46.859754 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e15e9203-24e9-41e6-9c88-ca1817691376 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:46.874819 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e15e9203-24e9-41e6-9c88-ca1817691376 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:46.891709 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e15e9203-24e9-41e6-9c88-ca1817691376 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:46.892337 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e15e9203-24e9-41e6-9c88-ca1817691376 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:46.893208 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e15e9203-24e9-41e6-9c88-ca1817691376 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:46.893731 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e15e9203-24e9-41e6-9c88-ca1817691376 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:46.966577 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-74725d77-0e9e-4b41-8967-024daa61d6fb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:47.000174 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-74725d77-0e9e-4b41-8967-024daa61d6fb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:47.007953 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-74725d77-0e9e-4b41-8967-024daa61d6fb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:47.014252 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-74725d77-0e9e-4b41-8967-024daa61d6fb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1809 microversion: 2.20 time: 0.988153 Jun 05 08:28:47.018763 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 807/1625] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:46 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1809 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:47.034287 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cb348ddc-6ed0-4a58-b6f1-8830748e7c4a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:47.041334 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-cb348ddc-6ed0-4a58-b6f1-8830748e7c4a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:47.068254 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cb348ddc-6ed0-4a58-b6f1-8830748e7c4a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:47.069543 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cb348ddc-6ed0-4a58-b6f1-8830748e7c4a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:47.072910 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cb348ddc-6ed0-4a58-b6f1-8830748e7c4a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:47.074135 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cb348ddc-6ed0-4a58-b6f1-8830748e7c4a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:47.439696 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e15e9203-24e9-41e6-9c88-ca1817691376 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:47.457285 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e15e9203-24e9-41e6-9c88-ca1817691376 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:47.459463 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e15e9203-24e9-41e6-9c88-ca1817691376 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:47.466715 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e15e9203-24e9-41e6-9c88-ca1817691376 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 0.613688 Jun 05 08:28:47.479522 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 819/1626] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:46 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:47.485278 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ebe4d0d1-8830-4df2-8393-1abe0bcb0c1e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:47.493592 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ebe4d0d1-8830-4df2-8393-1abe0bcb0c1e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 54c464ac-f10b-4558-a1ef-24c9319d7364] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:47.512097 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ebe4d0d1-8830-4df2-8393-1abe0bcb0c1e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:47.512934 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ebe4d0d1-8830-4df2-8393-1abe0bcb0c1e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:47.513950 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ebe4d0d1-8830-4df2-8393-1abe0bcb0c1e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:47.514614 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ebe4d0d1-8830-4df2-8393-1abe0bcb0c1e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:47.541719 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-cb348ddc-6ed0-4a58-b6f1-8830748e7c4a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:47.561924 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-cb348ddc-6ed0-4a58-b6f1-8830748e7c4a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1210 microversion: 2.1 time: 0.536290 Jun 05 08:28:47.566213 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 808/1627] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:47 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1210 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:47.597772 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-50f57e29-25f7-48a2-9433-42db4443080f tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1728247279", "metadata": {"image_type": "test"}}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:28:47.606019 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-50f57e29-25f7-48a2-9433-42db4443080f tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] [instance: d14db277-eb47-4014-b054-beb64ba573ed] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:47.639399 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-50f57e29-25f7-48a2-9433-42db4443080f tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:47.643077 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-50f57e29-25f7-48a2-9433-42db4443080f tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:47.644571 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-50f57e29-25f7-48a2-9433-42db4443080f tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:47.646954 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-50f57e29-25f7-48a2-9433-42db4443080f tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:47.747122 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-50f57e29-25f7-48a2-9433-42db4443080f tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Getting quotas for project bc14eff36af743bc94180fe1e24da809. Resources: dict_keys(['metadata_items']) {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:28:47.758106 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-50f57e29-25f7-48a2-9433-42db4443080f tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Getting quotas for user bd54c03d9a244d21b13f7ba4d914d2a9 and project bc14eff36af743bc94180fe1e24da809. Resources: dict_keys(['metadata_items']) {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:28:47.844939 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ebe4d0d1-8830-4df2-8393-1abe0bcb0c1e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:47.855480 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ebe4d0d1-8830-4df2-8393-1abe0bcb0c1e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364" status: 200 len: 1307 microversion: 2.1 time: 0.374389 Jun 05 08:28:47.857029 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 820/1628] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:47 2022] GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364 => generated 1307 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:47.862652 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6fdbda7a-a6b9-4309-9d08-f10e581ee8f0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:47.863545 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6fdbda7a-a6b9-4309-9d08-f10e581ee8f0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:47.871441 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6fdbda7a-a6b9-4309-9d08-f10e581ee8f0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:47.872117 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6fdbda7a-a6b9-4309-9d08-f10e581ee8f0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:47.872916 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6fdbda7a-a6b9-4309-9d08-f10e581ee8f0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:47.873367 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6fdbda7a-a6b9-4309-9d08-f10e581ee8f0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:47.941378 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6fdbda7a-a6b9-4309-9d08-f10e581ee8f0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:47.941848 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6fdbda7a-a6b9-4309-9d08-f10e581ee8f0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:47.942292 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-6fdbda7a-a6b9-4309-9d08-f10e581ee8f0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:48.030456 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6fdbda7a-a6b9-4309-9d08-f10e581ee8f0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:48.039602 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6fdbda7a-a6b9-4309-9d08-f10e581ee8f0 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.181355 Jun 05 08:28:48.051934 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 821/1629] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:47 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:48.393612 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-fdbadf7b-2e24-48da-bc54-e41a7b825156 req-ff3f5387-55c6-4a0d-a019-ab62694d07cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54c464ac-f10b-4558-a1ef-24c9319d7364", "tag": "e48c18b0-4da6-4d66-afed-f0591fad5a60"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:28:48.410935 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-fdbadf7b-2e24-48da-bc54-e41a7b825156 req-ff3f5387-55c6-4a0d-a019-ab62694d07cf service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:48.411875 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-fdbadf7b-2e24-48da-bc54-e41a7b825156 req-ff3f5387-55c6-4a0d-a019-ab62694d07cf service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:48.427652 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-50f57e29-25f7-48a2-9433-42db4443080f tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "POST /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed/action" status: 202 len: 0 microversion: 2.1 time: 0.854074 Jun 05 08:28:48.429378 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-fdbadf7b-2e24-48da-bc54-e41a7b825156 req-ff3f5387-55c6-4a0d-a019-ab62694d07cf service nova] Creating event network-changed:e48c18b0-4da6-4d66-afed-f0591fad5a60 for instance 54c464ac-f10b-4558-a1ef-24c9319d7364 on n-h2-844739-1 Jun 05 08:28:48.431389 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 809/1630] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Jun 5 08:28:47 2022] POST /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed/action => generated 0 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 05 08:28:48.437715 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-fdbadf7b-2e24-48da-bc54-e41a7b825156 req-ff3f5387-55c6-4a0d-a019-ab62694d07cf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.384473 Jun 05 08:28:48.441095 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 822/1631] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:28:48.442450 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f2448a19-1be2-4172-80d8-4f143c8833ac tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:48.443501 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f2448a19-1be2-4172-80d8-4f143c8833ac tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:48.452836 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-dc78de6c-c685-4014-86d5-0079059162f4 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f24339c95e0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:48.455149 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f2448a19-1be2-4172-80d8-4f143c8833ac tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:48.455612 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f2448a19-1be2-4172-80d8-4f143c8833ac tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:48.456460 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f2448a19-1be2-4172-80d8-4f143c8833ac tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:48.457104 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f2448a19-1be2-4172-80d8-4f143c8833ac tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:48.532219 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-dc78de6c-c685-4014-86d5-0079059162f4 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b" status: 200 len: 1424 microversion: 2.1 time: 0.087614 Jun 05 08:28:48.533047 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 823/1632] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:28:48 2022] GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b => generated 1424 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:48.542349 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8d9a201d-e4e4-4d11-af40-0d9660a6a3a1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:48.543086 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8d9a201d-e4e4-4d11-af40-0d9660a6a3a1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:48.549719 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8d9a201d-e4e4-4d11-af40-0d9660a6a3a1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:48.550882 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8d9a201d-e4e4-4d11-af40-0d9660a6a3a1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:48.551338 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8d9a201d-e4e4-4d11-af40-0d9660a6a3a1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:48.552221 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8d9a201d-e4e4-4d11-af40-0d9660a6a3a1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:48.744515 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8d9a201d-e4e4-4d11-af40-0d9660a6a3a1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:48.759725 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8d9a201d-e4e4-4d11-af40-0d9660a6a3a1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:48.761274 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8d9a201d-e4e4-4d11-af40-0d9660a6a3a1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:48.768626 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8d9a201d-e4e4-4d11-af40-0d9660a6a3a1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 0.233233 Jun 05 08:28:48.769828 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 824/1633] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:48 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:48.786518 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f2448a19-1be2-4172-80d8-4f143c8833ac tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:48.792860 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8ad58840-7d31-4891-bf53-7490765a3536 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:48.796751 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8ad58840-7d31-4891-bf53-7490765a3536 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:48.797533 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f2448a19-1be2-4172-80d8-4f143c8833ac tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:48.799831 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f2448a19-1be2-4172-80d8-4f143c8833ac tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:48.801596 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f2448a19-1be2-4172-80d8-4f143c8833ac tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1809 microversion: 2.20 time: 0.368122 Jun 05 08:28:48.813442 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8ad58840-7d31-4891-bf53-7490765a3536 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:48.813771 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 810/1634] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:48 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1809 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:48.814480 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8ad58840-7d31-4891-bf53-7490765a3536 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:48.816317 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8ad58840-7d31-4891-bf53-7490765a3536 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:48.817871 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8ad58840-7d31-4891-bf53-7490765a3536 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:48.874711 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-404cd7d9-2d92-40b4-ae22-664cde58bfc8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:48.875601 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-404cd7d9-2d92-40b4-ae22-664cde58bfc8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 54c464ac-f10b-4558-a1ef-24c9319d7364] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:48.886076 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-404cd7d9-2d92-40b4-ae22-664cde58bfc8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:48.886707 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-404cd7d9-2d92-40b4-ae22-664cde58bfc8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:48.887838 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-404cd7d9-2d92-40b4-ae22-664cde58bfc8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:48.889606 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-404cd7d9-2d92-40b4-ae22-664cde58bfc8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:49.154249 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8ad58840-7d31-4891-bf53-7490765a3536 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:49.168749 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8ad58840-7d31-4891-bf53-7490765a3536 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1210 microversion: 2.1 time: 0.397567 Jun 05 08:28:49.171101 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 825/1635] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:48 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1210 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:49.193797 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-cd1ba7c2-3c03-4c7d-bcc7-189eab0f5266 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:49.194470 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-cd1ba7c2-3c03-4c7d-bcc7-189eab0f5266 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:49.206512 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-404cd7d9-2d92-40b4-ae22-664cde58bfc8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:49.214589 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cd1ba7c2-3c03-4c7d-bcc7-189eab0f5266 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:49.214798 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-404cd7d9-2d92-40b4-ae22-664cde58bfc8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364" status: 200 len: 1307 microversion: 2.1 time: 0.344339 Jun 05 08:28:49.216131 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cd1ba7c2-3c03-4c7d-bcc7-189eab0f5266 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:49.217534 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 811/1636] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:48 2022] GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364 => generated 1307 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:49.219676 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cd1ba7c2-3c03-4c7d-bcc7-189eab0f5266 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:49.222397 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cd1ba7c2-3c03-4c7d-bcc7-189eab0f5266 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:49.286186 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cd1ba7c2-3c03-4c7d-bcc7-189eab0f5266 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:49.286638 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cd1ba7c2-3c03-4c7d-bcc7-189eab0f5266 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:49.287316 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-cd1ba7c2-3c03-4c7d-bcc7-189eab0f5266 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:49.338936 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-cd1ba7c2-3c03-4c7d-bcc7-189eab0f5266 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:49.348584 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-cd1ba7c2-3c03-4c7d-bcc7-189eab0f5266 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.166163 Jun 05 08:28:49.352071 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 826/1637] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:49 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:49.545972 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-592a88a1-cbb2-49eb-8042-eced5e86682f tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f244048fca0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:49.609675 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-592a88a1-cbb2-49eb-8042-eced5e86682f tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b" status: 200 len: 1424 microversion: 2.1 time: 0.067428 Jun 05 08:28:49.610752 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 812/1638] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:28:49 2022] GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b => generated 1424 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:49.789603 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5cd0d46c-f8da-4a00-9dca-4b6f80c74074 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:49.790145 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5cd0d46c-f8da-4a00-9dca-4b6f80c74074 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:49.799448 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5cd0d46c-f8da-4a00-9dca-4b6f80c74074 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:49.799899 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5cd0d46c-f8da-4a00-9dca-4b6f80c74074 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:49.800811 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5cd0d46c-f8da-4a00-9dca-4b6f80c74074 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:49.801585 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5cd0d46c-f8da-4a00-9dca-4b6f80c74074 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:49.824672 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2dc65090-6f87-4980-830c-b93858927664 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:49.825620 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2dc65090-6f87-4980-830c-b93858927664 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:49.846904 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2dc65090-6f87-4980-830c-b93858927664 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:49.847993 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2dc65090-6f87-4980-830c-b93858927664 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:49.849853 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2dc65090-6f87-4980-830c-b93858927664 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:49.860436 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2dc65090-6f87-4980-830c-b93858927664 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:49.917386 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:28:49.971706 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5cd0d46c-f8da-4a00-9dca-4b6f80c74074 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:49.982926 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5cd0d46c-f8da-4a00-9dca-4b6f80c74074 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:49.984787 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5cd0d46c-f8da-4a00-9dca-4b6f80c74074 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:49.986221 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5cd0d46c-f8da-4a00-9dca-4b6f80c74074 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 0.201346 Jun 05 08:28:49.997675 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 827/1639] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:49 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:50.107791 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2dc65090-6f87-4980-830c-b93858927664 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:50.120844 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2dc65090-6f87-4980-830c-b93858927664 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:50.122612 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2dc65090-6f87-4980-830c-b93858927664 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:50.124374 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2dc65090-6f87-4980-830c-b93858927664 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1809 microversion: 2.20 time: 0.307605 Jun 05 08:28:50.125288 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 813/1640] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:49 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1809 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:50.187712 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f84f2b92-1e70-4ad6-af6f-978a9d3df1e7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:50.189302 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f84f2b92-1e70-4ad6-af6f-978a9d3df1e7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:50.200746 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f84f2b92-1e70-4ad6-af6f-978a9d3df1e7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:50.201727 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f84f2b92-1e70-4ad6-af6f-978a9d3df1e7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:50.203356 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f84f2b92-1e70-4ad6-af6f-978a9d3df1e7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:50.204032 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f84f2b92-1e70-4ad6-af6f-978a9d3df1e7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:50.237187 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ed8bd7c5-10be-42b9-bba1-2797ac722f30 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:50.238065 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ed8bd7c5-10be-42b9-bba1-2797ac722f30 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 54c464ac-f10b-4558-a1ef-24c9319d7364] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:50.251142 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ed8bd7c5-10be-42b9-bba1-2797ac722f30 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:50.251861 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ed8bd7c5-10be-42b9-bba1-2797ac722f30 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:50.252716 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ed8bd7c5-10be-42b9-bba1-2797ac722f30 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:50.253386 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ed8bd7c5-10be-42b9-bba1-2797ac722f30 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:50.409631 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f84f2b92-1e70-4ad6-af6f-978a9d3df1e7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:50.428350 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f84f2b92-1e70-4ad6-af6f-978a9d3df1e7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1210 microversion: 2.1 time: 0.244738 Jun 05 08:28:50.430469 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 828/1641] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:50 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1210 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:50.436727 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6b1af3bb-72f2-440f-a1a9-391150eee559 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:50.437574 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6b1af3bb-72f2-440f-a1a9-391150eee559 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:50.452383 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6b1af3bb-72f2-440f-a1a9-391150eee559 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:50.455029 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6b1af3bb-72f2-440f-a1a9-391150eee559 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:50.457060 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6b1af3bb-72f2-440f-a1a9-391150eee559 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:50.459436 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6b1af3bb-72f2-440f-a1a9-391150eee559 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:50.479727 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ed8bd7c5-10be-42b9-bba1-2797ac722f30 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:50.488258 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ed8bd7c5-10be-42b9-bba1-2797ac722f30 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364" status: 200 len: 1307 microversion: 2.1 time: 0.256362 Jun 05 08:28:50.501069 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 814/1642] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:50 2022] GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364 => generated 1307 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:50.512481 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6b1af3bb-72f2-440f-a1a9-391150eee559 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:50.513210 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6b1af3bb-72f2-440f-a1a9-391150eee559 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:50.513760 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-6b1af3bb-72f2-440f-a1a9-391150eee559 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:50.519903 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=100 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:28:50.566235 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6b1af3bb-72f2-440f-a1a9-391150eee559 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:50.579855 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6b1af3bb-72f2-440f-a1a9-391150eee559 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.147578 Jun 05 08:28:50.590295 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 829/1643] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:50 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:50.622963 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-881d43fb-152c-4015-8a5e-77f0122df857 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f2433c68040>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:50.742011 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-881d43fb-152c-4015-8a5e-77f0122df857 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b" status: 200 len: 1424 microversion: 2.1 time: 0.122280 Jun 05 08:28:50.743977 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 815/1644] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:28:50 2022] GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b => generated 1424 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:51.005078 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d6ae2a71-a526-41e3-8cbd-8ff6ee548ce4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:51.005982 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d6ae2a71-a526-41e3-8cbd-8ff6ee548ce4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:51.013686 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d6ae2a71-a526-41e3-8cbd-8ff6ee548ce4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:51.014427 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d6ae2a71-a526-41e3-8cbd-8ff6ee548ce4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:51.015435 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d6ae2a71-a526-41e3-8cbd-8ff6ee548ce4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:51.016148 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d6ae2a71-a526-41e3-8cbd-8ff6ee548ce4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:51.145282 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cf39fa6a-fa6b-42d3-911a-60cd3b99374b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:51.145901 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-cf39fa6a-fa6b-42d3-911a-60cd3b99374b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:51.159891 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cf39fa6a-fa6b-42d3-911a-60cd3b99374b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:51.160395 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cf39fa6a-fa6b-42d3-911a-60cd3b99374b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:51.161208 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cf39fa6a-fa6b-42d3-911a-60cd3b99374b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:51.161657 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cf39fa6a-fa6b-42d3-911a-60cd3b99374b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:51.377756 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d6ae2a71-a526-41e3-8cbd-8ff6ee548ce4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:51.392747 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d6ae2a71-a526-41e3-8cbd-8ff6ee548ce4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:51.394751 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d6ae2a71-a526-41e3-8cbd-8ff6ee548ce4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:51.397815 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d6ae2a71-a526-41e3-8cbd-8ff6ee548ce4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 0.396642 Jun 05 08:28:51.416124 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 830/1645] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:51 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:51.438129 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-cf39fa6a-fa6b-42d3-911a-60cd3b99374b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:51.447147 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-501a9382-eda0-4ce9-928d-6b8eda000122 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:51.447777 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-501a9382-eda0-4ce9-928d-6b8eda000122 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:51.449865 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-cf39fa6a-fa6b-42d3-911a-60cd3b99374b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:51.451936 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-cf39fa6a-fa6b-42d3-911a-60cd3b99374b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:51.453386 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-cf39fa6a-fa6b-42d3-911a-60cd3b99374b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1809 microversion: 2.20 time: 0.312497 Jun 05 08:28:51.454063 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 816/1646] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:51 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1809 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:28:51.466292 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-501a9382-eda0-4ce9-928d-6b8eda000122 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:51.466976 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-501a9382-eda0-4ce9-928d-6b8eda000122 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:51.467966 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-501a9382-eda0-4ce9-928d-6b8eda000122 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:51.468676 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-501a9382-eda0-4ce9-928d-6b8eda000122 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:51.508398 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1dd01976-6888-4f33-8209-5932b92f79b3 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:51.509165 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1dd01976-6888-4f33-8209-5932b92f79b3 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 54c464ac-f10b-4558-a1ef-24c9319d7364] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:51.517726 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1dd01976-6888-4f33-8209-5932b92f79b3 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:51.520091 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1dd01976-6888-4f33-8209-5932b92f79b3 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:51.525681 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1dd01976-6888-4f33-8209-5932b92f79b3 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:51.526462 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1dd01976-6888-4f33-8209-5932b92f79b3 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:51.708941 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-501a9382-eda0-4ce9-928d-6b8eda000122 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:51.723957 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-501a9382-eda0-4ce9-928d-6b8eda000122 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1210 microversion: 2.1 time: 0.281950 Jun 05 08:28:51.725087 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 831/1647] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:51 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1210 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:28:51.730688 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fa7ca5c7-f764-4d26-ab7a-fbe026ab313a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:51.731506 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-fa7ca5c7-f764-4d26-ab7a-fbe026ab313a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:51.738180 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fa7ca5c7-f764-4d26-ab7a-fbe026ab313a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:51.738876 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fa7ca5c7-f764-4d26-ab7a-fbe026ab313a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:51.739827 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fa7ca5c7-f764-4d26-ab7a-fbe026ab313a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:51.740469 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fa7ca5c7-f764-4d26-ab7a-fbe026ab313a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:51.791834 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fa7ca5c7-f764-4d26-ab7a-fbe026ab313a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:51.792595 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fa7ca5c7-f764-4d26-ab7a-fbe026ab313a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:51.793262 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-fa7ca5c7-f764-4d26-ab7a-fbe026ab313a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:51.819089 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1dd01976-6888-4f33-8209-5932b92f79b3 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:51.832991 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1dd01976-6888-4f33-8209-5932b92f79b3 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364" status: 200 len: 1307 microversion: 2.1 time: 0.326947 Jun 05 08:28:51.834205 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 817/1648] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:51 2022] GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364 => generated 1307 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:28:51.843881 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-86eccded-8ca4-483d-b780-f64739eb7d77 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f24335b5670>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:51.877852 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-fa7ca5c7-f764-4d26-ab7a-fbe026ab313a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:51.888218 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fa7ca5c7-f764-4d26-ab7a-fbe026ab313a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.161089 Jun 05 08:28:51.910043 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 832/1649] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:51 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:51.919321 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-86eccded-8ca4-483d-b780-f64739eb7d77 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b" status: 200 len: 1424 microversion: 2.1 time: 0.082222 Jun 05 08:28:51.920723 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 818/1650] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:28:51 2022] GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b => generated 1424 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:52.419761 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4744e500-08c8-4955-97dc-2d2295f0944e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:52.420494 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4744e500-08c8-4955-97dc-2d2295f0944e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:52.431164 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4744e500-08c8-4955-97dc-2d2295f0944e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:52.435199 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4744e500-08c8-4955-97dc-2d2295f0944e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:52.437212 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4744e500-08c8-4955-97dc-2d2295f0944e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:52.438493 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4744e500-08c8-4955-97dc-2d2295f0944e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:52.473659 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f4ae52c2-b47d-45cb-ad4e-6b8a4a2171c7 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:52.474388 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f4ae52c2-b47d-45cb-ad4e-6b8a4a2171c7 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:52.492447 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f4ae52c2-b47d-45cb-ad4e-6b8a4a2171c7 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:52.495629 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f4ae52c2-b47d-45cb-ad4e-6b8a4a2171c7 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:52.498625 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f4ae52c2-b47d-45cb-ad4e-6b8a4a2171c7 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:52.499188 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f4ae52c2-b47d-45cb-ad4e-6b8a4a2171c7 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:52.719279 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4744e500-08c8-4955-97dc-2d2295f0944e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:52.733640 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4744e500-08c8-4955-97dc-2d2295f0944e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:52.735174 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4744e500-08c8-4955-97dc-2d2295f0944e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:52.736410 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4744e500-08c8-4955-97dc-2d2295f0944e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 0.321775 Jun 05 08:28:52.740544 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 833/1651] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:52 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:52.750681 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ab874add-b75b-4ac6-b2d0-3fbf08c7526a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:52.751309 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ab874add-b75b-4ac6-b2d0-3fbf08c7526a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:52.765368 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ab874add-b75b-4ac6-b2d0-3fbf08c7526a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:52.765842 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ab874add-b75b-4ac6-b2d0-3fbf08c7526a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:52.766635 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ab874add-b75b-4ac6-b2d0-3fbf08c7526a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:52.767084 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ab874add-b75b-4ac6-b2d0-3fbf08c7526a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:52.938448 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f4ae52c2-b47d-45cb-ad4e-6b8a4a2171c7 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:52.962713 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f4ae52c2-b47d-45cb-ad4e-6b8a4a2171c7 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:52.970354 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f4ae52c2-b47d-45cb-ad4e-6b8a4a2171c7 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:52.978893 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f4ae52c2-b47d-45cb-ad4e-6b8a4a2171c7 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1809 microversion: 2.20 time: 0.503806 Jun 05 08:28:52.984145 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 819/1652] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:52 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1809 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:28:53.009017 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-28c1e223-62e3-483a-9352-f1487fe52692 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:53.009965 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-28c1e223-62e3-483a-9352-f1487fe52692 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 54c464ac-f10b-4558-a1ef-24c9319d7364] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:53.039901 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-28c1e223-62e3-483a-9352-f1487fe52692 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:53.040733 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-28c1e223-62e3-483a-9352-f1487fe52692 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:53.042382 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-28c1e223-62e3-483a-9352-f1487fe52692 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:53.043288 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-28c1e223-62e3-483a-9352-f1487fe52692 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:53.246437 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ab874add-b75b-4ac6-b2d0-3fbf08c7526a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:53.259947 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ab874add-b75b-4ac6-b2d0-3fbf08c7526a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1210 microversion: 2.1 time: 0.517766 Jun 05 08:28:53.262978 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 834/1653] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:52 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1210 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:53.269054 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d88f3f65-c186-412f-8f1e-9eaf914d71bd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:53.270094 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d88f3f65-c186-412f-8f1e-9eaf914d71bd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:53.279585 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d88f3f65-c186-412f-8f1e-9eaf914d71bd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:53.280595 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d88f3f65-c186-412f-8f1e-9eaf914d71bd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:53.281622 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d88f3f65-c186-412f-8f1e-9eaf914d71bd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:53.282630 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d88f3f65-c186-412f-8f1e-9eaf914d71bd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:53.371055 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d88f3f65-c186-412f-8f1e-9eaf914d71bd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:53.373910 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d88f3f65-c186-412f-8f1e-9eaf914d71bd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:53.375334 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-d88f3f65-c186-412f-8f1e-9eaf914d71bd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:53.457059 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d88f3f65-c186-412f-8f1e-9eaf914d71bd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:53.471970 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d88f3f65-c186-412f-8f1e-9eaf914d71bd tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.206762 Jun 05 08:28:53.473020 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 835/1654] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:53 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:53.478556 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-54bdcb6f-4cbe-4240-8961-1035511c6eca tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f24401431f0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:53.480728 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-28c1e223-62e3-483a-9352-f1487fe52692 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:53.493387 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-28c1e223-62e3-483a-9352-f1487fe52692 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364" status: 200 len: 1307 microversion: 2.1 time: 0.504599 Jun 05 08:28:53.503739 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 820/1655] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:52 2022] GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364 => generated 1307 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:53.544474 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-54bdcb6f-4cbe-4240-8961-1035511c6eca tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b" status: 200 len: 1424 microversion: 2.1 time: 0.069877 Jun 05 08:28:53.551237 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 836/1656] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:28:53 2022] GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b => generated 1424 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:53.755849 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-841336e1-c69e-4211-a705-37b43093346a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:53.756868 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-841336e1-c69e-4211-a705-37b43093346a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:53.769859 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-841336e1-c69e-4211-a705-37b43093346a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:53.770504 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-841336e1-c69e-4211-a705-37b43093346a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:53.771398 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-841336e1-c69e-4211-a705-37b43093346a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:53.771946 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-841336e1-c69e-4211-a705-37b43093346a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:53.971573 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-841336e1-c69e-4211-a705-37b43093346a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:53.983526 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-841336e1-c69e-4211-a705-37b43093346a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:53.985677 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-841336e1-c69e-4211-a705-37b43093346a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:53.987633 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-841336e1-c69e-4211-a705-37b43093346a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 0.236705 Jun 05 08:28:53.988582 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 821/1657] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:53 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:54.007161 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-21059110-4ed9-48f5-add9-486028f56010 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:54.007868 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-21059110-4ed9-48f5-add9-486028f56010 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:54.020899 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-21059110-4ed9-48f5-add9-486028f56010 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:54.021360 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-21059110-4ed9-48f5-add9-486028f56010 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:54.023244 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-21059110-4ed9-48f5-add9-486028f56010 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:54.023705 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-21059110-4ed9-48f5-add9-486028f56010 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:54.282637 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-56166609-2c3f-4686-9876-4ea064b2e427 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:54.283676 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-56166609-2c3f-4686-9876-4ea064b2e427 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:54.298052 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-56166609-2c3f-4686-9876-4ea064b2e427 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:54.305033 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-56166609-2c3f-4686-9876-4ea064b2e427 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:54.306086 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-56166609-2c3f-4686-9876-4ea064b2e427 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:54.308670 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-56166609-2c3f-4686-9876-4ea064b2e427 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:54.377452 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-21059110-4ed9-48f5-add9-486028f56010 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:54.400918 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-21059110-4ed9-48f5-add9-486028f56010 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:54.415055 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-21059110-4ed9-48f5-add9-486028f56010 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:54.421116 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-21059110-4ed9-48f5-add9-486028f56010 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1809 microversion: 2.20 time: 0.418346 Jun 05 08:28:54.427622 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 837/1658] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:54 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1809 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:54.489886 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-414cb765-fd4f-4655-b955-f0b243fdd7b1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:54.492915 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-414cb765-fd4f-4655-b955-f0b243fdd7b1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:54.507604 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-414cb765-fd4f-4655-b955-f0b243fdd7b1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:54.515214 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-414cb765-fd4f-4655-b955-f0b243fdd7b1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:54.517138 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-414cb765-fd4f-4655-b955-f0b243fdd7b1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:54.518213 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-414cb765-fd4f-4655-b955-f0b243fdd7b1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:54.601563 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:28:54.615204 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-414cb765-fd4f-4655-b955-f0b243fdd7b1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:54.617293 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-414cb765-fd4f-4655-b955-f0b243fdd7b1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:54.619581 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-414cb765-fd4f-4655-b955-f0b243fdd7b1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:54.662965 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-56166609-2c3f-4686-9876-4ea064b2e427 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:54.684564 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-56166609-2c3f-4686-9876-4ea064b2e427 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1210 microversion: 2.1 time: 0.405807 Jun 05 08:28:54.698824 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 822/1659] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:54 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1210 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:28:54.710600 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9558679d-31b2-4fef-a27d-8f753e962d84 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:54.713283 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9558679d-31b2-4fef-a27d-8f753e962d84 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 54c464ac-f10b-4558-a1ef-24c9319d7364] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:54.730655 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9558679d-31b2-4fef-a27d-8f753e962d84 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:54.731989 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9558679d-31b2-4fef-a27d-8f753e962d84 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:54.735164 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9558679d-31b2-4fef-a27d-8f753e962d84 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:54.736536 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9558679d-31b2-4fef-a27d-8f753e962d84 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:54.764013 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-414cb765-fd4f-4655-b955-f0b243fdd7b1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:54.772531 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-414cb765-fd4f-4655-b955-f0b243fdd7b1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.286379 Jun 05 08:28:54.782378 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 838/1660] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:54 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:54.787441 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a22cd1cb-da46-4e7b-9e01-ac5bda3ad40e tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f2433715430>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:54.908869 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a22cd1cb-da46-4e7b-9e01-ac5bda3ad40e tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b" status: 200 len: 1424 microversion: 2.1 time: 0.112717 Jun 05 08:28:54.912252 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 839/1661] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:28:54 2022] GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b => generated 1424 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:55.009420 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fbc47f68-8192-451a-ad15-7493168d7b28 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:55.009420 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-fbc47f68-8192-451a-ad15-7493168d7b28 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:55.018052 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fbc47f68-8192-451a-ad15-7493168d7b28 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:55.023963 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fbc47f68-8192-451a-ad15-7493168d7b28 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:55.025215 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fbc47f68-8192-451a-ad15-7493168d7b28 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:55.033023 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fbc47f68-8192-451a-ad15-7493168d7b28 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:55.153127 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-9558679d-31b2-4fef-a27d-8f753e962d84 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:55.174540 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9558679d-31b2-4fef-a27d-8f753e962d84 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364" status: 200 len: 1307 microversion: 2.1 time: 0.473891 Jun 05 08:28:55.188768 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 823/1662] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:54 2022] GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364 => generated 1307 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:55.430179 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-fbc47f68-8192-451a-ad15-7493168d7b28 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:55.443643 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-fbc47f68-8192-451a-ad15-7493168d7b28 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:55.446403 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-fbc47f68-8192-451a-ad15-7493168d7b28 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:55.448429 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fbc47f68-8192-451a-ad15-7493168d7b28 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 0.445709 Jun 05 08:28:55.449192 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 840/1663] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:55 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:28:55.455059 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-32ada7b3-c9a1-456d-9f2c-794db6f0ed2e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:55.455916 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-32ada7b3-c9a1-456d-9f2c-794db6f0ed2e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:55.468252 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-32ada7b3-c9a1-456d-9f2c-794db6f0ed2e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:55.469011 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-32ada7b3-c9a1-456d-9f2c-794db6f0ed2e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:55.470096 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-32ada7b3-c9a1-456d-9f2c-794db6f0ed2e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:55.474099 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-32ada7b3-c9a1-456d-9f2c-794db6f0ed2e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:55.675529 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-d4dc8cc9-4377-4b2d-8e32-c7223da7023c req-bffa6247-137b-4711-80b0-0c3e1e6b66d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d14db277-eb47-4014-b054-beb64ba573ed", "name": "network-vif-plugged", "status": "completed", "tag": "04bb4de3-61a0-4a52-934f-f6f853fe61f9"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:28:55.700741 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-d4dc8cc9-4377-4b2d-8e32-c7223da7023c req-bffa6247-137b-4711-80b0-0c3e1e6b66d2 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:55.701177 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-d4dc8cc9-4377-4b2d-8e32-c7223da7023c req-bffa6247-137b-4711-80b0-0c3e1e6b66d2 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:55.754217 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-d4dc8cc9-4377-4b2d-8e32-c7223da7023c req-bffa6247-137b-4711-80b0-0c3e1e6b66d2 service nova] Creating event network-vif-plugged:04bb4de3-61a0-4a52-934f-f6f853fe61f9 for instance d14db277-eb47-4014-b054-beb64ba573ed on n-h2-844739-1 Jun 05 08:28:55.769795 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-d4dc8cc9-4377-4b2d-8e32-c7223da7023c req-bffa6247-137b-4711-80b0-0c3e1e6b66d2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.448359 Jun 05 08:28:55.775285 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 824/1664] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:28:55.800083 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4581daaa-190a-4de6-a730-46ce568255ab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:55.801499 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4581daaa-190a-4de6-a730-46ce568255ab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:55.824928 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4581daaa-190a-4de6-a730-46ce568255ab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:55.825715 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4581daaa-190a-4de6-a730-46ce568255ab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:55.828989 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4581daaa-190a-4de6-a730-46ce568255ab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:55.829788 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4581daaa-190a-4de6-a730-46ce568255ab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:55.863961 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-32ada7b3-c9a1-456d-9f2c-794db6f0ed2e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:55.887371 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-32ada7b3-c9a1-456d-9f2c-794db6f0ed2e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:55.890608 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-32ada7b3-c9a1-456d-9f2c-794db6f0ed2e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:55.896191 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-32ada7b3-c9a1-456d-9f2c-794db6f0ed2e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1809 microversion: 2.20 time: 0.442613 Jun 05 08:28:55.897742 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 841/1665] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:55 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1809 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:55.908655 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0b8f0ed3-a93c-4f89-afd3-6c9d57a11f68 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:55.909520 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0b8f0ed3-a93c-4f89-afd3-6c9d57a11f68 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:55.938419 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0b8f0ed3-a93c-4f89-afd3-6c9d57a11f68 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:55.939084 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0b8f0ed3-a93c-4f89-afd3-6c9d57a11f68 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:55.940060 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0b8f0ed3-a93c-4f89-afd3-6c9d57a11f68 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:55.943740 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0b8f0ed3-a93c-4f89-afd3-6c9d57a11f68 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:56.087267 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0b8f0ed3-a93c-4f89-afd3-6c9d57a11f68 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:56.091754 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0b8f0ed3-a93c-4f89-afd3-6c9d57a11f68 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:56.092738 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-0b8f0ed3-a93c-4f89-afd3-6c9d57a11f68 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:56.147765 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4581daaa-190a-4de6-a730-46ce568255ab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:56.162371 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4581daaa-190a-4de6-a730-46ce568255ab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1210 microversion: 2.1 time: 0.382050 Jun 05 08:28:56.163714 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 825/1666] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:55 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1210 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:56.170004 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a5ca7db9-5c76-4093-be48-f436c4cad597 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f2433c46dc0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:56.195161 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0b8f0ed3-a93c-4f89-afd3-6c9d57a11f68 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:56.210572 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0b8f0ed3-a93c-4f89-afd3-6c9d57a11f68 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.311386 Jun 05 08:28:56.215110 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 842/1667] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:55 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:56.223656 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-524922aa-c4c3-4b19-aca2-10db962c4b2a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:56.227022 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-524922aa-c4c3-4b19-aca2-10db962c4b2a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 54c464ac-f10b-4558-a1ef-24c9319d7364] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:56.247126 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-524922aa-c4c3-4b19-aca2-10db962c4b2a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:56.249859 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-524922aa-c4c3-4b19-aca2-10db962c4b2a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:56.251115 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-524922aa-c4c3-4b19-aca2-10db962c4b2a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:56.254428 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-524922aa-c4c3-4b19-aca2-10db962c4b2a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:56.261605 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a5ca7db9-5c76-4093-be48-f436c4cad597 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b" status: 200 len: 1424 microversion: 2.1 time: 0.096620 Jun 05 08:28:56.262409 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 826/1668] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:28:56 2022] GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b => generated 1424 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:56.473029 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-32732669-9811-49c2-b9c5-76437dd17df9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:56.473953 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-32732669-9811-49c2-b9c5-76437dd17df9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:56.489022 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-32732669-9811-49c2-b9c5-76437dd17df9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:56.490168 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-32732669-9811-49c2-b9c5-76437dd17df9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:56.494231 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-32732669-9811-49c2-b9c5-76437dd17df9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:56.495347 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-32732669-9811-49c2-b9c5-76437dd17df9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:56.502542 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-524922aa-c4c3-4b19-aca2-10db962c4b2a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:56.520994 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-524922aa-c4c3-4b19-aca2-10db962c4b2a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364" status: 200 len: 1307 microversion: 2.1 time: 0.304450 Jun 05 08:28:56.531554 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 843/1669] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:56 2022] GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364 => generated 1307 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:56.919834 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ee2aae7d-1b71-4ab4-be67-a4c059c06f02 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:56.921667 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ee2aae7d-1b71-4ab4-be67-a4c059c06f02 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:56.940470 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ee2aae7d-1b71-4ab4-be67-a4c059c06f02 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:56.941632 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ee2aae7d-1b71-4ab4-be67-a4c059c06f02 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:56.942815 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ee2aae7d-1b71-4ab4-be67-a4c059c06f02 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:56.945058 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ee2aae7d-1b71-4ab4-be67-a4c059c06f02 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:56.951568 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-32732669-9811-49c2-b9c5-76437dd17df9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:56.966664 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-32732669-9811-49c2-b9c5-76437dd17df9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:56.968277 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-32732669-9811-49c2-b9c5-76437dd17df9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:56.981139 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-32732669-9811-49c2-b9c5-76437dd17df9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 0.515902 Jun 05 08:28:56.996721 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 827/1670] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:56 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:28:57.178657 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5641380d-572f-4429-900e-70a9b4bb6b34 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:57.179393 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5641380d-572f-4429-900e-70a9b4bb6b34 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:57.188201 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5641380d-572f-4429-900e-70a9b4bb6b34 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:57.201731 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5641380d-572f-4429-900e-70a9b4bb6b34 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:57.203581 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5641380d-572f-4429-900e-70a9b4bb6b34 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:57.205373 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5641380d-572f-4429-900e-70a9b4bb6b34 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:57.483013 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ee2aae7d-1b71-4ab4-be67-a4c059c06f02 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:57.498253 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ee2aae7d-1b71-4ab4-be67-a4c059c06f02 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:57.504833 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ee2aae7d-1b71-4ab4-be67-a4c059c06f02 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:57.509354 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ee2aae7d-1b71-4ab4-be67-a4c059c06f02 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1809 microversion: 2.20 time: 0.594789 Jun 05 08:28:57.510524 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 844/1671] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:56 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1809 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:57.521683 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ae702281-1d5a-4dc2-ad4b-fa004592a630 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:57.522815 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ae702281-1d5a-4dc2-ad4b-fa004592a630 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:57.545875 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ae702281-1d5a-4dc2-ad4b-fa004592a630 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:57.549120 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ae702281-1d5a-4dc2-ad4b-fa004592a630 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:57.551856 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ae702281-1d5a-4dc2-ad4b-fa004592a630 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:57.553896 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ae702281-1d5a-4dc2-ad4b-fa004592a630 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:57.644019 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ae702281-1d5a-4dc2-ad4b-fa004592a630 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:57.644864 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ae702281-1d5a-4dc2-ad4b-fa004592a630 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:57.645507 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-ae702281-1d5a-4dc2-ad4b-fa004592a630 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:58.282765 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ae702281-1d5a-4dc2-ad4b-fa004592a630 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:58.291235 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ae702281-1d5a-4dc2-ad4b-fa004592a630 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.779494 Jun 05 08:28:58.294541 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 845/1672] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:57 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:58.299433 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-22b9e25c-712c-47f5-b4e5-fccc9e31d54e tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f243379dee0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:58.385834 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-22b9e25c-712c-47f5-b4e5-fccc9e31d54e tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b" status: 200 len: 1424 microversion: 2.1 time: 0.089954 Jun 05 08:28:58.386668 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 846/1673] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:28:58 2022] GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b => generated 1424 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:58.396192 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fc62f013-f3ae-4785-8a10-fbb35de7f04d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:58.397624 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-fc62f013-f3ae-4785-8a10-fbb35de7f04d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 54c464ac-f10b-4558-a1ef-24c9319d7364] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:58.433449 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fc62f013-f3ae-4785-8a10-fbb35de7f04d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:58.434772 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fc62f013-f3ae-4785-8a10-fbb35de7f04d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:58.436331 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fc62f013-f3ae-4785-8a10-fbb35de7f04d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:58.438090 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fc62f013-f3ae-4785-8a10-fbb35de7f04d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:58.472815 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=100 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:28:58.478609 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5641380d-572f-4429-900e-70a9b4bb6b34 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:58.487856 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5641380d-572f-4429-900e-70a9b4bb6b34 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1210 microversion: 2.1 time: 1.313005 Jun 05 08:28:58.503979 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 828/1674] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:57 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1210 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:28:58.526999 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-cbbc1496-12b3-4e72-b6dd-2a33bd11624c req-6f8f1e9c-966a-47eb-ab32-22732ca940be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c464ac-f10b-4558-a1ef-24c9319d7364", "name": "network-vif-plugged", "status": "completed", "tag": "e48c18b0-4da6-4d66-afed-f0591fad5a60"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:28:58.548536 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-cbbc1496-12b3-4e72-b6dd-2a33bd11624c req-6f8f1e9c-966a-47eb-ab32-22732ca940be service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:58.550474 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-cbbc1496-12b3-4e72-b6dd-2a33bd11624c req-6f8f1e9c-966a-47eb-ab32-22732ca940be service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:58.579906 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-cbbc1496-12b3-4e72-b6dd-2a33bd11624c req-6f8f1e9c-966a-47eb-ab32-22732ca940be service nova] Creating event network-vif-plugged:e48c18b0-4da6-4d66-afed-f0591fad5a60 for instance 54c464ac-f10b-4558-a1ef-24c9319d7364 on n-h2-844739-1 Jun 05 08:28:58.606319 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-cbbc1496-12b3-4e72-b6dd-2a33bd11624c req-6f8f1e9c-966a-47eb-ab32-22732ca940be service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097313 Jun 05 08:28:58.606975 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 829/1675] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:28:58.621914 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c53522be-327c-4e80-b1c4-4ae207a6ed76 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:58.643938 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c53522be-327c-4e80-b1c4-4ae207a6ed76 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:58.672724 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c53522be-327c-4e80-b1c4-4ae207a6ed76 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:58.674206 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c53522be-327c-4e80-b1c4-4ae207a6ed76 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:58.675044 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c53522be-327c-4e80-b1c4-4ae207a6ed76 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:58.675499 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c53522be-327c-4e80-b1c4-4ae207a6ed76 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:59.160443 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-fc62f013-f3ae-4785-8a10-fbb35de7f04d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:59.174635 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fc62f013-f3ae-4785-8a10-fbb35de7f04d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364" status: 200 len: 1307 microversion: 2.1 time: 0.781710 Jun 05 08:28:59.185740 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 847/1676] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:58 2022] GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364 => generated 1307 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:59.199729 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3a01c05d-e43a-4fff-a451-2fa2f100be13 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:59.201730 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3a01c05d-e43a-4fff-a451-2fa2f100be13 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:59.215703 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3a01c05d-e43a-4fff-a451-2fa2f100be13 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:59.216634 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3a01c05d-e43a-4fff-a451-2fa2f100be13 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:59.217718 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3a01c05d-e43a-4fff-a451-2fa2f100be13 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:59.220613 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3a01c05d-e43a-4fff-a451-2fa2f100be13 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:59.307915 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c53522be-327c-4e80-b1c4-4ae207a6ed76 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:59.320787 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c53522be-327c-4e80-b1c4-4ae207a6ed76 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:59.323992 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c53522be-327c-4e80-b1c4-4ae207a6ed76 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:59.330826 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c53522be-327c-4e80-b1c4-4ae207a6ed76 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 0.722690 Jun 05 08:28:59.331957 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 830/1677] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:58 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:28:59.355873 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-11b5149a-5f29-4553-816c-b212a77fefad tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:59.365554 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-11b5149a-5f29-4553-816c-b212a77fefad tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:59.379831 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-11b5149a-5f29-4553-816c-b212a77fefad tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:59.392778 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-11b5149a-5f29-4553-816c-b212a77fefad tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:59.393956 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-11b5149a-5f29-4553-816c-b212a77fefad tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:59.394619 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-11b5149a-5f29-4553-816c-b212a77fefad tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:59.465748 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-11b5149a-5f29-4553-816c-b212a77fefad tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:59.466209 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-11b5149a-5f29-4553-816c-b212a77fefad tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:59.466680 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-11b5149a-5f29-4553-816c-b212a77fefad tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:28:59.590136 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-11b5149a-5f29-4553-816c-b212a77fefad tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:59.598189 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-11b5149a-5f29-4553-816c-b212a77fefad tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.264875 Jun 05 08:28:59.601892 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 831/1678] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:59 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:59.616367 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-895bbf8f-801e-4968-a21c-3c8454eca526 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f244029e160>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:59.714856 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-895bbf8f-801e-4968-a21c-3c8454eca526 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b" status: 200 len: 1424 microversion: 2.1 time: 0.111795 Jun 05 08:28:59.722467 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 832/1679] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:28:59 2022] GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b => generated 1424 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:28:59.728840 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a8e6b8d3-8ca4-4079-b9aa-68cf7cef38c4 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:28:59.729740 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a8e6b8d3-8ca4-4079-b9aa-68cf7cef38c4 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:28:59.745339 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a8e6b8d3-8ca4-4079-b9aa-68cf7cef38c4 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:59.746085 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a8e6b8d3-8ca4-4079-b9aa-68cf7cef38c4 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:59.746894 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a8e6b8d3-8ca4-4079-b9aa-68cf7cef38c4 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:28:59.747350 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a8e6b8d3-8ca4-4079-b9aa-68cf7cef38c4 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:28:59.826476 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3a01c05d-e43a-4fff-a451-2fa2f100be13 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:59.846685 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3a01c05d-e43a-4fff-a451-2fa2f100be13 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:59.848705 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3a01c05d-e43a-4fff-a451-2fa2f100be13 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:28:59.850723 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3a01c05d-e43a-4fff-a451-2fa2f100be13 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1809 microversion: 2.20 time: 0.663066 Jun 05 08:28:59.851463 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 848/1680] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:28:59 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1809 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:29:00.190385 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a8e6b8d3-8ca4-4079-b9aa-68cf7cef38c4 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:00.193023 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-063cbe53-7613-4106-9004-46dcf0244f9b tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:00.194439 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-063cbe53-7613-4106-9004-46dcf0244f9b tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 54c464ac-f10b-4558-a1ef-24c9319d7364] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:00.203114 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a8e6b8d3-8ca4-4079-b9aa-68cf7cef38c4 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1210 microversion: 2.1 time: 0.479121 Jun 05 08:29:00.205924 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-063cbe53-7613-4106-9004-46dcf0244f9b tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:00.211473 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 833/1681] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:28:59 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1210 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:00.212254 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-063cbe53-7613-4106-9004-46dcf0244f9b tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:00.213300 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-063cbe53-7613-4106-9004-46dcf0244f9b tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:00.213957 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-063cbe53-7613-4106-9004-46dcf0244f9b tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:00.358854 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f711adb3-b094-419f-984b-7e6a8bb47214 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:00.360458 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f711adb3-b094-419f-984b-7e6a8bb47214 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:00.375920 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f711adb3-b094-419f-984b-7e6a8bb47214 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:00.376575 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f711adb3-b094-419f-984b-7e6a8bb47214 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:00.377562 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f711adb3-b094-419f-984b-7e6a8bb47214 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:00.382217 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f711adb3-b094-419f-984b-7e6a8bb47214 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:00.491970 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-063cbe53-7613-4106-9004-46dcf0244f9b tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:00.507085 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-063cbe53-7613-4106-9004-46dcf0244f9b tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364" status: 200 len: 1307 microversion: 2.1 time: 0.317577 Jun 05 08:29:00.510528 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 849/1682] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:00 2022] GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364 => generated 1307 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:29:00.614885 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9b30b80d-143f-402a-9054-143032755671 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:00.623156 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9b30b80d-143f-402a-9054-143032755671 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:00.632841 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9b30b80d-143f-402a-9054-143032755671 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:00.640884 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9b30b80d-143f-402a-9054-143032755671 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:00.642107 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9b30b80d-143f-402a-9054-143032755671 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:00.642786 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9b30b80d-143f-402a-9054-143032755671 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:00.712832 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9b30b80d-143f-402a-9054-143032755671 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:00.722882 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9b30b80d-143f-402a-9054-143032755671 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:00.723965 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-9b30b80d-143f-402a-9054-143032755671 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:00.802040 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9b30b80d-143f-402a-9054-143032755671 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:00.810892 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9b30b80d-143f-402a-9054-143032755671 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.199781 Jun 05 08:29:00.822440 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 850/1683] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:00 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:29:00.832228 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-616e6c25-ac41-4176-990b-91ff5e43acc7 req-737f88e7-70fc-49a5-84c0-25a86d4782e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b271002d-4613-405c-aeed-7c06b205a045", "name": "network-vif-plugged", "status": "completed", "tag": "642e2803-a706-408c-b7c4-6157cb18ee50"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:29:00.846026 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-616e6c25-ac41-4176-990b-91ff5e43acc7 req-737f88e7-70fc-49a5-84c0-25a86d4782e5 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:00.857305 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-616e6c25-ac41-4176-990b-91ff5e43acc7 req-737f88e7-70fc-49a5-84c0-25a86d4782e5 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:00.892746 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-616e6c25-ac41-4176-990b-91ff5e43acc7 req-737f88e7-70fc-49a5-84c0-25a86d4782e5 service nova] Creating event network-vif-plugged:642e2803-a706-408c-b7c4-6157cb18ee50 for instance b271002d-4613-405c-aeed-7c06b205a045 on n-h2-844739-1 Jun 05 08:29:00.900392 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-616e6c25-ac41-4176-990b-91ff5e43acc7 req-737f88e7-70fc-49a5-84c0-25a86d4782e5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076102 Jun 05 08:29:00.901886 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 851/1684] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:29:00.909842 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4cefc397-207d-41c9-87ab-ee9275bd5a1c tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f24337158b0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:00.967257 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f711adb3-b094-419f-984b-7e6a8bb47214 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:01.005138 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4cefc397-207d-41c9-87ab-ee9275bd5a1c tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b" status: 200 len: 1424 microversion: 2.1 time: 0.101667 Jun 05 08:29:01.005709 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 852/1685] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:00 2022] GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b => generated 1424 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:01.009101 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f711adb3-b094-419f-984b-7e6a8bb47214 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:01.015099 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f711adb3-b094-419f-984b-7e6a8bb47214 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:01.024232 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ef23de21-add4-4830-a667-d03fbc426b1a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:01.026810 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f711adb3-b094-419f-984b-7e6a8bb47214 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1646 microversion: 2.25 time: 0.675461 Jun 05 08:29:01.030841 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 834/1686] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:29:00 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1646 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:29:01.032809 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ef23de21-add4-4830-a667-d03fbc426b1a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:01.045647 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ef23de21-add4-4830-a667-d03fbc426b1a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:01.047139 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ef23de21-add4-4830-a667-d03fbc426b1a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:01.057715 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ef23de21-add4-4830-a667-d03fbc426b1a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:01.061319 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ef23de21-add4-4830-a667-d03fbc426b1a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:01.222254 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4f0d5063-8e5b-4e58-8fbf-52ca58bb14f2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:01.223531 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4f0d5063-8e5b-4e58-8fbf-52ca58bb14f2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:01.236147 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4f0d5063-8e5b-4e58-8fbf-52ca58bb14f2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:01.236820 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4f0d5063-8e5b-4e58-8fbf-52ca58bb14f2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:01.239487 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4f0d5063-8e5b-4e58-8fbf-52ca58bb14f2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:01.244387 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4f0d5063-8e5b-4e58-8fbf-52ca58bb14f2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:01.255024 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=100 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:29:01.565064 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ef23de21-add4-4830-a667-d03fbc426b1a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:01.625936 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ef23de21-add4-4830-a667-d03fbc426b1a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:01.628583 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ef23de21-add4-4830-a667-d03fbc426b1a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:01.631947 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ef23de21-add4-4830-a667-d03fbc426b1a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1809 microversion: 2.20 time: 0.621616 Jun 05 08:29:01.633667 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 853/1687] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:29:01 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1809 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:29:01.657698 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-35edd03a-1a61-44f0-b013-0c2ef4e1861e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:01.665171 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-35edd03a-1a61-44f0-b013-0c2ef4e1861e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 54c464ac-f10b-4558-a1ef-24c9319d7364] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:01.678844 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-35edd03a-1a61-44f0-b013-0c2ef4e1861e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:01.680845 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-35edd03a-1a61-44f0-b013-0c2ef4e1861e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:01.681868 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-35edd03a-1a61-44f0-b013-0c2ef4e1861e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:01.682452 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-35edd03a-1a61-44f0-b013-0c2ef4e1861e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:01.696341 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4f0d5063-8e5b-4e58-8fbf-52ca58bb14f2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:01.742140 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4f0d5063-8e5b-4e58-8fbf-52ca58bb14f2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1210 microversion: 2.1 time: 0.514105 Jun 05 08:29:01.753216 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 835/1688] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:01 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1210 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:01.844063 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2cce9a2c-dad9-497b-be1c-f14b8769526e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:01.849179 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2cce9a2c-dad9-497b-be1c-f14b8769526e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:01.859555 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=100 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:29:01.862711 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2cce9a2c-dad9-497b-be1c-f14b8769526e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:01.863381 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2cce9a2c-dad9-497b-be1c-f14b8769526e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:01.864472 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2cce9a2c-dad9-497b-be1c-f14b8769526e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:01.865254 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2cce9a2c-dad9-497b-be1c-f14b8769526e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:01.958082 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2cce9a2c-dad9-497b-be1c-f14b8769526e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:01.962043 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2cce9a2c-dad9-497b-be1c-f14b8769526e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:01.962782 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-2cce9a2c-dad9-497b-be1c-f14b8769526e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:02.022544 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2cce9a2c-dad9-497b-be1c-f14b8769526e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:02.031890 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2cce9a2c-dad9-497b-be1c-f14b8769526e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.196995 Jun 05 08:29:02.033068 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 836/1689] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:01 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:02.040381 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9f3dce2f-ed5f-45bb-ad81-6ccb9dfbc83c tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f24455078b0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:02.043266 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-35edd03a-1a61-44f0-b013-0c2ef4e1861e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:02.056097 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-35edd03a-1a61-44f0-b013-0c2ef4e1861e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364" status: 200 len: 1486 microversion: 2.1 time: 0.416066 Jun 05 08:29:02.056879 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 854/1690] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:01 2022] GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364 => generated 1486 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:02.063154 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d0317747-0b14-4bf5-8128-0f83b1c56a08 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:02.064123 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d0317747-0b14-4bf5-8128-0f83b1c56a08 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:02.076904 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d0317747-0b14-4bf5-8128-0f83b1c56a08 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:02.077659 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d0317747-0b14-4bf5-8128-0f83b1c56a08 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:02.078721 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d0317747-0b14-4bf5-8128-0f83b1c56a08 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:02.079321 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d0317747-0b14-4bf5-8128-0f83b1c56a08 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:02.122043 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9f3dce2f-ed5f-45bb-ad81-6ccb9dfbc83c tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b" status: 200 len: 1424 microversion: 2.1 time: 0.087674 Jun 05 08:29:02.127920 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 837/1691] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:02 2022] GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b => generated 1424 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:02.151931 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6523dae4-97dd-4b1b-bdba-cacf8998b55a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:29:02.153597 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6523dae4-97dd-4b1b-bdba-cacf8998b55a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 54c464ac-f10b-4558-a1ef-24c9319d7364] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:02.167241 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6523dae4-97dd-4b1b-bdba-cacf8998b55a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:02.169310 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6523dae4-97dd-4b1b-bdba-cacf8998b55a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:02.170858 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6523dae4-97dd-4b1b-bdba-cacf8998b55a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:02.172558 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6523dae4-97dd-4b1b-bdba-cacf8998b55a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:02.317684 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6523dae4-97dd-4b1b-bdba-cacf8998b55a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "POST /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364/action" status: 202 len: 0 microversion: 2.1 time: 0.188341 Jun 05 08:29:02.322037 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 838/1692] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Jun 5 08:29:02 2022] POST /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:29:02.330552 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9f1b54e7-cdc0-4a15-bffd-9128b05f91bd tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:02.335778 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9f1b54e7-cdc0-4a15-bffd-9128b05f91bd tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 54c464ac-f10b-4558-a1ef-24c9319d7364] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:02.345265 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9f1b54e7-cdc0-4a15-bffd-9128b05f91bd tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:02.350951 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9f1b54e7-cdc0-4a15-bffd-9128b05f91bd tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:02.352053 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9f1b54e7-cdc0-4a15-bffd-9128b05f91bd tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:02.352766 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9f1b54e7-cdc0-4a15-bffd-9128b05f91bd tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:02.541667 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d0317747-0b14-4bf5-8128-0f83b1c56a08 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:02.572030 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d0317747-0b14-4bf5-8128-0f83b1c56a08 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:02.577402 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d0317747-0b14-4bf5-8128-0f83b1c56a08 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:02.579626 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d0317747-0b14-4bf5-8128-0f83b1c56a08 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1636 microversion: 2.25 time: 0.521400 Jun 05 08:29:02.582709 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 855/1693] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:29:02 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1636 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:29:02.601455 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c179e9d3-7baf-49e4-9bce-7becbf490f4a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Calling method '.version_select at 0x7f243382cdc0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:02.604494 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c179e9d3-7baf-49e4-9bce-7becbf490f4a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:02.605499 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c179e9d3-7baf-49e4-9bce-7becbf490f4a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:02.642307 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c179e9d3-7baf-49e4-9bce-7becbf490f4a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 2536 microversion: 2.25 time: 0.045115 Jun 05 08:29:02.644361 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 856/1694] 10.222.0.33 () {60 vars in 1183 bytes} [Sun Jun 5 08:29:02 2022] GET /compute/v2.1/os-migrations => generated 2536 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:29:02.661288 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6bbde946-9bf5-4883-87ff-1c67520cc919 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:02.664329 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6bbde946-9bf5-4883-87ff-1c67520cc919 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:02.670129 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-9f1b54e7-cdc0-4a15-bffd-9128b05f91bd tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:02.676655 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6bbde946-9bf5-4883-87ff-1c67520cc919 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:02.679467 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9f1b54e7-cdc0-4a15-bffd-9128b05f91bd tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364" status: 200 len: 1491 microversion: 2.1 time: 0.352646 Jun 05 08:29:02.679745 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6bbde946-9bf5-4883-87ff-1c67520cc919 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:02.680614 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 839/1695] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:02 2022] GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364 => generated 1491 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:29:02.682603 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6bbde946-9bf5-4883-87ff-1c67520cc919 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:02.683129 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6bbde946-9bf5-4883-87ff-1c67520cc919 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:02.686098 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0bcc0c56-20d0-4dbd-95ed-d449bd92afce tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:02.688561 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0bcc0c56-20d0-4dbd-95ed-d449bd92afce tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:02.706480 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0bcc0c56-20d0-4dbd-95ed-d449bd92afce tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:02.707126 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0bcc0c56-20d0-4dbd-95ed-d449bd92afce tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:02.711955 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0bcc0c56-20d0-4dbd-95ed-d449bd92afce tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:02.712576 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0bcc0c56-20d0-4dbd-95ed-d449bd92afce tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:02.986785 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6bbde946-9bf5-4883-87ff-1c67520cc919 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:03.003014 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6bbde946-9bf5-4883-87ff-1c67520cc919 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:03.015552 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6bbde946-9bf5-4883-87ff-1c67520cc919 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:03.017109 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6bbde946-9bf5-4883-87ff-1c67520cc919 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1809 microversion: 2.20 time: 0.366664 Jun 05 08:29:03.028739 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 857/1696] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:29:02 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1809 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:29:03.043372 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-60031b82-96d1-4e93-8112-ca88640f55bd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:03.044201 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-60031b82-96d1-4e93-8112-ca88640f55bd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:03.058663 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-60031b82-96d1-4e93-8112-ca88640f55bd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:03.059102 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-60031b82-96d1-4e93-8112-ca88640f55bd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:03.064983 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-60031b82-96d1-4e93-8112-ca88640f55bd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:03.070324 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-0bcc0c56-20d0-4dbd-95ed-d449bd92afce tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lazy-loading 'services' on Instance uuid 5d031b21-37d5-4454-bed7-db50a225bce5 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:03.072315 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-60031b82-96d1-4e93-8112-ca88640f55bd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:03.102350 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0bcc0c56-20d0-4dbd-95ed-d449bd92afce tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 2128 microversion: 2.25 time: 0.420389 Jun 05 08:29:03.104395 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 840/1697] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:29:02 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 2128 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:29:03.114202 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-223496a0-c3dc-4571-9131-b8c92df17d63 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:03.115070 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-223496a0-c3dc-4571-9131-b8c92df17d63 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:03.124598 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-223496a0-c3dc-4571-9131-b8c92df17d63 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:03.125276 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-223496a0-c3dc-4571-9131-b8c92df17d63 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:03.126255 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-223496a0-c3dc-4571-9131-b8c92df17d63 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:03.126866 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-223496a0-c3dc-4571-9131-b8c92df17d63 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:03.192623 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-223496a0-c3dc-4571-9131-b8c92df17d63 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:03.193366 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-223496a0-c3dc-4571-9131-b8c92df17d63 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:03.194588 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-223496a0-c3dc-4571-9131-b8c92df17d63 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:03.410627 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-223496a0-c3dc-4571-9131-b8c92df17d63 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:03.429540 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-223496a0-c3dc-4571-9131-b8c92df17d63 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.323871 Jun 05 08:29:03.435028 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 841/1698] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:03 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:03.441189 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-74e963f5-2334-4ce9-b202-725cf016576a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:03.448863 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-74e963f5-2334-4ce9-b202-725cf016576a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:03.464519 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-74e963f5-2334-4ce9-b202-725cf016576a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:03.466579 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-74e963f5-2334-4ce9-b202-725cf016576a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:03.468260 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-74e963f5-2334-4ce9-b202-725cf016576a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:03.469811 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-74e963f5-2334-4ce9-b202-725cf016576a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:03.506309 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-60031b82-96d1-4e93-8112-ca88640f55bd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:03.517979 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-60031b82-96d1-4e93-8112-ca88640f55bd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1210 microversion: 2.1 time: 0.486402 Jun 05 08:29:03.518767 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 858/1699] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:03 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1210 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:03.527875 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-42ca5148-7b20-41ae-8511-99795712d6c7 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f2433d6de50>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:03.887295 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-74e963f5-2334-4ce9-b202-725cf016576a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lazy-loading 'services' on Instance uuid 5d031b21-37d5-4454-bed7-db50a225bce5 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:03.921729 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-74e963f5-2334-4ce9-b202-725cf016576a tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 2128 microversion: 2.25 time: 0.485186 Jun 05 08:29:03.924919 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 842/1700] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:29:03 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 2128 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:29:03.933010 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-18c369ef-2f3a-4b01-bf7a-c8e35a33950f tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:03.934296 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-18c369ef-2f3a-4b01-bf7a-c8e35a33950f tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 54c464ac-f10b-4558-a1ef-24c9319d7364] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:03.941350 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-18c369ef-2f3a-4b01-bf7a-c8e35a33950f tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:03.942578 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-18c369ef-2f3a-4b01-bf7a-c8e35a33950f tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:03.944662 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-18c369ef-2f3a-4b01-bf7a-c8e35a33950f tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:03.945438 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-18c369ef-2f3a-4b01-bf7a-c8e35a33950f tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:04.245775 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-18c369ef-2f3a-4b01-bf7a-c8e35a33950f tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:04.262632 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-18c369ef-2f3a-4b01-bf7a-c8e35a33950f tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364" status: 200 len: 1471 microversion: 2.1 time: 0.335914 Jun 05 08:29:04.276910 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 843/1701] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:03 2022] GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364 => generated 1471 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:04.286449 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d081887f-873e-4383-81d9-a5f14558290a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:04.287208 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d081887f-873e-4383-81d9-a5f14558290a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:04.294863 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d081887f-873e-4383-81d9-a5f14558290a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:04.295824 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d081887f-873e-4383-81d9-a5f14558290a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:04.297046 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d081887f-873e-4383-81d9-a5f14558290a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:04.297716 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d081887f-873e-4383-81d9-a5f14558290a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:04.439428 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-d081887f-873e-4383-81d9-a5f14558290a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lazy-loading 'services' on Instance uuid 5d031b21-37d5-4454-bed7-db50a225bce5 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:04.628523 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d081887f-873e-4383-81d9-a5f14558290a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5/os-volume_attachments/326ddb91-10fa-48bc-b487-0aa7d11a57cb" status: 202 len: 0 microversion: 2.25 time: 0.347310 Jun 05 08:29:04.631762 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 844/1702] 10.222.0.33 () {60 vars in 1456 bytes} [Sun Jun 5 08:29:04 2022] DELETE /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5/os-volume_attachments/326ddb91-10fa-48bc-b487-0aa7d11a57cb => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:29:04.647913 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d99a82e2-85f6-4e91-a1d5-6f2ac9bda81b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:04.651257 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d99a82e2-85f6-4e91-a1d5-6f2ac9bda81b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:04.669383 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d99a82e2-85f6-4e91-a1d5-6f2ac9bda81b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:04.669823 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d99a82e2-85f6-4e91-a1d5-6f2ac9bda81b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:04.670941 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d99a82e2-85f6-4e91-a1d5-6f2ac9bda81b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:04.671584 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d99a82e2-85f6-4e91-a1d5-6f2ac9bda81b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:04.997280 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d99a82e2-85f6-4e91-a1d5-6f2ac9bda81b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:05.011605 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d99a82e2-85f6-4e91-a1d5-6f2ac9bda81b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:05.014289 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d99a82e2-85f6-4e91-a1d5-6f2ac9bda81b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:05.019492 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d99a82e2-85f6-4e91-a1d5-6f2ac9bda81b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1809 microversion: 2.20 time: 0.383303 Jun 05 08:29:05.020677 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 845/1703] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:29:04 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1809 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:29:05.038049 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-bd1ed4df-5362-4c00-9d23-3988e45f85df tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1705913888"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:29:05.041099 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-bd1ed4df-5362-4c00-9d23-3988e45f85df tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 54c464ac-f10b-4558-a1ef-24c9319d7364] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:05.051877 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bd1ed4df-5362-4c00-9d23-3988e45f85df tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:05.052677 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bd1ed4df-5362-4c00-9d23-3988e45f85df tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:05.054951 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bd1ed4df-5362-4c00-9d23-3988e45f85df tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:05.055646 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bd1ed4df-5362-4c00-9d23-3988e45f85df tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:05.070628 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-42ca5148-7b20-41ae-8511-99795712d6c7 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b" status: 200 len: 1424 microversion: 2.1 time: 1.546622 Jun 05 08:29:05.084851 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 859/1704] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:03 2022] GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b => generated 1424 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:05.090008 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9498f034-370f-4742-b9b5-92a317cba1bf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:05.096189 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9498f034-370f-4742-b9b5-92a317cba1bf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:05.110433 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9498f034-370f-4742-b9b5-92a317cba1bf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:05.113826 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9498f034-370f-4742-b9b5-92a317cba1bf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:05.114832 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9498f034-370f-4742-b9b5-92a317cba1bf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:05.116710 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9498f034-370f-4742-b9b5-92a317cba1bf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:05.222541 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9498f034-370f-4742-b9b5-92a317cba1bf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:05.223675 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9498f034-370f-4742-b9b5-92a317cba1bf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:05.224513 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-9498f034-370f-4742-b9b5-92a317cba1bf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:05.330021 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9498f034-370f-4742-b9b5-92a317cba1bf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:05.346828 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9498f034-370f-4742-b9b5-92a317cba1bf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.253812 Jun 05 08:29:05.350451 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 860/1705] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:05 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:05.366976 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3854aa21-a499-44a0-8f27-4534cb431943 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:05.367620 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3854aa21-a499-44a0-8f27-4534cb431943 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:05.382615 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3854aa21-a499-44a0-8f27-4534cb431943 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:05.384469 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3854aa21-a499-44a0-8f27-4534cb431943 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:05.386986 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3854aa21-a499-44a0-8f27-4534cb431943 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:05.388440 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3854aa21-a499-44a0-8f27-4534cb431943 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:05.768146 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3854aa21-a499-44a0-8f27-4534cb431943 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:05.772111 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-bd1ed4df-5362-4c00-9d23-3988e45f85df tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "POST /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364/action" status: 202 len: 0 microversion: 2.1 time: 0.735426 Jun 05 08:29:05.772848 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 846/1706] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Jun 5 08:29:05 2022] POST /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364/action => generated 0 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 05 08:29:05.784781 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3854aa21-a499-44a0-8f27-4534cb431943 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1198 microversion: 2.1 time: 0.431335 Jun 05 08:29:05.785917 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 861/1707] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:05 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1198 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:05.793477 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7bf303b2-5197-46bf-8783-fb3ecdef385c tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f2433710310>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:05.797676 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fa58177e-1a51-4317-a973-94d4cd648bdc tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:05.798906 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-fa58177e-1a51-4317-a973-94d4cd648bdc tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:05.806684 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fa58177e-1a51-4317-a973-94d4cd648bdc tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:05.807443 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fa58177e-1a51-4317-a973-94d4cd648bdc tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:05.808402 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fa58177e-1a51-4317-a973-94d4cd648bdc tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:05.809161 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fa58177e-1a51-4317-a973-94d4cd648bdc tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:05.870212 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fa58177e-1a51-4317-a973-94d4cd648bdc tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.090065 Jun 05 08:29:05.870983 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 847/1708] 10.222.0.33 () {60 vars in 1342 bytes} [Sun Jun 5 08:29:05 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:29:05.879480 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7bf303b2-5197-46bf-8783-fb3ecdef385c tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201" status: 200 len: 1414 microversion: 2.1 time: 0.090122 Jun 05 08:29:05.886421 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 862/1709] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:05 2022] GET /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201 => generated 1414 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:06.038938 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-99025014-13fe-450c-bfcd-24ecf79079e6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:06.039915 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-99025014-13fe-450c-bfcd-24ecf79079e6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:06.048098 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-99025014-13fe-450c-bfcd-24ecf79079e6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:06.053268 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-99025014-13fe-450c-bfcd-24ecf79079e6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:06.054501 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-99025014-13fe-450c-bfcd-24ecf79079e6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:06.055317 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-99025014-13fe-450c-bfcd-24ecf79079e6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:06.085920 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bd2873f1-806e-4c08-8803-bb7ee9a57bba tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f2433a5f040>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:06.102471 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:29:06.181640 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bd2873f1-806e-4c08-8803-bb7ee9a57bba tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b" status: 200 len: 1424 microversion: 2.1 time: 0.100893 Jun 05 08:29:06.188194 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 863/1710] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:06 2022] GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b => generated 1424 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:29:06.345429 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-99025014-13fe-450c-bfcd-24ecf79079e6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:06.364955 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-99025014-13fe-450c-bfcd-24ecf79079e6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:06.367232 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-99025014-13fe-450c-bfcd-24ecf79079e6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:06.368559 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-99025014-13fe-450c-bfcd-24ecf79079e6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1796 microversion: 2.20 time: 0.333854 Jun 05 08:29:06.369286 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 848/1711] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:29:06 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1796 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:29:06.370473 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f1cb303f-6221-427b-be43-cffdd0672335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:06.371332 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f1cb303f-6221-427b-be43-cffdd0672335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:06.395534 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f1cb303f-6221-427b-be43-cffdd0672335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:06.396732 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f1cb303f-6221-427b-be43-cffdd0672335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:06.398734 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f1cb303f-6221-427b-be43-cffdd0672335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:06.400320 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f1cb303f-6221-427b-be43-cffdd0672335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:06.462282 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f1cb303f-6221-427b-be43-cffdd0672335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:06.463049 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f1cb303f-6221-427b-be43-cffdd0672335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:06.463797 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-f1cb303f-6221-427b-be43-cffdd0672335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:06.528702 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f1cb303f-6221-427b-be43-cffdd0672335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:06.544414 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f1cb303f-6221-427b-be43-cffdd0672335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.181062 Jun 05 08:29:06.546625 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 864/1712] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:06 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:29:06.803444 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a45375c4-01b8-4f32-a85a-6d4db703e028 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:06.804249 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a45375c4-01b8-4f32-a85a-6d4db703e028 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:06.820604 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a45375c4-01b8-4f32-a85a-6d4db703e028 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:06.831524 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a45375c4-01b8-4f32-a85a-6d4db703e028 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:06.832542 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a45375c4-01b8-4f32-a85a-6d4db703e028 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:06.836948 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a45375c4-01b8-4f32-a85a-6d4db703e028 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:06.884308 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-054963ac-b8f7-4fb3-a14a-380eff1e3bab tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:06.885459 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-054963ac-b8f7-4fb3-a14a-380eff1e3bab tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:06.913483 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-054963ac-b8f7-4fb3-a14a-380eff1e3bab tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:06.919204 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-054963ac-b8f7-4fb3-a14a-380eff1e3bab tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:06.921025 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-054963ac-b8f7-4fb3-a14a-380eff1e3bab tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:06.922309 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-054963ac-b8f7-4fb3-a14a-380eff1e3bab tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:06.976691 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-054963ac-b8f7-4fb3-a14a-380eff1e3bab tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.098412 Jun 05 08:29:06.978191 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 865/1713] 10.222.0.33 () {60 vars in 1342 bytes} [Sun Jun 5 08:29:06 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 05 08:29:06.985583 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d677a223-c82f-4117-ba48-33ee041d6767 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24453e38b0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:07.056992 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d677a223-c82f-4117-ba48-33ee041d6767 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201" status: 200 len: 1414 microversion: 2.1 time: 0.077499 Jun 05 08:29:07.057988 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 866/1714] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:06 2022] GET /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201 => generated 1414 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:07.177353 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a45375c4-01b8-4f32-a85a-6d4db703e028 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:07.188016 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a45375c4-01b8-4f32-a85a-6d4db703e028 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1198 microversion: 2.1 time: 0.389129 Jun 05 08:29:07.199154 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 849/1715] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:06 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1198 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:07.200920 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d0e93a3b-1984-4b4f-a5a3-3199bdf98024 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f24453e3ee0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:07.262973 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d0e93a3b-1984-4b4f-a5a3-3199bdf98024 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b" status: 200 len: 1424 microversion: 2.1 time: 0.066284 Jun 05 08:29:07.264125 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 867/1716] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:07 2022] GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b => generated 1424 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:07.562034 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9cff2dfb-e243-4519-900b-d3b4716a786f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:07.562806 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9cff2dfb-e243-4519-900b-d3b4716a786f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:07.576621 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9cff2dfb-e243-4519-900b-d3b4716a786f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:07.577171 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9cff2dfb-e243-4519-900b-d3b4716a786f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:07.578066 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9cff2dfb-e243-4519-900b-d3b4716a786f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:07.578547 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9cff2dfb-e243-4519-900b-d3b4716a786f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:07.652416 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9cff2dfb-e243-4519-900b-d3b4716a786f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:07.652416 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9cff2dfb-e243-4519-900b-d3b4716a786f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:07.652970 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-9cff2dfb-e243-4519-900b-d3b4716a786f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:07.731422 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-9cff2dfb-e243-4519-900b-d3b4716a786f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:07.743536 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9cff2dfb-e243-4519-900b-d3b4716a786f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.185239 Jun 05 08:29:07.744782 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 850/1717] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:07 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:07.996616 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f94e5265-969d-4411-93e9-a98aba12c8a5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:07.998718 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f94e5265-969d-4411-93e9-a98aba12c8a5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:08.022466 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f94e5265-969d-4411-93e9-a98aba12c8a5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:08.023015 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f94e5265-969d-4411-93e9-a98aba12c8a5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:08.023979 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f94e5265-969d-4411-93e9-a98aba12c8a5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:08.024727 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f94e5265-969d-4411-93e9-a98aba12c8a5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:08.073342 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-70dd86b9-f91a-452e-9957-530ff5c65f2d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24454b3ee0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:08.102542 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f94e5265-969d-4411-93e9-a98aba12c8a5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.114431 Jun 05 08:29:08.113870 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 868/1718] 10.222.0.33 () {60 vars in 1342 bytes} [Sun Jun 5 08:29:07 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:29:08.213204 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9c9ff4cb-9ade-46b6-aae0-8a781731e2ac tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:08.215119 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9c9ff4cb-9ade-46b6-aae0-8a781731e2ac tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:08.240558 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9c9ff4cb-9ade-46b6-aae0-8a781731e2ac tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:08.241703 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9c9ff4cb-9ade-46b6-aae0-8a781731e2ac tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:08.243557 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9c9ff4cb-9ade-46b6-aae0-8a781731e2ac tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:08.247762 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9c9ff4cb-9ade-46b6-aae0-8a781731e2ac tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:08.268571 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-70dd86b9-f91a-452e-9957-530ff5c65f2d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201" status: 200 len: 1414 microversion: 2.1 time: 0.200896 Jun 05 08:29:08.273058 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 851/1719] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:08 2022] GET /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201 => generated 1414 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:29:08.299017 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b9c2f130-3455-424e-805d-09fc3539c60f tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f2433ab2940>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:08.460290 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b9c2f130-3455-424e-805d-09fc3539c60f tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b" status: 200 len: 1424 microversion: 2.1 time: 0.169981 Jun 05 08:29:08.461343 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 852/1720] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:08 2022] GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b => generated 1424 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:08.550054 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9c9ff4cb-9ade-46b6-aae0-8a781731e2ac tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:08.561956 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9c9ff4cb-9ade-46b6-aae0-8a781731e2ac tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1198 microversion: 2.1 time: 0.355673 Jun 05 08:29:08.573192 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 869/1721] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:08 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1198 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:29:08.763825 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7e0b1720-3776-4cac-a620-ecbce31e6bbc tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:08.764849 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7e0b1720-3776-4cac-a620-ecbce31e6bbc tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:08.774798 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7e0b1720-3776-4cac-a620-ecbce31e6bbc tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:08.775623 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7e0b1720-3776-4cac-a620-ecbce31e6bbc tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:08.780134 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7e0b1720-3776-4cac-a620-ecbce31e6bbc tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:08.781038 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7e0b1720-3776-4cac-a620-ecbce31e6bbc tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:08.861773 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7e0b1720-3776-4cac-a620-ecbce31e6bbc tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:08.868250 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7e0b1720-3776-4cac-a620-ecbce31e6bbc tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:08.873149 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-7e0b1720-3776-4cac-a620-ecbce31e6bbc tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:08.952397 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7e0b1720-3776-4cac-a620-ecbce31e6bbc tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:08.962278 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7e0b1720-3776-4cac-a620-ecbce31e6bbc tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.200468 Jun 05 08:29:08.963392 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 853/1722] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:08 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:09.124486 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-51362d73-4cd8-4f0a-b543-631dbcd0b88b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:09.125564 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-51362d73-4cd8-4f0a-b543-631dbcd0b88b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:09.135240 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-51362d73-4cd8-4f0a-b543-631dbcd0b88b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:09.135693 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-51362d73-4cd8-4f0a-b543-631dbcd0b88b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:09.136503 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-51362d73-4cd8-4f0a-b543-631dbcd0b88b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:09.141205 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-51362d73-4cd8-4f0a-b543-631dbcd0b88b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:09.205121 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=100 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:29:09.251515 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-51362d73-4cd8-4f0a-b543-631dbcd0b88b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.132172 Jun 05 08:29:09.253214 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 870/1723] 10.222.0.33 () {60 vars in 1342 bytes} [Sun Jun 5 08:29:09 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:29:09.283105 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-86ad3b49-ad2b-4bfc-9c00-cd464b22b9a5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f2433861940>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:09.349117 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-86ad3b49-ad2b-4bfc-9c00-cd464b22b9a5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201" status: 200 len: 1414 microversion: 2.1 time: 0.070193 Jun 05 08:29:09.349877 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 854/1724] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:09 2022] GET /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201 => generated 1414 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:09.477189 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0fe6f1f9-90bd-49d1-a3aa-fd399e636ee9 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f2433d73670>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:09.551813 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0fe6f1f9-90bd-49d1-a3aa-fd399e636ee9 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b" status: 200 len: 1424 microversion: 2.1 time: 0.078944 Jun 05 08:29:09.559982 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 871/1725] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:09 2022] GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b => generated 1424 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:09.581354 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3d41dba2-f1a9-444b-99d5-0d83062d75ce tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:09.583020 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3d41dba2-f1a9-444b-99d5-0d83062d75ce tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:09.593196 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3d41dba2-f1a9-444b-99d5-0d83062d75ce tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:09.594138 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3d41dba2-f1a9-444b-99d5-0d83062d75ce tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:09.595147 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3d41dba2-f1a9-444b-99d5-0d83062d75ce tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:09.595899 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3d41dba2-f1a9-444b-99d5-0d83062d75ce tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:09.807929 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3d41dba2-f1a9-444b-99d5-0d83062d75ce tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:09.817757 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3d41dba2-f1a9-444b-99d5-0d83062d75ce tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1198 microversion: 2.1 time: 0.241143 Jun 05 08:29:09.819592 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 855/1726] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:09 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1198 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:09.979463 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d5c8b3fa-fd06-4c93-beda-6c5d23ac0124 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:09.981398 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d5c8b3fa-fd06-4c93-beda-6c5d23ac0124 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:10.011012 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d5c8b3fa-fd06-4c93-beda-6c5d23ac0124 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:10.014074 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d5c8b3fa-fd06-4c93-beda-6c5d23ac0124 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:10.024242 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d5c8b3fa-fd06-4c93-beda-6c5d23ac0124 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:10.027020 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d5c8b3fa-fd06-4c93-beda-6c5d23ac0124 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:10.120457 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d5c8b3fa-fd06-4c93-beda-6c5d23ac0124 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:10.121297 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d5c8b3fa-fd06-4c93-beda-6c5d23ac0124 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:10.125720 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-d5c8b3fa-fd06-4c93-beda-6c5d23ac0124 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:10.205657 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d5c8b3fa-fd06-4c93-beda-6c5d23ac0124 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:10.216353 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d5c8b3fa-fd06-4c93-beda-6c5d23ac0124 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.241539 Jun 05 08:29:10.221019 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 872/1727] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:09 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:10.265549 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5afad191-119d-40ca-bb2e-318622b20261 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:10.266548 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5afad191-119d-40ca-bb2e-318622b20261 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:10.281551 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5afad191-119d-40ca-bb2e-318622b20261 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:10.282662 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5afad191-119d-40ca-bb2e-318622b20261 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:10.285825 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5afad191-119d-40ca-bb2e-318622b20261 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:10.286373 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5afad191-119d-40ca-bb2e-318622b20261 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:10.342836 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5afad191-119d-40ca-bb2e-318622b20261 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.082280 Jun 05 08:29:10.343894 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 856/1728] 10.222.0.33 () {60 vars in 1342 bytes} [Sun Jun 5 08:29:10 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:29:10.364564 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-94baa0f1-66b3-4969-a616-522b160c49a9 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f2433c94e50>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:10.535195 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-94baa0f1-66b3-4969-a616-522b160c49a9 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201" status: 200 len: 1414 microversion: 2.1 time: 0.172060 Jun 05 08:29:10.535828 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 873/1729] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:10 2022] GET /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201 => generated 1414 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:10.570796 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d28fe914-6c38-41d7-80d6-96186debb444 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f24454a7700>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:10.835568 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6278e6de-f09f-4b5c-9eb9-2ac7b713d6b2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:10.836270 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6278e6de-f09f-4b5c-9eb9-2ac7b713d6b2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:10.847098 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6278e6de-f09f-4b5c-9eb9-2ac7b713d6b2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:10.847530 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6278e6de-f09f-4b5c-9eb9-2ac7b713d6b2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:10.858885 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6278e6de-f09f-4b5c-9eb9-2ac7b713d6b2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:10.863420 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6278e6de-f09f-4b5c-9eb9-2ac7b713d6b2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:11.315055 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6278e6de-f09f-4b5c-9eb9-2ac7b713d6b2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:11.332163 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6278e6de-f09f-4b5c-9eb9-2ac7b713d6b2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1198 microversion: 2.1 time: 0.501020 Jun 05 08:29:11.335891 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 874/1730] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:10 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1198 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:11.350613 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-c4d83599-46ee-4733-9c24-c57765496450 req-ffa555e5-d665-489b-b5e0-de227079dbda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c464ac-f10b-4558-a1ef-24c9319d7364", "name": "network-vif-plugged", "status": "completed", "tag": "e48c18b0-4da6-4d66-afed-f0591fad5a60"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:29:11.375506 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-c4d83599-46ee-4733-9c24-c57765496450 req-ffa555e5-d665-489b-b5e0-de227079dbda service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:11.378470 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-c4d83599-46ee-4733-9c24-c57765496450 req-ffa555e5-d665-489b-b5e0-de227079dbda service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:11.414720 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-c4d83599-46ee-4733-9c24-c57765496450 req-ffa555e5-d665-489b-b5e0-de227079dbda service nova] Creating event network-vif-plugged:e48c18b0-4da6-4d66-afed-f0591fad5a60 for instance 54c464ac-f10b-4558-a1ef-24c9319d7364 on n-h2-844739-1 Jun 05 08:29:11.426707 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-c4d83599-46ee-4733-9c24-c57765496450 req-ffa555e5-d665-489b-b5e0-de227079dbda service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086641 Jun 05 08:29:11.430732 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 875/1731] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:29:11.442977 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-410513fb-08a0-4a64-a3f7-a010f319ef9a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:11.448630 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-410513fb-08a0-4a64-a3f7-a010f319ef9a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:11.462610 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-410513fb-08a0-4a64-a3f7-a010f319ef9a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:11.464725 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-410513fb-08a0-4a64-a3f7-a010f319ef9a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:11.472974 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-410513fb-08a0-4a64-a3f7-a010f319ef9a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:11.473835 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-410513fb-08a0-4a64-a3f7-a010f319ef9a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:11.606700 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-410513fb-08a0-4a64-a3f7-a010f319ef9a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:11.609044 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-410513fb-08a0-4a64-a3f7-a010f319ef9a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:11.611034 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-410513fb-08a0-4a64-a3f7-a010f319ef9a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:11.773294 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-410513fb-08a0-4a64-a3f7-a010f319ef9a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:11.790418 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-410513fb-08a0-4a64-a3f7-a010f319ef9a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.357978 Jun 05 08:29:11.796267 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 876/1732] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:11 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:11.815972 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0d8c3584-ee1f-4fed-89b3-ec0f88e4d7cc tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:11.826187 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0d8c3584-ee1f-4fed-89b3-ec0f88e4d7cc tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:11.833547 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0d8c3584-ee1f-4fed-89b3-ec0f88e4d7cc tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:11.834537 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0d8c3584-ee1f-4fed-89b3-ec0f88e4d7cc tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:11.835307 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0d8c3584-ee1f-4fed-89b3-ec0f88e4d7cc tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:11.839474 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0d8c3584-ee1f-4fed-89b3-ec0f88e4d7cc tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:11.923371 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0d8c3584-ee1f-4fed-89b3-ec0f88e4d7cc tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.125641 Jun 05 08:29:11.929931 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 877/1733] 10.222.0.33 () {60 vars in 1342 bytes} [Sun Jun 5 08:29:11 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:29:11.945469 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8e4c69dd-1a05-42a5-a63c-8e96cd394898 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f243382c940>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:16.879381 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d28fe914-6c38-41d7-80d6-96186debb444 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b" status: 200 len: 1433 microversion: 2.1 time: 6.315933 Jun 05 08:29:16.880386 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 857/1734] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:10 2022] GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b => generated 1433 bytes in 6318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:16.896663 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-19f0eff3-fc52-4271-8eed-2073f8b53805 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:16.901435 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-19f0eff3-fc52-4271-8eed-2073f8b53805 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:16.932800 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-19f0eff3-fc52-4271-8eed-2073f8b53805 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:16.933628 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-19f0eff3-fc52-4271-8eed-2073f8b53805 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:16.936792 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-19f0eff3-fc52-4271-8eed-2073f8b53805 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:16.937297 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-19f0eff3-fc52-4271-8eed-2073f8b53805 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:17.007708 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8e4c69dd-1a05-42a5-a63c-8e96cd394898 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201" status: 200 len: 1414 microversion: 2.1 time: 5.075399 Jun 05 08:29:17.016792 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 878/1735] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:11 2022] GET /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201 => generated 1414 bytes in 5085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:17.030123 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3388a223-ce77-4934-9f33-a17c37886a21 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:17.030752 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3388a223-ce77-4934-9f33-a17c37886a21 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:17.046461 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3388a223-ce77-4934-9f33-a17c37886a21 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:17.047152 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3388a223-ce77-4934-9f33-a17c37886a21 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:17.048129 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3388a223-ce77-4934-9f33-a17c37886a21 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:17.049004 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3388a223-ce77-4934-9f33-a17c37886a21 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:17.121032 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3388a223-ce77-4934-9f33-a17c37886a21 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:17.121494 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3388a223-ce77-4934-9f33-a17c37886a21 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:17.121964 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-3388a223-ce77-4934-9f33-a17c37886a21 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:17.151339 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-19f0eff3-fc52-4271-8eed-2073f8b53805 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:17.163917 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-19f0eff3-fc52-4271-8eed-2073f8b53805 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1198 microversion: 2.1 time: 0.281715 Jun 05 08:29:17.171371 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 858/1736] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:16 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1198 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:17.183206 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7a3c3c07-0590-4395-909b-0612c1b07134 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:17.186551 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7a3c3c07-0590-4395-909b-0612c1b07134 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:17.203974 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7a3c3c07-0590-4395-909b-0612c1b07134 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:17.204900 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7a3c3c07-0590-4395-909b-0612c1b07134 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:17.206033 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7a3c3c07-0590-4395-909b-0612c1b07134 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:17.206630 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7a3c3c07-0590-4395-909b-0612c1b07134 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:17.231217 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3388a223-ce77-4934-9f33-a17c37886a21 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:17.239057 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3388a223-ce77-4934-9f33-a17c37886a21 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.221152 Jun 05 08:29:17.239645 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 879/1737] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:17 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:17.256512 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-fa4b8856-28fa-45d0-a478-1d8c2b0d2952 req-7344be8d-9f8c-4806-959c-a8ba58711823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b732c5a-d12e-4ca7-aa45-dbe571de1c37", "name": "network-vif-plugged", "status": "completed", "tag": "cec071fd-e740-4058-b029-ed9348ba5833"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:29:17.295680 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-fa4b8856-28fa-45d0-a478-1d8c2b0d2952 req-7344be8d-9f8c-4806-959c-a8ba58711823 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:17.296596 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-fa4b8856-28fa-45d0-a478-1d8c2b0d2952 req-7344be8d-9f8c-4806-959c-a8ba58711823 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:17.297933 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7a3c3c07-0590-4395-909b-0612c1b07134 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.121890 Jun 05 08:29:17.300331 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 859/1738] 10.222.0.33 () {60 vars in 1342 bytes} [Sun Jun 5 08:29:17 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:29:17.307779 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-677b73b1-8613-433a-ae31-80e52289bd67 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f2433c4b1f0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:17.356113 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-fa4b8856-28fa-45d0-a478-1d8c2b0d2952 req-7344be8d-9f8c-4806-959c-a8ba58711823 service nova] Creating event network-vif-plugged:cec071fd-e740-4058-b029-ed9348ba5833 for instance 0b732c5a-d12e-4ca7-aa45-dbe571de1c37 on n-h1-844739-1 Jun 05 08:29:17.371165 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-fa4b8856-28fa-45d0-a478-1d8c2b0d2952 req-7344be8d-9f8c-4806-959c-a8ba58711823 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130248 Jun 05 08:29:17.371963 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 880/1739] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:29:17.423279 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-677b73b1-8613-433a-ae31-80e52289bd67 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b" status: 200 len: 1433 microversion: 2.1 time: 0.102894 Jun 05 08:29:17.424750 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 860/1740] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:17 2022] GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b => generated 1433 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:17.438989 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b5170efb-7b29-4933-8ff1-a8a3342ea043 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:17.440293 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b5170efb-7b29-4933-8ff1-a8a3342ea043 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] [instance: d14db277-eb47-4014-b054-beb64ba573ed] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:17.460936 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b5170efb-7b29-4933-8ff1-a8a3342ea043 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:17.465163 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b5170efb-7b29-4933-8ff1-a8a3342ea043 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:17.469764 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b5170efb-7b29-4933-8ff1-a8a3342ea043 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:17.470542 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b5170efb-7b29-4933-8ff1-a8a3342ea043 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:17.770825 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b5170efb-7b29-4933-8ff1-a8a3342ea043 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd54c03d9a244d21b13f7ba4d914d2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc14eff36af743bc94180fe1e24da809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:17.786630 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b5170efb-7b29-4933-8ff1-a8a3342ea043 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed" status: 200 len: 1467 microversion: 2.1 time: 0.352618 Jun 05 08:29:17.789095 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 881/1741] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:17 2022] GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed => generated 1467 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:17.805403 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-31d87d19-c32f-4fa3-a756-a58b10bae070 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f24454a8b80>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:17.902789 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-31d87d19-c32f-4fa3-a756-a58b10bae070 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/images/1241bde3-ef1f-41a5-b0fa-6f409216229a" status: 200 len: 784 microversion: 2.1 time: 0.102233 Jun 05 08:29:17.904204 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 861/1742] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:17 2022] GET /compute/v2.1/images/1241bde3-ef1f-41a5-b0fa-6f409216229a => generated 784 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:29:17.915051 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-55545e11-16ec-4658-9806-ddbb160d9f92 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:17.932009 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-55545e11-16ec-4658-9806-ddbb160d9f92 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020974 Jun 05 08:29:17.933320 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 882/1743] 10.222.0.33 () {58 vars in 1136 bytes} [Sun Jun 5 08:29:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:29:17.945565 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0a0d7b4c-6b83-40b4-abf7-32085c24e7b5 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f244549e0d0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:18.030132 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-278b554c-75ad-4587-a972-46b6ef8057f4 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f2433719940>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:19.463605 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0a0d7b4c-6b83-40b4-abf7-32085c24e7b5 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "DELETE /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b" status: 204 len: 0 microversion: 2.1 time: 1.522349 Jun 05 08:29:19.464985 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 862/1744] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:17 2022] DELETE /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b => generated 0 bytes in 1525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:29:19.470810 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ef5d446c-4a0d-48a2-a6f4-d38b7940add2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:19.471741 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ef5d446c-4a0d-48a2-a6f4-d38b7940add2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:19.497144 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ef5d446c-4a0d-48a2-a6f4-d38b7940add2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:19.498945 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ef5d446c-4a0d-48a2-a6f4-d38b7940add2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:19.499889 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ef5d446c-4a0d-48a2-a6f4-d38b7940add2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:19.501628 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ef5d446c-4a0d-48a2-a6f4-d38b7940add2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:19.565052 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-278b554c-75ad-4587-a972-46b6ef8057f4 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201" status: 200 len: 1414 microversion: 2.1 time: 1.540013 Jun 05 08:29:19.566202 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 883/1745] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:18 2022] GET /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201 => generated 1414 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:19.581357 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-00a10d27-3a37-4567-a1fe-1e5e9789ecaa tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:19.582572 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-00a10d27-3a37-4567-a1fe-1e5e9789ecaa tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:19.601422 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-00a10d27-3a37-4567-a1fe-1e5e9789ecaa tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:19.604780 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-00a10d27-3a37-4567-a1fe-1e5e9789ecaa tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:19.606925 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-00a10d27-3a37-4567-a1fe-1e5e9789ecaa tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:19.607572 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-00a10d27-3a37-4567-a1fe-1e5e9789ecaa tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:19.725998 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-00a10d27-3a37-4567-a1fe-1e5e9789ecaa tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:19.726453 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-00a10d27-3a37-4567-a1fe-1e5e9789ecaa tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:19.741758 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-00a10d27-3a37-4567-a1fe-1e5e9789ecaa tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:19.817562 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-00a10d27-3a37-4567-a1fe-1e5e9789ecaa tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:19.829404 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ef5d446c-4a0d-48a2-a6f4-d38b7940add2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:19.831617 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-00a10d27-3a37-4567-a1fe-1e5e9789ecaa tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.259815 Jun 05 08:29:19.844100 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 884/1746] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:19 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:19.853290 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ef5d446c-4a0d-48a2-a6f4-d38b7940add2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1381 microversion: 2.1 time: 0.386862 Jun 05 08:29:19.854353 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 863/1747] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:19 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1381 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:19.855659 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-203f25a8-b069-4a68-8f81-1e1dcb7efe2c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:19.857097 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-203f25a8-b069-4a68-8f81-1e1dcb7efe2c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:19.868940 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-90ebb537-b68b-4dcc-84b5-08044487efa7 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f2433b95940>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:19.876157 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-203f25a8-b069-4a68-8f81-1e1dcb7efe2c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:19.877020 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-203f25a8-b069-4a68-8f81-1e1dcb7efe2c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:19.878072 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-203f25a8-b069-4a68-8f81-1e1dcb7efe2c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:19.880893 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-203f25a8-b069-4a68-8f81-1e1dcb7efe2c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:19.895260 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-90ebb537-b68b-4dcc-84b5-08044487efa7 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] HTTP exception thrown: Image not found. Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-90ebb537-b68b-4dcc-84b5-08044487efa7 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Request method failure captured: Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b HTTP/1.1 Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGko8VNge2Qc4iZkBkd_3fVhSB1PfMa2MikyVB5I8bFO21Vy7_uPN3jCxMb6k1rKgF4G73dVFq239O6JMUiCrQN0X8ZCyj0RRjJwzKyjIfYR52_kTBfdqiYQkROlAGWuiIW_3lVCZeHEVsDD_4L2Q7WFo3SEv0EhhviKzVniSeABwow Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: bc14eff36af743bc94180fe1e24da809 Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ImagesOneServerTestJSON-1049237888 Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bc14eff36af743bc94180fe1e24da809"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc14eff36af743bc94180fe1e24da809"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bc14eff36af743bc94180fe1e24da809", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc14eff36af743bc94180fe1e24da809"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ImagesOneServerTestJSON-1049237888 Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: bc14eff36af743bc94180fe1e24da809 Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1049237888 Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ImagesOneServerTestJSON-1049237888-project Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: bd54c03d9a244d21b13f7ba4d914d2a9 Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ImagesOneServerTestJSON-1049237888-project Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: exception: Image not found. Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'cdef69d2-d185-40b2-b977-e294efa0fb9b'} Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID cdef69d2-d185-40b2-b977-e294efa0fb9b Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 05 08:29:19.899195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cdef69d2-d185-40b2-b977-e294efa0fb9b could not be found. Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 05 08:29:19.910279 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:29:19.918694 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-90ebb537-b68b-4dcc-84b5-08044487efa7 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Returning 404 to user: Image not found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:29:19.918694 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-90ebb537-b68b-4dcc-84b5-08044487efa7 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b" status: 404 len: 62 microversion: 2.1 time: 0.060206 Jun 05 08:29:19.919670 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 864/1748] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:19 2022] GET /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:29:19.998572 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-203f25a8-b069-4a68-8f81-1e1dcb7efe2c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.150566 Jun 05 08:29:20.000108 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 885/1749] 10.222.0.33 () {60 vars in 1342 bytes} [Sun Jun 5 08:29:19 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:29:20.011320 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d4fe0d8e-cb57-43be-b59f-41faf89c22a8 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-666829591"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:29:20.013649 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d4fe0d8e-cb57-43be-b59f-41faf89c22a8 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] [instance: d14db277-eb47-4014-b054-beb64ba573ed] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:20.029975 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d4fe0d8e-cb57-43be-b59f-41faf89c22a8 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:20.031774 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d4fe0d8e-cb57-43be-b59f-41faf89c22a8 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:20.035070 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d4fe0d8e-cb57-43be-b59f-41faf89c22a8 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:20.035751 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d4fe0d8e-cb57-43be-b59f-41faf89c22a8 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:20.264197 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b187b9a9-50a9-41b3-a30c-da8fb12f0d9c tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:20.264824 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b187b9a9-50a9-41b3-a30c-da8fb12f0d9c tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:20.288242 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b187b9a9-50a9-41b3-a30c-da8fb12f0d9c tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:20.288824 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b187b9a9-50a9-41b3-a30c-da8fb12f0d9c tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:20.289666 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b187b9a9-50a9-41b3-a30c-da8fb12f0d9c tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:20.290121 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b187b9a9-50a9-41b3-a30c-da8fb12f0d9c tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:20.482631 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d4fe0d8e-cb57-43be-b59f-41faf89c22a8 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "POST /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed/action" status: 202 len: 0 microversion: 2.1 time: 0.481021 Jun 05 08:29:20.502017 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 886/1750] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Jun 5 08:29:20 2022] POST /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 05 08:29:20.524466 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ba55b452-557b-4c5d-bd70-a1ef1f4b5221 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f2433759670>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:20.550415 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b187b9a9-50a9-41b3-a30c-da8fb12f0d9c tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1532 microversion: 2.1 time: 0.629237 Jun 05 08:29:20.553577 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 865/1751] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:19 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1532 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:20.582564 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-10c4ee12-8565-4867-b762-16133af7507a tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:20.584775 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-10c4ee12-8565-4867-b762-16133af7507a tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:20.595189 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10c4ee12-8565-4867-b762-16133af7507a tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:20.596141 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10c4ee12-8565-4867-b762-16133af7507a tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:20.597829 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10c4ee12-8565-4867-b762-16133af7507a tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:20.598995 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10c4ee12-8565-4867-b762-16133af7507a tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:20.633471 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ba55b452-557b-4c5d-bd70-a1ef1f4b5221 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/images/3b6faed6-d552-4af9-9bfe-11706e2cf941" status: 200 len: 1428 microversion: 2.1 time: 0.124534 Jun 05 08:29:20.636244 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 887/1752] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:20 2022] GET /compute/v2.1/images/3b6faed6-d552-4af9-9bfe-11706e2cf941 => generated 1428 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:20.652481 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-60e6fcce-2e94-4bc9-a61a-99777bccc327 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f2433d738b0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:20.774257 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-60e6fcce-2e94-4bc9-a61a-99777bccc327 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201" status: 200 len: 1414 microversion: 2.1 time: 0.137766 Jun 05 08:29:20.783186 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 888/1753] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:20 2022] GET /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201 => generated 1414 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:20.862986 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7f2612a3-7a03-4642-8d2d-e7aec0aa782d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:20.863848 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7f2612a3-7a03-4642-8d2d-e7aec0aa782d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:20.893640 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7f2612a3-7a03-4642-8d2d-e7aec0aa782d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:20.895180 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7f2612a3-7a03-4642-8d2d-e7aec0aa782d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:20.898320 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7f2612a3-7a03-4642-8d2d-e7aec0aa782d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:20.898821 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7f2612a3-7a03-4642-8d2d-e7aec0aa782d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:20.986819 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7f2612a3-7a03-4642-8d2d-e7aec0aa782d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:20.988394 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7f2612a3-7a03-4642-8d2d-e7aec0aa782d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:20.988875 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-7f2612a3-7a03-4642-8d2d-e7aec0aa782d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:21.253307 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-10c4ee12-8565-4867-b762-16133af7507a tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1532 microversion: 2.1 time: 0.686746 Jun 05 08:29:21.257117 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 866/1754] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:20 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1532 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:21.274385 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0197b245-0a8b-491e-a162-1305f3368684 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:21.278182 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0197b245-0a8b-491e-a162-1305f3368684 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:21.296603 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7f2612a3-7a03-4642-8d2d-e7aec0aa782d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:21.310743 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0197b245-0a8b-491e-a162-1305f3368684 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:21.325736 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7f2612a3-7a03-4642-8d2d-e7aec0aa782d tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.464417 Jun 05 08:29:21.326820 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0197b245-0a8b-491e-a162-1305f3368684 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:21.328318 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 889/1755] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:20 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:21.341594 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0197b245-0a8b-491e-a162-1305f3368684 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:21.342204 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0197b245-0a8b-491e-a162-1305f3368684 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:21.352013 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-658a1b46-f8a2-4e5c-89aa-5507b71410a7 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:21.356895 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:29:21.356895 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:29:21.359004 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-658a1b46-f8a2-4e5c-89aa-5507b71410a7 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:21.362577 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-658a1b46-f8a2-4e5c-89aa-5507b71410a7 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:21.365481 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-658a1b46-f8a2-4e5c-89aa-5507b71410a7 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:21.366049 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-658a1b46-f8a2-4e5c-89aa-5507b71410a7 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:21.440032 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-658a1b46-f8a2-4e5c-89aa-5507b71410a7 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.098774 Jun 05 08:29:21.443696 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 890/1756] 10.222.0.33 () {58 vars in 1175 bytes} [Sun Jun 5 08:29:21 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:29:21.457841 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-4d5b1f5f-e02f-43d6-a58d-a3503e36e2db req-c7f3ef5e-ba33-4ad7-b899-05711e41c0b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d14db277-eb47-4014-b054-beb64ba573ed", "name": "network-vif-unplugged", "status": "completed", "tag": "04bb4de3-61a0-4a52-934f-f6f853fe61f9"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:29:21.475711 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0197b245-0a8b-491e-a162-1305f3368684 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.214702 Jun 05 08:29:21.483306 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 867/1757] 10.222.0.33 () {60 vars in 1342 bytes} [Sun Jun 5 08:29:21 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5/os-volume_attachments => generated 197 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:29:21.489289 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-4d5b1f5f-e02f-43d6-a58d-a3503e36e2db req-c7f3ef5e-ba33-4ad7-b899-05711e41c0b1 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:21.491762 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-4d5b1f5f-e02f-43d6-a58d-a3503e36e2db req-c7f3ef5e-ba33-4ad7-b899-05711e41c0b1 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:21.497451 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-429f7f18-f63e-49c1-8f32-2b9babf2a775 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-844739-1", "block_migration": false, "disk_over_commit": false}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:29:21.503837 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-429f7f18-f63e-49c1-8f32-2b9babf2a775 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:21.530854 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-429f7f18-f63e-49c1-8f32-2b9babf2a775 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:21.531878 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-429f7f18-f63e-49c1-8f32-2b9babf2a775 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:21.533173 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-4d5b1f5f-e02f-43d6-a58d-a3503e36e2db req-c7f3ef5e-ba33-4ad7-b899-05711e41c0b1 service nova] Creating event network-vif-unplugged:04bb4de3-61a0-4a52-934f-f6f853fe61f9 for instance d14db277-eb47-4014-b054-beb64ba573ed on n-h2-844739-1 Jun 05 08:29:21.536148 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-429f7f18-f63e-49c1-8f32-2b9babf2a775 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:21.537274 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-429f7f18-f63e-49c1-8f32-2b9babf2a775 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:21.557479 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-4d5b1f5f-e02f-43d6-a58d-a3503e36e2db req-c7f3ef5e-ba33-4ad7-b899-05711e41c0b1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106237 Jun 05 08:29:21.559333 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 891/1758] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:29:21.636609 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-429f7f18-f63e-49c1-8f32-2b9babf2a775 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lazy-loading 'flavor' on Instance uuid 0b732c5a-d12e-4ca7-aa45-dbe571de1c37 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:21.651252 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7a301b47-63ab-49d7-b12a-ca35cda8ac90 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f2433a5f040>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:21.655136 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-429f7f18-f63e-49c1-8f32-2b9babf2a775 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Going to try to live migrate instance to n-h2-844739-1 {{(pid=119050) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 05 08:29:21.783059 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7a301b47-63ab-49d7-b12a-ca35cda8ac90 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/images/3b6faed6-d552-4af9-9bfe-11706e2cf941" status: 200 len: 1428 microversion: 2.1 time: 0.139878 Jun 05 08:29:21.788953 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 892/1759] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:21 2022] GET /compute/v2.1/images/3b6faed6-d552-4af9-9bfe-11706e2cf941 => generated 1428 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:21.825618 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3d362993-1a08-47f7-a091-bfa2311dedc8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24453e71f0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:21.955300 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3d362993-1a08-47f7-a091-bfa2311dedc8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201" status: 200 len: 1414 microversion: 2.1 time: 0.156358 Jun 05 08:29:21.957158 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 893/1760] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:21 2022] GET /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201 => generated 1414 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:22.350900 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-17fa6c7d-5993-4f53-9bf8-4d84b1523a66 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:22.352383 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-17fa6c7d-5993-4f53-9bf8-4d84b1523a66 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:22.360496 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=100 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:29:22.375978 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-17fa6c7d-5993-4f53-9bf8-4d84b1523a66 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:22.383751 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-17fa6c7d-5993-4f53-9bf8-4d84b1523a66 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:22.384722 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-17fa6c7d-5993-4f53-9bf8-4d84b1523a66 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:22.385239 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-17fa6c7d-5993-4f53-9bf8-4d84b1523a66 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:22.484175 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-17fa6c7d-5993-4f53-9bf8-4d84b1523a66 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:22.484632 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-17fa6c7d-5993-4f53-9bf8-4d84b1523a66 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:22.485096 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-17fa6c7d-5993-4f53-9bf8-4d84b1523a66 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:22.582558 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-17fa6c7d-5993-4f53-9bf8-4d84b1523a66 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:22.591601 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-17fa6c7d-5993-4f53-9bf8-4d84b1523a66 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.249608 Jun 05 08:29:22.592580 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 894/1761] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:22 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:29:22.607440 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b80bddff-fec9-4f7e-b068-c897359aef3a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:22.608872 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b80bddff-fec9-4f7e-b068-c897359aef3a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:22.627235 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b80bddff-fec9-4f7e-b068-c897359aef3a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:22.628192 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b80bddff-fec9-4f7e-b068-c897359aef3a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:22.629387 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b80bddff-fec9-4f7e-b068-c897359aef3a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:22.630638 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b80bddff-fec9-4f7e-b068-c897359aef3a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:22.672491 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:29:22.716311 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b80bddff-fec9-4f7e-b068-c897359aef3a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.122319 Jun 05 08:29:22.717575 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 895/1762] 10.222.0.33 () {60 vars in 1342 bytes} [Sun Jun 5 08:29:22 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:29:22.806567 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-adc4c3c6-ca13-4d8c-86dc-ea66c5b34ba2 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f24453e7790>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:22.929430 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-adc4c3c6-ca13-4d8c-86dc-ea66c5b34ba2 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/images/3b6faed6-d552-4af9-9bfe-11706e2cf941" status: 200 len: 1428 microversion: 2.1 time: 0.130535 Jun 05 08:29:22.930033 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 896/1763] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:22 2022] GET /compute/v2.1/images/3b6faed6-d552-4af9-9bfe-11706e2cf941 => generated 1428 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:29:22.972763 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9109b64a-c06b-4a3a-a7f4-8d81807bfa17 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f2433a70670>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:23.059395 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9109b64a-c06b-4a3a-a7f4-8d81807bfa17 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201" status: 200 len: 1414 microversion: 2.1 time: 0.093137 Jun 05 08:29:23.059979 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 897/1764] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:22 2022] GET /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201 => generated 1414 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:23.610040 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a8b536d5-73a7-49c1-9a0f-273ccb528add tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:23.611257 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a8b536d5-73a7-49c1-9a0f-273ccb528add tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:23.626240 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a8b536d5-73a7-49c1-9a0f-273ccb528add tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:23.626701 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a8b536d5-73a7-49c1-9a0f-273ccb528add tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:23.627514 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a8b536d5-73a7-49c1-9a0f-273ccb528add tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:23.627964 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a8b536d5-73a7-49c1-9a0f-273ccb528add tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:23.747520 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a8b536d5-73a7-49c1-9a0f-273ccb528add tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:23.748309 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a8b536d5-73a7-49c1-9a0f-273ccb528add tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:23.748469 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-a8b536d5-73a7-49c1-9a0f-273ccb528add tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:23.864827 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a8b536d5-73a7-49c1-9a0f-273ccb528add tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:23.876768 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a8b536d5-73a7-49c1-9a0f-273ccb528add tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.272463 Jun 05 08:29:23.877937 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 898/1765] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:23 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:23.886936 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ab52c41a-a62a-4c3d-ac7b-ed959217fb51 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:23.890281 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ab52c41a-a62a-4c3d-ac7b-ed959217fb51 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:23.905455 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ab52c41a-a62a-4c3d-ac7b-ed959217fb51 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:23.906888 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ab52c41a-a62a-4c3d-ac7b-ed959217fb51 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:23.908396 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ab52c41a-a62a-4c3d-ac7b-ed959217fb51 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:23.910587 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ab52c41a-a62a-4c3d-ac7b-ed959217fb51 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:23.999651 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ab52c41a-a62a-4c3d-ac7b-ed959217fb51 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.120279 Jun 05 08:29:24.010003 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 899/1766] 10.222.0.33 () {60 vars in 1342 bytes} [Sun Jun 5 08:29:23 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:24.016638 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6949f057-81d7-4129-be10-d5531abc60f4 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f2440143ee0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:24.120644 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6949f057-81d7-4129-be10-d5531abc60f4 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/images/3b6faed6-d552-4af9-9bfe-11706e2cf941" status: 200 len: 1428 microversion: 2.1 time: 0.109183 Jun 05 08:29:24.124990 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 900/1767] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:24 2022] GET /compute/v2.1/images/3b6faed6-d552-4af9-9bfe-11706e2cf941 => generated 1428 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:24.135875 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-20947ef9-12ba-4f37-bb8c-26e86bcd3e2f tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24453e3a60>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:24.306135 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-20947ef9-12ba-4f37-bb8c-26e86bcd3e2f tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201" status: 200 len: 1414 microversion: 2.1 time: 0.179693 Jun 05 08:29:24.306895 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 901/1768] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:24 2022] GET /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201 => generated 1414 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:24.904582 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-58945598-173c-409c-9604-15b65978f3f6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:24.905901 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-58945598-173c-409c-9604-15b65978f3f6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:24.930339 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-58945598-173c-409c-9604-15b65978f3f6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:24.933376 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-58945598-173c-409c-9604-15b65978f3f6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:24.939796 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-58945598-173c-409c-9604-15b65978f3f6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:24.942080 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-58945598-173c-409c-9604-15b65978f3f6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:25.098328 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-58945598-173c-409c-9604-15b65978f3f6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:25.098862 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-58945598-173c-409c-9604-15b65978f3f6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:25.104994 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-58945598-173c-409c-9604-15b65978f3f6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:25.248874 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-429f7f18-f63e-49c1-8f32-2b9babf2a775 tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37/action" status: 202 len: 0 microversion: 2.1 time: 3.762284 Jun 05 08:29:25.249741 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 868/1769] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Jun 5 08:29:21 2022] POST /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37/action => generated 0 bytes in 3766 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:29:25.261272 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-615f5ff9-67f6-47bc-a7ef-f3d0cd7144cb tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f2433c345e0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:25.419998 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-58945598-173c-409c-9604-15b65978f3f6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:25.431391 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-58945598-173c-409c-9604-15b65978f3f6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.540349 Jun 05 08:29:25.452511 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 902/1770] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:24 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:25.482085 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bc725d6d-215f-4076-a231-20de056a9caf tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:25.487140 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-bc725d6d-215f-4076-a231-20de056a9caf tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:25.513879 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bc725d6d-215f-4076-a231-20de056a9caf tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:25.519290 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bc725d6d-215f-4076-a231-20de056a9caf tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:25.526201 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bc725d6d-215f-4076-a231-20de056a9caf tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:25.526860 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bc725d6d-215f-4076-a231-20de056a9caf tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:25.560560 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-615f5ff9-67f6-47bc-a7ef-f3d0cd7144cb tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/images/3b6faed6-d552-4af9-9bfe-11706e2cf941" status: 200 len: 1428 microversion: 2.1 time: 0.309391 Jun 05 08:29:25.561152 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 869/1771] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:25 2022] GET /compute/v2.1/images/3b6faed6-d552-4af9-9bfe-11706e2cf941 => generated 1428 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:25.573558 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-43758fba-15ed-41d6-a018-02f4f7c8642f tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24454a7c10>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:27.407411 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-bc725d6d-215f-4076-a231-20de056a9caf tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:27.418655 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bc725d6d-215f-4076-a231-20de056a9caf tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1391 microversion: 2.1 time: 1.961260 Jun 05 08:29:27.429517 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 903/1772] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:25 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1391 bytes in 1976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:27.451790 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-cebb8dbf-011c-487f-864d-b179ebc45196 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:27.453130 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-cebb8dbf-011c-487f-864d-b179ebc45196 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:27.482728 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cebb8dbf-011c-487f-864d-b179ebc45196 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:27.483557 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cebb8dbf-011c-487f-864d-b179ebc45196 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:27.495122 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cebb8dbf-011c-487f-864d-b179ebc45196 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:27.496523 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cebb8dbf-011c-487f-864d-b179ebc45196 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:27.659613 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cebb8dbf-011c-487f-864d-b179ebc45196 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:27.662665 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cebb8dbf-011c-487f-864d-b179ebc45196 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:27.663402 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-cebb8dbf-011c-487f-864d-b179ebc45196 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:28.149930 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-cebb8dbf-011c-487f-864d-b179ebc45196 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:28.169902 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-cebb8dbf-011c-487f-864d-b179ebc45196 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.735503 Jun 05 08:29:28.171717 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 904/1773] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:27 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:28.184281 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fde82433-a356-4a4c-b0ea-146797e94220 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f2433a5fdc0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:31.387730 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:29:31.673076 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=57 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:29:31.765461 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:29:32.686877 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-43758fba-15ed-41d6-a018-02f4f7c8642f tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201" status: 200 len: 1423 microversion: 2.1 time: 7.124667 Jun 05 08:29:32.687641 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 870/1774] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:25 2022] GET /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201 => generated 1423 bytes in 7126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:32.693469 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-eeedb234-326b-4559-bec0-43164660c546 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:32.694091 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-eeedb234-326b-4559-bec0-43164660c546 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:32.717280 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-eeedb234-326b-4559-bec0-43164660c546 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:32.717746 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-eeedb234-326b-4559-bec0-43164660c546 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:32.718530 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-eeedb234-326b-4559-bec0-43164660c546 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:32.725038 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-eeedb234-326b-4559-bec0-43164660c546 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:32.732680 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fde82433-a356-4a4c-b0ea-146797e94220 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/images/3b6faed6-d552-4af9-9bfe-11706e2cf941" status: 200 len: 1428 microversion: 2.1 time: 4.558288 Jun 05 08:29:32.733831 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 905/1775] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:28 2022] GET /compute/v2.1/images/3b6faed6-d552-4af9-9bfe-11706e2cf941 => generated 1428 bytes in 4562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:32.755390 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-72eaf40d-9933-4dc1-b02d-6a3d1dcc868e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:32.757506 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-72eaf40d-9933-4dc1-b02d-6a3d1dcc868e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:32.780192 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-72eaf40d-9933-4dc1-b02d-6a3d1dcc868e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:32.781104 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-72eaf40d-9933-4dc1-b02d-6a3d1dcc868e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:32.782062 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-72eaf40d-9933-4dc1-b02d-6a3d1dcc868e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:32.782664 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-72eaf40d-9933-4dc1-b02d-6a3d1dcc868e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:32.827803 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-72eaf40d-9933-4dc1-b02d-6a3d1dcc868e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:32.828354 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-72eaf40d-9933-4dc1-b02d-6a3d1dcc868e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:32.829027 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-72eaf40d-9933-4dc1-b02d-6a3d1dcc868e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:33.048974 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-72eaf40d-9933-4dc1-b02d-6a3d1dcc868e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:33.063264 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-72eaf40d-9933-4dc1-b02d-6a3d1dcc868e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.319770 Jun 05 08:29:33.066789 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 906/1776] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:32 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:33.073571 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-cbee3d33-523b-474c-b98a-6476575d4929 req-ea488f2a-298b-46fb-947a-050c217a5ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d14db277-eb47-4014-b054-beb64ba573ed", "name": "network-vif-plugged", "status": "completed", "tag": "04bb4de3-61a0-4a52-934f-f6f853fe61f9"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:29:33.091219 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-cbee3d33-523b-474c-b98a-6476575d4929 req-ea488f2a-298b-46fb-947a-050c217a5ca7 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:33.092011 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-cbee3d33-523b-474c-b98a-6476575d4929 req-ea488f2a-298b-46fb-947a-050c217a5ca7 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:33.106076 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-cbee3d33-523b-474c-b98a-6476575d4929 req-ea488f2a-298b-46fb-947a-050c217a5ca7 service nova] Creating event network-vif-plugged:04bb4de3-61a0-4a52-934f-f6f853fe61f9 for instance d14db277-eb47-4014-b054-beb64ba573ed on n-h2-844739-1 Jun 05 08:29:33.113639 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-cbee3d33-523b-474c-b98a-6476575d4929 req-ea488f2a-298b-46fb-947a-050c217a5ca7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043968 Jun 05 08:29:33.115538 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 907/1777] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:29:33.124832 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4b739153-9772-4c25-9575-2d3909c47fbb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Action: 'create', calling method: .version_select at 0x7f243382c670>, body: {"keypair": {"name": "tempest-keypair-705772990", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7xunGVyRcrPJWzrmDnNm5hybra2+Ga3V5W0zIr1mPOaIq/10KDnlK8DBBkiqTXqnfBI8hfU525CCzU8ruZgXzgY2db3UbSsqKDFnV9VuduS1Ve0L6enMFVPbVXKAM2Iw=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:29:33.154541 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-4b739153-9772-4c25-9575-2d3909c47fbb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Getting quotas for project ddc6408756fb4f4f9f65f4c9d5c186dc. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:29:33.161188 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-4b739153-9772-4c25-9575-2d3909c47fbb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Getting quotas for user a7845e5ff0904a14b7f6c4960cc54ef6 and project ddc6408756fb4f4f9f65f4c9d5c186dc. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:29:33.196516 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4b739153-9772-4c25-9575-2d3909c47fbb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.078955 Jun 05 08:29:33.201302 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 908/1778] 10.222.0.33 () {62 vars in 1199 bytes} [Sun Jun 5 08:29:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 85 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 05 08:29:33.209000 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6fc38421-f9f3-4919-a5ff-27591da65dc5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24453f85e0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:33.285933 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-eeedb234-326b-4559-bec0-43164660c546 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:33.299895 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-eeedb234-326b-4559-bec0-43164660c546 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1391 microversion: 2.1 time: 0.607520 Jun 05 08:29:33.302619 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 871/1779] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:32 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1391 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:33.754152 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1774d6f3-6924-4553-8dd1-ddbbe038894c tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f24454b3040>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:42.717489 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:29:43.105682 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=49 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:29:43.171121 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=4 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:29:43.186077 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:29:43.290159 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=6 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:29:45.142886 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6fc38421-f9f3-4919-a5ff-27591da65dc5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201" status: 200 len: 1423 microversion: 2.1 time: 11.939919 Jun 05 08:29:45.144118 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 909/1780] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:33 2022] GET /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201 => generated 1423 bytes in 11942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:45.149877 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1376fee1-d5dc-45fe-bd23-9b4b7f361d29 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:45.150723 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1774d6f3-6924-4553-8dd1-ddbbe038894c tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/images/3b6faed6-d552-4af9-9bfe-11706e2cf941" status: 200 len: 1437 microversion: 2.1 time: 11.406951 Jun 05 08:29:45.151773 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 872/1781] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:33 2022] GET /compute/v2.1/images/3b6faed6-d552-4af9-9bfe-11706e2cf941 => generated 1437 bytes in 11409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:29:45.151974 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1376fee1-d5dc-45fe-bd23-9b4b7f361d29 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:45.157888 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6d7d1922-af42-45d9-b635-779511b44010 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:45.158518 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6d7d1922-af42-45d9-b635-779511b44010 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:45.166099 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6d7d1922-af42-45d9-b635-779511b44010 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:45.166761 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6d7d1922-af42-45d9-b635-779511b44010 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:45.171128 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6d7d1922-af42-45d9-b635-779511b44010 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:45.171670 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6d7d1922-af42-45d9-b635-779511b44010 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:45.173917 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1376fee1-d5dc-45fe-bd23-9b4b7f361d29 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:45.174736 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1376fee1-d5dc-45fe-bd23-9b4b7f361d29 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:45.176665 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1376fee1-d5dc-45fe-bd23-9b4b7f361d29 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:45.177702 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1376fee1-d5dc-45fe-bd23-9b4b7f361d29 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:45.234044 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1376fee1-d5dc-45fe-bd23-9b4b7f361d29 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:45.234795 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1376fee1-d5dc-45fe-bd23-9b4b7f361d29 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:45.235488 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-1376fee1-d5dc-45fe-bd23-9b4b7f361d29 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:45.323032 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-1376fee1-d5dc-45fe-bd23-9b4b7f361d29 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:45.345048 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1376fee1-d5dc-45fe-bd23-9b4b7f361d29 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.198972 Jun 05 08:29:45.345686 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 910/1782] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:45 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:45.351716 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2758c230-9882-4cb7-bfe6-285fa83c29a1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1160706670", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "7b0419ea-7078-4694-9f8c-6d89629c2a2c"}, {"port": "07c8ff98-a22e-410d-9341-f7e044856815", "tag": "port-1"}, {"port": "cb457b77-bef8-4764-bb0e-ace5a2c35d93", "tag": "port-2"}, {"uuid": "24293f9d-8ade-4fa6-b093-dc8503b8e597", "tag": "net-1"}, {"uuid": "24293f9d-8ade-4fa6-b093-dc8503b8e597"}, {"uuid": "7862a1eb-0da5-4c30-b6a8-899891c380ea", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "7862a1eb-0da5-4c30-b6a8-899891c380ea", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "69de3970-49e7-46bd-8071-ab5582e108d7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "f8b4f031-cf9b-4937-88ef-549b0a9a3433", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "f2912e4c-3d51-4a5b-b21e-ae5edda3c83b", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--38281472"}], "key_name": "tempest-keypair-705772990", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:29:45.379085 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6d7d1922-af42-45d9-b635-779511b44010 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:45.389366 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6d7d1922-af42-45d9-b635-779511b44010 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1391 microversion: 2.1 time: 0.236188 Jun 05 08:29:45.389942 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 873/1783] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:45 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1391 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:45.394907 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-1c476923-cebd-45e7-918b-8a372243e88e req-837bba0d-a7e4-4973-80db-068734707fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c464ac-f10b-4558-a1ef-24c9319d7364", "name": "network-vif-unplugged", "status": "completed", "tag": "e48c18b0-4da6-4d66-afed-f0591fad5a60"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:29:45.404844 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-1c476923-cebd-45e7-918b-8a372243e88e req-837bba0d-a7e4-4973-80db-068734707fce service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:45.405631 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-1c476923-cebd-45e7-918b-8a372243e88e req-837bba0d-a7e4-4973-80db-068734707fce service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:45.421473 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-1c476923-cebd-45e7-918b-8a372243e88e req-837bba0d-a7e4-4973-80db-068734707fce service nova] Creating event network-vif-unplugged:e48c18b0-4da6-4d66-afed-f0591fad5a60 for instance 54c464ac-f10b-4558-a1ef-24c9319d7364 on n-h2-844739-1 Jun 05 08:29:45.428716 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-1c476923-cebd-45e7-918b-8a372243e88e req-837bba0d-a7e4-4973-80db-068734707fce service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037254 Jun 05 08:29:45.429517 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 874/1784] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:29:45.436896 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-84d01173-528a-4dc8-9517-7580838d7a1e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24454a8700>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:45.568067 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-2758c230-9882-4cb7-bfe6-285fa83c29a1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] validate_networks() for [('7b0419ea-7078-4694-9f8c-6d89629c2a2c', None, None, None, None, None), (None, None, '07c8ff98-a22e-410d-9341-f7e044856815', None, None, None), (None, None, 'cb457b77-bef8-4764-bb0e-ace5a2c35d93', None, None, None), ('24293f9d-8ade-4fa6-b093-dc8503b8e597', None, None, None, None, None), ('24293f9d-8ade-4fa6-b093-dc8503b8e597', None, None, None, None, None), ('7862a1eb-0da5-4c30-b6a8-899891c380ea', '10.2.2.100', None, None, None, None), ('7862a1eb-0da5-4c30-b6a8-899891c380ea', '10.2.2.200', None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:29:46.216725 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-84d01173-528a-4dc8-9517-7580838d7a1e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "DELETE /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201" status: 204 len: 0 microversion: 2.1 time: 0.785823 Jun 05 08:29:46.217862 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 875/1785] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:45 2022] DELETE /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201 => generated 0 bytes in 787 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:29:46.225933 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-af188292-bac2-45fc-860d-cb7c4c69a86c tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f2433c34f70>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:46.337140 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-af188292-bac2-45fc-860d-cb7c4c69a86c tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/images/3b6faed6-d552-4af9-9bfe-11706e2cf941" status: 200 len: 1437 microversion: 2.1 time: 0.118006 Jun 05 08:29:46.339056 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 876/1786] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:29:46 2022] GET /compute/v2.1/images/3b6faed6-d552-4af9-9bfe-11706e2cf941 => generated 1437 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:46.346041 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-93eb68c8-535d-4e8f-81c2-84ffc85a4cb8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:46.347328 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-93eb68c8-535d-4e8f-81c2-84ffc85a4cb8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 54c464ac-f10b-4558-a1ef-24c9319d7364] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:46.359029 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-93eb68c8-535d-4e8f-81c2-84ffc85a4cb8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:46.359825 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-93eb68c8-535d-4e8f-81c2-84ffc85a4cb8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:46.361050 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-93eb68c8-535d-4e8f-81c2-84ffc85a4cb8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:46.361759 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-93eb68c8-535d-4e8f-81c2-84ffc85a4cb8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:46.396273 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-93eb68c8-535d-4e8f-81c2-84ffc85a4cb8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 54c464ac-f10b-4558-a1ef-24c9319d7364] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:29:46.497637 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-93eb68c8-535d-4e8f-81c2-84ffc85a4cb8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "DELETE /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364" status: 204 len: 0 microversion: 2.1 time: 0.156872 Jun 05 08:29:46.498486 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 877/1787] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:29:46 2022] DELETE /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:29:46.506434 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a106a68d-58e8-488b-b12f-d56392147ab2 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:46.507431 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a106a68d-58e8-488b-b12f-d56392147ab2 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] [instance: d14db277-eb47-4014-b054-beb64ba573ed] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:46.517638 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a106a68d-58e8-488b-b12f-d56392147ab2 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:46.518218 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a106a68d-58e8-488b-b12f-d56392147ab2 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:46.519082 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a106a68d-58e8-488b-b12f-d56392147ab2 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:46.520805 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a106a68d-58e8-488b-b12f-d56392147ab2 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:46.819190 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a106a68d-58e8-488b-b12f-d56392147ab2 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd54c03d9a244d21b13f7ba4d914d2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc14eff36af743bc94180fe1e24da809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:46.828776 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a106a68d-58e8-488b-b12f-d56392147ab2 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed" status: 200 len: 1467 microversion: 2.1 time: 0.328408 Jun 05 08:29:46.842046 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 878/1788] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:46 2022] GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed => generated 1467 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:46.850283 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f824373a-0351-4ceb-83c7-b517693919ef tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:46.851161 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f824373a-0351-4ceb-83c7-b517693919ef tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:46.880226 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f824373a-0351-4ceb-83c7-b517693919ef tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:46.884211 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f824373a-0351-4ceb-83c7-b517693919ef tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:46.885461 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f824373a-0351-4ceb-83c7-b517693919ef tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:46.886383 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f824373a-0351-4ceb-83c7-b517693919ef tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:46.960935 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f824373a-0351-4ceb-83c7-b517693919ef tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:46.961422 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f824373a-0351-4ceb-83c7-b517693919ef tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:46.961904 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-f824373a-0351-4ceb-83c7-b517693919ef tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:47.041954 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f824373a-0351-4ceb-83c7-b517693919ef tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:47.054200 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f824373a-0351-4ceb-83c7-b517693919ef tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.210372 Jun 05 08:29:47.060148 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 879/1789] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:46 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:47.087172 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d8d18295-ff24-420b-ba5c-e6d4bf77b842 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:47.088406 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d8d18295-ff24-420b-ba5c-e6d4bf77b842 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:47.096179 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d8d18295-ff24-420b-ba5c-e6d4bf77b842 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:47.096831 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d8d18295-ff24-420b-ba5c-e6d4bf77b842 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:47.098883 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d8d18295-ff24-420b-ba5c-e6d4bf77b842 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:47.099587 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d8d18295-ff24-420b-ba5c-e6d4bf77b842 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:47.355362 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d8d18295-ff24-420b-ba5c-e6d4bf77b842 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:47.368820 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d8d18295-ff24-420b-ba5c-e6d4bf77b842 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1391 microversion: 2.1 time: 0.296409 Jun 05 08:29:47.369681 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 880/1790] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:47 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1391 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:47.380576 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5fc3d5cd-8b15-490c-b216-92df6a4a01aa tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-171861527", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "78ad483b-a47a-44a2-8bc0-8789288467d5"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:29:47.455318 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-5fc3d5cd-8b15-490c-b216-92df6a4a01aa tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] validate_networks() for [('78ad483b-a47a-44a2-8bc0-8789288467d5', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:29:48.461078 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-5fc3d5cd-8b15-490c-b216-92df6a4a01aa tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:29:48.461687 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-5fc3d5cd-8b15-490c-b216-92df6a4a01aa tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:29:48.461983 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-5fc3d5cd-8b15-490c-b216-92df6a4a01aa tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:29:48.462398 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-5fc3d5cd-8b15-490c-b216-92df6a4a01aa tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:29:48.462811 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-5fc3d5cd-8b15-490c-b216-92df6a4a01aa tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:29:48.474405 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5fc3d5cd-8b15-490c-b216-92df6a4a01aa tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:48.475518 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5fc3d5cd-8b15-490c-b216-92df6a4a01aa tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:48.477088 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5fc3d5cd-8b15-490c-b216-92df6a4a01aa tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:48.477691 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5fc3d5cd-8b15-490c-b216-92df6a4a01aa tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:48.509527 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-5fc3d5cd-8b15-490c-b216-92df6a4a01aa tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Getting quotas for project d7e0706485194d6ab0cf41ea0f651074. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:29:48.516230 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-5fc3d5cd-8b15-490c-b216-92df6a4a01aa tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Getting quotas for user 41b99bee0b35400281da332533850481 and project d7e0706485194d6ab0cf41ea0f651074. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:29:48.547227 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5fc3d5cd-8b15-490c-b216-92df6a4a01aa tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:29:48.550869 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5fc3d5cd-8b15-490c-b216-92df6a4a01aa tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:29:48.610110 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5fc3d5cd-8b15-490c-b216-92df6a4a01aa tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.234145 Jun 05 08:29:48.610766 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 881/1791] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:29:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:29:48.617622 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8a87d3b5-7379-4d2c-a456-1146e2de47b9 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f24454ac4c0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:49.724006 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-2758c230-9882-4cb7-bfe6-285fa83c29a1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:29:49.724648 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-2758c230-9882-4cb7-bfe6-285fa83c29a1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:29:49.725439 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-2758c230-9882-4cb7-bfe6-285fa83c29a1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:29:49.726170 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-2758c230-9882-4cb7-bfe6-285fa83c29a1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:29:49.726670 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-2758c230-9882-4cb7-bfe6-285fa83c29a1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:29:49.747271 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2758c230-9882-4cb7-bfe6-285fa83c29a1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:49.747391 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8a87d3b5-7379-4d2c-a456-1146e2de47b9 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "DELETE /compute/v2.1/images/3b6faed6-d552-4af9-9bfe-11706e2cf941" status: 204 len: 0 microversion: 2.1 time: 1.135109 Jun 05 08:29:49.747803 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2758c230-9882-4cb7-bfe6-285fa83c29a1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:49.748148 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 882/1792] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:48 2022] DELETE /compute/v2.1/images/3b6faed6-d552-4af9-9bfe-11706e2cf941 => generated 0 bytes in 1137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:29:49.748349 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2758c230-9882-4cb7-bfe6-285fa83c29a1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:49.748869 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2758c230-9882-4cb7-bfe6-285fa83c29a1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:49.755408 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7ae7e009-e3eb-479e-9181-46748ff75c2b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:49.756757 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7ae7e009-e3eb-479e-9181-46748ff75c2b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:49.767058 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7ae7e009-e3eb-479e-9181-46748ff75c2b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:49.767856 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7ae7e009-e3eb-479e-9181-46748ff75c2b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:49.769131 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7ae7e009-e3eb-479e-9181-46748ff75c2b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:49.772854 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7ae7e009-e3eb-479e-9181-46748ff75c2b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:49.783043 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-2758c230-9882-4cb7-bfe6-285fa83c29a1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Getting quotas for project ddc6408756fb4f4f9f65f4c9d5c186dc. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:29:49.800756 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-2758c230-9882-4cb7-bfe6-285fa83c29a1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Getting quotas for user a7845e5ff0904a14b7f6c4960cc54ef6 and project ddc6408756fb4f4f9f65f4c9d5c186dc. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:29:49.832061 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7ae7e009-e3eb-479e-9181-46748ff75c2b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments/3a0352fb-91e0-46a6-8586-9d9e3a766056" status: 200 len: 194 microversion: 2.20 time: 0.082696 Jun 05 08:29:49.833943 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 883/1793] 10.222.0.33 () {60 vars in 1453 bytes} [Sun Jun 5 08:29:49 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments/3a0352fb-91e0-46a6-8586-9d9e3a766056 => generated 194 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:29:49.860467 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e3a9f5ff-f563-491e-9269-d005c2619552 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:49.861608 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e3a9f5ff-f563-491e-9269-d005c2619552 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:49.896490 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e3a9f5ff-f563-491e-9269-d005c2619552 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:49.897654 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e3a9f5ff-f563-491e-9269-d005c2619552 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:49.899519 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e3a9f5ff-f563-491e-9269-d005c2619552 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:49.901534 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e3a9f5ff-f563-491e-9269-d005c2619552 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:49.978102 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e3a9f5ff-f563-491e-9269-d005c2619552 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:49.979545 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e3a9f5ff-f563-491e-9269-d005c2619552 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:49.980328 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-e3a9f5ff-f563-491e-9269-d005c2619552 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:50.046981 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e3a9f5ff-f563-491e-9269-d005c2619552 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:50.057916 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e3a9f5ff-f563-491e-9269-d005c2619552 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.222686 Jun 05 08:29:50.058499 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 884/1794] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:49 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:50.066393 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e530076e-9467-4106-9a97-643b195d6bcc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:50.067582 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e530076e-9467-4106-9a97-643b195d6bcc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:50.076475 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e530076e-9467-4106-9a97-643b195d6bcc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:50.076930 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e530076e-9467-4106-9a97-643b195d6bcc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:50.077721 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e530076e-9467-4106-9a97-643b195d6bcc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:50.078221 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e530076e-9467-4106-9a97-643b195d6bcc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:50.088184 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2758c230-9882-4cb7-bfe6-285fa83c29a1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:29:50.091501 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2758c230-9882-4cb7-bfe6-285fa83c29a1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='69de3970-49e7-46bd-8071-ab5582e108d7',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='f8b4f031-cf9b-4937-88ef-549b0a9a3433',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f2912e4c-3d51-4a5b-b21e-ae5edda3c83b',volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:29:50.406677 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e530076e-9467-4106-9a97-643b195d6bcc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:50.427995 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e530076e-9467-4106-9a97-643b195d6bcc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1391 microversion: 2.1 time: 0.366694 Jun 05 08:29:50.431287 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 885/1795] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:50 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1391 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:50.447367 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0b88f3f7-9584-4be5-a604-b6674a1206ee tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:50.454483 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0b88f3f7-9584-4be5-a604-b6674a1206ee tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:50.467097 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0b88f3f7-9584-4be5-a604-b6674a1206ee tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:50.467804 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0b88f3f7-9584-4be5-a604-b6674a1206ee tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:50.468827 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0b88f3f7-9584-4be5-a604-b6674a1206ee tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:50.469652 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0b88f3f7-9584-4be5-a604-b6674a1206ee tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:50.564361 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0b88f3f7-9584-4be5-a604-b6674a1206ee tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:50.574719 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0b88f3f7-9584-4be5-a604-b6674a1206ee tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 200 len: 1277 microversion: 2.1 time: 0.141818 Jun 05 08:29:50.575948 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 886/1796] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:50 2022] GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 1277 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:50.585018 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-4d2a4dea-e211-4658-a84c-5814e36cc5bb req-bc6fa3d7-3728-4f59-ad5b-348ab8a0085c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d14db277-eb47-4014-b054-beb64ba573ed", "name": "network-vif-unplugged", "status": "completed", "tag": "04bb4de3-61a0-4a52-934f-f6f853fe61f9"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:29:50.588324 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2758c230-9882-4cb7-bfe6-285fa83c29a1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 5.241235 Jun 05 08:29:50.589173 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 911/1797] 10.222.0.33 () {62 vars in 1188 bytes} [Sun Jun 5 08:29:45 2022] POST /compute/v2.1/servers => generated 404 bytes in 5243 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 05 08:29:50.596827 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-4d2a4dea-e211-4658-a84c-5814e36cc5bb req-bc6fa3d7-3728-4f59-ad5b-348ab8a0085c service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:50.597401 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-4d2a4dea-e211-4658-a84c-5814e36cc5bb req-bc6fa3d7-3728-4f59-ad5b-348ab8a0085c service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:50.601298 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3d9a6b96-5978-449c-9e3c-173cf0f57564 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '.version_select at 0x7f2433cd3dc0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:50.612599 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-4d2a4dea-e211-4658-a84c-5814e36cc5bb req-bc6fa3d7-3728-4f59-ad5b-348ab8a0085c service nova] Creating event network-vif-unplugged:04bb4de3-61a0-4a52-934f-f6f853fe61f9 for instance d14db277-eb47-4014-b054-beb64ba573ed on n-h2-844739-1 Jun 05 08:29:50.618620 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-4d2a4dea-e211-4658-a84c-5814e36cc5bb req-bc6fa3d7-3728-4f59-ad5b-348ab8a0085c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041138 Jun 05 08:29:50.619342 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 887/1798] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:29:50.624869 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-664eb217-2bdf-4442-970a-221858e8e8b7 req-c730b83b-d07b-45cb-861c-eee93d83d8ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c464ac-f10b-4558-a1ef-24c9319d7364", "name": "network-vif-deleted", "tag": "e48c18b0-4da6-4d66-afed-f0591fad5a60"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:29:50.630623 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-3d9a6b96-5978-449c-9e3c-173cf0f57564 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] HTTP exception thrown: Image not found. Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3d9a6b96-5978-449c-9e3c-173cf0f57564 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Request method failure captured: Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: request: DELETE /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b HTTP/1.1 Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGko8VNge2Qc4iZkBkd_3fVhSB1PfMa2MikyVB5I8bFO21Vy7_uPN3jCxMb6k1rKgF4G73dVFq239O6JMUiCrQN0X8ZCyj0RRjJwzKyjIfYR52_kTBfdqiYQkROlAGWuiIW_3lVCZeHEVsDD_4L2Q7WFo3SEv0EhhviKzVniSeABwow Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: bc14eff36af743bc94180fe1e24da809 Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ImagesOneServerTestJSON-1049237888 Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bc14eff36af743bc94180fe1e24da809"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc14eff36af743bc94180fe1e24da809"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bc14eff36af743bc94180fe1e24da809", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc14eff36af743bc94180fe1e24da809"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ImagesOneServerTestJSON-1049237888 Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: bc14eff36af743bc94180fe1e24da809 Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1049237888 Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ImagesOneServerTestJSON-1049237888-project Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: bd54c03d9a244d21b13f7ba4d914d2a9 Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ImagesOneServerTestJSON-1049237888-project Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: exception: Image not found. Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'cdef69d2-d185-40b2-b977-e294efa0fb9b'} Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cdef69d2-d185-40b2-b977-e294efa0fb9b to delete Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cdef69d2-d185-40b2-b977-e294efa0fb9b could not be found. Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:29:50.632760 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:29:50.639013 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:29:50.639013 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:29:50.639013 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:29:50.639013 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:29:50.639013 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:29:50.639013 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:29:50.639013 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:29:50.639013 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:29:50.639013 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 05 08:29:50.639013 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 05 08:29:50.639013 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 05 08:29:50.639013 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:29:50.639013 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:29:50.639013 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:29:50.639013 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:29:50.639013 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:29:50.639013 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:29:50.639013 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:29:50.639013 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:29:50.639013 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 05 08:29:50.639013 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:29:50.641424 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-664eb217-2bdf-4442-970a-221858e8e8b7 req-c730b83b-d07b-45cb-861c-eee93d83d8ce service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:50.641424 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-664eb217-2bdf-4442-970a-221858e8e8b7 req-c730b83b-d07b-45cb-861c-eee93d83d8ce service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:50.644295 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3d9a6b96-5978-449c-9e3c-173cf0f57564 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Returning 404 to user: Image not found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:29:50.645512 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3d9a6b96-5978-449c-9e3c-173cf0f57564 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "DELETE /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b" status: 404 len: 62 microversion: 2.1 time: 0.053850 Jun 05 08:29:50.646599 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 912/1799] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:50 2022] DELETE /compute/v2.1/images/cdef69d2-d185-40b2-b977-e294efa0fb9b => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:29:50.651852 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-664eb217-2bdf-4442-970a-221858e8e8b7 req-c730b83b-d07b-45cb-861c-eee93d83d8ce service nova] Creating event network-vif-deleted:e48c18b0-4da6-4d66-afed-f0591fad5a60 for instance 54c464ac-f10b-4558-a1ef-24c9319d7364 on n-h2-844739-1 Jun 05 08:29:50.654998 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c698b3aa-781b-4210-aa80-83879db671ec tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:50.655802 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c698b3aa-781b-4210-aa80-83879db671ec tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:50.657965 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-664eb217-2bdf-4442-970a-221858e8e8b7 req-c730b83b-d07b-45cb-861c-eee93d83d8ce service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036828 Jun 05 08:29:50.658580 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 888/1800] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:29:50.665208 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c698b3aa-781b-4210-aa80-83879db671ec tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:50.665985 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8b31c462-2f12-4d07-8532-5b5ae9699c0a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:50.666313 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8b31c462-2f12-4d07-8532-5b5ae9699c0a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:50.667241 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c698b3aa-781b-4210-aa80-83879db671ec tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:50.668263 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c698b3aa-781b-4210-aa80-83879db671ec tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:50.668914 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c698b3aa-781b-4210-aa80-83879db671ec tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:50.778068 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8b31c462-2f12-4d07-8532-5b5ae9699c0a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:50.795880 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8b31c462-2f12-4d07-8532-5b5ae9699c0a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:50.798076 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8b31c462-2f12-4d07-8532-5b5ae9699c0a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:50.799488 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8b31c462-2f12-4d07-8532-5b5ae9699c0a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1285 microversion: 2.42 time: 0.139821 Jun 05 08:29:50.800149 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 889/1801] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:29:50 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:29:50.814521 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ef9f20f5-2a9e-4551-b512-23be190c4ea5 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:50.816016 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ef9f20f5-2a9e-4551-b512-23be190c4ea5 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] [instance: d14db277-eb47-4014-b054-beb64ba573ed] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:50.836276 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ef9f20f5-2a9e-4551-b512-23be190c4ea5 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:50.837929 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ef9f20f5-2a9e-4551-b512-23be190c4ea5 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:50.840255 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ef9f20f5-2a9e-4551-b512-23be190c4ea5 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:50.840617 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ef9f20f5-2a9e-4551-b512-23be190c4ea5 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:50.872222 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-c698b3aa-781b-4210-aa80-83879db671ec tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lazy-loading 'services' on Instance uuid b271002d-4613-405c-aeed-7c06b205a045 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:50.890615 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ef9f20f5-2a9e-4551-b512-23be190c4ea5 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] [instance: d14db277-eb47-4014-b054-beb64ba573ed] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:29:51.019267 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ef9f20f5-2a9e-4551-b512-23be190c4ea5 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed" status: 204 len: 0 microversion: 2.1 time: 0.217366 Jun 05 08:29:51.020899 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 890/1802] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:29:50 2022] DELETE /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:29:51.031786 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ce345460-444b-474f-a938-55962229ef02 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:51.034020 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ce345460-444b-474f-a938-55962229ef02 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] [instance: d14db277-eb47-4014-b054-beb64ba573ed] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:51.065433 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ce345460-444b-474f-a938-55962229ef02 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:51.067825 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ce345460-444b-474f-a938-55962229ef02 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:51.071861 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ce345460-444b-474f-a938-55962229ef02 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:51.072967 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ce345460-444b-474f-a938-55962229ef02 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:51.176561 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c698b3aa-781b-4210-aa80-83879db671ec tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments/3a0352fb-91e0-46a6-8586-9d9e3a766056" status: 202 len: 0 microversion: 2.20 time: 0.525528 Jun 05 08:29:51.178945 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 913/1803] 10.222.0.33 () {60 vars in 1456 bytes} [Sun Jun 5 08:29:50 2022] DELETE /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments/3a0352fb-91e0-46a6-8586-9d9e3a766056 => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:29:51.201242 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e248ed6d-22fb-44d1-bbad-6a43558f0f4a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:51.202046 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e248ed6d-22fb-44d1-bbad-6a43558f0f4a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:51.212249 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e248ed6d-22fb-44d1-bbad-6a43558f0f4a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:51.213008 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e248ed6d-22fb-44d1-bbad-6a43558f0f4a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:51.214831 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e248ed6d-22fb-44d1-bbad-6a43558f0f4a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:51.215508 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e248ed6d-22fb-44d1-bbad-6a43558f0f4a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:51.260019 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e248ed6d-22fb-44d1-bbad-6a43558f0f4a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:51.260816 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e248ed6d-22fb-44d1-bbad-6a43558f0f4a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:51.261276 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-e248ed6d-22fb-44d1-bbad-6a43558f0f4a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:51.359274 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e248ed6d-22fb-44d1-bbad-6a43558f0f4a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:51.370969 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e248ed6d-22fb-44d1-bbad-6a43558f0f4a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.190548 Jun 05 08:29:51.371794 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 914/1804] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:51 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:51.386204 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-acd2f2c2-a146-4b17-888c-889bd16deba8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:51.387680 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-acd2f2c2-a146-4b17-888c-889bd16deba8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:51.398841 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-acd2f2c2-a146-4b17-888c-889bd16deba8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:51.403321 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-acd2f2c2-a146-4b17-888c-889bd16deba8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:51.405884 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-acd2f2c2-a146-4b17-888c-889bd16deba8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:51.408472 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-acd2f2c2-a146-4b17-888c-889bd16deba8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:51.471160 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-acd2f2c2-a146-4b17-888c-889bd16deba8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.097802 Jun 05 08:29:51.480362 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 915/1805] 10.222.0.33 () {60 vars in 1342 bytes} [Sun Jun 5 08:29:51 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:29:51.489117 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d929fde4-b1d6-48a9-ab0b-580491087351 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:51.490576 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d929fde4-b1d6-48a9-ab0b-580491087351 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:51.498861 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d929fde4-b1d6-48a9-ab0b-580491087351 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:51.499597 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d929fde4-b1d6-48a9-ab0b-580491087351 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:51.500686 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d929fde4-b1d6-48a9-ab0b-580491087351 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:51.501355 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d929fde4-b1d6-48a9-ab0b-580491087351 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:51.524806 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ce345460-444b-474f-a938-55962229ef02 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd54c03d9a244d21b13f7ba4d914d2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc14eff36af743bc94180fe1e24da809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:51.535607 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ce345460-444b-474f-a938-55962229ef02 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed" status: 200 len: 1473 microversion: 2.1 time: 0.510311 Jun 05 08:29:51.537497 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 891/1806] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:51 2022] GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed => generated 1473 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:51.593279 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c114c513-6bc9-4524-884f-91680dbe4686 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:51.593912 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c114c513-6bc9-4524-884f-91680dbe4686 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:51.601887 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c114c513-6bc9-4524-884f-91680dbe4686 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:51.602713 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c114c513-6bc9-4524-884f-91680dbe4686 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:51.603832 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c114c513-6bc9-4524-884f-91680dbe4686 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:51.604591 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c114c513-6bc9-4524-884f-91680dbe4686 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:51.609680 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:29:51.890868 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c114c513-6bc9-4524-884f-91680dbe4686 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:51.901778 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c114c513-6bc9-4524-884f-91680dbe4686 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 200 len: 1265 microversion: 2.1 time: 0.312611 Jun 05 08:29:51.904956 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 892/1807] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:51 2022] GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 1265 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:51.911238 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a9b0c3a1-27e6-402c-90f7-b3df24c6eb4b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:51.912192 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a9b0c3a1-27e6-402c-90f7-b3df24c6eb4b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:51.956529 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d929fde4-b1d6-48a9-ab0b-580491087351 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:51.966486 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d929fde4-b1d6-48a9-ab0b-580491087351 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1391 microversion: 2.1 time: 0.484611 Jun 05 08:29:51.968891 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 916/1808] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:51 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1391 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:52.016573 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a9b0c3a1-27e6-402c-90f7-b3df24c6eb4b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:52.026185 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a9b0c3a1-27e6-402c-90f7-b3df24c6eb4b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:52.028114 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a9b0c3a1-27e6-402c-90f7-b3df24c6eb4b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:52.029696 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a9b0c3a1-27e6-402c-90f7-b3df24c6eb4b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1285 microversion: 2.42 time: 0.123360 Jun 05 08:29:52.030527 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 893/1809] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:29:51 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:29:52.396881 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-776e82f3-0ebb-407f-9a9a-5ef4d3016c37 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:52.397825 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-776e82f3-0ebb-407f-9a9a-5ef4d3016c37 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:52.410707 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-776e82f3-0ebb-407f-9a9a-5ef4d3016c37 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:52.411534 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-776e82f3-0ebb-407f-9a9a-5ef4d3016c37 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:52.412397 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-776e82f3-0ebb-407f-9a9a-5ef4d3016c37 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:52.412814 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-776e82f3-0ebb-407f-9a9a-5ef4d3016c37 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:52.486033 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-776e82f3-0ebb-407f-9a9a-5ef4d3016c37 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:52.486570 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-776e82f3-0ebb-407f-9a9a-5ef4d3016c37 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:52.487102 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-776e82f3-0ebb-407f-9a9a-5ef4d3016c37 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:52.495029 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6bfe581c-ed64-48d5-bb7c-af594272942b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:52.496621 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6bfe581c-ed64-48d5-bb7c-af594272942b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:52.508217 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6bfe581c-ed64-48d5-bb7c-af594272942b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:52.508677 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6bfe581c-ed64-48d5-bb7c-af594272942b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:52.509657 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6bfe581c-ed64-48d5-bb7c-af594272942b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:52.510263 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6bfe581c-ed64-48d5-bb7c-af594272942b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:52.547341 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6bfe581c-ed64-48d5-bb7c-af594272942b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059111 Jun 05 08:29:52.548829 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 894/1810] 10.222.0.33 () {60 vars in 1342 bytes} [Sun Jun 5 08:29:52 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 05 08:29:52.555447 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8b8070e1-5445-41a6-ae3a-8ca7a4faa61e tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:52.556748 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8b8070e1-5445-41a6-ae3a-8ca7a4faa61e tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] [instance: d14db277-eb47-4014-b054-beb64ba573ed] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:52.563993 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8b8070e1-5445-41a6-ae3a-8ca7a4faa61e tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:52.564814 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8b8070e1-5445-41a6-ae3a-8ca7a4faa61e tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:52.566002 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8b8070e1-5445-41a6-ae3a-8ca7a4faa61e tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:52.566853 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8b8070e1-5445-41a6-ae3a-8ca7a4faa61e tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:52.569536 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-776e82f3-0ebb-407f-9a9a-5ef4d3016c37 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:52.579633 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-776e82f3-0ebb-407f-9a9a-5ef4d3016c37 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.194536 Jun 05 08:29:52.582014 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 917/1811] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:52 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:52.742964 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-fd231fd4-45fe-4cb9-b33d-acb00e87b97f req-16193190-1713-49c1-983f-57b0ccdebb88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b732c5a-d12e-4ca7-aa45-dbe571de1c37", "name": "network-vif-unplugged", "status": "completed", "tag": "cec071fd-e740-4058-b029-ed9348ba5833"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:29:52.757973 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-fd231fd4-45fe-4cb9-b33d-acb00e87b97f req-16193190-1713-49c1-983f-57b0ccdebb88 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:52.762257 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-fd231fd4-45fe-4cb9-b33d-acb00e87b97f req-16193190-1713-49c1-983f-57b0ccdebb88 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:52.793107 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-fd231fd4-45fe-4cb9-b33d-acb00e87b97f req-16193190-1713-49c1-983f-57b0ccdebb88 service nova] Creating event network-vif-unplugged:cec071fd-e740-4058-b029-ed9348ba5833 for instance 0b732c5a-d12e-4ca7-aa45-dbe571de1c37 on n-h1-844739-1 Jun 05 08:29:52.824060 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-fd231fd4-45fe-4cb9-b33d-acb00e87b97f req-16193190-1713-49c1-983f-57b0ccdebb88 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081757 Jun 05 08:29:52.825365 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 918/1812] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:29:52.923835 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-95d12720-6677-4a1d-b0ab-1e7d1697b2e7 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:52.925244 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-95d12720-6677-4a1d-b0ab-1e7d1697b2e7 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:52.938790 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-95d12720-6677-4a1d-b0ab-1e7d1697b2e7 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:52.942717 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-95d12720-6677-4a1d-b0ab-1e7d1697b2e7 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:52.943740 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-95d12720-6677-4a1d-b0ab-1e7d1697b2e7 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:52.945863 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-95d12720-6677-4a1d-b0ab-1e7d1697b2e7 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:53.055264 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8b8070e1-5445-41a6-ae3a-8ca7a4faa61e tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd54c03d9a244d21b13f7ba4d914d2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc14eff36af743bc94180fe1e24da809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:53.066300 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8b8070e1-5445-41a6-ae3a-8ca7a4faa61e tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed" status: 200 len: 1473 microversion: 2.1 time: 0.515854 Jun 05 08:29:53.067392 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 895/1813] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:52 2022] GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed => generated 1473 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:53.073053 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-12d4cd67-bf4d-4d3b-b148-0fdab3c58a33 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:53.073968 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-12d4cd67-bf4d-4d3b-b148-0fdab3c58a33 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:53.082968 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-12d4cd67-bf4d-4d3b-b148-0fdab3c58a33 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:53.083697 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-12d4cd67-bf4d-4d3b-b148-0fdab3c58a33 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:53.084851 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-12d4cd67-bf4d-4d3b-b148-0fdab3c58a33 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:53.087466 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-12d4cd67-bf4d-4d3b-b148-0fdab3c58a33 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:54.135729 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-95d12720-6677-4a1d-b0ab-1e7d1697b2e7 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:54.148689 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-95d12720-6677-4a1d-b0ab-1e7d1697b2e7 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 200 len: 1307 microversion: 2.1 time: 1.225933 Jun 05 08:29:54.149345 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 919/1814] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:52 2022] GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 1307 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:54.172122 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3cbab826-37c5-468d-a0e0-3b32c44bcefb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:54.173018 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3cbab826-37c5-468d-a0e0-3b32c44bcefb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:54.184233 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3cbab826-37c5-468d-a0e0-3b32c44bcefb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:54.197358 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3cbab826-37c5-468d-a0e0-3b32c44bcefb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:54.202526 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3cbab826-37c5-468d-a0e0-3b32c44bcefb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:54.203203 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3cbab826-37c5-468d-a0e0-3b32c44bcefb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:54.208532 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-12d4cd67-bf4d-4d3b-b148-0fdab3c58a33 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:54.224960 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-12d4cd67-bf4d-4d3b-b148-0fdab3c58a33 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1391 microversion: 2.1 time: 1.151548 Jun 05 08:29:54.229127 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 896/1815] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:53 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1391 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:54.262301 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fdb1dc72-252e-4a8d-a0ab-640002575cf6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:54.272026 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-fdb1dc72-252e-4a8d-a0ab-640002575cf6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:54.291564 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fdb1dc72-252e-4a8d-a0ab-640002575cf6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:54.293239 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fdb1dc72-252e-4a8d-a0ab-640002575cf6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:54.296986 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fdb1dc72-252e-4a8d-a0ab-640002575cf6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:54.302283 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fdb1dc72-252e-4a8d-a0ab-640002575cf6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:54.405827 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3cbab826-37c5-468d-a0e0-3b32c44bcefb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:54.427306 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fdb1dc72-252e-4a8d-a0ab-640002575cf6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.181603 Jun 05 08:29:54.434864 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 897/1816] 10.222.0.33 () {60 vars in 1342 bytes} [Sun Jun 5 08:29:54 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:29:54.436987 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3cbab826-37c5-468d-a0e0-3b32c44bcefb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:54.446018 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3cbab826-37c5-468d-a0e0-3b32c44bcefb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:54.450877 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3cbab826-37c5-468d-a0e0-3b32c44bcefb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1593 microversion: 2.42 time: 0.295941 Jun 05 08:29:54.455713 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b3a2ebdb-b11e-4b8b-8601-577d98511166 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:54.456229 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 920/1817] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:29:54 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1593 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:29:54.465468 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b3a2ebdb-b11e-4b8b-8601-577d98511166 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:54.476961 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-743d4950-bb55-4e1c-af81-f259821d7c0c tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:54.478150 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-743d4950-bb55-4e1c-af81-f259821d7c0c tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] [instance: d14db277-eb47-4014-b054-beb64ba573ed] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:54.482838 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b3a2ebdb-b11e-4b8b-8601-577d98511166 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:54.491466 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b3a2ebdb-b11e-4b8b-8601-577d98511166 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:54.496445 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b3a2ebdb-b11e-4b8b-8601-577d98511166 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:54.498405 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b3a2ebdb-b11e-4b8b-8601-577d98511166 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:54.506695 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-743d4950-bb55-4e1c-af81-f259821d7c0c tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:54.508599 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-743d4950-bb55-4e1c-af81-f259821d7c0c tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:54.514626 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-743d4950-bb55-4e1c-af81-f259821d7c0c tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:54.515351 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-743d4950-bb55-4e1c-af81-f259821d7c0c tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:54.585731 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b3a2ebdb-b11e-4b8b-8601-577d98511166 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:54.587713 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b3a2ebdb-b11e-4b8b-8601-577d98511166 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:54.589458 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-b3a2ebdb-b11e-4b8b-8601-577d98511166 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:54.753532 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b3a2ebdb-b11e-4b8b-8601-577d98511166 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:54.769799 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b3a2ebdb-b11e-4b8b-8601-577d98511166 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.331413 Jun 05 08:29:54.783583 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 898/1818] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:54 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:54.866646 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-2c646dcd-d522-46a5-9aa4-f2ede831835f req-b0da20f2-8854-436d-93cc-fda1dbe62ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b732c5a-d12e-4ca7-aa45-dbe571de1c37", "tag": "cec071fd-e740-4058-b029-ed9348ba5833"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:29:54.882758 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-2c646dcd-d522-46a5-9aa4-f2ede831835f req-b0da20f2-8854-436d-93cc-fda1dbe62ae5 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:54.885071 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-2c646dcd-d522-46a5-9aa4-f2ede831835f req-b0da20f2-8854-436d-93cc-fda1dbe62ae5 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:54.915534 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-2c646dcd-d522-46a5-9aa4-f2ede831835f req-b0da20f2-8854-436d-93cc-fda1dbe62ae5 service nova] Creating event network-changed:cec071fd-e740-4058-b029-ed9348ba5833 for instance 0b732c5a-d12e-4ca7-aa45-dbe571de1c37 on n-h1-844739-1 Jun 05 08:29:54.922153 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-2c646dcd-d522-46a5-9aa4-f2ede831835f req-b0da20f2-8854-436d-93cc-fda1dbe62ae5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060751 Jun 05 08:29:54.923070 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 899/1819] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:29:55.057839 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-743d4950-bb55-4e1c-af81-f259821d7c0c tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd54c03d9a244d21b13f7ba4d914d2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc14eff36af743bc94180fe1e24da809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:55.068887 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-743d4950-bb55-4e1c-af81-f259821d7c0c tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed" status: 200 len: 1473 microversion: 2.1 time: 0.607553 Jun 05 08:29:55.069478 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 921/1820] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:54 2022] GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed => generated 1473 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:55.168332 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c6f01a6e-7a1d-4c65-a2e9-0af883f068af tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:55.169228 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c6f01a6e-7a1d-4c65-a2e9-0af883f068af tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:55.200304 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c6f01a6e-7a1d-4c65-a2e9-0af883f068af tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:55.201082 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c6f01a6e-7a1d-4c65-a2e9-0af883f068af tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:55.202258 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c6f01a6e-7a1d-4c65-a2e9-0af883f068af tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:55.205695 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c6f01a6e-7a1d-4c65-a2e9-0af883f068af tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:55.250288 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-31c2228e-35ae-4543-8d96-1c0e9a4cf59d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:55.251677 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-31c2228e-35ae-4543-8d96-1c0e9a4cf59d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:55.276187 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-31c2228e-35ae-4543-8d96-1c0e9a4cf59d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:55.278307 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-31c2228e-35ae-4543-8d96-1c0e9a4cf59d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:55.286340 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-31c2228e-35ae-4543-8d96-1c0e9a4cf59d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:55.288502 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-31c2228e-35ae-4543-8d96-1c0e9a4cf59d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:55.894131 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c6f01a6e-7a1d-4c65-a2e9-0af883f068af tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:55.905493 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c6f01a6e-7a1d-4c65-a2e9-0af883f068af tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 200 len: 1307 microversion: 2.1 time: 0.742555 Jun 05 08:29:55.908635 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 900/1821] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:55 2022] GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 1307 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:29:55.917553 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-62fa408f-93dd-459a-814d-62a1143a1e5c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:55.923624 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-62fa408f-93dd-459a-814d-62a1143a1e5c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:55.938590 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-62fa408f-93dd-459a-814d-62a1143a1e5c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:55.940588 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-62fa408f-93dd-459a-814d-62a1143a1e5c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:55.945352 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-31c2228e-35ae-4543-8d96-1c0e9a4cf59d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:55.956716 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-31c2228e-35ae-4543-8d96-1c0e9a4cf59d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1391 microversion: 2.1 time: 0.714542 Jun 05 08:29:55.957956 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-62fa408f-93dd-459a-814d-62a1143a1e5c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:55.964092 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-62fa408f-93dd-459a-814d-62a1143a1e5c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:55.979175 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 922/1822] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:55 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1391 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:29:55.993872 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-61e518b1-8102-4163-b9df-4f3b3aad2e40 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:56.004850 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-61e518b1-8102-4163-b9df-4f3b3aad2e40 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:56.021047 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-61e518b1-8102-4163-b9df-4f3b3aad2e40 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:56.023192 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-61e518b1-8102-4163-b9df-4f3b3aad2e40 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:56.027223 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-61e518b1-8102-4163-b9df-4f3b3aad2e40 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:56.027891 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-61e518b1-8102-4163-b9df-4f3b3aad2e40 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:56.072395 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-62fa408f-93dd-459a-814d-62a1143a1e5c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.158639 Jun 05 08:29:56.082614 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 901/1823] 10.222.0.33 () {60 vars in 1342 bytes} [Sun Jun 5 08:29:55 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:29:56.102289 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9ec969fd-2a6d-461a-bd3b-e4373d85b76b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:56.104292 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9ec969fd-2a6d-461a-bd3b-e4373d85b76b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:56.119827 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9ec969fd-2a6d-461a-bd3b-e4373d85b76b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:56.124709 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9ec969fd-2a6d-461a-bd3b-e4373d85b76b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:56.126330 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9ec969fd-2a6d-461a-bd3b-e4373d85b76b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:56.126953 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9ec969fd-2a6d-461a-bd3b-e4373d85b76b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:56.210399 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9ec969fd-2a6d-461a-bd3b-e4373d85b76b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:56.211445 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9ec969fd-2a6d-461a-bd3b-e4373d85b76b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:56.212102 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-9ec969fd-2a6d-461a-bd3b-e4373d85b76b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:56.490701 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-9ec969fd-2a6d-461a-bd3b-e4373d85b76b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:56.509525 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9ec969fd-2a6d-461a-bd3b-e4373d85b76b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.425528 Jun 05 08:29:56.510373 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 902/1824] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:56 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:56.515563 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-401e84b8-dd74-48ab-be57-22c6476a1d50 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:56.518982 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-401e84b8-dd74-48ab-be57-22c6476a1d50 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] [instance: d14db277-eb47-4014-b054-beb64ba573ed] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:56.528882 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-401e84b8-dd74-48ab-be57-22c6476a1d50 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:56.537796 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-401e84b8-dd74-48ab-be57-22c6476a1d50 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:56.539021 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-401e84b8-dd74-48ab-be57-22c6476a1d50 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:56.539670 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-401e84b8-dd74-48ab-be57-22c6476a1d50 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:56.611641 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-401e84b8-dd74-48ab-be57-22c6476a1d50 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:56.612415 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-401e84b8-dd74-48ab-be57-22c6476a1d50 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:56.613116 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-401e84b8-dd74-48ab-be57-22c6476a1d50 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Lazy-loading 'fault' on Instance uuid d14db277-eb47-4014-b054-beb64ba573ed {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:56.638516 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-61e518b1-8102-4163-b9df-4f3b3aad2e40 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:56.670759 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-61e518b1-8102-4163-b9df-4f3b3aad2e40 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:56.693321 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-61e518b1-8102-4163-b9df-4f3b3aad2e40 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:56.711418 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-61e518b1-8102-4163-b9df-4f3b3aad2e40 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1659 microversion: 2.42 time: 0.712271 Jun 05 08:29:56.713006 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-401e84b8-dd74-48ab-be57-22c6476a1d50 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd54c03d9a244d21b13f7ba4d914d2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc14eff36af743bc94180fe1e24da809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:56.721893 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-401e84b8-dd74-48ab-be57-22c6476a1d50 tempest-ImagesOneServerTestJSON-1049237888 tempest-ImagesOneServerTestJSON-1049237888-project] 10.222.0.33 "GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed" status: 200 len: 1362 microversion: 2.1 time: 0.210023 Jun 05 08:29:56.730149 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 923/1825] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:29:55 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1659 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:29:56.730846 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 903/1826] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:56 2022] GET /compute/v2.1/servers/d14db277-eb47-4014-b054-beb64ba573ed => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:56.924097 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-504e0a62-0b65-4e87-a126-a1181f7fb419 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:56.925792 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-504e0a62-0b65-4e87-a126-a1181f7fb419 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:56.942658 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-504e0a62-0b65-4e87-a126-a1181f7fb419 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:56.943455 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-504e0a62-0b65-4e87-a126-a1181f7fb419 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:56.950952 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-504e0a62-0b65-4e87-a126-a1181f7fb419 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:56.952785 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-504e0a62-0b65-4e87-a126-a1181f7fb419 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:56.960947 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-2176ff39-ce0b-47be-8bf5-a4778893be79 req-d6e789fb-d5dc-42da-8fe6-5702f0a04e97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d73be951-4be1-4f53-ab55-92c80bdc199d", "tag": "08bcdec3-4528-44c9-bd1e-24888f45cd2c"}, {"server_uuid": "d14db277-eb47-4014-b054-beb64ba573ed", "name": "network-vif-deleted", "tag": "04bb4de3-61a0-4a52-934f-f6f853fe61f9"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:29:56.994617 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-2176ff39-ce0b-47be-8bf5-a4778893be79 req-d6e789fb-d5dc-42da-8fe6-5702f0a04e97 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:57.010817 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-2176ff39-ce0b-47be-8bf5-a4778893be79 req-d6e789fb-d5dc-42da-8fe6-5702f0a04e97 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:57.068320 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-2176ff39-ce0b-47be-8bf5-a4778893be79 req-d6e789fb-d5dc-42da-8fe6-5702f0a04e97 service nova] Creating event network-changed:08bcdec3-4528-44c9-bd1e-24888f45cd2c for instance d73be951-4be1-4f53-ab55-92c80bdc199d on n-h2-844739-1 Jun 05 08:29:57.068849 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-2176ff39-ce0b-47be-8bf5-a4778893be79 req-d6e789fb-d5dc-42da-8fe6-5702f0a04e97 service nova] Creating event network-vif-deleted:04bb4de3-61a0-4a52-934f-f6f853fe61f9 for instance d14db277-eb47-4014-b054-beb64ba573ed on n-h2-844739-1 Jun 05 08:29:57.089012 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-2176ff39-ce0b-47be-8bf5-a4778893be79 req-d6e789fb-d5dc-42da-8fe6-5702f0a04e97 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.132491 Jun 05 08:29:57.090027 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 904/1827] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:29:57.095352 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-045c9813-aa91-44b0-83fc-555176970588 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:57.097618 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-045c9813-aa91-44b0-83fc-555176970588 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:57.119685 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:29:57.128595 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-045c9813-aa91-44b0-83fc-555176970588 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:57.133344 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-045c9813-aa91-44b0-83fc-555176970588 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:57.134492 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-045c9813-aa91-44b0-83fc-555176970588 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:57.136354 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-045c9813-aa91-44b0-83fc-555176970588 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:57.525511 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-504e0a62-0b65-4e87-a126-a1181f7fb419 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:57.541321 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-504e0a62-0b65-4e87-a126-a1181f7fb419 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 200 len: 1307 microversion: 2.1 time: 0.620902 Jun 05 08:29:57.541910 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 924/1828] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:56 2022] GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 1307 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:57.570283 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8788d5db-43a9-41fa-9792-fba41cacd595 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:57.572328 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8788d5db-43a9-41fa-9792-fba41cacd595 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:57.586650 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8788d5db-43a9-41fa-9792-fba41cacd595 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:57.587118 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-045c9813-aa91-44b0-83fc-555176970588 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:57.590692 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8788d5db-43a9-41fa-9792-fba41cacd595 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:57.596412 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8788d5db-43a9-41fa-9792-fba41cacd595 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:57.600394 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8788d5db-43a9-41fa-9792-fba41cacd595 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:57.616712 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-045c9813-aa91-44b0-83fc-555176970588 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1391 microversion: 2.1 time: 0.508621 Jun 05 08:29:57.618313 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 905/1829] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:57 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1391 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:57.632473 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-020f0a13-0922-49d2-95c8-93d390cded7f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:57.635929 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-020f0a13-0922-49d2-95c8-93d390cded7f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:57.652952 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-020f0a13-0922-49d2-95c8-93d390cded7f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:57.653413 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-020f0a13-0922-49d2-95c8-93d390cded7f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:57.657220 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8788d5db-43a9-41fa-9792-fba41cacd595 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.099600 Jun 05 08:29:57.662804 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-020f0a13-0922-49d2-95c8-93d390cded7f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:57.663568 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 925/1830] 10.222.0.33 () {60 vars in 1342 bytes} [Sun Jun 5 08:29:57 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:29:57.668998 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-020f0a13-0922-49d2-95c8-93d390cded7f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:57.735420 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-462837c0-b1cb-4911-a210-0164549fafdb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:57.736078 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-462837c0-b1cb-4911-a210-0164549fafdb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:57.738806 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-020f0a13-0922-49d2-95c8-93d390cded7f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:57.739826 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-020f0a13-0922-49d2-95c8-93d390cded7f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:57.740602 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-020f0a13-0922-49d2-95c8-93d390cded7f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:29:57.746357 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-462837c0-b1cb-4911-a210-0164549fafdb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:57.746672 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-462837c0-b1cb-4911-a210-0164549fafdb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:57.755779 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-462837c0-b1cb-4911-a210-0164549fafdb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:57.757515 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-462837c0-b1cb-4911-a210-0164549fafdb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:57.920551 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-020f0a13-0922-49d2-95c8-93d390cded7f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:57.949350 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-020f0a13-0922-49d2-95c8-93d390cded7f tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.329442 Jun 05 08:29:57.965274 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 906/1831] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:57 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:29:58.561898 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-db50a5ea-d49c-4877-9ff5-49a7703e9c43 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:58.563679 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-db50a5ea-d49c-4877-9ff5-49a7703e9c43 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:58.589406 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:29:58.597797 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-db50a5ea-d49c-4877-9ff5-49a7703e9c43 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:58.599511 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-db50a5ea-d49c-4877-9ff5-49a7703e9c43 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:58.601724 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-db50a5ea-d49c-4877-9ff5-49a7703e9c43 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:58.602384 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-db50a5ea-d49c-4877-9ff5-49a7703e9c43 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:59.320884 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-462837c0-b1cb-4911-a210-0164549fafdb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:59.340758 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-462837c0-b1cb-4911-a210-0164549fafdb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:59.346371 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-462837c0-b1cb-4911-a210-0164549fafdb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:29:59.348936 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-462837c0-b1cb-4911-a210-0164549fafdb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1704 microversion: 2.42 time: 1.618317 Jun 05 08:29:59.363050 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 926/1832] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:29:57 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1704 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:29:59.374399 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c63088b5-09c4-4965-a959-d27b076a0618 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:29:59.377389 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c63088b5-09c4-4965-a959-d27b076a0618 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:29:59.408076 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c63088b5-09c4-4965-a959-d27b076a0618 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:59.410123 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c63088b5-09c4-4965-a959-d27b076a0618 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:59.412628 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c63088b5-09c4-4965-a959-d27b076a0618 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:29:59.413411 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c63088b5-09c4-4965-a959-d27b076a0618 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:29:59.460844 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:29:59.763326 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:29:59.821470 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=6 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:30:00.072850 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-db50a5ea-d49c-4877-9ff5-49a7703e9c43 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:00.092747 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-db50a5ea-d49c-4877-9ff5-49a7703e9c43 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 200 len: 1307 microversion: 2.1 time: 1.537859 Jun 05 08:30:00.095774 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 907/1833] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:58 2022] GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 1307 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:00.121629 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ff6ea708-012b-40fb-a6cb-c577a5c3c8aa tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:00.124999 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ff6ea708-012b-40fb-a6cb-c577a5c3c8aa tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:00.158611 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ff6ea708-012b-40fb-a6cb-c577a5c3c8aa tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:00.163185 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ff6ea708-012b-40fb-a6cb-c577a5c3c8aa tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:00.168813 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ff6ea708-012b-40fb-a6cb-c577a5c3c8aa tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:00.171621 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ff6ea708-012b-40fb-a6cb-c577a5c3c8aa tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:00.255874 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ff6ea708-012b-40fb-a6cb-c577a5c3c8aa tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.151370 Jun 05 08:30:00.259469 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 908/1834] 10.222.0.33 () {60 vars in 1342 bytes} [Sun Jun 5 08:30:00 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:30:00.268652 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-10651a2d-7d23-4caf-b29e-21f3477986a1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:00.271483 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-10651a2d-7d23-4caf-b29e-21f3477986a1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:00.291881 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10651a2d-7d23-4caf-b29e-21f3477986a1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:00.296261 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10651a2d-7d23-4caf-b29e-21f3477986a1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:00.298937 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10651a2d-7d23-4caf-b29e-21f3477986a1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:00.303398 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10651a2d-7d23-4caf-b29e-21f3477986a1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:00.417776 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10651a2d-7d23-4caf-b29e-21f3477986a1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:00.418705 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10651a2d-7d23-4caf-b29e-21f3477986a1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:00.419503 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-10651a2d-7d23-4caf-b29e-21f3477986a1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:30:00.435058 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=100 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:30:00.481342 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c63088b5-09c4-4965-a959-d27b076a0618 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:00.493644 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c63088b5-09c4-4965-a959-d27b076a0618 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1391 microversion: 2.1 time: 1.129079 Jun 05 08:30:00.494605 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 927/1835] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:29:59 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1391 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:00.506996 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-10551257-bb26-4ea3-b527-82994befd636 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:00.508492 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-10551257-bb26-4ea3-b527-82994befd636 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:00.521552 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-10551257-bb26-4ea3-b527-82994befd636 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:00.525362 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-10551257-bb26-4ea3-b527-82994befd636 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:00.526839 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-10551257-bb26-4ea3-b527-82994befd636 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:00.528214 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-10551257-bb26-4ea3-b527-82994befd636 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:00.580317 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-10651a2d-7d23-4caf-b29e-21f3477986a1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:00.597553 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-10651a2d-7d23-4caf-b29e-21f3477986a1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.336647 Jun 05 08:30:00.599397 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 909/1836] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:00 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:01.068197 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-82d97423-ff19-473a-852a-4b7dfa7a91bf tempest-ListImageFiltersNegativeTestJSON-1395838702 tempest-ListImageFiltersNegativeTestJSON-1395838702-project] Calling method '.version_select at 0x7f244549e940>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:01.127755 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-10551257-bb26-4ea3-b527-82994befd636 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:01.137403 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-82d97423-ff19-473a-852a-4b7dfa7a91bf tempest-ListImageFiltersNegativeTestJSON-1395838702 tempest-ListImageFiltersNegativeTestJSON-1395838702-project] HTTP exception thrown: Image not found. Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-82d97423-ff19-473a-852a-4b7dfa7a91bf tempest-ListImageFiltersNegativeTestJSON-1395838702 tempest-ListImageFiltersNegativeTestJSON-1395838702-project] Request method failure captured: Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/images/946a566d-963d-405a-b0e4-03f9af13b493 HTTP/1.1 Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGmIQkZ73H4miJ3SA7Eh77ufHrkZvnyyAPmOUgHEVJy8vOCgS6JtTCmF0oTPqk5a0odoEdXS6NxO9_kt-88Oy4iiu6riLO1ZBPtYMtmVrMRVrY-RrROAL6JEJzws7kke-xh7pv1zdq4f-HE1Z9AnWyPSS04BVlchT6yF_trGV0jh0jY Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 25aba3694a6d4d0eb9ba1e7b0db726df Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1395838702 Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/25aba3694a6d4d0eb9ba1e7b0db726df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/25aba3694a6d4d0eb9ba1e7b0db726df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_25aba3694a6d4d0eb9ba1e7b0db726df", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/25aba3694a6d4d0eb9ba1e7b0db726df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1395838702 Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 25aba3694a6d4d0eb9ba1e7b0db726df Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1395838702 Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ListImageFiltersNegativeTestJSON-1395838702-project Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: afdb6e1ad8ce4fd2a00eae72efc3ae1f Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1395838702-project Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: exception: Image not found. Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '946a566d-963d-405a-b0e4-03f9af13b493'} Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 946a566d-963d-405a-b0e4-03f9af13b493 Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 05 08:30:01.140187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 946a566d-963d-405a-b0e4-03f9af13b493 could not be found. Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-82d97423-ff19-473a-852a-4b7dfa7a91bf tempest-ListImageFiltersNegativeTestJSON-1395838702 tempest-ListImageFiltersNegativeTestJSON-1395838702-project] Returning 404 to user: Image not found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:30:01.144288 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-82d97423-ff19-473a-852a-4b7dfa7a91bf tempest-ListImageFiltersNegativeTestJSON-1395838702 tempest-ListImageFiltersNegativeTestJSON-1395838702-project] 10.222.0.33 "GET /compute/v2.1/images/946a566d-963d-405a-b0e4-03f9af13b493" status: 404 len: 62 microversion: 2.1 time: 0.272470 Jun 05 08:30:01.152293 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-10551257-bb26-4ea3-b527-82994befd636 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:01.152842 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 910/1837] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:30:00 2022] GET /compute/v2.1/images/946a566d-963d-405a-b0e4-03f9af13b493 => generated 62 bytes in 277 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:30:01.153054 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-10551257-bb26-4ea3-b527-82994befd636 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:01.153054 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-10551257-bb26-4ea3-b527-82994befd636 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1749 microversion: 2.42 time: 0.651683 Jun 05 08:30:01.155496 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 928/1838] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:00 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1749 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:01.183567 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-90785a9c-b338-43ef-89fd-df3b3de6fd47 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:01.184232 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-90785a9c-b338-43ef-89fd-df3b3de6fd47 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:01.213852 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-90785a9c-b338-43ef-89fd-df3b3de6fd47 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:01.222790 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-90785a9c-b338-43ef-89fd-df3b3de6fd47 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:01.223985 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-90785a9c-b338-43ef-89fd-df3b3de6fd47 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:01.231118 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-90785a9c-b338-43ef-89fd-df3b3de6fd47 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:01.267041 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1ce98c0a-0395-47de-a5dc-dfcabc071862 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:01.268314 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1ce98c0a-0395-47de-a5dc-dfcabc071862 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:01.284391 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ce98c0a-0395-47de-a5dc-dfcabc071862 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:01.285276 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ce98c0a-0395-47de-a5dc-dfcabc071862 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:01.286759 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ce98c0a-0395-47de-a5dc-dfcabc071862 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:01.287592 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ce98c0a-0395-47de-a5dc-dfcabc071862 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:01.373978 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1ce98c0a-0395-47de-a5dc-dfcabc071862 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.110439 Jun 05 08:30:01.385793 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 929/1839] 10.222.0.33 () {60 vars in 1342 bytes} [Sun Jun 5 08:30:01 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 05 08:30:01.512811 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ef50a9c0-de75-48ee-b971-92e033459b1c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:01.514606 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ef50a9c0-de75-48ee-b971-92e033459b1c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:01.527697 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ef50a9c0-de75-48ee-b971-92e033459b1c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:01.528640 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ef50a9c0-de75-48ee-b971-92e033459b1c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:01.530069 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ef50a9c0-de75-48ee-b971-92e033459b1c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:01.532698 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ef50a9c0-de75-48ee-b971-92e033459b1c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:01.855295 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-90785a9c-b338-43ef-89fd-df3b3de6fd47 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:01.870877 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-90785a9c-b338-43ef-89fd-df3b3de6fd47 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 200 len: 1307 microversion: 2.1 time: 0.712093 Jun 05 08:30:01.871884 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 911/1840] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:01 2022] GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 1307 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:01.881514 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-57832475-0896-4540-a755-0dabed6e4cbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:01.884936 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-57832475-0896-4540-a755-0dabed6e4cbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:01.905996 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-57832475-0896-4540-a755-0dabed6e4cbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:01.910829 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-57832475-0896-4540-a755-0dabed6e4cbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:01.916928 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-57832475-0896-4540-a755-0dabed6e4cbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:01.918265 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-57832475-0896-4540-a755-0dabed6e4cbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:01.921564 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ef50a9c0-de75-48ee-b971-92e033459b1c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:01.935580 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ef50a9c0-de75-48ee-b971-92e033459b1c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1391 microversion: 2.1 time: 0.427030 Jun 05 08:30:01.966768 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 930/1841] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:01 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1391 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:30:01.996101 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-03fdbdeb-d55d-49ba-9506-b05c14920c2b req-9d181fdd-4b2e-4209-a3c2-27853d5d94fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73be951-4be1-4f53-ab55-92c80bdc199d", "name": "network-vif-plugged", "status": "completed", "tag": "08bcdec3-4528-44c9-bd1e-24888f45cd2c"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:02.011519 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-57832475-0896-4540-a755-0dabed6e4cbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:02.015502 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-57832475-0896-4540-a755-0dabed6e4cbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:02.016399 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-57832475-0896-4540-a755-0dabed6e4cbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:30:02.027231 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=10 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:30:02.030995 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-03fdbdeb-d55d-49ba-9506-b05c14920c2b req-9d181fdd-4b2e-4209-a3c2-27853d5d94fb service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:02.031498 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-03fdbdeb-d55d-49ba-9506-b05c14920c2b req-9d181fdd-4b2e-4209-a3c2-27853d5d94fb service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:02.085163 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-03fdbdeb-d55d-49ba-9506-b05c14920c2b req-9d181fdd-4b2e-4209-a3c2-27853d5d94fb service nova] Creating event network-vif-plugged:08bcdec3-4528-44c9-bd1e-24888f45cd2c for instance d73be951-4be1-4f53-ab55-92c80bdc199d on n-h2-844739-1 Jun 05 08:30:02.110704 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-03fdbdeb-d55d-49ba-9506-b05c14920c2b req-9d181fdd-4b2e-4209-a3c2-27853d5d94fb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130000 Jun 05 08:30:02.111377 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 931/1842] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:30:02.134494 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-57832475-0896-4540-a755-0dabed6e4cbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:02.143474 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-57832475-0896-4540-a755-0dabed6e4cbf tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.269771 Jun 05 08:30:02.144062 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 912/1843] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:01 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:02.172100 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ee5bf308-27a3-4083-b7bc-c04ec78d2f39 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:02.172815 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ee5bf308-27a3-4083-b7bc-c04ec78d2f39 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:02.182325 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ee5bf308-27a3-4083-b7bc-c04ec78d2f39 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:02.182784 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ee5bf308-27a3-4083-b7bc-c04ec78d2f39 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:02.187696 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ee5bf308-27a3-4083-b7bc-c04ec78d2f39 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:02.188196 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ee5bf308-27a3-4083-b7bc-c04ec78d2f39 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:02.390740 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9b20dd48-2825-42da-8ae4-990cfa4cbba9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:02.391747 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9b20dd48-2825-42da-8ae4-990cfa4cbba9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:02.412631 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9b20dd48-2825-42da-8ae4-990cfa4cbba9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:02.415172 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9b20dd48-2825-42da-8ae4-990cfa4cbba9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:02.417870 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9b20dd48-2825-42da-8ae4-990cfa4cbba9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:02.419236 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9b20dd48-2825-42da-8ae4-990cfa4cbba9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:02.466049 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9b20dd48-2825-42da-8ae4-990cfa4cbba9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079104 Jun 05 08:30:02.467124 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 913/1844] 10.222.0.33 () {60 vars in 1342 bytes} [Sun Jun 5 08:30:02 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:30:02.880704 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ee5bf308-27a3-4083-b7bc-c04ec78d2f39 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:02.889485 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7d0eec7d-614c-4f6c-9aaa-1a0d8f5f6587 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:02.890101 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7d0eec7d-614c-4f6c-9aaa-1a0d8f5f6587 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:02.896422 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ee5bf308-27a3-4083-b7bc-c04ec78d2f39 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:02.898995 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ee5bf308-27a3-4083-b7bc-c04ec78d2f39 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:02.903125 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ee5bf308-27a3-4083-b7bc-c04ec78d2f39 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1839 microversion: 2.42 time: 0.735073 Jun 05 08:30:02.906574 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 932/1845] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:02 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1839 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:02.922413 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7d0eec7d-614c-4f6c-9aaa-1a0d8f5f6587 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:02.923879 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7d0eec7d-614c-4f6c-9aaa-1a0d8f5f6587 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:02.926993 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7d0eec7d-614c-4f6c-9aaa-1a0d8f5f6587 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:02.927450 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7d0eec7d-614c-4f6c-9aaa-1a0d8f5f6587 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:02.956144 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5ee5b09b-ceff-4fba-9295-9d17b0f92ff3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:02.957953 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5ee5b09b-ceff-4fba-9295-9d17b0f92ff3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:02.971013 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5ee5b09b-ceff-4fba-9295-9d17b0f92ff3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:02.973584 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5ee5b09b-ceff-4fba-9295-9d17b0f92ff3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:02.976716 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5ee5b09b-ceff-4fba-9295-9d17b0f92ff3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:02.978266 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5ee5b09b-ceff-4fba-9295-9d17b0f92ff3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:03.296007 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7d0eec7d-614c-4f6c-9aaa-1a0d8f5f6587 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:03.305492 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5ee5b09b-ceff-4fba-9295-9d17b0f92ff3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:03.316297 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5ee5b09b-ceff-4fba-9295-9d17b0f92ff3 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1391 microversion: 2.1 time: 0.364823 Jun 05 08:30:03.327886 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 933/1846] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:02 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1391 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:03.331256 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7d0eec7d-614c-4f6c-9aaa-1a0d8f5f6587 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 200 len: 1307 microversion: 2.1 time: 0.446096 Jun 05 08:30:03.335326 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9917a7b1-c613-4c30-9ef2-d52714c97335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:03.336440 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9917a7b1-c613-4c30-9ef2-d52714c97335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:03.337645 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 914/1847] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:02 2022] GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 1307 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:30:03.345347 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9917a7b1-c613-4c30-9ef2-d52714c97335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:03.346009 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9917a7b1-c613-4c30-9ef2-d52714c97335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:03.347026 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9917a7b1-c613-4c30-9ef2-d52714c97335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:03.348391 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9917a7b1-c613-4c30-9ef2-d52714c97335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:03.388987 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9917a7b1-c613-4c30-9ef2-d52714c97335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:03.390159 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9917a7b1-c613-4c30-9ef2-d52714c97335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:03.391051 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-9917a7b1-c613-4c30-9ef2-d52714c97335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:30:03.439777 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9917a7b1-c613-4c30-9ef2-d52714c97335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:03.458317 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9917a7b1-c613-4c30-9ef2-d52714c97335 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.128640 Jun 05 08:30:03.472460 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 934/1848] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:03 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:03.479018 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f48a32b4-aa3c-461c-99d6-66eb98ae15fd tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:03.479980 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f48a32b4-aa3c-461c-99d6-66eb98ae15fd tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:03.494563 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f48a32b4-aa3c-461c-99d6-66eb98ae15fd tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:03.495029 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f48a32b4-aa3c-461c-99d6-66eb98ae15fd tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:03.495955 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f48a32b4-aa3c-461c-99d6-66eb98ae15fd tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:03.496288 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f48a32b4-aa3c-461c-99d6-66eb98ae15fd tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:03.590263 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f48a32b4-aa3c-461c-99d6-66eb98ae15fd tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.114472 Jun 05 08:30:03.592791 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 915/1849] 10.222.0.33 () {60 vars in 1342 bytes} [Sun Jun 5 08:30:03 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:30:03.937780 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a797d2de-8ed7-4fcd-a139-b53102a6de9d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:03.947889 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a797d2de-8ed7-4fcd-a139-b53102a6de9d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:03.962761 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a797d2de-8ed7-4fcd-a139-b53102a6de9d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:03.964841 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a797d2de-8ed7-4fcd-a139-b53102a6de9d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:03.966159 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a797d2de-8ed7-4fcd-a139-b53102a6de9d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:03.966852 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a797d2de-8ed7-4fcd-a139-b53102a6de9d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:04.419530 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a797d2de-8ed7-4fcd-a139-b53102a6de9d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:04.452912 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a797d2de-8ed7-4fcd-a139-b53102a6de9d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:04.459954 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a797d2de-8ed7-4fcd-a139-b53102a6de9d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:04.461695 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a797d2de-8ed7-4fcd-a139-b53102a6de9d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1839 microversion: 2.42 time: 0.537239 Jun 05 08:30:04.478037 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 935/1850] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:03 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1839 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:04.493433 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-dbf6ef41-8e2a-4b28-9f75-08be1f6c44c6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:04.496597 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-dbf6ef41-8e2a-4b28-9f75-08be1f6c44c6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:04.518145 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dbf6ef41-8e2a-4b28-9f75-08be1f6c44c6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:04.521310 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dbf6ef41-8e2a-4b28-9f75-08be1f6c44c6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:04.523027 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dbf6ef41-8e2a-4b28-9f75-08be1f6c44c6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:04.523735 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dbf6ef41-8e2a-4b28-9f75-08be1f6c44c6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:04.779377 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-8b548db1-842a-4c0b-aaba-9ebf1402b900 req-7ea310a6-652c-46d9-8582-1c2c9e44f68e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40933e98-d7d3-4d63-9012-ad5607e45085", "tag": "4b72d95e-c895-455c-8626-04e2ca35dbf3"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:04.796284 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-8b548db1-842a-4c0b-aaba-9ebf1402b900 req-7ea310a6-652c-46d9-8582-1c2c9e44f68e service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:04.798305 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-8b548db1-842a-4c0b-aaba-9ebf1402b900 req-7ea310a6-652c-46d9-8582-1c2c9e44f68e service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:04.829739 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-8b548db1-842a-4c0b-aaba-9ebf1402b900 req-7ea310a6-652c-46d9-8582-1c2c9e44f68e service nova] Creating event network-changed:4b72d95e-c895-455c-8626-04e2ca35dbf3 for instance 40933e98-d7d3-4d63-9012-ad5607e45085 on n-h1-844739-1 Jun 05 08:30:04.844884 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-8b548db1-842a-4c0b-aaba-9ebf1402b900 req-7ea310a6-652c-46d9-8582-1c2c9e44f68e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.868356 Jun 05 08:30:04.849154 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 916/1851] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:30:04.855219 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-39fb1823-f353-4d81-b9fe-da0e9424fea5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:04.855946 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-39fb1823-f353-4d81-b9fe-da0e9424fea5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:04.876760 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-39fb1823-f353-4d81-b9fe-da0e9424fea5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:04.877215 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-39fb1823-f353-4d81-b9fe-da0e9424fea5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:04.880589 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-39fb1823-f353-4d81-b9fe-da0e9424fea5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:04.881357 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-39fb1823-f353-4d81-b9fe-da0e9424fea5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:04.885607 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-dbf6ef41-8e2a-4b28-9f75-08be1f6c44c6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:04.894179 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-dbf6ef41-8e2a-4b28-9f75-08be1f6c44c6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1391 microversion: 2.1 time: 0.413472 Jun 05 08:30:04.895308 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 936/1852] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:04 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1391 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:04.918845 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-45a6665f-3c4f-4110-8efd-34f458780ee1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:04.924406 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-45a6665f-3c4f-4110-8efd-34f458780ee1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:04.939452 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-45a6665f-3c4f-4110-8efd-34f458780ee1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:04.940261 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-45a6665f-3c4f-4110-8efd-34f458780ee1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:04.952647 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-45a6665f-3c4f-4110-8efd-34f458780ee1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:04.953117 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-45a6665f-3c4f-4110-8efd-34f458780ee1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:05.047759 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-45a6665f-3c4f-4110-8efd-34f458780ee1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:05.048253 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-45a6665f-3c4f-4110-8efd-34f458780ee1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:05.048718 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-45a6665f-3c4f-4110-8efd-34f458780ee1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:30:05.160895 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-45a6665f-3c4f-4110-8efd-34f458780ee1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:05.170924 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-45a6665f-3c4f-4110-8efd-34f458780ee1 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.274564 Jun 05 08:30:05.175223 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 937/1853] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:04 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:05.183100 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a7c887b3-cd76-45f5-b04d-41feded6500f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:05.187414 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a7c887b3-cd76-45f5-b04d-41feded6500f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:05.201006 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-39fb1823-f353-4d81-b9fe-da0e9424fea5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:05.203547 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a7c887b3-cd76-45f5-b04d-41feded6500f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:05.205907 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a7c887b3-cd76-45f5-b04d-41feded6500f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:05.206973 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a7c887b3-cd76-45f5-b04d-41feded6500f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:05.211086 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a7c887b3-cd76-45f5-b04d-41feded6500f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:05.214583 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-39fb1823-f353-4d81-b9fe-da0e9424fea5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 200 len: 1486 microversion: 2.1 time: 0.364098 Jun 05 08:30:05.217473 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 917/1854] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:04 2022] GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 1486 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:05.239853 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9ef87eca-eddf-4d71-ae83-4bedc5102f0a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:05.257301 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9ef87eca-eddf-4d71-ae83-4bedc5102f0a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:05.257965 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9ef87eca-eddf-4d71-ae83-4bedc5102f0a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:05.286124 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a7c887b3-cd76-45f5-b04d-41feded6500f tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.104883 Jun 05 08:30:05.287823 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 938/1855] 10.222.0.33 () {60 vars in 1342 bytes} [Sun Jun 5 08:30:05 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:30:05.439405 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9ef87eca-eddf-4d71-ae83-4bedc5102f0a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Going to try to stop instance {{(pid=119050) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 05 08:30:05.511001 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9ef87eca-eddf-4d71-ae83-4bedc5102f0a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "POST /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d/action" status: 202 len: 0 microversion: 2.1 time: 0.275098 Jun 05 08:30:05.512870 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 918/1856] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Jun 5 08:30:05 2022] POST /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 05 08:30:05.520402 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-932fbe71-be23-4caa-924d-45bbbe1fa3bb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:05.521461 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-932fbe71-be23-4caa-924d-45bbbe1fa3bb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:05.531552 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-932fbe71-be23-4caa-924d-45bbbe1fa3bb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:05.533224 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-932fbe71-be23-4caa-924d-45bbbe1fa3bb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:05.534479 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-932fbe71-be23-4caa-924d-45bbbe1fa3bb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:05.535639 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-932fbe71-be23-4caa-924d-45bbbe1fa3bb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:05.857951 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6deeee32-0137-44c8-aebd-52360cf68381 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Action: 'create', calling method: .version_select at 0x7f2433a5fdc0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHB9Oo6Dn8bGEajoyCcpiZjiiAUmrQmQDPRkaIf9YKk7xZCTg/7NE8S0AXc+Q/UXNGJ39DSlWDgYEfHIyZsth52kdGEnh7ntkxcjdD2cUQaDD0V373PGTf8F1qUfy2ePeg=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:05.870081 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-6deeee32-0137-44c8-aebd-52360cf68381 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6deeee32-0137-44c8-aebd-52360cf68381 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Request method failure captured: Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 257 Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGmN2Ci9frrUzW5ZMn_mT5xL-VpKYSTIt5gdZE3IwLWUFP4LPP-gKK8ZmALTjcR0jcXNBPb3pS5mXsKBGTLF3Yx9eALODZIZ1R2gX-c3eBxTTBqHa-i3ofNFAh5Q_ad0EhsU4hPrEwIXdHQ3u6KG2UCS7U87LBLCU2_bEN1RnIYKjh8 Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 38065b59193d43969d49f52e6c8e6277 Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-182244114 Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/38065b59193d43969d49f52e6c8e6277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38065b59193d43969d49f52e6c8e6277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_38065b59193d43969d49f52e6c8e6277", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38065b59193d43969d49f52e6c8e6277"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-KeyPairsNegativeTestJSON-182244114 Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 38065b59193d43969d49f52e6c8e6277 Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-182244114 Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-KeyPairsNegativeTestJSON-182244114-project Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 69b94d6721264d369ac892cba9031916 Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-KeyPairsNegativeTestJSON-182244114-project Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHB9Oo6Dn8bGEajoyCcpiZjiiAUmrQmQDPRkaIf9YKk7xZCTg/7NE8S0AXc+Q/UXNGJ39DSlWDgYEfHIyZsth52kdGEnh7ntkxcjdD2cUQaDD0V373PGTf8F1qUfy2ePeg=="}} Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHB9Oo6Dn8bGEajoyCcpiZjiiAUmrQmQDPRkaIf9YKk7xZCTg/7NE8S0AXc+Q/UXNGJ39DSlWDgYEfHIyZsth52kdGEnh7ntkxcjdD2cUQaDD0V373PGTf8F1qUfy2ePeg=='}}} Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:30:05.872417 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:30:05.876831 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:30:05.876831 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:30:05.876831 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:30:05.876831 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:30:05.876831 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:30:05.876831 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:30:05.876831 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 05 08:30:05.876831 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 05 08:30:05.876831 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 05 08:30:05.876831 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 05 08:30:05.876831 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jun 05 08:30:05.876831 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:30:05.876831 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:30:05.876831 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:30:05.876831 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:05.876831 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:30:05.876831 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:30:05.876831 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:30:05.876831 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:30:05.876831 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jun 05 08:30:05.876831 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:30:05.881630 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6deeee32-0137-44c8-aebd-52360cf68381 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:30:05.882673 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6deeee32-0137-44c8-aebd-52360cf68381 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.560914 Jun 05 08:30:05.891032 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 939/1857] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:30:05 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 570 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 05 08:30:05.913919 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1b00f336-452d-41fb-8949-bfc1e5982f66 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:05.914796 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1b00f336-452d-41fb-8949-bfc1e5982f66 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:05.927948 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1b00f336-452d-41fb-8949-bfc1e5982f66 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:05.935838 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1b00f336-452d-41fb-8949-bfc1e5982f66 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:05.937011 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1b00f336-452d-41fb-8949-bfc1e5982f66 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:05.937673 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1b00f336-452d-41fb-8949-bfc1e5982f66 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:05.947020 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-932fbe71-be23-4caa-924d-45bbbe1fa3bb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:05.961322 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-932fbe71-be23-4caa-924d-45bbbe1fa3bb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:05.963557 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-932fbe71-be23-4caa-924d-45bbbe1fa3bb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:05.965208 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-932fbe71-be23-4caa-924d-45bbbe1fa3bb tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1860 microversion: 2.42 time: 0.450679 Jun 05 08:30:05.981132 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 919/1858] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:05 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1860 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:05.987103 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b8f5bcc4-22e0-45b4-9131-06cf190e23b7 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Action: 'create', calling method: .version_select at 0x7f244549e940>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1558072005", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:06.008126 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-b8f5bcc4-22e0-45b4-9131-06cf190e23b7 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Getting quotas for project 38065b59193d43969d49f52e6c8e6277. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:30:06.014195 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-b8f5bcc4-22e0-45b4-9131-06cf190e23b7 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Getting quotas for user 69b94d6721264d369ac892cba9031916 and project 38065b59193d43969d49f52e6c8e6277. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:30:06.054133 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-b8f5bcc4-22e0-45b4-9131-06cf190e23b7 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b8f5bcc4-22e0-45b4-9131-06cf190e23b7 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Request method failure captured: Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 2167 Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGmN2Ci9frrUzW5ZMn_mT5xL-VpKYSTIt5gdZE3IwLWUFP4LPP-gKK8ZmALTjcR0jcXNBPb3pS5mXsKBGTLF3Yx9eALODZIZ1R2gX-c3eBxTTBqHa-i3ofNFAh5Q_ad0EhsU4hPrEwIXdHQ3u6KG2UCS7U87LBLCU2_bEN1RnIYKjh8 Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 38065b59193d43969d49f52e6c8e6277 Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-182244114 Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/38065b59193d43969d49f52e6c8e6277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38065b59193d43969d49f52e6c8e6277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_38065b59193d43969d49f52e6c8e6277", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38065b59193d43969d49f52e6c8e6277"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-KeyPairsNegativeTestJSON-182244114 Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 38065b59193d43969d49f52e6c8e6277 Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-182244114 Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-KeyPairsNegativeTestJSON-182244114-project Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 69b94d6721264d369ac892cba9031916 Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-KeyPairsNegativeTestJSON-182244114-project Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1558072005", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:30:06.069508 n-d-844739-1 devstack@n-api.service[119050]: exception: Keypair data is invalid: failed to generate fingerprint Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1558072005', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:30:06.071792 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:30:06.074374 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:30:06.074374 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:30:06.074374 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:30:06.074374 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:30:06.074374 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 05 08:30:06.074374 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 05 08:30:06.074374 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 05 08:30:06.074374 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 05 08:30:06.074374 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jun 05 08:30:06.074374 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:06.074374 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:30:06.074374 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:06.074374 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:06.074374 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:30:06.074374 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:30:06.074374 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:30:06.074374 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:30:06.074374 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jun 05 08:30:06.074374 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:06.074374 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b8f5bcc4-22e0-45b4-9131-06cf190e23b7 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:30:06.074374 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b8f5bcc4-22e0-45b4-9131-06cf190e23b7 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.089516 Jun 05 08:30:06.074374 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 920/1859] 10.222.0.33 () {60 vars in 1159 bytes} [Sun Jun 5 08:30:05 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 05 08:30:06.087904 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c90326a1-105d-4730-8ad8-14d19afdc744 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:06.088626 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c90326a1-105d-4730-8ad8-14d19afdc744 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:06.107959 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c90326a1-105d-4730-8ad8-14d19afdc744 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:06.108552 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c90326a1-105d-4730-8ad8-14d19afdc744 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:06.109386 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c90326a1-105d-4730-8ad8-14d19afdc744 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:06.109835 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c90326a1-105d-4730-8ad8-14d19afdc744 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:06.302984 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-1b00f336-452d-41fb-8949-bfc1e5982f66 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:06.327144 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1b00f336-452d-41fb-8949-bfc1e5982f66 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 200 len: 1496 microversion: 2.1 time: 0.420935 Jun 05 08:30:06.340753 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 940/1860] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:05 2022] GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 1496 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:06.358542 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3d58b67b-ef30-4bd0-81b4-196353ade960 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Action: 'create', calling method: .version_select at 0x7f24453fa820>, body: {"keypair": {"name": "tempest-keypair-694190713", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0g2XctYmvw8Y/G1yj0uAz2v2um+yAgzYOtDosvGi1N6XH0yYviNaFrRYwbf45OR4BEwnS5w5nsMA59nbZMF20S5iaPXp9JhG+BJGvpSjdUaB9s+R7hw3CpemeEgeCHrg=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:06.383835 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-3d58b67b-ef30-4bd0-81b4-196353ade960 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Getting quotas for project 38065b59193d43969d49f52e6c8e6277. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:30:06.392790 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-3d58b67b-ef30-4bd0-81b4-196353ade960 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Getting quotas for user 69b94d6721264d369ac892cba9031916 and project 38065b59193d43969d49f52e6c8e6277. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:30:06.397416 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c90326a1-105d-4730-8ad8-14d19afdc744 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:06.435202 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3d58b67b-ef30-4bd0-81b4-196353ade960 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.093163 Jun 05 08:30:06.436109 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 941/1861] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:30:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:30:06.439286 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c90326a1-105d-4730-8ad8-14d19afdc744 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1391 microversion: 2.1 time: 0.364974 Jun 05 08:30:06.440422 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 921/1862] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:06 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1391 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:06.443004 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5a527c6b-2e3a-4b4c-ba9a-9a68c51d8e58 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:06.445777 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5a527c6b-2e3a-4b4c-ba9a-9a68c51d8e58 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:06.456944 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a527c6b-2e3a-4b4c-ba9a-9a68c51d8e58 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:06.458135 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a527c6b-2e3a-4b4c-ba9a-9a68c51d8e58 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:06.459614 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a527c6b-2e3a-4b4c-ba9a-9a68c51d8e58 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:06.460307 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a527c6b-2e3a-4b4c-ba9a-9a68c51d8e58 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:06.461652 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9460ac22-ba6b-4890-9a83-ce5a80b32aa6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:06.464836 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9460ac22-ba6b-4890-9a83-ce5a80b32aa6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:06.483850 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9460ac22-ba6b-4890-9a83-ce5a80b32aa6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:06.486344 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9460ac22-ba6b-4890-9a83-ce5a80b32aa6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:06.490196 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9460ac22-ba6b-4890-9a83-ce5a80b32aa6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:06.490897 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9460ac22-ba6b-4890-9a83-ce5a80b32aa6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:06.511635 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:30:06.557033 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a527c6b-2e3a-4b4c-ba9a-9a68c51d8e58 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:06.558744 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a527c6b-2e3a-4b4c-ba9a-9a68c51d8e58 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:06.559323 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-5a527c6b-2e3a-4b4c-ba9a-9a68c51d8e58 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:30:06.586941 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9460ac22-ba6b-4890-9a83-ce5a80b32aa6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.145432 Jun 05 08:30:06.587973 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 922/1863] 10.222.0.33 () {60 vars in 1342 bytes} [Sun Jun 5 08:30:06 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:30:06.605203 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-037e7766-f9b5-4a15-8d2f-1121f589aeac tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Action: 'create', calling method: .version_select at 0x7f2445440820>, body: {"keypair": {"name": "tempest-keypair-694190713", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJb8nlDM4fdiGr2lxvqMVN3EUFaW5xhRim9aAPnBnH2V7jrpLQKrlBuH4tnrmB3ecF66TTZVBX0wfcMs0I5JAUohjYk1LRaK2XIeNUohg/+PD61VgqVI7lezj5LIhz/TGA=="}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:06.639457 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5a527c6b-2e3a-4b4c-ba9a-9a68c51d8e58 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:06.646377 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-037e7766-f9b5-4a15-8d2f-1121f589aeac tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Getting quotas for project 38065b59193d43969d49f52e6c8e6277. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:30:06.655376 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5a527c6b-2e3a-4b4c-ba9a-9a68c51d8e58 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.217342 Jun 05 08:30:06.657622 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-037e7766-f9b5-4a15-8d2f-1121f589aeac tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Getting quotas for user 69b94d6721264d369ac892cba9031916 and project 38065b59193d43969d49f52e6c8e6277. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:30:06.658343 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 942/1864] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:06 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:06.726867 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-037e7766-f9b5-4a15-8d2f-1121f589aeac tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] HTTP exception thrown: Key pair 'tempest-keypair-694190713' already exists. Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-037e7766-f9b5-4a15-8d2f-1121f589aeac tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Request method failure captured: Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 272 Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGmN2Ci9frrUzW5ZMn_mT5xL-VpKYSTIt5gdZE3IwLWUFP4LPP-gKK8ZmALTjcR0jcXNBPb3pS5mXsKBGTLF3Yx9eALODZIZ1R2gX-c3eBxTTBqHa-i3ofNFAh5Q_ad0EhsU4hPrEwIXdHQ3u6KG2UCS7U87LBLCU2_bEN1RnIYKjh8 Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 38065b59193d43969d49f52e6c8e6277 Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-182244114 Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/38065b59193d43969d49f52e6c8e6277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38065b59193d43969d49f52e6c8e6277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_38065b59193d43969d49f52e6c8e6277", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38065b59193d43969d49f52e6c8e6277"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-KeyPairsNegativeTestJSON-182244114 Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 38065b59193d43969d49f52e6c8e6277 Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-182244114 Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-KeyPairsNegativeTestJSON-182244114-project Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 69b94d6721264d369ac892cba9031916 Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-KeyPairsNegativeTestJSON-182244114-project Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: {"keypair": {"name": "tempest-keypair-694190713", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJb8nlDM4fdiGr2lxvqMVN3EUFaW5xhRim9aAPnBnH2V7jrpLQKrlBuH4tnrmB3ecF66TTZVBX0wfcMs0I5JAUohjYk1LRaK2XIeNUohg/+PD61VgqVI7lezj5LIhz/TGA=="}} Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: exception: Key pair 'tempest-keypair-694190713' already exists. Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-694190713', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJb8nlDM4fdiGr2lxvqMVN3EUFaW5xhRim9aAPnBnH2V7jrpLQKrlBuH4tnrmB3ecF66TTZVBX0wfcMs0I5JAUohjYk1LRaK2XIeNUohg/+PD61VgqVI7lezj5LIhz/TGA=='}}} Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result.read() Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '69b94d6721264d369ac892cba9031916-tempest-keypair-694190713' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jun 05 08:30:06.739894 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi session.flush() Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._flush(objects) Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi compat.raise_( Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi flush_context.execute() Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi rec.execute(self) Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result.read() Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 05 08:30:06.750261 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '69b94d6721264d369ac892cba9031916-tempest-keypair-694190713' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 6, 5, 8, 30, 6, 714211), 'updated_at': None, 'name': 'tempest-keypair-694190713', 'user_id': '69b94d6721264d369ac892cba9031916', 'fingerprint': '46:ca:7f:0b:6a:01:8f:4c:0a:c0:a0:42:ca:1e:e1:6c', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJb8nlDM4fdiGr2lxvqMVN3EUFaW5xhRim9aAPnBnH2V7jrpLQKrlBuH4tnrmB3ecF66TTZVBX0wfcMs0I5JAUohjYk1LRaK2XIeNUohg/+PD61VgqVI7lezj5LIhz/TGA==', 'type': 'ssh'}] Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi keypair.create() Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._create() Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-694190713' already exists. Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jun 05 08:30:06.761971 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-694190713' already exists. Jun 05 08:30:06.773802 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:06.773802 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:30:06.773802 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:06.773802 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:06.773802 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:30:06.773802 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:30:06.773802 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:30:06.773802 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:30:06.773802 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-694190713' already exists. Jun 05 08:30:06.773802 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:06.773802 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-037e7766-f9b5-4a15-8d2f-1121f589aeac tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Returning 409 to user: Key pair 'tempest-keypair-694190713' already exists. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:30:06.773802 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-037e7766-f9b5-4a15-8d2f-1121f589aeac tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.149805 Jun 05 08:30:06.773802 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 923/1865] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:30:06 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 158 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:30:06.777054 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e68d0ab4-9f92-4478-b5af-ab911c401f06 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Calling method '.version_select at 0x7f24453ed8b0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:06.857439 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e68d0ab4-9f92-4478-b5af-ab911c401f06 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-694190713" status: 202 len: 0 microversion: 2.1 time: 0.102886 Jun 05 08:30:06.862285 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 943/1866] 10.222.0.33 () {58 vars in 1217 bytes} [Sun Jun 5 08:30:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-694190713 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:30:06.878165 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7c637052-3b6e-4159-9c03-86a956bb7029 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Action: 'create', calling method: .version_select at 0x7f24454b6940>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFp4/Bs2sDcz5L1WyOX0Dsuzp8CdZ6dUpjkN5f6jIHttHViMgDlzC/Vvtr9c0GKv6xEyDVW5WR4stFxCKnXh4TIwYtM1P5ZgQ3XWGeqrCOzogfcg2eezA6hIjWKmrpUJtw=="}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7c637052-3b6e-4159-9c03-86a956bb7029 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Request method failure captured: Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 247 Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGmN2Ci9frrUzW5ZMn_mT5xL-VpKYSTIt5gdZE3IwLWUFP4LPP-gKK8ZmALTjcR0jcXNBPb3pS5mXsKBGTLF3Yx9eALODZIZ1R2gX-c3eBxTTBqHa-i3ofNFAh5Q_ad0EhsU4hPrEwIXdHQ3u6KG2UCS7U87LBLCU2_bEN1RnIYKjh8 Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 38065b59193d43969d49f52e6c8e6277 Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-182244114 Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/38065b59193d43969d49f52e6c8e6277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38065b59193d43969d49f52e6c8e6277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_38065b59193d43969d49f52e6c8e6277", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38065b59193d43969d49f52e6c8e6277"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-KeyPairsNegativeTestJSON-182244114 Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 38065b59193d43969d49f52e6c8e6277 Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-182244114 Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-KeyPairsNegativeTestJSON-182244114-project Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 69b94d6721264d369ac892cba9031916 Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-KeyPairsNegativeTestJSON-182244114-project Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFp4/Bs2sDcz5L1WyOX0Dsuzp8CdZ6dUpjkN5f6jIHttHViMgDlzC/Vvtr9c0GKv6xEyDVW5WR4stFxCKnXh4TIwYtM1P5ZgQ3XWGeqrCOzogfcg2eezA6hIjWKmrpUJtw=="}} Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: exception: Invalid input for field/attribute name. Value: . '' is too short Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFp4/Bs2sDcz5L1WyOX0Dsuzp8CdZ6dUpjkN5f6jIHttHViMgDlzC/Vvtr9c0GKv6xEyDVW5WR4stFxCKnXh4TIwYtM1P5ZgQ3XWGeqrCOzogfcg2eezA6hIjWKmrpUJtw=='}}} Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise error Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi '' Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 05 08:30:06.886946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 05 08:30:06.891925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 05 08:30:06.891925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 05 08:30:06.891925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 05 08:30:06.891925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 05 08:30:06.891925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jun 05 08:30:06.891925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:06.891925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:30:06.891925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:06.891925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:06.891925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:30:06.891925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:30:06.891925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 05 08:30:06.891925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 05 08:30:06.891925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jun 05 08:30:06.891925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:06.891925 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7c637052-3b6e-4159-9c03-86a956bb7029 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:30:06.891925 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7c637052-3b6e-4159-9c03-86a956bb7029 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.019225 Jun 05 08:30:06.896815 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 924/1867] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:30:06 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 05 08:30:06.919464 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6f2836ac-a629-4eca-8fe6-f95697782b42 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Action: 'create', calling method: .version_select at 0x7f2433759b80>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1665740520", "public_key": " "}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:06.937821 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-45a4ac90-ef68-4bc7-8c75-79a6e7b60fc0 req-a704370e-efc2-4f5a-9911-cd111ead480b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40933e98-d7d3-4d63-9012-ad5607e45085", "tag": "07c8ff98-a22e-410d-9341-f7e044856815"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:06.967222 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-6f2836ac-a629-4eca-8fe6-f95697782b42 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Getting quotas for project 38065b59193d43969d49f52e6c8e6277. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:30:06.975007 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-45a4ac90-ef68-4bc7-8c75-79a6e7b60fc0 req-a704370e-efc2-4f5a-9911-cd111ead480b service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:06.979042 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-45a4ac90-ef68-4bc7-8c75-79a6e7b60fc0 req-a704370e-efc2-4f5a-9911-cd111ead480b service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:06.994296 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-6f2836ac-a629-4eca-8fe6-f95697782b42 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Getting quotas for user 69b94d6721264d369ac892cba9031916 and project 38065b59193d43969d49f52e6c8e6277. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:30:07.030706 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-6f2836ac-a629-4eca-8fe6-f95697782b42 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6f2836ac-a629-4eca-8fe6-f95697782b42 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Request method failure captured: Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 95 Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGmN2Ci9frrUzW5ZMn_mT5xL-VpKYSTIt5gdZE3IwLWUFP4LPP-gKK8ZmALTjcR0jcXNBPb3pS5mXsKBGTLF3Yx9eALODZIZ1R2gX-c3eBxTTBqHa-i3ofNFAh5Q_ad0EhsU4hPrEwIXdHQ3u6KG2UCS7U87LBLCU2_bEN1RnIYKjh8 Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 38065b59193d43969d49f52e6c8e6277 Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-182244114 Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/38065b59193d43969d49f52e6c8e6277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38065b59193d43969d49f52e6c8e6277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_38065b59193d43969d49f52e6c8e6277", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38065b59193d43969d49f52e6c8e6277"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-KeyPairsNegativeTestJSON-182244114 Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 38065b59193d43969d49f52e6c8e6277 Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-182244114 Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-KeyPairsNegativeTestJSON-182244114-project Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 69b94d6721264d369ac892cba9031916 Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-KeyPairsNegativeTestJSON-182244114-project Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1665740520", "public_key": " "}} Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: exception: Keypair data is invalid: failed to generate fingerprint Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1665740520', 'public_key': ' '}}} Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:30:07.033966 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:07.039305 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:30:07.039305 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:30:07.039305 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:30:07.039305 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:30:07.039305 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:30:07.039305 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:30:07.039305 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:30:07.039305 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:30:07.039305 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:30:07.039305 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:30:07.039305 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:30:07.039305 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:30:07.039305 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 05 08:30:07.039305 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 05 08:30:07.039305 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 05 08:30:07.039305 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 05 08:30:07.039305 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jun 05 08:30:07.039305 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:30:07.039305 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:30:07.039305 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:30:07.039305 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:07.039305 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:30:07.039305 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:30:07.039305 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:30:07.039305 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:30:07.039305 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jun 05 08:30:07.039305 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:30:07.043954 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-45a4ac90-ef68-4bc7-8c75-79a6e7b60fc0 req-a704370e-efc2-4f5a-9911-cd111ead480b service nova] Creating event network-changed:07c8ff98-a22e-410d-9341-f7e044856815 for instance 40933e98-d7d3-4d63-9012-ad5607e45085 on n-h1-844739-1 Jun 05 08:30:07.044483 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6f2836ac-a629-4eca-8fe6-f95697782b42 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:30:07.045617 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6f2836ac-a629-4eca-8fe6-f95697782b42 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.144229 Jun 05 08:30:07.059572 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 944/1868] 10.222.0.33 () {60 vars in 1157 bytes} [Sun Jun 5 08:30:06 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 159 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 05 08:30:07.065784 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-45a4ac90-ef68-4bc7-8c75-79a6e7b60fc0 req-a704370e-efc2-4f5a-9911-cd111ead480b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131525 Jun 05 08:30:07.066289 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-059c524b-37d2-42c5-a640-ba4b43cb3ca6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:07.069460 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-059c524b-37d2-42c5-a640-ba4b43cb3ca6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:07.071539 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 925/1869] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:30:07.076695 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-059c524b-37d2-42c5-a640-ba4b43cb3ca6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:07.078307 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-059c524b-37d2-42c5-a640-ba4b43cb3ca6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:07.082305 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-059c524b-37d2-42c5-a640-ba4b43cb3ca6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:07.083864 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c65dcfcb-f906-43a2-b539-1701c1712a63 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Action: 'create', calling method: .version_select at 0x7f2433d739d0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQ5DbFdvUOUMO6kZ3VY6jC0qF/9Tv8C0E9LUeLX7/bLufdQGA3/sQIZJ2+yyg7ZSpwfP8nQfasXxjXBleKtPbKfqCR26dHT3dEauQkG1AjYNMLYEMZgzDm4V5p7Jcm+Kg=="}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:07.084066 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-059c524b-37d2-42c5-a640-ba4b43cb3ca6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c65dcfcb-f906-43a2-b539-1701c1712a63 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Request method failure captured: Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 507 Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGmN2Ci9frrUzW5ZMn_mT5xL-VpKYSTIt5gdZE3IwLWUFP4LPP-gKK8ZmALTjcR0jcXNBPb3pS5mXsKBGTLF3Yx9eALODZIZ1R2gX-c3eBxTTBqHa-i3ofNFAh5Q_ad0EhsU4hPrEwIXdHQ3u6KG2UCS7U87LBLCU2_bEN1RnIYKjh8 Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 38065b59193d43969d49f52e6c8e6277 Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-182244114 Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/38065b59193d43969d49f52e6c8e6277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38065b59193d43969d49f52e6c8e6277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_38065b59193d43969d49f52e6c8e6277", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38065b59193d43969d49f52e6c8e6277"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-KeyPairsNegativeTestJSON-182244114 Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 38065b59193d43969d49f52e6c8e6277 Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-182244114 Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-KeyPairsNegativeTestJSON-182244114-project Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 69b94d6721264d369ac892cba9031916 Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-KeyPairsNegativeTestJSON-182244114-project Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQ5DbFdvUOUMO6kZ3VY6jC0qF/9Tv8C0E9LUeLX7/bLufdQGA3/sQIZJ2+yyg7ZSpwfP8nQfasXxjXBleKtPbKfqCR26dHT3dEauQkG1AjYNMLYEMZgzDm4V5p7Jcm+Kg=="}} Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQ5DbFdvUOUMO6kZ3VY6jC0qF/9Tv8C0E9LUeLX7/bLufdQGA3/sQIZJ2+yyg7ZSpwfP8nQfasXxjXBleKtPbKfqCR26dHT3dEauQkG1AjYNMLYEMZgzDm4V5p7Jcm+Kg=='}}} Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise error Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jun 05 08:30:07.092709 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:07.095834 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:30:07.095834 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:07.095834 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:07.095834 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:30:07.095834 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:30:07.095834 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:30:07.095834 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:30:07.095834 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:30:07.095834 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:30:07.095834 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:30:07.095834 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:30:07.095834 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:30:07.095834 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:30:07.095834 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 05 08:30:07.095834 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 05 08:30:07.095834 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 05 08:30:07.095834 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 05 08:30:07.095834 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 05 08:30:07.095834 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 05 08:30:07.095834 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 05 08:30:07.095834 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:07.095834 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:30:07.095834 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:07.095834 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:07.095834 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:30:07.095834 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:30:07.095834 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 05 08:30:07.095834 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 05 08:30:07.095834 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 05 08:30:07.095834 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:07.101395 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c65dcfcb-f906-43a2-b539-1701c1712a63 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:30:07.103877 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c65dcfcb-f906-43a2-b539-1701c1712a63 tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.030452 Jun 05 08:30:07.105556 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 926/1870] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:30:07 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 05 08:30:07.137154 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5b9c684b-6ef7-4502-896f-5e10d952befa tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Action: 'create', calling method: .version_select at 0x7f244549edc0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1956118732", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:07.194991 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-5b9c684b-6ef7-4502-896f-5e10d952befa tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Getting quotas for project 38065b59193d43969d49f52e6c8e6277. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:30:07.214719 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-5b9c684b-6ef7-4502-896f-5e10d952befa tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Getting quotas for user 69b94d6721264d369ac892cba9031916 and project 38065b59193d43969d49f52e6c8e6277. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:30:07.245040 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-5b9c684b-6ef7-4502-896f-5e10d952befa tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5b9c684b-6ef7-4502-896f-5e10d952befa tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Request method failure captured: Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 118 Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGmN2Ci9frrUzW5ZMn_mT5xL-VpKYSTIt5gdZE3IwLWUFP4LPP-gKK8ZmALTjcR0jcXNBPb3pS5mXsKBGTLF3Yx9eALODZIZ1R2gX-c3eBxTTBqHa-i3ofNFAh5Q_ad0EhsU4hPrEwIXdHQ3u6KG2UCS7U87LBLCU2_bEN1RnIYKjh8 Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 38065b59193d43969d49f52e6c8e6277 Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-182244114 Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/38065b59193d43969d49f52e6c8e6277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38065b59193d43969d49f52e6c8e6277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_38065b59193d43969d49f52e6c8e6277", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38065b59193d43969d49f52e6c8e6277"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-KeyPairsNegativeTestJSON-182244114 Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 38065b59193d43969d49f52e6c8e6277 Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-182244114 Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-KeyPairsNegativeTestJSON-182244114-project Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 69b94d6721264d369ac892cba9031916 Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-KeyPairsNegativeTestJSON-182244114-project Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1956118732", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: exception: Keypair data is invalid: failed to generate fingerprint Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1956118732', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jun 05 08:30:07.248740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jun 05 08:30:07.253736 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:07.256449 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5b9c684b-6ef7-4502-896f-5e10d952befa tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:30:07.259067 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5b9c684b-6ef7-4502-896f-5e10d952befa tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.141876 Jun 05 08:30:07.263420 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 927/1871] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:30:07 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 05 08:30:07.272941 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5363bf22-f096-4e87-bb38-8cdb3722e9fd tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Calling method '.version_select at 0x7f24454a8ee0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:07.295415 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-5363bf22-f096-4e87-bb38-8cdb3722e9fd tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1913097815 not found for user 69b94d6721264d369ac892cba9031916 Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5363bf22-f096-4e87-bb38-8cdb3722e9fd tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Request method failure captured: Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1913097815 HTTP/1.1 Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGmN2Ci9frrUzW5ZMn_mT5xL-VpKYSTIt5gdZE3IwLWUFP4LPP-gKK8ZmALTjcR0jcXNBPb3pS5mXsKBGTLF3Yx9eALODZIZ1R2gX-c3eBxTTBqHa-i3ofNFAh5Q_ad0EhsU4hPrEwIXdHQ3u6KG2UCS7U87LBLCU2_bEN1RnIYKjh8 Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 38065b59193d43969d49f52e6c8e6277 Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-182244114 Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/38065b59193d43969d49f52e6c8e6277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38065b59193d43969d49f52e6c8e6277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_38065b59193d43969d49f52e6c8e6277", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38065b59193d43969d49f52e6c8e6277"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-KeyPairsNegativeTestJSON-182244114 Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 38065b59193d43969d49f52e6c8e6277 Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-182244114 Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-KeyPairsNegativeTestJSON-182244114-project Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 69b94d6721264d369ac892cba9031916 Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-KeyPairsNegativeTestJSON-182244114-project Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: exception: Keypair tempest-keypair-non-existent-1913097815 not found for user 69b94d6721264d369ac892cba9031916 Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'tempest-keypair-non-existent-1913097815'} Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1913097815 not found for user 69b94d6721264d369ac892cba9031916 Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:07.297973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:30:07.302908 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:07.302908 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:07.302908 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:30:07.302908 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:30:07.302908 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:30:07.302908 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:30:07.302908 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:30:07.302908 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:30:07.302908 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 05 08:30:07.302908 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:30:07.302908 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:30:07.302908 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:30:07.302908 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jun 05 08:30:07.302908 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jun 05 08:30:07.302908 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jun 05 08:30:07.302908 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jun 05 08:30:07.302908 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1913097815 not found for user 69b94d6721264d369ac892cba9031916 Jun 05 08:30:07.302908 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:07.302908 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:30:07.302908 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:07.302908 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:07.302908 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:30:07.302908 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:30:07.302908 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:30:07.302908 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:30:07.302908 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1913097815 not found for user 69b94d6721264d369ac892cba9031916 Jun 05 08:30:07.302908 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:07.307973 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5363bf22-f096-4e87-bb38-8cdb3722e9fd tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1913097815 not found for user 69b94d6721264d369ac892cba9031916 {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:30:07.307973 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5363bf22-f096-4e87-bb38-8cdb3722e9fd tempest-KeyPairsNegativeTestJSON-182244114 tempest-KeyPairsNegativeTestJSON-182244114-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1913097815" status: 404 len: 145 microversion: 2.1 time: 0.039073 Jun 05 08:30:07.308560 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 928/1872] 10.222.0.33 () {58 vars in 1259 bytes} [Sun Jun 5 08:30:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1913097815 => generated 145 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:30:07.346789 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d03a773b-8d03-4f44-b23e-8c4dee05e796 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:07.347533 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d03a773b-8d03-4f44-b23e-8c4dee05e796 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:07.359900 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d03a773b-8d03-4f44-b23e-8c4dee05e796 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:07.360136 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d03a773b-8d03-4f44-b23e-8c4dee05e796 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:07.373256 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d03a773b-8d03-4f44-b23e-8c4dee05e796 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:07.373963 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d03a773b-8d03-4f44-b23e-8c4dee05e796 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:07.510762 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-059c524b-37d2-42c5-a640-ba4b43cb3ca6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:07.531897 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-059c524b-37d2-42c5-a640-ba4b43cb3ca6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:07.533489 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-059c524b-37d2-42c5-a640-ba4b43cb3ca6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:07.534905 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-059c524b-37d2-42c5-a640-ba4b43cb3ca6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1860 microversion: 2.42 time: 0.473573 Jun 05 08:30:07.536328 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 945/1873] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:07 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1860 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:07.554108 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b9004be5-943c-4cb6-8bf6-0df719a24ed1 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:07.554789 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b9004be5-943c-4cb6-8bf6-0df719a24ed1 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:07.572214 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b9004be5-943c-4cb6-8bf6-0df719a24ed1 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:07.572961 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b9004be5-943c-4cb6-8bf6-0df719a24ed1 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:07.574561 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b9004be5-943c-4cb6-8bf6-0df719a24ed1 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:07.576747 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b9004be5-943c-4cb6-8bf6-0df719a24ed1 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:07.843370 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d03a773b-8d03-4f44-b23e-8c4dee05e796 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:07.857149 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d03a773b-8d03-4f44-b23e-8c4dee05e796 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 200 len: 1496 microversion: 2.1 time: 0.514737 Jun 05 08:30:07.860156 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 929/1874] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:07 2022] GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 1496 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:30:07.867077 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b9004be5-943c-4cb6-8bf6-0df719a24ed1 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:07.880791 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-283e7e9b-5a9e-4b62-b843-87c9724a7bbe tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:07.884576 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b9004be5-943c-4cb6-8bf6-0df719a24ed1 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1391 microversion: 2.1 time: 0.333892 Jun 05 08:30:07.886833 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 946/1875] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:07 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1391 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:07.890832 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-283e7e9b-5a9e-4b62-b843-87c9724a7bbe tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:07.895041 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c7bb8ca6-fbf9-4b87-83db-89329a2b8dba tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:07.896520 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c7bb8ca6-fbf9-4b87-83db-89329a2b8dba tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:07.903504 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-283e7e9b-5a9e-4b62-b843-87c9724a7bbe tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:07.905160 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-283e7e9b-5a9e-4b62-b843-87c9724a7bbe tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:07.909283 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-283e7e9b-5a9e-4b62-b843-87c9724a7bbe tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:07.910382 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-283e7e9b-5a9e-4b62-b843-87c9724a7bbe tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:07.911618 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c7bb8ca6-fbf9-4b87-83db-89329a2b8dba tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:07.916203 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c7bb8ca6-fbf9-4b87-83db-89329a2b8dba tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:07.917355 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c7bb8ca6-fbf9-4b87-83db-89329a2b8dba tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:07.918525 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c7bb8ca6-fbf9-4b87-83db-89329a2b8dba tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:07.965145 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=100 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:30:07.998378 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-283e7e9b-5a9e-4b62-b843-87c9724a7bbe tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.134295 Jun 05 08:30:07.999379 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 930/1876] 10.222.0.33 () {60 vars in 1342 bytes} [Sun Jun 5 08:30:07 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:30:08.011963 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c7bb8ca6-fbf9-4b87-83db-89329a2b8dba tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:08.014446 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c7bb8ca6-fbf9-4b87-83db-89329a2b8dba tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:08.016852 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-c7bb8ca6-fbf9-4b87-83db-89329a2b8dba tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:30:08.111693 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c7bb8ca6-fbf9-4b87-83db-89329a2b8dba tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:08.121192 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c7bb8ca6-fbf9-4b87-83db-89329a2b8dba tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.234158 Jun 05 08:30:08.130387 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 947/1877] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:07 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:08.554655 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-70e8d6be-428c-456a-b4ea-2944c7eace4f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:08.555198 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-70e8d6be-428c-456a-b4ea-2944c7eace4f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:08.595542 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-70e8d6be-428c-456a-b4ea-2944c7eace4f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:08.596008 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-70e8d6be-428c-456a-b4ea-2944c7eace4f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:08.596852 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-70e8d6be-428c-456a-b4ea-2944c7eace4f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:08.597303 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-70e8d6be-428c-456a-b4ea-2944c7eace4f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:08.877894 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bb86f550-d83b-4f3b-b355-8136b4b997db tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:08.880682 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-bb86f550-d83b-4f3b-b355-8136b4b997db tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:08.897635 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bb86f550-d83b-4f3b-b355-8136b4b997db tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:08.899964 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bb86f550-d83b-4f3b-b355-8136b4b997db tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:08.900858 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bb86f550-d83b-4f3b-b355-8136b4b997db tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:08.901528 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bb86f550-d83b-4f3b-b355-8136b4b997db tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:08.984173 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-70e8d6be-428c-456a-b4ea-2944c7eace4f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:09.018154 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-70e8d6be-428c-456a-b4ea-2944c7eace4f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:09.021313 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-70e8d6be-428c-456a-b4ea-2944c7eace4f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:09.022744 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-70e8d6be-428c-456a-b4ea-2944c7eace4f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.472424 Jun 05 08:30:09.036426 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 931/1878] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:08 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:09.046606 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-059b1a28-7152-4ddd-9c23-5d52d6d1b981 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:09.047471 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-059b1a28-7152-4ddd-9c23-5d52d6d1b981 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:09.057441 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-059b1a28-7152-4ddd-9c23-5d52d6d1b981 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:09.058130 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-059b1a28-7152-4ddd-9c23-5d52d6d1b981 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:09.059174 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-059b1a28-7152-4ddd-9c23-5d52d6d1b981 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:09.059941 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-059b1a28-7152-4ddd-9c23-5d52d6d1b981 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:09.380954 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-bb86f550-d83b-4f3b-b355-8136b4b997db tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:09.389339 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bb86f550-d83b-4f3b-b355-8136b4b997db tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 200 len: 1496 microversion: 2.1 time: 0.515833 Jun 05 08:30:09.395962 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 948/1879] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:08 2022] GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 1496 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:09.401388 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-54db374e-3f73-40e7-ba71-b2f2dfaef2af tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:09.402373 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-54db374e-3f73-40e7-ba71-b2f2dfaef2af tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:09.431507 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-54db374e-3f73-40e7-ba71-b2f2dfaef2af tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:09.432297 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-54db374e-3f73-40e7-ba71-b2f2dfaef2af tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:09.433335 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-54db374e-3f73-40e7-ba71-b2f2dfaef2af tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:09.434016 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-54db374e-3f73-40e7-ba71-b2f2dfaef2af tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:09.512604 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-54db374e-3f73-40e7-ba71-b2f2dfaef2af tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.115188 Jun 05 08:30:09.513994 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 949/1880] 10.222.0.33 () {60 vars in 1342 bytes} [Sun Jun 5 08:30:09 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:30:09.521240 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-2cbe46eb-b200-4f4a-9cc7-9daf08515eaa req-9756c07c-1023-4cb0-9d5a-478df2c8c490 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40933e98-d7d3-4d63-9012-ad5607e45085", "tag": "cb457b77-bef8-4764-bb0e-ace5a2c35d93"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:09.526655 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-059b1a28-7152-4ddd-9c23-5d52d6d1b981 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:09.545262 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-2cbe46eb-b200-4f4a-9cc7-9daf08515eaa req-9756c07c-1023-4cb0-9d5a-478df2c8c490 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:09.546248 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-059b1a28-7152-4ddd-9c23-5d52d6d1b981 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1391 microversion: 2.1 time: 0.505114 Jun 05 08:30:09.547347 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 932/1881] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:09 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1391 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:09.547503 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-2cbe46eb-b200-4f4a-9cc7-9daf08515eaa req-9756c07c-1023-4cb0-9d5a-478df2c8c490 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:09.562758 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d016ec75-a87a-4478-b54c-0ae901bbc54c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:09.562995 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d016ec75-a87a-4478-b54c-0ae901bbc54c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:09.570582 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d016ec75-a87a-4478-b54c-0ae901bbc54c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:09.571234 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d016ec75-a87a-4478-b54c-0ae901bbc54c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:09.572339 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d016ec75-a87a-4478-b54c-0ae901bbc54c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:09.572815 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d016ec75-a87a-4478-b54c-0ae901bbc54c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:09.577905 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:30:09.591126 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-2cbe46eb-b200-4f4a-9cc7-9daf08515eaa req-9756c07c-1023-4cb0-9d5a-478df2c8c490 service nova] Creating event network-changed:cb457b77-bef8-4764-bb0e-ace5a2c35d93 for instance 40933e98-d7d3-4d63-9012-ad5607e45085 on n-h1-844739-1 Jun 05 08:30:09.607787 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-2cbe46eb-b200-4f4a-9cc7-9daf08515eaa req-9756c07c-1023-4cb0-9d5a-478df2c8c490 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085806 Jun 05 08:30:09.609854 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 950/1882] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:30:09.667039 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d016ec75-a87a-4478-b54c-0ae901bbc54c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:09.667508 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d016ec75-a87a-4478-b54c-0ae901bbc54c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:09.667984 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-d016ec75-a87a-4478-b54c-0ae901bbc54c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:30:09.777783 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d016ec75-a87a-4478-b54c-0ae901bbc54c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:09.800651 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d016ec75-a87a-4478-b54c-0ae901bbc54c tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.252097 Jun 05 08:30:09.815513 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 933/1883] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:09 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:10.045226 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-de07e2c0-29b7-4962-a375-051229f3a2fa tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:10.045930 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-de07e2c0-29b7-4962-a375-051229f3a2fa tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:10.069252 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-de07e2c0-29b7-4962-a375-051229f3a2fa tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:10.069643 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-de07e2c0-29b7-4962-a375-051229f3a2fa tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:10.070435 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-de07e2c0-29b7-4962-a375-051229f3a2fa tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:10.070863 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-de07e2c0-29b7-4962-a375-051229f3a2fa tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:10.408996 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fe35a45b-66ac-434a-acff-b3f380cd41e3 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:10.410369 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-fe35a45b-66ac-434a-acff-b3f380cd41e3 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:10.425113 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fe35a45b-66ac-434a-acff-b3f380cd41e3 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:10.428429 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fe35a45b-66ac-434a-acff-b3f380cd41e3 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:10.431799 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fe35a45b-66ac-434a-acff-b3f380cd41e3 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:10.431799 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fe35a45b-66ac-434a-acff-b3f380cd41e3 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:10.646400 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-de07e2c0-29b7-4962-a375-051229f3a2fa tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:10.671576 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-de07e2c0-29b7-4962-a375-051229f3a2fa tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:10.676231 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-de07e2c0-29b7-4962-a375-051229f3a2fa tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:10.692861 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-de07e2c0-29b7-4962-a375-051229f3a2fa tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.651542 Jun 05 08:30:10.693448 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 951/1884] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:10 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:10.715120 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-11d0cf59-67b2-491f-8121-efefdf58e283 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:10.716084 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-11d0cf59-67b2-491f-8121-efefdf58e283 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:10.733534 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-11d0cf59-67b2-491f-8121-efefdf58e283 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:10.734218 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-11d0cf59-67b2-491f-8121-efefdf58e283 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:10.737782 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-11d0cf59-67b2-491f-8121-efefdf58e283 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:10.739023 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-11d0cf59-67b2-491f-8121-efefdf58e283 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:10.742239 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-fe35a45b-66ac-434a-acff-b3f380cd41e3 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:10.752018 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fe35a45b-66ac-434a-acff-b3f380cd41e3 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 200 len: 1496 microversion: 2.1 time: 0.347089 Jun 05 08:30:10.771397 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 934/1885] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:10 2022] GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 1496 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:30:10.787114 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c702abcd-2ba1-429b-ad14-ace0acbe0c4b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:10.787781 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c702abcd-2ba1-429b-ad14-ace0acbe0c4b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:10.803362 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c702abcd-2ba1-429b-ad14-ace0acbe0c4b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:10.805110 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c702abcd-2ba1-429b-ad14-ace0acbe0c4b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:10.809934 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c702abcd-2ba1-429b-ad14-ace0acbe0c4b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:10.812003 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c702abcd-2ba1-429b-ad14-ace0acbe0c4b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:10.858539 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-11d0cf59-67b2-491f-8121-efefdf58e283 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.163994 Jun 05 08:30:10.861394 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 952/1886] 10.222.0.33 () {60 vars in 1342 bytes} [Sun Jun 5 08:30:10 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:30:10.873123 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-34d9e6e2-40c1-47a6-b0f1-b937365c2de5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:10.873742 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-34d9e6e2-40c1-47a6-b0f1-b937365c2de5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:10.889307 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-34d9e6e2-40c1-47a6-b0f1-b937365c2de5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:10.889764 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-34d9e6e2-40c1-47a6-b0f1-b937365c2de5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:10.890766 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-34d9e6e2-40c1-47a6-b0f1-b937365c2de5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:10.891975 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-34d9e6e2-40c1-47a6-b0f1-b937365c2de5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:10.985636 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-34d9e6e2-40c1-47a6-b0f1-b937365c2de5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:10.986089 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-34d9e6e2-40c1-47a6-b0f1-b937365c2de5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:10.986732 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-34d9e6e2-40c1-47a6-b0f1-b937365c2de5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:30:11.152649 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-34d9e6e2-40c1-47a6-b0f1-b937365c2de5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:11.161326 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-34d9e6e2-40c1-47a6-b0f1-b937365c2de5 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.298331 Jun 05 08:30:11.170337 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 953/1887] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:10 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:11.179900 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c702abcd-2ba1-429b-ad14-ace0acbe0c4b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:11.191816 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c702abcd-2ba1-429b-ad14-ace0acbe0c4b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1391 microversion: 2.1 time: 0.418728 Jun 05 08:30:11.193615 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 935/1888] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:10 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1391 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:11.634382 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-be95154b-bd0d-4b81-a4e6-2d1d670dbd4e req-1f22d3a9-2d69-463b-bfbe-8005383c9009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40933e98-d7d3-4d63-9012-ad5607e45085", "tag": "50f3c778-e1df-4dd9-ba33-fc1897f015e1"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:11.656184 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-be95154b-bd0d-4b81-a4e6-2d1d670dbd4e req-1f22d3a9-2d69-463b-bfbe-8005383c9009 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:11.657081 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-be95154b-bd0d-4b81-a4e6-2d1d670dbd4e req-1f22d3a9-2d69-463b-bfbe-8005383c9009 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:11.700082 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-be95154b-bd0d-4b81-a4e6-2d1d670dbd4e req-1f22d3a9-2d69-463b-bfbe-8005383c9009 service nova] Creating event network-changed:50f3c778-e1df-4dd9-ba33-fc1897f015e1 for instance 40933e98-d7d3-4d63-9012-ad5607e45085 on n-h1-844739-1 Jun 05 08:30:11.705721 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-be95154b-bd0d-4b81-a4e6-2d1d670dbd4e req-1f22d3a9-2d69-463b-bfbe-8005383c9009 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078252 Jun 05 08:30:11.706639 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 954/1889] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:30:11.721059 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0871c8cc-17d1-4921-b075-c626810b04a1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:11.727068 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0871c8cc-17d1-4921-b075-c626810b04a1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:11.741751 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0871c8cc-17d1-4921-b075-c626810b04a1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:11.742586 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0871c8cc-17d1-4921-b075-c626810b04a1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:11.743636 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0871c8cc-17d1-4921-b075-c626810b04a1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:11.745081 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0871c8cc-17d1-4921-b075-c626810b04a1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:11.773032 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-768b2814-cf75-41a8-8474-b85971d33400 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:11.774147 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-768b2814-cf75-41a8-8474-b85971d33400 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:11.788913 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-768b2814-cf75-41a8-8474-b85971d33400 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:11.789379 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-768b2814-cf75-41a8-8474-b85971d33400 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:11.792302 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-768b2814-cf75-41a8-8474-b85971d33400 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:11.795538 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-768b2814-cf75-41a8-8474-b85971d33400 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:12.223966 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-768b2814-cf75-41a8-8474-b85971d33400 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:12.239075 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-768b2814-cf75-41a8-8474-b85971d33400 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 200 len: 1496 microversion: 2.1 time: 0.467476 Jun 05 08:30:12.240392 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 955/1890] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:11 2022] GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 1496 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:30:12.255506 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-edcbb1af-9ef4-4b54-a423-158e1212d5be tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:12.257028 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-edcbb1af-9ef4-4b54-a423-158e1212d5be tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:12.269392 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-edcbb1af-9ef4-4b54-a423-158e1212d5be tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:12.272774 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-edcbb1af-9ef4-4b54-a423-158e1212d5be tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:12.275271 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-edcbb1af-9ef4-4b54-a423-158e1212d5be tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:12.277640 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-edcbb1af-9ef4-4b54-a423-158e1212d5be tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:12.367418 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-edcbb1af-9ef4-4b54-a423-158e1212d5be tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.120679 Jun 05 08:30:12.369915 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 956/1891] 10.222.0.33 () {60 vars in 1342 bytes} [Sun Jun 5 08:30:12 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:30:12.387925 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a469c233-7af5-4132-bade-10249d139179 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:12.392621 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a469c233-7af5-4132-bade-10249d139179 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:12.409549 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0871c8cc-17d1-4921-b075-c626810b04a1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:12.418369 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a469c233-7af5-4132-bade-10249d139179 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:12.422396 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0871c8cc-17d1-4921-b075-c626810b04a1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:12.422751 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a469c233-7af5-4132-bade-10249d139179 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:12.423843 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a469c233-7af5-4132-bade-10249d139179 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:12.423979 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0871c8cc-17d1-4921-b075-c626810b04a1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:12.424904 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a469c233-7af5-4132-bade-10249d139179 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:12.425166 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0871c8cc-17d1-4921-b075-c626810b04a1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.710888 Jun 05 08:30:12.443809 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 936/1892] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:11 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:12.452641 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1f71a9cb-df4c-43de-96fc-805682bb12c6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:12.456317 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1f71a9cb-df4c-43de-96fc-805682bb12c6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:12.474170 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1f71a9cb-df4c-43de-96fc-805682bb12c6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:12.481451 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1f71a9cb-df4c-43de-96fc-805682bb12c6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:12.482983 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1f71a9cb-df4c-43de-96fc-805682bb12c6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:12.483943 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1f71a9cb-df4c-43de-96fc-805682bb12c6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:12.515536 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a469c233-7af5-4132-bade-10249d139179 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:12.515989 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a469c233-7af5-4132-bade-10249d139179 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:12.516472 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-a469c233-7af5-4132-bade-10249d139179 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:30:12.609688 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a469c233-7af5-4132-bade-10249d139179 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:12.624928 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a469c233-7af5-4132-bade-10249d139179 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.252730 Jun 05 08:30:12.625824 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 957/1893] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:12 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:12.697618 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7a16841a-d2f1-46e4-9010-7dadedbf0cbb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-444904223", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "a7010e4a-eda5-41d8-af56-68a4d3196193"}], "block_device_mapping_v2": [{"uuid": "bd869467-9542-4d70-a58b-d1b38b2b3b7a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:13.241057 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1f71a9cb-df4c-43de-96fc-805682bb12c6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:13.254847 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1f71a9cb-df4c-43de-96fc-805682bb12c6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1391 microversion: 2.1 time: 0.808739 Jun 05 08:30:13.262559 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 937/1894] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:12 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1391 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:13.268873 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d0ba5014-e705-489c-b359-b5eff140b7ee tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:13.269789 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d0ba5014-e705-489c-b359-b5eff140b7ee tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:13.287532 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d0ba5014-e705-489c-b359-b5eff140b7ee tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:13.287999 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d0ba5014-e705-489c-b359-b5eff140b7ee tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:13.288814 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d0ba5014-e705-489c-b359-b5eff140b7ee tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:13.289263 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d0ba5014-e705-489c-b359-b5eff140b7ee tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:13.650743 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d0ba5014-e705-489c-b359-b5eff140b7ee tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:13.664575 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d0ba5014-e705-489c-b359-b5eff140b7ee tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 200 len: 1496 microversion: 2.1 time: 0.400485 Jun 05 08:30:13.665574 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 938/1895] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:13 2022] GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 1496 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:13.678433 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fc90ed03-e230-4b26-b3a1-a85ca9337277 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:13.686176 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-fc90ed03-e230-4b26-b3a1-a85ca9337277 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:13.709187 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fc90ed03-e230-4b26-b3a1-a85ca9337277 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:13.709909 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fc90ed03-e230-4b26-b3a1-a85ca9337277 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:13.711454 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fc90ed03-e230-4b26-b3a1-a85ca9337277 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:13.714127 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fc90ed03-e230-4b26-b3a1-a85ca9337277 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:13.810992 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fc90ed03-e230-4b26-b3a1-a85ca9337277 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.133407 Jun 05 08:30:13.812941 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 939/1896] 10.222.0.33 () {60 vars in 1342 bytes} [Sun Jun 5 08:30:13 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045/os-volume_attachments => generated 25 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:13.831300 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-36615873-fde5-4abb-9b10-03d814ef96ba tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:13.832624 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-36615873-fde5-4abb-9b10-03d814ef96ba tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:13.847099 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-36615873-fde5-4abb-9b10-03d814ef96ba tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:13.852137 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-36615873-fde5-4abb-9b10-03d814ef96ba tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:13.853819 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-36615873-fde5-4abb-9b10-03d814ef96ba tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:13.859311 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-36615873-fde5-4abb-9b10-03d814ef96ba tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:14.288172 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-36615873-fde5-4abb-9b10-03d814ef96ba tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:14.308303 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-36615873-fde5-4abb-9b10-03d814ef96ba tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:14.315531 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-36615873-fde5-4abb-9b10-03d814ef96ba tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:14.317378 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-36615873-fde5-4abb-9b10-03d814ef96ba tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.503217 Jun 05 08:30:14.323954 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 940/1897] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:13 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:14.334128 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c8bd825c-31b7-4425-a407-c0cdeded3869 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:14.337294 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c8bd825c-31b7-4425-a407-c0cdeded3869 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:14.348977 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:30:14.350780 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c8bd825c-31b7-4425-a407-c0cdeded3869 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:14.351428 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c8bd825c-31b7-4425-a407-c0cdeded3869 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:14.352402 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c8bd825c-31b7-4425-a407-c0cdeded3869 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:14.353003 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c8bd825c-31b7-4425-a407-c0cdeded3869 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:14.444606 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c8bd825c-31b7-4425-a407-c0cdeded3869 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:14.445463 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c8bd825c-31b7-4425-a407-c0cdeded3869 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:14.445561 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-c8bd825c-31b7-4425-a407-c0cdeded3869 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:30:14.490548 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c8bd825c-31b7-4425-a407-c0cdeded3869 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:14.509666 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c8bd825c-31b7-4425-a407-c0cdeded3869 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.184104 Jun 05 08:30:14.520106 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 941/1898] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:14 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:14.525053 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-fdc95233-f074-47eb-bf99-8b59a986ccda req-dc9551dc-c3b6-423a-b6ab-0c5605a176a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40933e98-d7d3-4d63-9012-ad5607e45085", "tag": "2f3b34fc-705b-4063-a0c0-7ed026c1ebba"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:14.534408 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-fdc95233-f074-47eb-bf99-8b59a986ccda req-dc9551dc-c3b6-423a-b6ab-0c5605a176a8 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:14.534868 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-fdc95233-f074-47eb-bf99-8b59a986ccda req-dc9551dc-c3b6-423a-b6ab-0c5605a176a8 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:14.546442 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-fdc95233-f074-47eb-bf99-8b59a986ccda req-dc9551dc-c3b6-423a-b6ab-0c5605a176a8 service nova] Creating event network-changed:2f3b34fc-705b-4063-a0c0-7ed026c1ebba for instance 40933e98-d7d3-4d63-9012-ad5607e45085 on n-h1-844739-1 Jun 05 08:30:14.551922 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-fdc95233-f074-47eb-bf99-8b59a986ccda req-dc9551dc-c3b6-423a-b6ab-0c5605a176a8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030011 Jun 05 08:30:14.553006 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 942/1899] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:30:14.931720 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7e489188-c394-48bc-8039-edcb41102aaa tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] Action: 'create', calling method: .version_select at 0x7f24454864c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-252956869", "description": "tempest-description-2092748127"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:15.186619 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7e489188-c394-48bc-8039-edcb41102aaa tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.632280 Jun 05 08:30:15.188206 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 943/1900] 10.222.0.33 () {60 vars in 1179 bytes} [Sun Jun 5 08:30:14 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:30:15.196230 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ce8f0a9d-120b-4478-9820-7e6569557d21 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:15.200914 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ce8f0a9d-120b-4478-9820-7e6569557d21 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:15.252921 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ce8f0a9d-120b-4478-9820-7e6569557d21 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:15.258467 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ce8f0a9d-120b-4478-9820-7e6569557d21 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:15.259603 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ce8f0a9d-120b-4478-9820-7e6569557d21 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:15.261705 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ce8f0a9d-120b-4478-9820-7e6569557d21 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:15.633462 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ce8f0a9d-120b-4478-9820-7e6569557d21 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:15.645794 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ce8f0a9d-120b-4478-9820-7e6569557d21 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1391 microversion: 2.1 time: 0.455590 Jun 05 08:30:15.646763 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 944/1901] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:15 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1391 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:15.659809 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a768138f-dcca-43fe-9e88-d8875f9baa86 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:15.661327 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a768138f-dcca-43fe-9e88-d8875f9baa86 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:15.668194 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a768138f-dcca-43fe-9e88-d8875f9baa86 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:15.670229 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a768138f-dcca-43fe-9e88-d8875f9baa86 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:15.671222 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a768138f-dcca-43fe-9e88-d8875f9baa86 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:15.677376 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a768138f-dcca-43fe-9e88-d8875f9baa86 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:15.940094 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a768138f-dcca-43fe-9e88-d8875f9baa86 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:15.949064 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a768138f-dcca-43fe-9e88-d8875f9baa86 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 200 len: 1496 microversion: 2.1 time: 0.300705 Jun 05 08:30:15.949650 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 945/1902] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:15 2022] GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 1496 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:15.963656 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9d5603ea-90c7-4825-88d1-4a84b8ae7eac tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] Action: 'create', calling method: .version_select at 0x7f244549ec10>, body: {"security_group_rule": {"parent_group_id": "1aedd41b-3d1a-4946-a114-16a57a7742c3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:16.336806 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9d5603ea-90c7-4825-88d1-4a84b8ae7eac tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.383760 Jun 05 08:30:16.341386 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 946/1903] 10.222.0.33 () {60 vars in 1194 bytes} [Sun Jun 5 08:30:15 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:30:16.372858 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e2b69f8e-20c6-46fc-a8d8-0b56fa3b4bc5 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:16.374596 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e2b69f8e-20c6-46fc-a8d8-0b56fa3b4bc5 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:16.383626 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e2b69f8e-20c6-46fc-a8d8-0b56fa3b4bc5 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:16.384590 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e2b69f8e-20c6-46fc-a8d8-0b56fa3b4bc5 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:16.385745 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e2b69f8e-20c6-46fc-a8d8-0b56fa3b4bc5 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:16.386354 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e2b69f8e-20c6-46fc-a8d8-0b56fa3b4bc5 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:16.631275 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e2b69f8e-20c6-46fc-a8d8-0b56fa3b4bc5 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:16.648986 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e2b69f8e-20c6-46fc-a8d8-0b56fa3b4bc5 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:16.651741 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e2b69f8e-20c6-46fc-a8d8-0b56fa3b4bc5 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:16.653343 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e2b69f8e-20c6-46fc-a8d8-0b56fa3b4bc5 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.307148 Jun 05 08:30:16.657914 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 947/1904] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:16 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:16.671926 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-045b9dd3-7452-46d4-a619-df5d47b71c4b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:16.672788 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-045b9dd3-7452-46d4-a619-df5d47b71c4b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:16.685738 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-045b9dd3-7452-46d4-a619-df5d47b71c4b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:16.688053 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-045b9dd3-7452-46d4-a619-df5d47b71c4b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:16.688435 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-045b9dd3-7452-46d4-a619-df5d47b71c4b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:16.688880 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-045b9dd3-7452-46d4-a619-df5d47b71c4b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:16.732365 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-045b9dd3-7452-46d4-a619-df5d47b71c4b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:16.733087 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-045b9dd3-7452-46d4-a619-df5d47b71c4b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:16.733810 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-045b9dd3-7452-46d4-a619-df5d47b71c4b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:30:16.825926 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-045b9dd3-7452-46d4-a619-df5d47b71c4b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:16.835264 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-045b9dd3-7452-46d4-a619-df5d47b71c4b tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.176237 Jun 05 08:30:16.836414 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 948/1905] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:16 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:16.841390 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-825fdc26-d5bf-42bf-b121-761b0ffadce1 tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] Action: 'create', calling method: .version_select at 0x7f24453ed4c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1584621484", "description": "tempest-description-947988227"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:17.007554 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=8 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:30:17.037325 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-825fdc26-d5bf-42bf-b121-761b0ffadce1 tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.199699 Jun 05 08:30:17.038739 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 949/1906] 10.222.0.33 () {60 vars in 1179 bytes} [Sun Jun 5 08:30:16 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:30:17.045810 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-beb2bde3-4846-41f1-a5ad-4353de024331 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:17.046191 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-beb2bde3-4846-41f1-a5ad-4353de024331 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:17.061587 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-beb2bde3-4846-41f1-a5ad-4353de024331 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:17.062294 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-beb2bde3-4846-41f1-a5ad-4353de024331 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:17.063093 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-beb2bde3-4846-41f1-a5ad-4353de024331 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:17.063671 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-beb2bde3-4846-41f1-a5ad-4353de024331 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:17.227483 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=12 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:30:17.243631 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-beb2bde3-4846-41f1-a5ad-4353de024331 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:17.252208 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-beb2bde3-4846-41f1-a5ad-4353de024331 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1391 microversion: 2.1 time: 0.212485 Jun 05 08:30:17.261876 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 950/1907] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:17 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1391 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:17.261876 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-564624db-eb13-428b-b441-d10e5915b127 req-91bb8ad5-5c08-41e3-ad08-b2a4d955ef4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40933e98-d7d3-4d63-9012-ad5607e45085", "tag": "6625a448-ba61-493b-896c-b465fe36dc0c"}, {"name": "network-changed", "server_uuid": "40933e98-d7d3-4d63-9012-ad5607e45085", "tag": "0c4f6906-83f1-49f6-9951-e7976dadeb79"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:17.267082 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-564624db-eb13-428b-b441-d10e5915b127 req-91bb8ad5-5c08-41e3-ad08-b2a4d955ef4f service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:17.267631 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-564624db-eb13-428b-b441-d10e5915b127 req-91bb8ad5-5c08-41e3-ad08-b2a4d955ef4f service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:17.282759 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-564624db-eb13-428b-b441-d10e5915b127 req-91bb8ad5-5c08-41e3-ad08-b2a4d955ef4f service nova] Creating event network-changed:6625a448-ba61-493b-896c-b465fe36dc0c for instance 40933e98-d7d3-4d63-9012-ad5607e45085 on n-h1-844739-1 Jun 05 08:30:17.283397 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-564624db-eb13-428b-b441-d10e5915b127 req-91bb8ad5-5c08-41e3-ad08-b2a4d955ef4f service nova] Creating event network-changed:0c4f6906-83f1-49f6-9951-e7976dadeb79 for instance 40933e98-d7d3-4d63-9012-ad5607e45085 on n-h1-844739-1 Jun 05 08:30:17.290071 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-564624db-eb13-428b-b441-d10e5915b127 req-91bb8ad5-5c08-41e3-ad08-b2a4d955ef4f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035395 Jun 05 08:30:17.290975 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 951/1908] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:30:17.296383 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-22e75fb3-5296-435b-9ec2-693a33d0c958 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:17.297081 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-22e75fb3-5296-435b-9ec2-693a33d0c958 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:17.303805 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-22e75fb3-5296-435b-9ec2-693a33d0c958 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:17.304299 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-22e75fb3-5296-435b-9ec2-693a33d0c958 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:17.305082 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-22e75fb3-5296-435b-9ec2-693a33d0c958 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:17.305659 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-22e75fb3-5296-435b-9ec2-693a33d0c958 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:17.475218 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-22e75fb3-5296-435b-9ec2-693a33d0c958 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:17.485420 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-22e75fb3-5296-435b-9ec2-693a33d0c958 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 200 len: 1496 microversion: 2.1 time: 0.192944 Jun 05 08:30:17.500852 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 952/1909] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:17 2022] GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 1496 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:17.506393 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e947d418-feb8-4813-9d79-e3e21966dde2 tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] Action: 'create', calling method: .version_select at 0x7f24404f1ee0>, body: {"security_group_rule": {"parent_group_id": "1f66cd97-6e69-46aa-bd33-aa49e06ec55b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:17.730511 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e947d418-feb8-4813-9d79-e3e21966dde2 tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.228264 Jun 05 08:30:17.731674 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 953/1910] 10.222.0.33 () {60 vars in 1194 bytes} [Sun Jun 5 08:30:17 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:30:17.736368 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f296dadf-6470-498f-8fdd-22609bcc7b7e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:17.737115 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f296dadf-6470-498f-8fdd-22609bcc7b7e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:17.749049 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f296dadf-6470-498f-8fdd-22609bcc7b7e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:17.749512 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f296dadf-6470-498f-8fdd-22609bcc7b7e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:17.750301 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f296dadf-6470-498f-8fdd-22609bcc7b7e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:17.750734 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f296dadf-6470-498f-8fdd-22609bcc7b7e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:17.768089 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=100 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:30:17.994309 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f296dadf-6470-498f-8fdd-22609bcc7b7e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:18.005180 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f296dadf-6470-498f-8fdd-22609bcc7b7e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:18.006902 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f296dadf-6470-498f-8fdd-22609bcc7b7e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:18.008460 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f296dadf-6470-498f-8fdd-22609bcc7b7e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.275589 Jun 05 08:30:18.009100 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 954/1911] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:17 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:18.013955 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6cc6890a-c3bb-4627-8316-54cc5dddf62a tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] Action: 'create', calling method: .version_select at 0x7f24454bd670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-123111993", "description": "tempest-description-1342820127"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:18.268813 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6cc6890a-c3bb-4627-8316-54cc5dddf62a tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.258192 Jun 05 08:30:18.269591 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 955/1912] 10.222.0.33 () {60 vars in 1179 bytes} [Sun Jun 5 08:30:18 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:30:18.274849 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-813a0fee-12cb-4456-8d23-332aada5a223 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:18.275798 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-813a0fee-12cb-4456-8d23-332aada5a223 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:18.283286 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-813a0fee-12cb-4456-8d23-332aada5a223 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:18.284278 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-813a0fee-12cb-4456-8d23-332aada5a223 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:18.286014 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-813a0fee-12cb-4456-8d23-332aada5a223 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:18.286765 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-813a0fee-12cb-4456-8d23-332aada5a223 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:18.326062 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-813a0fee-12cb-4456-8d23-332aada5a223 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:18.326892 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-813a0fee-12cb-4456-8d23-332aada5a223 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:18.327583 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-813a0fee-12cb-4456-8d23-332aada5a223 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:30:18.397139 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-813a0fee-12cb-4456-8d23-332aada5a223 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:18.405490 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-813a0fee-12cb-4456-8d23-332aada5a223 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.134679 Jun 05 08:30:18.421798 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 956/1913] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:18 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:18.427496 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-00807ebc-69a1-4569-a6f5-af4a95f9b331 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:18.428437 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-00807ebc-69a1-4569-a6f5-af4a95f9b331 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:18.435228 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-00807ebc-69a1-4569-a6f5-af4a95f9b331 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:18.435982 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-00807ebc-69a1-4569-a6f5-af4a95f9b331 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:18.437047 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-00807ebc-69a1-4569-a6f5-af4a95f9b331 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:18.437693 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-00807ebc-69a1-4569-a6f5-af4a95f9b331 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:18.641988 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-00807ebc-69a1-4569-a6f5-af4a95f9b331 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:18.657660 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-00807ebc-69a1-4569-a6f5-af4a95f9b331 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1391 microversion: 2.1 time: 0.234268 Jun 05 08:30:18.662020 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 957/1914] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:18 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1391 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:18.667834 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-24ede66d-09b4-4631-ba3f-f3f27e6ed623 tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] Action: 'create', calling method: .version_select at 0x7f24454b6790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-885881845", "description": "tempest-description-771487486"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:18.867295 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-24ede66d-09b4-4631-ba3f-f3f27e6ed623 tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.203475 Jun 05 08:30:18.876931 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 958/1915] 10.222.0.33 () {60 vars in 1179 bytes} [Sun Jun 5 08:30:18 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:30:18.885065 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-373ee3d6-6897-4cdd-900a-d1626f04b3ff tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:18.886008 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-373ee3d6-6897-4cdd-900a-d1626f04b3ff tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:18.896554 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-373ee3d6-6897-4cdd-900a-d1626f04b3ff tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:18.897036 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-373ee3d6-6897-4cdd-900a-d1626f04b3ff tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:18.897855 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-373ee3d6-6897-4cdd-900a-d1626f04b3ff tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:18.898300 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-373ee3d6-6897-4cdd-900a-d1626f04b3ff tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:19.076511 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-373ee3d6-6897-4cdd-900a-d1626f04b3ff tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:19.085568 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-373ee3d6-6897-4cdd-900a-d1626f04b3ff tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 200 len: 1496 microversion: 2.1 time: 0.206501 Jun 05 08:30:19.086765 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 959/1916] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:18 2022] GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 1496 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:19.092407 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9e78516c-1828-43f2-ac8c-f227e0aefd6c tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] Action: 'create', calling method: .version_select at 0x7f2433d73d30>, body: {"security_group_rule": {"parent_group_id": "ce4ac9d5-3eb2-422d-af2e-8352fb609c03", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "06334157-7352-42fc-a450-faefd6f19537"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:19.362319 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9e78516c-1828-43f2-ac8c-f227e0aefd6c tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.273468 Jun 05 08:30:19.363004 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 960/1917] 10.222.0.33 () {60 vars in 1194 bytes} [Sun Jun 5 08:30:19 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:30:19.368243 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-22a5c3ca-c9c0-4b94-8106-9fd770a16ef8 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:19.369155 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-22a5c3ca-c9c0-4b94-8106-9fd770a16ef8 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:19.377434 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-22a5c3ca-c9c0-4b94-8106-9fd770a16ef8 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:19.377980 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-22a5c3ca-c9c0-4b94-8106-9fd770a16ef8 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:19.379128 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-22a5c3ca-c9c0-4b94-8106-9fd770a16ef8 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:19.379383 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-22a5c3ca-c9c0-4b94-8106-9fd770a16ef8 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:19.622555 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-22a5c3ca-c9c0-4b94-8106-9fd770a16ef8 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:19.643694 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-22a5c3ca-c9c0-4b94-8106-9fd770a16ef8 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:19.648314 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-22a5c3ca-c9c0-4b94-8106-9fd770a16ef8 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:19.650076 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-22a5c3ca-c9c0-4b94-8106-9fd770a16ef8 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.285606 Jun 05 08:30:19.667363 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 961/1918] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:19 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:19.677190 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3da995ec-ba89-4f11-bfcf-3e03bc8d938f tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] Action: 'create', calling method: .version_select at 0x7f24453ed820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2089545896", "description": "tempest-description-991286718"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:19.891669 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3da995ec-ba89-4f11-bfcf-3e03bc8d938f tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.221622 Jun 05 08:30:19.892799 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 962/1919] 10.222.0.33 () {60 vars in 1179 bytes} [Sun Jun 5 08:30:19 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:30:19.898190 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1c51b04a-2ff6-4ad2-930b-5df4b7127d09 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:19.899225 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1c51b04a-2ff6-4ad2-930b-5df4b7127d09 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:19.913048 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1c51b04a-2ff6-4ad2-930b-5df4b7127d09 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:19.913681 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1c51b04a-2ff6-4ad2-930b-5df4b7127d09 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:19.914661 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1c51b04a-2ff6-4ad2-930b-5df4b7127d09 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:19.915282 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1c51b04a-2ff6-4ad2-930b-5df4b7127d09 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:19.980515 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1c51b04a-2ff6-4ad2-930b-5df4b7127d09 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:19.981236 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1c51b04a-2ff6-4ad2-930b-5df4b7127d09 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:19.981865 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-1c51b04a-2ff6-4ad2-930b-5df4b7127d09 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:30:20.031009 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1c51b04a-2ff6-4ad2-930b-5df4b7127d09 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:20.039528 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1c51b04a-2ff6-4ad2-930b-5df4b7127d09 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.145279 Jun 05 08:30:20.040455 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 963/1920] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:19 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:20.055723 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-246db976-cace-4ef5-ad37-96ffd7c5cc33 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:20.056834 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-246db976-cace-4ef5-ad37-96ffd7c5cc33 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:20.064313 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-246db976-cace-4ef5-ad37-96ffd7c5cc33 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:20.064802 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-246db976-cace-4ef5-ad37-96ffd7c5cc33 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:20.065596 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-246db976-cace-4ef5-ad37-96ffd7c5cc33 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:20.066039 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-246db976-cace-4ef5-ad37-96ffd7c5cc33 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:20.237908 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-246db976-cace-4ef5-ad37-96ffd7c5cc33 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:20.246061 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-246db976-cace-4ef5-ad37-96ffd7c5cc33 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1391 microversion: 2.1 time: 0.204596 Jun 05 08:30:20.252703 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 964/1921] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:20 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1391 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:20.257439 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-86ac74c0-784c-4e4e-872c-0603d9fecb6c tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] Action: 'create', calling method: .version_select at 0x7f244549ddc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2068404437", "description": "tempest-description-265727352"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:20.462341 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-86ac74c0-784c-4e4e-872c-0603d9fecb6c tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.214584 Jun 05 08:30:20.463047 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 965/1922] 10.222.0.33 () {60 vars in 1179 bytes} [Sun Jun 5 08:30:20 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:30:20.467913 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5c4e91f1-20e0-4ab7-ae73-af859d631b8d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:20.468712 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5c4e91f1-20e0-4ab7-ae73-af859d631b8d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:20.485663 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5c4e91f1-20e0-4ab7-ae73-af859d631b8d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:20.488785 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5c4e91f1-20e0-4ab7-ae73-af859d631b8d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:20.489799 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5c4e91f1-20e0-4ab7-ae73-af859d631b8d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:20.492652 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5c4e91f1-20e0-4ab7-ae73-af859d631b8d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:20.716777 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5c4e91f1-20e0-4ab7-ae73-af859d631b8d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:20.725021 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5c4e91f1-20e0-4ab7-ae73-af859d631b8d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 200 len: 1496 microversion: 2.1 time: 0.260833 Jun 05 08:30:20.727675 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 966/1923] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:20 2022] GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 1496 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:20.732944 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-db1832fd-9003-4671-9259-1f1163d6124c tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] Action: 'create', calling method: .version_select at 0x7f24453ed4c0>, body: {"security_group_rule": {"parent_group_id": "ad6e1ef8-e31e-4a3f-ad3d-8f699c51833a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "20e8b62e-ba88-4d8c-a4d4-05b62b79d441"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:21.353068 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-db1832fd-9003-4671-9259-1f1163d6124c tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.623255 Jun 05 08:30:21.357040 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 967/1924] 10.222.0.33 () {60 vars in 1194 bytes} [Sun Jun 5 08:30:20 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:30:21.363870 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-dd4a6d54-eb70-4365-a8ed-8b0fbfaaa86a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:21.364770 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-dd4a6d54-eb70-4365-a8ed-8b0fbfaaa86a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:21.372187 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dd4a6d54-eb70-4365-a8ed-8b0fbfaaa86a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:21.372974 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dd4a6d54-eb70-4365-a8ed-8b0fbfaaa86a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:21.374156 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dd4a6d54-eb70-4365-a8ed-8b0fbfaaa86a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:21.374678 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dd4a6d54-eb70-4365-a8ed-8b0fbfaaa86a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:21.589820 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-dd4a6d54-eb70-4365-a8ed-8b0fbfaaa86a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:21.599578 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-dd4a6d54-eb70-4365-a8ed-8b0fbfaaa86a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:21.601122 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-dd4a6d54-eb70-4365-a8ed-8b0fbfaaa86a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:21.602303 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-dd4a6d54-eb70-4365-a8ed-8b0fbfaaa86a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.243925 Jun 05 08:30:21.604735 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 968/1925] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:21 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:21.612282 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3bf7289c-bbc8-481c-b944-69c4ce9fe7af tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:21.612282 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3bf7289c-bbc8-481c-b944-69c4ce9fe7af tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:21.616393 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3bf7289c-bbc8-481c-b944-69c4ce9fe7af tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:21.616848 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3bf7289c-bbc8-481c-b944-69c4ce9fe7af tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:21.617981 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3bf7289c-bbc8-481c-b944-69c4ce9fe7af tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:21.618417 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3bf7289c-bbc8-481c-b944-69c4ce9fe7af tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:21.654935 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3bf7289c-bbc8-481c-b944-69c4ce9fe7af tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:21.655391 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3bf7289c-bbc8-481c-b944-69c4ce9fe7af tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:21.655849 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-3bf7289c-bbc8-481c-b944-69c4ce9fe7af tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:30:21.703885 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3bf7289c-bbc8-481c-b944-69c4ce9fe7af tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:21.715571 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3bf7289c-bbc8-481c-b944-69c4ce9fe7af tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.110336 Jun 05 08:30:21.716664 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 969/1926] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:21 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:21.724285 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-625c66cb-8073-411b-9f1f-b77f56e075e6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:21.724954 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-625c66cb-8073-411b-9f1f-b77f56e075e6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:21.732667 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-625c66cb-8073-411b-9f1f-b77f56e075e6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:21.733466 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-625c66cb-8073-411b-9f1f-b77f56e075e6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:21.734416 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-625c66cb-8073-411b-9f1f-b77f56e075e6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:21.735023 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-625c66cb-8073-411b-9f1f-b77f56e075e6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:21.892804 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-625c66cb-8073-411b-9f1f-b77f56e075e6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:21.902677 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-625c66cb-8073-411b-9f1f-b77f56e075e6 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1391 microversion: 2.1 time: 0.184831 Jun 05 08:30:21.912200 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 970/1927] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:21 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1391 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:21.916271 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-972f7e5e-0354-4b4d-994e-fd7b1f054fc4 tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] Calling method '.version_select at 0x7f24453edd30>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:22.139766 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-972f7e5e-0354-4b4d-994e-fd7b1f054fc4 tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/20e8b62e-ba88-4d8c-a4d4-05b62b79d441" status: 202 len: 0 microversion: 2.1 time: 0.234883 Jun 05 08:30:22.140686 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 971/1928] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:30:21 2022] DELETE /compute/v2.1/os-security-groups/20e8b62e-ba88-4d8c-a4d4-05b62b79d441 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:30:22.146785 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f52779e0-dacf-4992-b3fd-1e510ad8601e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:22.147819 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f52779e0-dacf-4992-b3fd-1e510ad8601e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:22.158261 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f52779e0-dacf-4992-b3fd-1e510ad8601e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:22.158918 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f52779e0-dacf-4992-b3fd-1e510ad8601e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:22.160024 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f52779e0-dacf-4992-b3fd-1e510ad8601e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:22.160709 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f52779e0-dacf-4992-b3fd-1e510ad8601e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:22.318735 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f52779e0-dacf-4992-b3fd-1e510ad8601e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:22.327936 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f52779e0-dacf-4992-b3fd-1e510ad8601e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 200 len: 1496 microversion: 2.1 time: 0.185603 Jun 05 08:30:22.328850 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 972/1929] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:22 2022] GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 1496 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:22.343307 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3570d1ba-7306-4962-a264-0af38079900f tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] Calling method '.version_select at 0x7f24454865e0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:22.403911 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3570d1ba-7306-4962-a264-0af38079900f tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/ad6e1ef8-e31e-4a3f-ad3d-8f699c51833a" status: 200 len: 247 microversion: 2.1 time: 0.073724 Jun 05 08:30:22.404892 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 973/1930] 10.222.0.33 () {58 vars in 1268 bytes} [Sun Jun 5 08:30:22 2022] GET /compute/v2.1/os-security-groups/ad6e1ef8-e31e-4a3f-ad3d-8f699c51833a => generated 247 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:30:22.417693 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4375ad86-790b-4bc6-8d14-e504b2b923d1 tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] Action: 'create', calling method: .version_select at 0x7f2433c349d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2146006439", "description": "tempest-description-1737272399"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:22.593100 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4375ad86-790b-4bc6-8d14-e504b2b923d1 tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.179409 Jun 05 08:30:22.593851 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 974/1931] 10.222.0.33 () {60 vars in 1179 bytes} [Sun Jun 5 08:30:22 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:30:22.606410 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b8ee76f2-019a-4651-afba-08c4bbe177e6 tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] Action: 'create', calling method: .version_select at 0x7f2445405790>, body: {"security_group_rule": {"parent_group_id": "26900349-aaf8-49d4-8a9c-79f971c005cb", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:22.615641 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=60 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:30:22.730116 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:30:22.821962 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b8ee76f2-019a-4651-afba-08c4bbe177e6 tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.220756 Jun 05 08:30:22.822928 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 975/1932] 10.222.0.33 () {60 vars in 1194 bytes} [Sun Jun 5 08:30:22 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:30:22.829628 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c84ba9e7-1ade-4856-865a-5a0d9e2c02ff tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:22.830357 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c84ba9e7-1ade-4856-865a-5a0d9e2c02ff tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:22.841151 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c84ba9e7-1ade-4856-865a-5a0d9e2c02ff tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:22.841880 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c84ba9e7-1ade-4856-865a-5a0d9e2c02ff tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:22.843094 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c84ba9e7-1ade-4856-865a-5a0d9e2c02ff tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:22.843828 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c84ba9e7-1ade-4856-865a-5a0d9e2c02ff tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:23.055142 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c84ba9e7-1ade-4856-865a-5a0d9e2c02ff tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:23.065649 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c84ba9e7-1ade-4856-865a-5a0d9e2c02ff tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:23.070682 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c84ba9e7-1ade-4856-865a-5a0d9e2c02ff tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:23.070682 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c84ba9e7-1ade-4856-865a-5a0d9e2c02ff tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.243661 Jun 05 08:30:23.070682 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 976/1933] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:22 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:23.074914 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4ec1a954-5661-44ad-9416-6d66c08eeda7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:23.075639 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4ec1a954-5661-44ad-9416-6d66c08eeda7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:23.082795 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4ec1a954-5661-44ad-9416-6d66c08eeda7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:23.083366 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4ec1a954-5661-44ad-9416-6d66c08eeda7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:23.084383 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4ec1a954-5661-44ad-9416-6d66c08eeda7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:23.085013 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4ec1a954-5661-44ad-9416-6d66c08eeda7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:23.117485 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4ec1a954-5661-44ad-9416-6d66c08eeda7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:23.118036 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4ec1a954-5661-44ad-9416-6d66c08eeda7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:23.118653 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-4ec1a954-5661-44ad-9416-6d66c08eeda7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:30:23.165158 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4ec1a954-5661-44ad-9416-6d66c08eeda7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:23.172941 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4ec1a954-5661-44ad-9416-6d66c08eeda7 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.102619 Jun 05 08:30:23.173500 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 977/1934] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:23 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:23.180744 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-94b030b8-4ed2-4b22-9d94-9566d684d506 tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] Action: 'create', calling method: .version_select at 0x7f24453a75e0>, body: {"security_group_rule": {"parent_group_id": "26900349-aaf8-49d4-8a9c-79f971c005cb", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:23.383269 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-94b030b8-4ed2-4b22-9d94-9566d684d506 tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.207310 Jun 05 08:30:23.384819 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 978/1935] 10.222.0.33 () {60 vars in 1194 bytes} [Sun Jun 5 08:30:23 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:30:23.395553 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c227ead1-47fb-480a-aa8b-9ec654481473 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:23.396225 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c227ead1-47fb-480a-aa8b-9ec654481473 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:23.402540 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c227ead1-47fb-480a-aa8b-9ec654481473 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:23.402996 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c227ead1-47fb-480a-aa8b-9ec654481473 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:23.403776 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c227ead1-47fb-480a-aa8b-9ec654481473 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:23.404402 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c227ead1-47fb-480a-aa8b-9ec654481473 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:23.556527 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c227ead1-47fb-480a-aa8b-9ec654481473 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:23.567188 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c227ead1-47fb-480a-aa8b-9ec654481473 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1391 microversion: 2.1 time: 0.175046 Jun 05 08:30:23.567642 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 979/1936] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:23 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:23.573981 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-da4ca087-ffcc-4914-8267-a9fdd00c9134 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:23.574901 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-da4ca087-ffcc-4914-8267-a9fdd00c9134 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:23.582864 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-da4ca087-ffcc-4914-8267-a9fdd00c9134 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:23.583640 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-da4ca087-ffcc-4914-8267-a9fdd00c9134 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:23.584639 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-da4ca087-ffcc-4914-8267-a9fdd00c9134 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:23.584968 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-da4ca087-ffcc-4914-8267-a9fdd00c9134 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:23.603938 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=100 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:30:23.730586 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-da4ca087-ffcc-4914-8267-a9fdd00c9134 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:23.739892 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-da4ca087-ffcc-4914-8267-a9fdd00c9134 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 200 len: 1496 microversion: 2.1 time: 0.170123 Jun 05 08:30:23.748484 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 980/1937] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:23 2022] GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 1496 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:23.756688 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7cf2c8f2-9df0-489c-a851-d8f139ef3f2a tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] Calling method '.version_select at 0x7f24454b6430>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:23.821508 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7cf2c8f2-9df0-489c-a851-d8f139ef3f2a tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/26900349-aaf8-49d4-8a9c-79f971c005cb" status: 200 len: 665 microversion: 2.1 time: 0.070779 Jun 05 08:30:23.822078 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 981/1938] 10.222.0.33 () {58 vars in 1268 bytes} [Sun Jun 5 08:30:23 2022] GET /compute/v2.1/os-security-groups/26900349-aaf8-49d4-8a9c-79f971c005cb => generated 665 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:30:23.834727 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0340ff93-c29c-4acb-919e-ca76ffce55c2 tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] Calling method '.version_select at 0x7f24453a1f70>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:24.002360 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0340ff93-c29c-4acb-919e-ca76ffce55c2 tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-group-rules/f6128f1b-f7ed-40b0-ba52-529f521cdcf3" status: 202 len: 0 microversion: 2.1 time: 0.171653 Jun 05 08:30:24.003259 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 982/1939] 10.222.0.33 () {58 vars in 1286 bytes} [Sun Jun 5 08:30:23 2022] DELETE /compute/v2.1/os-security-group-rules/f6128f1b-f7ed-40b0-ba52-529f521cdcf3 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 05 08:30:24.015101 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d3bd29b3-bc99-4e8b-99c8-aecf20053bc9 tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] Calling method '.version_select at 0x7f2445486f70>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:24.230602 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d3bd29b3-bc99-4e8b-99c8-aecf20053bc9 tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/26900349-aaf8-49d4-8a9c-79f971c005cb" status: 202 len: 0 microversion: 2.1 time: 0.221559 Jun 05 08:30:24.234831 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 983/1940] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:30:24 2022] DELETE /compute/v2.1/os-security-groups/26900349-aaf8-49d4-8a9c-79f971c005cb => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:30:24.240175 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-60ed456d-1bc3-4d84-bec4-486c7659b3c1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:24.241267 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-60ed456d-1bc3-4d84-bec4-486c7659b3c1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:24.252544 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-60ed456d-1bc3-4d84-bec4-486c7659b3c1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:24.253013 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-60ed456d-1bc3-4d84-bec4-486c7659b3c1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:24.254354 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-60ed456d-1bc3-4d84-bec4-486c7659b3c1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:24.254803 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-60ed456d-1bc3-4d84-bec4-486c7659b3c1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:24.459066 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-60ed456d-1bc3-4d84-bec4-486c7659b3c1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:24.468959 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-60ed456d-1bc3-4d84-bec4-486c7659b3c1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:24.470739 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-60ed456d-1bc3-4d84-bec4-486c7659b3c1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:24.472067 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-60ed456d-1bc3-4d84-bec4-486c7659b3c1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.235945 Jun 05 08:30:24.483864 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 984/1941] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:24 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:24.483864 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e6b1c351-f7d3-4282-900f-253bf643ae5e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:24.483864 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e6b1c351-f7d3-4282-900f-253bf643ae5e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:24.485454 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e6b1c351-f7d3-4282-900f-253bf643ae5e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:24.486084 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e6b1c351-f7d3-4282-900f-253bf643ae5e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:24.486998 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e6b1c351-f7d3-4282-900f-253bf643ae5e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:24.487521 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e6b1c351-f7d3-4282-900f-253bf643ae5e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:24.523472 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e6b1c351-f7d3-4282-900f-253bf643ae5e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:24.523961 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e6b1c351-f7d3-4282-900f-253bf643ae5e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:24.524521 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-e6b1c351-f7d3-4282-900f-253bf643ae5e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:30:24.587483 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e6b1c351-f7d3-4282-900f-253bf643ae5e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:24.596397 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e6b1c351-f7d3-4282-900f-253bf643ae5e tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.122169 Jun 05 08:30:24.597359 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 985/1942] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:24 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:24.609888 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-406f811f-1100-45fd-a52b-0155b4c19a3c tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] Calling method '.version_select at 0x7f2445486f70>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:24.686018 n-d-844739-1 devstack@n-api.service[119050]: DEBUG neutronclient.v2_0.client [None req-406f811f-1100-45fd-a52b-0155b4c19a3c tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 20e8b62e-ba88-4d8c-a4d4-05b62b79d441 does not exist", "detail": ""}} {{(pid=119050) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 05 08:30:24.690599 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.security_group_api [None req-406f811f-1100-45fd-a52b-0155b4c19a3c tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] Neutron security group 20e8b62e-ba88-4d8c-a4d4-05b62b79d441 not found {{(pid=119050) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 05 08:30:24.692410 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-406f811f-1100-45fd-a52b-0155b4c19a3c tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] HTTP exception thrown: Security group 20e8b62e-ba88-4d8c-a4d4-05b62b79d441 does not exist Jun 05 08:30:24.692410 n-d-844739-1 devstack@n-api.service[119050]: Neutron server returns request_ids: ['req-5e827baa-8f5f-438e-9515-4855ed296dbc'] Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-406f811f-1100-45fd-a52b-0155b4c19a3c tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] Request method failure captured: Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: request: DELETE /compute/v2.1/os-security-groups/20e8b62e-ba88-4d8c-a4d4-05b62b79d441 HTTP/1.1 Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGmVhSXhTbNzK2kFCwH9xEeduguqWcHm1b6nnM5UWWLRHTGwsBIEFj6_yGnAglA9_iqJ7BxuDxISF3UqsF_GA2rY8PQEvvXRSiP6iSEWzTwkKYEkaqqeAk_CVMUsR6Z5HA8kh5ABxksPxDOflew-dFzx9H5fznrPp3yPPTlrOY_DLmY Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 006034795a93495ab9618f8e461dea23 Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1739098106 Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/006034795a93495ab9618f8e461dea23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/006034795a93495ab9618f8e461dea23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_006034795a93495ab9618f8e461dea23", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/006034795a93495ab9618f8e461dea23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1739098106 Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 006034795a93495ab9618f8e461dea23 Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1739098106 Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-SecurityGroupRulesTestJSON-1739098106-project Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 8969e42878f74247a8b88a40d3962a0c Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1739098106-project Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: exception: Security group 20e8b62e-ba88-4d8c-a4d4-05b62b79d441 does not exist Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: Neutron server returns request_ids: ['req-5e827baa-8f5f-438e-9515-4855ed296dbc'] Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '20e8b62e-ba88-4d8c-a4d4-05b62b79d441'} Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 05 08:30:24.695888 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 20e8b62e-ba88-4d8c-a4d4-05b62b79d441 does not exist Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e827baa-8f5f-438e-9515-4855ed296dbc'] Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 20e8b62e-ba88-4d8c-a4d4-05b62b79d441 does not exist Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e827baa-8f5f-438e-9515-4855ed296dbc'] Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 20e8b62e-ba88-4d8c-a4d4-05b62b79d441 does not exist Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e827baa-8f5f-438e-9515-4855ed296dbc'] Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 20e8b62e-ba88-4d8c-a4d4-05b62b79d441 does not exist Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e827baa-8f5f-438e-9515-4855ed296dbc'] Jun 05 08:30:24.700176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:30:24.706416 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-406f811f-1100-45fd-a52b-0155b4c19a3c tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] Returning 404 to user: Security group 20e8b62e-ba88-4d8c-a4d4-05b62b79d441 does not exist Jun 05 08:30:24.706416 n-d-844739-1 devstack@n-api.service[119050]: Neutron server returns request_ids: ['req-5e827baa-8f5f-438e-9515-4855ed296dbc'] {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:30:24.708200 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-406f811f-1100-45fd-a52b-0155b4c19a3c tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/20e8b62e-ba88-4d8c-a4d4-05b62b79d441" status: 404 len: 194 microversion: 2.1 time: 0.109588 Jun 05 08:30:24.713942 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 986/1943] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:30:24 2022] DELETE /compute/v2.1/os-security-groups/20e8b62e-ba88-4d8c-a4d4-05b62b79d441 => generated 194 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:30:24.724337 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-97616a49-65cf-4476-9726-1c73fb78c99d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:24.724986 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-97616a49-65cf-4476-9726-1c73fb78c99d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:24.736606 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-97616a49-65cf-4476-9726-1c73fb78c99d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:24.737314 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-97616a49-65cf-4476-9726-1c73fb78c99d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:24.739925 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-97616a49-65cf-4476-9726-1c73fb78c99d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:24.740553 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-97616a49-65cf-4476-9726-1c73fb78c99d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:24.780923 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-7a16841a-d2f1-46e4-9010-7dadedbf0cbb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] validate_networks() for [('a7010e4a-eda5-41d8-af56-68a4d3196193', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:30:25.022196 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-97616a49-65cf-4476-9726-1c73fb78c99d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:25.039388 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-97616a49-65cf-4476-9726-1c73fb78c99d tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1391 microversion: 2.1 time: 0.324321 Jun 05 08:30:25.051062 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 987/1944] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:24 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1391 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:25.063389 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1756dc89-c3e5-4886-b86b-1922a26970b1 tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] Calling method '.version_select at 0x7f2433d20a60>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:25.509697 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-7a16841a-d2f1-46e4-9010-7dadedbf0cbb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:30:25.510667 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-7a16841a-d2f1-46e4-9010-7dadedbf0cbb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:30:25.511558 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-7a16841a-d2f1-46e4-9010-7dadedbf0cbb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:30:25.512491 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-7a16841a-d2f1-46e4-9010-7dadedbf0cbb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:30:25.513108 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-7a16841a-d2f1-46e4-9010-7dadedbf0cbb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:30:25.523163 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1756dc89-c3e5-4886-b86b-1922a26970b1 tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/ad6e1ef8-e31e-4a3f-ad3d-8f699c51833a" status: 202 len: 0 microversion: 2.1 time: 0.470450 Jun 05 08:30:25.524811 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 988/1945] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:30:25 2022] DELETE /compute/v2.1/os-security-groups/ad6e1ef8-e31e-4a3f-ad3d-8f699c51833a => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:30:25.533944 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-16548716-d4e6-4c57-aaf2-ea1c3b7214e7 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:25.535727 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-16548716-d4e6-4c57-aaf2-ea1c3b7214e7 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:25.558816 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7a16841a-d2f1-46e4-9010-7dadedbf0cbb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:25.560292 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7a16841a-d2f1-46e4-9010-7dadedbf0cbb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:25.562315 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7a16841a-d2f1-46e4-9010-7dadedbf0cbb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:25.562994 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7a16841a-d2f1-46e4-9010-7dadedbf0cbb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:25.570302 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-16548716-d4e6-4c57-aaf2-ea1c3b7214e7 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:25.571905 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-16548716-d4e6-4c57-aaf2-ea1c3b7214e7 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:25.574052 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-16548716-d4e6-4c57-aaf2-ea1c3b7214e7 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:25.576578 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-16548716-d4e6-4c57-aaf2-ea1c3b7214e7 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:25.605700 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-7a16841a-d2f1-46e4-9010-7dadedbf0cbb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Getting quotas for project fb5c1766af9c4e079f74b67177db0246. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:30:25.618538 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-7a16841a-d2f1-46e4-9010-7dadedbf0cbb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Getting quotas for user 03720c07cc1e4ae6a2c621b1d3feed9a and project fb5c1766af9c4e079f74b67177db0246. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:30:25.714202 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7a16841a-d2f1-46e4-9010-7dadedbf0cbb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:30:25.716666 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7a16841a-d2f1-46e4-9010-7dadedbf0cbb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bd869467-9542-4d70-a58b-d1b38b2b3b7a',volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:30:25.867980 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-16548716-d4e6-4c57-aaf2-ea1c3b7214e7 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:25.876178 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-16548716-d4e6-4c57-aaf2-ea1c3b7214e7 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 200 len: 1496 microversion: 2.1 time: 0.349279 Jun 05 08:30:25.886227 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 989/1946] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:25 2022] GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 1496 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:25.890903 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7a16841a-d2f1-46e4-9010-7dadedbf0cbb tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 13.205546 Jun 05 08:30:25.891992 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a8ae2b0a-e204-4dbe-8b5d-cb95a609cf74 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:25.892923 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a8ae2b0a-e204-4dbe-8b5d-cb95a609cf74 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:25.893219 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 958/1947] 10.222.0.33 () {62 vars in 1187 bytes} [Sun Jun 5 08:30:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 13209 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 05 08:30:25.900413 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a8ae2b0a-e204-4dbe-8b5d-cb95a609cf74 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:25.901142 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a8ae2b0a-e204-4dbe-8b5d-cb95a609cf74 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:25.902403 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a8ae2b0a-e204-4dbe-8b5d-cb95a609cf74 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:25.903031 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a8ae2b0a-e204-4dbe-8b5d-cb95a609cf74 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:25.908759 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d8942238-5b30-4310-bcb3-2680dbff4f3c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:25.908759 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d8942238-5b30-4310-bcb3-2680dbff4f3c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:25.917202 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d8942238-5b30-4310-bcb3-2680dbff4f3c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:25.917768 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d8942238-5b30-4310-bcb3-2680dbff4f3c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:25.918668 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d8942238-5b30-4310-bcb3-2680dbff4f3c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:25.919256 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d8942238-5b30-4310-bcb3-2680dbff4f3c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:25.937366 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a8ae2b0a-e204-4dbe-8b5d-cb95a609cf74 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:30:26.031484 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a8ae2b0a-e204-4dbe-8b5d-cb95a609cf74 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 204 len: 0 microversion: 2.20 time: 0.143273 Jun 05 08:30:26.032666 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 990/1948] 10.222.0.33 () {60 vars in 1279 bytes} [Sun Jun 5 08:30:25 2022] DELETE /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:30:26.044291 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fba4b828-5f29-401f-bde0-7a611814fda8 tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] Calling method '.version_select at 0x7f24454861f0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:26.413873 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d8942238-5b30-4310-bcb3-2680dbff4f3c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:26.424987 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d8942238-5b30-4310-bcb3-2680dbff4f3c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:26.426668 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d8942238-5b30-4310-bcb3-2680dbff4f3c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:26.427840 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d8942238-5b30-4310-bcb3-2680dbff4f3c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.532003 Jun 05 08:30:26.431943 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 959/1949] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:25 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:26.437038 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b1a6816e-1981-46d3-89db-7935c19b9801 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:26.437656 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b1a6816e-1981-46d3-89db-7935c19b9801 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:26.448767 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b1a6816e-1981-46d3-89db-7935c19b9801 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:26.449674 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b1a6816e-1981-46d3-89db-7935c19b9801 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:26.450952 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b1a6816e-1981-46d3-89db-7935c19b9801 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:26.451545 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b1a6816e-1981-46d3-89db-7935c19b9801 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:26.528357 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b1a6816e-1981-46d3-89db-7935c19b9801 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:26.530143 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b1a6816e-1981-46d3-89db-7935c19b9801 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:26.530601 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-b1a6816e-1981-46d3-89db-7935c19b9801 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:30:26.561644 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fba4b828-5f29-401f-bde0-7a611814fda8 tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/06334157-7352-42fc-a450-faefd6f19537" status: 202 len: 0 microversion: 2.1 time: 0.527412 Jun 05 08:30:26.563526 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 991/1950] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:30:26 2022] DELETE /compute/v2.1/os-security-groups/06334157-7352-42fc-a450-faefd6f19537 => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:30:26.571414 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-221019b8-7744-47f5-8fb6-1345a5baf5af tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:26.572495 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-221019b8-7744-47f5-8fb6-1345a5baf5af tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:26.589724 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-221019b8-7744-47f5-8fb6-1345a5baf5af tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:26.591931 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-221019b8-7744-47f5-8fb6-1345a5baf5af tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:26.595951 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-221019b8-7744-47f5-8fb6-1345a5baf5af tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:26.599010 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-221019b8-7744-47f5-8fb6-1345a5baf5af tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:26.669633 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b1a6816e-1981-46d3-89db-7935c19b9801 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:26.692911 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b1a6816e-1981-46d3-89db-7935c19b9801 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.253672 Jun 05 08:30:26.693988 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 960/1951] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:26 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:26.706885 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d4fb1a43-839d-4236-b5bc-f30d0c968d82 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:26.709941 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d4fb1a43-839d-4236-b5bc-f30d0c968d82 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:26.757572 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d4fb1a43-839d-4236-b5bc-f30d0c968d82 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:26.758072 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d4fb1a43-839d-4236-b5bc-f30d0c968d82 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:26.758865 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d4fb1a43-839d-4236-b5bc-f30d0c968d82 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:26.759308 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d4fb1a43-839d-4236-b5bc-f30d0c968d82 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:26.760666 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-221019b8-7744-47f5-8fb6-1345a5baf5af tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:26.770849 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-221019b8-7744-47f5-8fb6-1345a5baf5af tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:26.776975 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-221019b8-7744-47f5-8fb6-1345a5baf5af tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:26.778978 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-221019b8-7744-47f5-8fb6-1345a5baf5af tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1176 microversion: 2.25 time: 0.213163 Jun 05 08:30:26.784407 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 992/1952] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:26 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1176 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:26.796364 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-750d00ec-028d-491e-9862-235944648d54 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:26.797516 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-750d00ec-028d-491e-9862-235944648d54 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:26.809310 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-750d00ec-028d-491e-9862-235944648d54 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:26.810410 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-750d00ec-028d-491e-9862-235944648d54 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:26.811725 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-750d00ec-028d-491e-9862-235944648d54 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:26.812429 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-750d00ec-028d-491e-9862-235944648d54 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:27.001209 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d4fb1a43-839d-4236-b5bc-f30d0c968d82 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:27.011238 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d4fb1a43-839d-4236-b5bc-f30d0c968d82 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:27.012778 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d4fb1a43-839d-4236-b5bc-f30d0c968d82 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:27.014385 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d4fb1a43-839d-4236-b5bc-f30d0c968d82 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1724 microversion: 2.20 time: 0.317490 Jun 05 08:30:27.015454 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 961/1953] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:26 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1724 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:27.027949 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7856ee0c-5d7a-47d3-b5c7-170f0be0539a tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] Calling method '.version_select at 0x7f24453ed9d0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:27.059668 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-750d00ec-028d-491e-9862-235944648d54 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:27.071159 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-750d00ec-028d-491e-9862-235944648d54 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1391 microversion: 2.1 time: 0.284955 Jun 05 08:30:27.071761 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 993/1954] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:26 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1391 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:27.084553 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-32bc3dd2-c40c-40a0-99ed-7353d14c1bd6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:27.085560 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-32bc3dd2-c40c-40a0-99ed-7353d14c1bd6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:27.093184 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-32bc3dd2-c40c-40a0-99ed-7353d14c1bd6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:27.093635 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-32bc3dd2-c40c-40a0-99ed-7353d14c1bd6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:27.094887 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-32bc3dd2-c40c-40a0-99ed-7353d14c1bd6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:27.095480 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-32bc3dd2-c40c-40a0-99ed-7353d14c1bd6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:27.143331 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-32bc3dd2-c40c-40a0-99ed-7353d14c1bd6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:30:27.299916 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-32bc3dd2-c40c-40a0-99ed-7353d14c1bd6 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 204 len: 0 microversion: 2.1 time: 0.226066 Jun 05 08:30:27.311452 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 994/1955] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:30:27 2022] DELETE /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:30:27.320293 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b32dd866-5013-475c-a3ad-e60a87297066 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:27.321515 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b32dd866-5013-475c-a3ad-e60a87297066 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:27.338759 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b32dd866-5013-475c-a3ad-e60a87297066 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:27.339228 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b32dd866-5013-475c-a3ad-e60a87297066 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:27.340099 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b32dd866-5013-475c-a3ad-e60a87297066 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:27.340378 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7856ee0c-5d7a-47d3-b5c7-170f0be0539a tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/ce4ac9d5-3eb2-422d-af2e-8352fb609c03" status: 202 len: 0 microversion: 2.1 time: 0.323628 Jun 05 08:30:27.340550 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b32dd866-5013-475c-a3ad-e60a87297066 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:27.345025 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 962/1956] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:30:27 2022] DELETE /compute/v2.1/os-security-groups/ce4ac9d5-3eb2-422d-af2e-8352fb609c03 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:30:27.353244 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-33820dda-7e86-49b7-9afb-320f838dd78a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:27.359363 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-33820dda-7e86-49b7-9afb-320f838dd78a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:27.398115 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-33820dda-7e86-49b7-9afb-320f838dd78a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:27.403795 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-33820dda-7e86-49b7-9afb-320f838dd78a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:27.405853 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-33820dda-7e86-49b7-9afb-320f838dd78a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:27.408815 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-33820dda-7e86-49b7-9afb-320f838dd78a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:27.541611 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-33820dda-7e86-49b7-9afb-320f838dd78a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:27.543895 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-33820dda-7e86-49b7-9afb-320f838dd78a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:27.545444 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-33820dda-7e86-49b7-9afb-320f838dd78a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:30:27.678066 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-33820dda-7e86-49b7-9afb-320f838dd78a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:27.706799 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-33820dda-7e86-49b7-9afb-320f838dd78a tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1370 microversion: 2.1 time: 0.360452 Jun 05 08:30:27.709845 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 963/1957] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:27 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1370 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:27.715628 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9dc89992-01f8-4368-a348-93e24c756691 tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] Calling method '.version_select at 0x7f24331f8a60>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:29.061890 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b32dd866-5013-475c-a3ad-e60a87297066 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:29.072016 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b32dd866-5013-475c-a3ad-e60a87297066 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 200 len: 1496 microversion: 2.1 time: 1.759122 Jun 05 08:30:29.075242 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 995/1958] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:27 2022] GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 1496 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:29.082394 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ef9d02a9-bf85-4c17-9f82-4033a86c06f8 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:29.083762 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ef9d02a9-bf85-4c17-9f82-4033a86c06f8 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:29.101794 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ef9d02a9-bf85-4c17-9f82-4033a86c06f8 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:29.103318 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ef9d02a9-bf85-4c17-9f82-4033a86c06f8 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:29.104471 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ef9d02a9-bf85-4c17-9f82-4033a86c06f8 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:29.105181 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ef9d02a9-bf85-4c17-9f82-4033a86c06f8 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:29.686084 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9dc89992-01f8-4368-a348-93e24c756691 tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/1f66cd97-6e69-46aa-bd33-aa49e06ec55b" status: 202 len: 0 microversion: 2.1 time: 1.973805 Jun 05 08:30:29.686684 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 964/1959] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:30:27 2022] DELETE /compute/v2.1/os-security-groups/1f66cd97-6e69-46aa-bd33-aa49e06ec55b => generated 0 bytes in 1976 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:30:29.694388 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6453c3c0-8fbb-4f88-83d6-2e2a72aa9293 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:29.697171 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6453c3c0-8fbb-4f88-83d6-2e2a72aa9293 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:29.717332 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6453c3c0-8fbb-4f88-83d6-2e2a72aa9293 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:29.743698 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6453c3c0-8fbb-4f88-83d6-2e2a72aa9293 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:29.745047 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6453c3c0-8fbb-4f88-83d6-2e2a72aa9293 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:29.750036 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6453c3c0-8fbb-4f88-83d6-2e2a72aa9293 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:30.674849 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ef9d02a9-bf85-4c17-9f82-4033a86c06f8 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:30.705384 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ef9d02a9-bf85-4c17-9f82-4033a86c06f8 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:30.709524 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ef9d02a9-bf85-4c17-9f82-4033a86c06f8 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:30.715694 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ef9d02a9-bf85-4c17-9f82-4033a86c06f8 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 1.637892 Jun 05 08:30:30.716568 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 996/1960] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:29 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:30.729202 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-bb1fa0a1-15da-449e-b4df-8a97ecca16ec tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:30.729856 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-bb1fa0a1-15da-449e-b4df-8a97ecca16ec tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:30.747375 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bb1fa0a1-15da-449e-b4df-8a97ecca16ec tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:30.748293 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bb1fa0a1-15da-449e-b4df-8a97ecca16ec tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:30.749471 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bb1fa0a1-15da-449e-b4df-8a97ecca16ec tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:30.750324 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bb1fa0a1-15da-449e-b4df-8a97ecca16ec tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:30.798646 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6453c3c0-8fbb-4f88-83d6-2e2a72aa9293 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:30.811806 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6453c3c0-8fbb-4f88-83d6-2e2a72aa9293 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:30.817483 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6453c3c0-8fbb-4f88-83d6-2e2a72aa9293 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:30.820288 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6453c3c0-8fbb-4f88-83d6-2e2a72aa9293 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1292 microversion: 2.25 time: 1.132509 Jun 05 08:30:30.823838 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 965/1961] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:29 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1292 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:30.831837 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-07b92999-7109-447b-95a7-508c4d20544f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:30.836422 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-07b92999-7109-447b-95a7-508c4d20544f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:30.844943 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-07b92999-7109-447b-95a7-508c4d20544f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:30.852599 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-07b92999-7109-447b-95a7-508c4d20544f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:30.853831 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-07b92999-7109-447b-95a7-508c4d20544f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:30.854526 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-07b92999-7109-447b-95a7-508c4d20544f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:30.874967 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-bb1fa0a1-15da-449e-b4df-8a97ecca16ec tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:30.912703 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-bb1fa0a1-15da-449e-b4df-8a97ecca16ec tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:30.914962 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-bb1fa0a1-15da-449e-b4df-8a97ecca16ec tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:30.918034 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-bb1fa0a1-15da-449e-b4df-8a97ecca16ec tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1656 microversion: 2.20 time: 0.197827 Jun 05 08:30:30.918848 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 997/1962] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:30 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1656 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:30.930771 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-726e078c-b76b-42b3-bcd7-8f174bcf4e95 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:30.936111 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-726e078c-b76b-42b3-bcd7-8f174bcf4e95 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: d4f4188b-2421-4e0a-8ac7-0140bed18989] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:30.950131 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-726e078c-b76b-42b3-bcd7-8f174bcf4e95 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:30.951564 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-726e078c-b76b-42b3-bcd7-8f174bcf4e95 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:30.954024 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-726e078c-b76b-42b3-bcd7-8f174bcf4e95 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:30.958423 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-726e078c-b76b-42b3-bcd7-8f174bcf4e95 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:31.051337 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-726e078c-b76b-42b3-bcd7-8f174bcf4e95 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:31.057955 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-726e078c-b76b-42b3-bcd7-8f174bcf4e95 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:31.058989 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-726e078c-b76b-42b3-bcd7-8f174bcf4e95 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid d4f4188b-2421-4e0a-8ac7-0140bed18989 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:30:31.281378 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-726e078c-b76b-42b3-bcd7-8f174bcf4e95 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:31.290617 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-726e078c-b76b-42b3-bcd7-8f174bcf4e95 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989" status: 200 len: 1364 microversion: 2.1 time: 0.370460 Jun 05 08:30:31.300950 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 998/1963] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:30 2022] GET /compute/v2.1/servers/d4f4188b-2421-4e0a-8ac7-0140bed18989 => generated 1364 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:31.324313 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-461c5cd3-cc46-47a1-84ec-47a9a1e002e7 req-09e28f37-c908-4773-a520-7390cb8499c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12ef7912-7054-4457-b1a4-c266b5bcb3e5", "tag": "25cc4210-356d-47b2-9e15-cf3ee146a37b"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:31.356250 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:30:31.384734 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-461c5cd3-cc46-47a1-84ec-47a9a1e002e7 req-09e28f37-c908-4773-a520-7390cb8499c0 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:31.385191 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-461c5cd3-cc46-47a1-84ec-47a9a1e002e7 req-09e28f37-c908-4773-a520-7390cb8499c0 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:31.389605 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:30:31.461869 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-461c5cd3-cc46-47a1-84ec-47a9a1e002e7 req-09e28f37-c908-4773-a520-7390cb8499c0 service nova] Creating event network-changed:25cc4210-356d-47b2-9e15-cf3ee146a37b for instance 12ef7912-7054-4457-b1a4-c266b5bcb3e5 on n-h1-844739-1 Jun 05 08:30:31.484828 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-461c5cd3-cc46-47a1-84ec-47a9a1e002e7 req-09e28f37-c908-4773-a520-7390cb8499c0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186762 Jun 05 08:30:31.490910 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 999/1964] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:30:31.508798 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-07b92999-7109-447b-95a7-508c4d20544f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:31.520441 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-07b92999-7109-447b-95a7-508c4d20544f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1391 microversion: 2.1 time: 0.693853 Jun 05 08:30:31.528698 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 966/1965] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:30 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1391 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:31.537750 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c1943a4c-54f3-468e-85b6-147d9302026a tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] Calling method '.version_select at 0x7f244535eb80>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:31.545860 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fcd15d69-118d-42ac-bdf1-5bbc4f0df3bd tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:31.551218 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-fcd15d69-118d-42ac-bdf1-5bbc4f0df3bd tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:31.579638 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fcd15d69-118d-42ac-bdf1-5bbc4f0df3bd tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:31.580489 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fcd15d69-118d-42ac-bdf1-5bbc4f0df3bd tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:31.582642 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fcd15d69-118d-42ac-bdf1-5bbc4f0df3bd tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:31.586171 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fcd15d69-118d-42ac-bdf1-5bbc4f0df3bd tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:32.112377 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-fcd15d69-118d-42ac-bdf1-5bbc4f0df3bd tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:32.134743 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fcd15d69-118d-42ac-bdf1-5bbc4f0df3bd tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 200 len: 1496 microversion: 2.1 time: 0.604505 Jun 05 08:30:32.135710 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 967/1966] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:31 2022] GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 1496 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:32.140902 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-39403375-11c8-4671-8ce4-95566fe8d877 req-36469843-6c6e-43d2-aff1-296f7782f768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b271002d-4613-405c-aeed-7c06b205a045", "name": "network-vif-deleted", "tag": "642e2803-a706-408c-b7c4-6157cb18ee50"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:32.157654 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-39403375-11c8-4671-8ce4-95566fe8d877 req-36469843-6c6e-43d2-aff1-296f7782f768 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:32.164869 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-39403375-11c8-4671-8ce4-95566fe8d877 req-36469843-6c6e-43d2-aff1-296f7782f768 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:32.188513 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-39403375-11c8-4671-8ce4-95566fe8d877 req-36469843-6c6e-43d2-aff1-296f7782f768 service nova] Creating event network-vif-deleted:642e2803-a706-408c-b7c4-6157cb18ee50 for instance b271002d-4613-405c-aeed-7c06b205a045 on n-h2-844739-1 Jun 05 08:30:32.200310 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-39403375-11c8-4671-8ce4-95566fe8d877 req-36469843-6c6e-43d2-aff1-296f7782f768 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062865 Jun 05 08:30:32.204412 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 968/1967] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:30:32.211128 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7b4c8d02-707d-4bb5-bcee-74a4fc20e680 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:32.217037 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7b4c8d02-707d-4bb5-bcee-74a4fc20e680 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:32.236339 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7b4c8d02-707d-4bb5-bcee-74a4fc20e680 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:32.237065 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7b4c8d02-707d-4bb5-bcee-74a4fc20e680 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:32.238087 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7b4c8d02-707d-4bb5-bcee-74a4fc20e680 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:32.240464 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7b4c8d02-707d-4bb5-bcee-74a4fc20e680 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:32.308352 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7b4c8d02-707d-4bb5-bcee-74a4fc20e680 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:30:32.343534 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c1943a4c-54f3-468e-85b6-147d9302026a tempest-SecurityGroupRulesTestJSON-1739098106 tempest-SecurityGroupRulesTestJSON-1739098106-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/1aedd41b-3d1a-4946-a114-16a57a7742c3" status: 202 len: 0 microversion: 2.1 time: 0.850102 Jun 05 08:30:32.344514 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1000/1968] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:30:31 2022] DELETE /compute/v2.1/os-security-groups/1aedd41b-3d1a-4946-a114-16a57a7742c3 => generated 0 bytes in 853 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:30:32.353317 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4d91eb9c-f99f-460f-8fb2-941ffe3c5aa7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:32.354831 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4d91eb9c-f99f-460f-8fb2-941ffe3c5aa7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:32.374069 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4d91eb9c-f99f-460f-8fb2-941ffe3c5aa7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:32.376296 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4d91eb9c-f99f-460f-8fb2-941ffe3c5aa7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:32.378396 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4d91eb9c-f99f-460f-8fb2-941ffe3c5aa7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:32.382412 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4d91eb9c-f99f-460f-8fb2-941ffe3c5aa7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:32.528673 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7b4c8d02-707d-4bb5-bcee-74a4fc20e680 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 204 len: 0 microversion: 2.1 time: 0.320212 Jun 05 08:30:32.541821 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 969/1969] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:30:32 2022] DELETE /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:30:32.563416 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4bb9d4e3-f2bb-40e7-a169-6ee583f25bc6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:32.565574 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4bb9d4e3-f2bb-40e7-a169-6ee583f25bc6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:32.580652 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4bb9d4e3-f2bb-40e7-a169-6ee583f25bc6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:32.581109 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4bb9d4e3-f2bb-40e7-a169-6ee583f25bc6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:32.586065 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4bb9d4e3-f2bb-40e7-a169-6ee583f25bc6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:32.586588 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4bb9d4e3-f2bb-40e7-a169-6ee583f25bc6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:33.398501 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4bb9d4e3-f2bb-40e7-a169-6ee583f25bc6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:33.420088 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4bb9d4e3-f2bb-40e7-a169-6ee583f25bc6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:33.436257 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4bb9d4e3-f2bb-40e7-a169-6ee583f25bc6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:33.443967 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4bb9d4e3-f2bb-40e7-a169-6ee583f25bc6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1292 microversion: 2.25 time: 0.894454 Jun 05 08:30:33.444658 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 970/1970] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:32 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1292 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:33.450029 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1d252788-85fc-47ac-900e-a99d096aa67a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:33.450656 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1d252788-85fc-47ac-900e-a99d096aa67a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:33.469305 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4d91eb9c-f99f-460f-8fb2-941ffe3c5aa7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:33.471708 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1d252788-85fc-47ac-900e-a99d096aa67a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:33.472196 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1d252788-85fc-47ac-900e-a99d096aa67a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:33.473152 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1d252788-85fc-47ac-900e-a99d096aa67a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:33.473608 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1d252788-85fc-47ac-900e-a99d096aa67a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:33.501315 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4d91eb9c-f99f-460f-8fb2-941ffe3c5aa7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:33.504116 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4d91eb9c-f99f-460f-8fb2-941ffe3c5aa7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:33.509340 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4d91eb9c-f99f-460f-8fb2-941ffe3c5aa7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 1.160378 Jun 05 08:30:33.512405 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1001/1971] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:32 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:33.526071 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d2cbd66c-0060-43e8-a03c-583f84c89aa7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:33.527607 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d2cbd66c-0060-43e8-a03c-583f84c89aa7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:33.541026 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d2cbd66c-0060-43e8-a03c-583f84c89aa7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:33.541880 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d2cbd66c-0060-43e8-a03c-583f84c89aa7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:33.545128 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d2cbd66c-0060-43e8-a03c-583f84c89aa7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:33.545978 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d2cbd66c-0060-43e8-a03c-583f84c89aa7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:33.558795 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1d252788-85fc-47ac-900e-a99d096aa67a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:33.559247 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1d252788-85fc-47ac-900e-a99d096aa67a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:33.559714 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-1d252788-85fc-47ac-900e-a99d096aa67a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lazy-loading 'fault' on Instance uuid b271002d-4613-405c-aeed-7c06b205a045 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:30:33.717856 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-1d252788-85fc-47ac-900e-a99d096aa67a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:33.730577 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-1d252788-85fc-47ac-900e-a99d096aa67a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:33.734387 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-1d252788-85fc-47ac-900e-a99d096aa67a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:33.738819 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1d252788-85fc-47ac-900e-a99d096aa67a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1426 microversion: 2.20 time: 0.292072 Jun 05 08:30:33.739692 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 971/1972] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:33 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1426 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:33.756921 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5e5d3f99-c169-472b-a49a-9fcd8f64f0da tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:33.757953 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5e5d3f99-c169-472b-a49a-9fcd8f64f0da tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:33.765583 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5e5d3f99-c169-472b-a49a-9fcd8f64f0da tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:33.766589 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5e5d3f99-c169-472b-a49a-9fcd8f64f0da tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:33.767550 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5e5d3f99-c169-472b-a49a-9fcd8f64f0da tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:33.769807 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5e5d3f99-c169-472b-a49a-9fcd8f64f0da tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:33.862841 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5e5d3f99-c169-472b-a49a-9fcd8f64f0da tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:33.864094 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5e5d3f99-c169-472b-a49a-9fcd8f64f0da tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:33.865107 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-5e5d3f99-c169-472b-a49a-9fcd8f64f0da tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid 8cddf461-3546-4475-91c7-419b46a255af {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:30:33.920755 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d2cbd66c-0060-43e8-a03c-583f84c89aa7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:33.934512 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d2cbd66c-0060-43e8-a03c-583f84c89aa7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1381 microversion: 2.1 time: 0.419763 Jun 05 08:30:33.936376 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1002/1973] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:33 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1381 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:33.945479 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5e5d3f99-c169-472b-a49a-9fcd8f64f0da tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:33.965869 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-131f0aea-2ca7-49cb-a84a-6f9564232ad9 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:33.967096 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5e5d3f99-c169-472b-a49a-9fcd8f64f0da tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 200 len: 1364 microversion: 2.1 time: 0.214237 Jun 05 08:30:33.968738 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 972/1974] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:33 2022] GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:33.970332 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-131f0aea-2ca7-49cb-a84a-6f9564232ad9 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:33.984263 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-131f0aea-2ca7-49cb-a84a-6f9564232ad9 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:33.984642 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-df4099a4-909b-487e-8e92-e16c43aea563 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '.version_select at 0x7f244533f0d0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:33.985241 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-131f0aea-2ca7-49cb-a84a-6f9564232ad9 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:33.986995 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-131f0aea-2ca7-49cb-a84a-6f9564232ad9 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:33.987790 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-131f0aea-2ca7-49cb-a84a-6f9564232ad9 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:34.034769 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-df4099a4-909b-487e-8e92-e16c43aea563 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1366342627" status: 204 len: 0 microversion: 2.20 time: 0.061547 Jun 05 08:30:34.039359 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 973/1975] 10.222.0.33 () {60 vars in 1261 bytes} [Sun Jun 5 08:30:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1366342627 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:30:34.064272 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d0f7734e-e04f-46e2-a0b9-aaed4137d86f tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Calling method '.version_select at 0x7f24453ce940>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:34.073226 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d0f7734e-e04f-46e2-a0b9-aaed4137d86f tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:34.074537 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d0f7734e-e04f-46e2-a0b9-aaed4137d86f tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:34.116203 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d0f7734e-e04f-46e2-a0b9-aaed4137d86f tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 2704 microversion: 2.1 time: 0.072093 Jun 05 08:30:34.117240 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 974/1976] 10.222.0.33 () {58 vars in 1142 bytes} [Sun Jun 5 08:30:34 2022] GET /compute/v2.1/os-migrations => generated 2704 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:34.137624 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8f27df8b-6eb8-4eac-bac1-4163f67704eb tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:34.138266 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8f27df8b-6eb8-4eac-bac1-4163f67704eb tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:34.154222 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8f27df8b-6eb8-4eac-bac1-4163f67704eb tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:34.154864 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8f27df8b-6eb8-4eac-bac1-4163f67704eb tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:34.155804 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8f27df8b-6eb8-4eac-bac1-4163f67704eb tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:34.157730 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8f27df8b-6eb8-4eac-bac1-4163f67704eb tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:34.319759 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-131f0aea-2ca7-49cb-a84a-6f9564232ad9 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:34.331232 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-131f0aea-2ca7-49cb-a84a-6f9564232ad9 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 200 len: 1496 microversion: 2.1 time: 0.391993 Jun 05 08:30:34.336094 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1003/1977] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:33 2022] GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 1496 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:34.462424 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-58d247e9-3496-41c8-aa44-0cc431ea1fb4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:34.463094 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-58d247e9-3496-41c8-aa44-0cc431ea1fb4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:34.481481 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-58d247e9-3496-41c8-aa44-0cc431ea1fb4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:34.482045 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-58d247e9-3496-41c8-aa44-0cc431ea1fb4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:34.482789 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-58d247e9-3496-41c8-aa44-0cc431ea1fb4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:34.483401 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-58d247e9-3496-41c8-aa44-0cc431ea1fb4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:34.595046 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8f27df8b-6eb8-4eac-bac1-4163f67704eb tempest-LiveMigrationTest-1258631272 tempest-LiveMigrationTest-1258631272-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1532 microversion: 2.1 time: 0.467619 Jun 05 08:30:34.611030 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 975/1978] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:34 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1532 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:34.625141 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6c8a1ae4-5b71-4a27-b071-36ffb9e0f7ec tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:34.626492 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6c8a1ae4-5b71-4a27-b071-36ffb9e0f7ec tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:34.649480 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6c8a1ae4-5b71-4a27-b071-36ffb9e0f7ec tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:34.650856 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6c8a1ae4-5b71-4a27-b071-36ffb9e0f7ec tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:34.655472 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6c8a1ae4-5b71-4a27-b071-36ffb9e0f7ec tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:34.658659 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6c8a1ae4-5b71-4a27-b071-36ffb9e0f7ec tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:34.706642 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:30:34.867687 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-58d247e9-3496-41c8-aa44-0cc431ea1fb4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:34.883612 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-58d247e9-3496-41c8-aa44-0cc431ea1fb4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:34.886242 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-58d247e9-3496-41c8-aa44-0cc431ea1fb4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:34.889449 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-58d247e9-3496-41c8-aa44-0cc431ea1fb4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1292 microversion: 2.25 time: 0.431308 Jun 05 08:30:34.892216 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1004/1979] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:34 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1292 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:34.906689 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-708155f7-a0dd-4e0f-a264-1b60590df5c8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:34.907559 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-708155f7-a0dd-4e0f-a264-1b60590df5c8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:34.925346 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-708155f7-a0dd-4e0f-a264-1b60590df5c8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:34.933608 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-708155f7-a0dd-4e0f-a264-1b60590df5c8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:34.934471 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-708155f7-a0dd-4e0f-a264-1b60590df5c8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:34.935334 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-708155f7-a0dd-4e0f-a264-1b60590df5c8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:35.003952 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-708155f7-a0dd-4e0f-a264-1b60590df5c8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:30:35.159044 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-708155f7-a0dd-4e0f-a264-1b60590df5c8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 204 len: 0 microversion: 2.1 time: 0.261517 Jun 05 08:30:35.160229 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1005/1980] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:30:34 2022] DELETE /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:30:35.168651 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9cfb86d3-5f3e-47b3-8f8f-da7ef75cda88 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:35.170022 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9cfb86d3-5f3e-47b3-8f8f-da7ef75cda88 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] [instance: 8cddf461-3546-4475-91c7-419b46a255af] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:35.179487 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9cfb86d3-5f3e-47b3-8f8f-da7ef75cda88 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:35.180278 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9cfb86d3-5f3e-47b3-8f8f-da7ef75cda88 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:35.181358 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9cfb86d3-5f3e-47b3-8f8f-da7ef75cda88 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:35.182128 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9cfb86d3-5f3e-47b3-8f8f-da7ef75cda88 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:35.236649 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9cfb86d3-5f3e-47b3-8f8f-da7ef75cda88 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:35.240297 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9cfb86d3-5f3e-47b3-8f8f-da7ef75cda88 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:35.241047 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-9cfb86d3-5f3e-47b3-8f8f-da7ef75cda88 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Lazy-loading 'fault' on Instance uuid 8cddf461-3546-4475-91c7-419b46a255af {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:30:35.337494 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-9cfb86d3-5f3e-47b3-8f8f-da7ef75cda88 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '937d94e450c7457483bc6f6a03332644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ff420b4eb2442d3b779708d6fe78c1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:35.346370 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9cfb86d3-5f3e-47b3-8f8f-da7ef75cda88 tempest-DeleteServersAdminTestJSON-1318540523 tempest-DeleteServersAdminTestJSON-1318540523-project] 10.222.0.33 "GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af" status: 200 len: 1364 microversion: 2.1 time: 0.183977 Jun 05 08:30:35.347139 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1006/1981] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:35 2022] GET /compute/v2.1/servers/8cddf461-3546-4475-91c7-419b46a255af => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:35.366506 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fe8d7461-eddd-4eab-9b2f-2f539adbad84 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:35.366677 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-fe8d7461-eddd-4eab-9b2f-2f539adbad84 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:35.373999 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fe8d7461-eddd-4eab-9b2f-2f539adbad84 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:35.374467 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fe8d7461-eddd-4eab-9b2f-2f539adbad84 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:35.375709 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fe8d7461-eddd-4eab-9b2f-2f539adbad84 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:35.376189 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fe8d7461-eddd-4eab-9b2f-2f539adbad84 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:35.579103 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6c8a1ae4-5b71-4a27-b071-36ffb9e0f7ec tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:35.612782 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:30:35.640700 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6c8a1ae4-5b71-4a27-b071-36ffb9e0f7ec tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:35.644409 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6c8a1ae4-5b71-4a27-b071-36ffb9e0f7ec tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:35.647593 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6c8a1ae4-5b71-4a27-b071-36ffb9e0f7ec tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 1.035120 Jun 05 08:30:35.652779 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 976/1982] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:34 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:35.659693 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-263407a5-69d0-450c-a229-ee72790050f8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:35.662124 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-263407a5-69d0-450c-a229-ee72790050f8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:35.674226 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=6 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:30:35.692702 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-263407a5-69d0-450c-a229-ee72790050f8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:35.702536 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-263407a5-69d0-450c-a229-ee72790050f8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:35.703381 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-263407a5-69d0-450c-a229-ee72790050f8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:35.703836 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-263407a5-69d0-450c-a229-ee72790050f8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:36.109133 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-fe8d7461-eddd-4eab-9b2f-2f539adbad84 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:36.123121 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fe8d7461-eddd-4eab-9b2f-2f539adbad84 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1387 microversion: 2.1 time: 0.761431 Jun 05 08:30:36.123710 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1007/1983] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:35 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1387 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:36.142608 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9c6f5770-96f7-4602-91ed-49afb553d6a3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:36.143532 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9c6f5770-96f7-4602-91ed-49afb553d6a3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:36.162906 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9c6f5770-96f7-4602-91ed-49afb553d6a3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:36.166592 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9c6f5770-96f7-4602-91ed-49afb553d6a3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:36.167959 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9c6f5770-96f7-4602-91ed-49afb553d6a3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:36.171095 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9c6f5770-96f7-4602-91ed-49afb553d6a3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:36.535158 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-263407a5-69d0-450c-a229-ee72790050f8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:36.570176 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-263407a5-69d0-450c-a229-ee72790050f8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 200 len: 1496 microversion: 2.1 time: 0.915930 Jun 05 08:30:36.578761 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 977/1984] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:35 2022] GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 1496 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:36.601000 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-02c136de-db87-4ecc-88cd-0a6e9cc8dd83 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Action: 'create', calling method: .version_select at 0x7f24453e7af0>, body: {"keypair": {"name": "tempest-keypair-818595835", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPra8oOL5bbjKIkCFNYK0Kuiu+NQ+ccbww1mwOgLe3T96SzlFnU06aNTlHkJ1+D0JJZO9dc3vIRyV3NGE3KmEatsxuqypfTlixwi5TWpSNmb4lCMLqIZtvEx+cjV3QWoQ=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:36.650899 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-02c136de-db87-4ecc-88cd-0a6e9cc8dd83 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Getting quotas for project 2ed0e53a23984cea813890af8c283d0f. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:30:36.669036 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-02c136de-db87-4ecc-88cd-0a6e9cc8dd83 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Getting quotas for user 4ffd5630f41a48a694fc306c78712796 and project 2ed0e53a23984cea813890af8c283d0f. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:30:36.744457 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-02c136de-db87-4ecc-88cd-0a6e9cc8dd83 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.163288 Jun 05 08:30:36.745376 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 978/1985] 10.222.0.33 () {62 vars in 1199 bytes} [Sun Jun 5 08:30:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 165 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 05 08:30:36.761220 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-86772427-5938-4ae9-b77e-3ad7604c4a86 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:36.764326 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-86772427-5938-4ae9-b77e-3ad7604c4a86 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:36.789444 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-86772427-5938-4ae9-b77e-3ad7604c4a86 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:36.790015 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-86772427-5938-4ae9-b77e-3ad7604c4a86 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:36.790848 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-86772427-5938-4ae9-b77e-3ad7604c4a86 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:36.794073 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-86772427-5938-4ae9-b77e-3ad7604c4a86 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:37.143766 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-9c6f5770-96f7-4602-91ed-49afb553d6a3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:37.168458 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-9c6f5770-96f7-4602-91ed-49afb553d6a3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:37.176946 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-9c6f5770-96f7-4602-91ed-49afb553d6a3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:37.182485 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9c6f5770-96f7-4602-91ed-49afb553d6a3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1292 microversion: 2.25 time: 1.051309 Jun 05 08:30:37.202688 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1008/1986] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:36 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1292 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:37.211989 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9aab5b8d-088a-477f-98d3-aee9eea11746 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:37.214117 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9aab5b8d-088a-477f-98d3-aee9eea11746 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:37.234363 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9aab5b8d-088a-477f-98d3-aee9eea11746 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:37.234826 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9aab5b8d-088a-477f-98d3-aee9eea11746 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:37.236265 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9aab5b8d-088a-477f-98d3-aee9eea11746 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:37.238731 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9aab5b8d-088a-477f-98d3-aee9eea11746 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:37.549622 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-86772427-5938-4ae9-b77e-3ad7604c4a86 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:37.569501 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-86772427-5938-4ae9-b77e-3ad7604c4a86 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:37.571023 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-86772427-5938-4ae9-b77e-3ad7604c4a86 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:37.586065 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-86772427-5938-4ae9-b77e-3ad7604c4a86 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.825758 Jun 05 08:30:37.586728 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 979/1987] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:36 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:37.767468 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-9aab5b8d-088a-477f-98d3-aee9eea11746 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:37.785116 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9aab5b8d-088a-477f-98d3-aee9eea11746 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1387 microversion: 2.1 time: 0.581188 Jun 05 08:30:37.796379 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1009/1988] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:37 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1387 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:37.810233 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0e681fc5-473f-485d-bf95-4f9dd07c12d8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:37.811095 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0e681fc5-473f-485d-bf95-4f9dd07c12d8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:37.825117 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0e681fc5-473f-485d-bf95-4f9dd07c12d8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:37.826603 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0e681fc5-473f-485d-bf95-4f9dd07c12d8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:37.827673 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0e681fc5-473f-485d-bf95-4f9dd07c12d8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:37.828398 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0e681fc5-473f-485d-bf95-4f9dd07c12d8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:38.330444 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-67c042d6-23c4-440c-a0e7-74252c7d7477 tempest-AZV2TestJSON-382436781 tempest-AZV2TestJSON-382436781-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:38.335264 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-67c042d6-23c4-440c-a0e7-74252c7d7477 tempest-AZV2TestJSON-382436781 tempest-AZV2TestJSON-382436781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:38.336107 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-67c042d6-23c4-440c-a0e7-74252c7d7477 tempest-AZV2TestJSON-382436781 tempest-AZV2TestJSON-382436781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:38.339294 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-67c042d6-23c4-440c-a0e7-74252c7d7477 tempest-AZV2TestJSON-382436781 tempest-AZV2TestJSON-382436781-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:38.341093 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-67c042d6-23c4-440c-a0e7-74252c7d7477 tempest-AZV2TestJSON-382436781 tempest-AZV2TestJSON-382436781-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:38.426875 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-67c042d6-23c4-440c-a0e7-74252c7d7477 tempest-AZV2TestJSON-382436781 tempest-AZV2TestJSON-382436781-project] 10.222.0.33 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.838603 Jun 05 08:30:38.435182 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 980/1989] 10.222.0.33 () {58 vars in 1163 bytes} [Sun Jun 5 08:30:37 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:30:38.488831 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-f241919b-7185-422d-b8ba-d8dc49d4cc51 req-eae7c3ea-fd20-4368-923e-5e65fc394cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b732c5a-d12e-4ca7-aa45-dbe571de1c37", "name": "network-vif-deleted", "tag": "cec071fd-e740-4058-b029-ed9348ba5833"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:38.492885 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0e681fc5-473f-485d-bf95-4f9dd07c12d8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:38.506189 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0e681fc5-473f-485d-bf95-4f9dd07c12d8 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 200 len: 1473 microversion: 2.1 time: 0.707692 Jun 05 08:30:38.523292 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1010/1990] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:37 2022] GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 1473 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:38.532166 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0a6ca3b0-f140-4a1a-b694-1a3a3ea1ae70 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:38.536886 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0a6ca3b0-f140-4a1a-b694-1a3a3ea1ae70 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:38.540461 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-f241919b-7185-422d-b8ba-d8dc49d4cc51 req-eae7c3ea-fd20-4368-923e-5e65fc394cda service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:38.541814 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-f241919b-7185-422d-b8ba-d8dc49d4cc51 req-eae7c3ea-fd20-4368-923e-5e65fc394cda service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:38.558707 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0a6ca3b0-f140-4a1a-b694-1a3a3ea1ae70 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:38.560515 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0a6ca3b0-f140-4a1a-b694-1a3a3ea1ae70 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:38.564528 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0a6ca3b0-f140-4a1a-b694-1a3a3ea1ae70 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:38.564528 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0a6ca3b0-f140-4a1a-b694-1a3a3ea1ae70 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:38.602897 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-f241919b-7185-422d-b8ba-d8dc49d4cc51 req-eae7c3ea-fd20-4368-923e-5e65fc394cda service nova] Creating event network-vif-deleted:cec071fd-e740-4058-b029-ed9348ba5833 for instance 0b732c5a-d12e-4ca7-aa45-dbe571de1c37 on n-h2-844739-1 Jun 05 08:30:38.622156 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-f241919b-7185-422d-b8ba-d8dc49d4cc51 req-eae7c3ea-fd20-4368-923e-5e65fc394cda service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152817 Jun 05 08:30:38.625395 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 981/1991] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:30:38.646494 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f1a95062-456f-49a0-8780-d17b85d31659 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-389256800"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:38.655819 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f1a95062-456f-49a0-8780-d17b85d31659 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:38.686803 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f1a95062-456f-49a0-8780-d17b85d31659 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:38.687778 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f1a95062-456f-49a0-8780-d17b85d31659 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:38.688899 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f1a95062-456f-49a0-8780-d17b85d31659 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:38.693177 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f1a95062-456f-49a0-8780-d17b85d31659 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:39.489593 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f1a95062-456f-49a0-8780-d17b85d31659 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "POST /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d/action" status: 202 len: 0 microversion: 2.1 time: 0.856666 Jun 05 08:30:39.499116 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 982/1992] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Jun 5 08:30:38 2022] POST /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d/action => generated 0 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 05 08:30:39.513263 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8c2b61ff-4ea5-4314-a9e2-2df30aa91681 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:39.515363 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8c2b61ff-4ea5-4314-a9e2-2df30aa91681 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:39.549905 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8c2b61ff-4ea5-4314-a9e2-2df30aa91681 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:39.550943 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8c2b61ff-4ea5-4314-a9e2-2df30aa91681 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:39.552566 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8c2b61ff-4ea5-4314-a9e2-2df30aa91681 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:39.553123 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8c2b61ff-4ea5-4314-a9e2-2df30aa91681 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:40.280814 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0a6ca3b0-f140-4a1a-b694-1a3a3ea1ae70 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:40.315271 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0a6ca3b0-f140-4a1a-b694-1a3a3ea1ae70 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:40.318034 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0a6ca3b0-f140-4a1a-b694-1a3a3ea1ae70 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:40.319612 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0a6ca3b0-f140-4a1a-b694-1a3a3ea1ae70 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1292 microversion: 2.25 time: 1.795000 Jun 05 08:30:40.321067 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1011/1993] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:38 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1292 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:40.339694 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3dbc02cb-a05c-4292-aabf-8498a9b40630 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:40.345108 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3dbc02cb-a05c-4292-aabf-8498a9b40630 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:40.359883 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3dbc02cb-a05c-4292-aabf-8498a9b40630 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:40.362118 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3dbc02cb-a05c-4292-aabf-8498a9b40630 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:40.363359 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3dbc02cb-a05c-4292-aabf-8498a9b40630 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:40.365007 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3dbc02cb-a05c-4292-aabf-8498a9b40630 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:40.534025 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8c2b61ff-4ea5-4314-a9e2-2df30aa91681 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:40.545874 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8c2b61ff-4ea5-4314-a9e2-2df30aa91681 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:40.558661 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8c2b61ff-4ea5-4314-a9e2-2df30aa91681 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:40.567408 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8c2b61ff-4ea5-4314-a9e2-2df30aa91681 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 1.065923 Jun 05 08:30:40.569678 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 983/1994] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:39 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:40.582317 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f8cc5541-e981-4a17-ab4b-c3335016b24a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f2445314f70>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:40.696227 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f8cc5541-e981-4a17-ab4b-c3335016b24a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e" status: 200 len: 1413 microversion: 2.1 time: 0.124722 Jun 05 08:30:40.696887 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 984/1995] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:30:40 2022] GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e => generated 1413 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:40.721881 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3dbc02cb-a05c-4292-aabf-8498a9b40630 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:40.731642 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3dbc02cb-a05c-4292-aabf-8498a9b40630 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.408799 Jun 05 08:30:40.744136 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1012/1996] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:40 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:41.343909 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-219e3ded-2422-4110-9d24-06ced52c19d9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:41.344468 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-219e3ded-2422-4110-9d24-06ced52c19d9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:41.375282 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-219e3ded-2422-4110-9d24-06ced52c19d9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:41.376378 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-219e3ded-2422-4110-9d24-06ced52c19d9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:41.377225 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-219e3ded-2422-4110-9d24-06ced52c19d9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:41.377678 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-219e3ded-2422-4110-9d24-06ced52c19d9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:41.590722 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5ff376ee-1da7-418b-917a-063ea6b68cf0 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:41.591367 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5ff376ee-1da7-418b-917a-063ea6b68cf0 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:41.633812 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5ff376ee-1da7-418b-917a-063ea6b68cf0 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:41.634322 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5ff376ee-1da7-418b-917a-063ea6b68cf0 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:41.635129 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5ff376ee-1da7-418b-917a-063ea6b68cf0 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:41.635574 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5ff376ee-1da7-418b-917a-063ea6b68cf0 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:41.678765 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-219e3ded-2422-4110-9d24-06ced52c19d9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:41.704934 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-219e3ded-2422-4110-9d24-06ced52c19d9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:41.712906 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-219e3ded-2422-4110-9d24-06ced52c19d9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:41.715399 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-219e3ded-2422-4110-9d24-06ced52c19d9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1292 microversion: 2.25 time: 0.379349 Jun 05 08:30:41.717883 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 985/1997] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:41 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1292 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:41.735369 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a9fe5445-6f7d-411e-aea5-f5220115e13f tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f244533fdc0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:41.827118 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a9fe5445-6f7d-411e-aea5-f5220115e13f tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e" status: 200 len: 1413 microversion: 2.1 time: 0.106262 Jun 05 08:30:41.844261 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 986/1998] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:30:41 2022] GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e => generated 1413 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:41.852976 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6deab05f-b1d2-41cc-9fa8-f3b56014c018 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:41.853598 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6deab05f-b1d2-41cc-9fa8-f3b56014c018 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:41.862351 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6deab05f-b1d2-41cc-9fa8-f3b56014c018 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:41.862351 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6deab05f-b1d2-41cc-9fa8-f3b56014c018 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:41.873817 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6deab05f-b1d2-41cc-9fa8-f3b56014c018 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:41.874443 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6deab05f-b1d2-41cc-9fa8-f3b56014c018 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:42.155797 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6deab05f-b1d2-41cc-9fa8-f3b56014c018 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:42.177541 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6deab05f-b1d2-41cc-9fa8-f3b56014c018 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.327590 Jun 05 08:30:42.183966 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 987/1999] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:41 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:42.331372 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5ff376ee-1da7-418b-917a-063ea6b68cf0 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:42.359981 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5ff376ee-1da7-418b-917a-063ea6b68cf0 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:42.361938 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5ff376ee-1da7-418b-917a-063ea6b68cf0 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:42.363706 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5ff376ee-1da7-418b-917a-063ea6b68cf0 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.778298 Jun 05 08:30:42.375842 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1013/2000] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:41 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:42.735944 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a54e7aa6-c852-47ac-8331-4f5a4546e610 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:42.740407 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a54e7aa6-c852-47ac-8331-4f5a4546e610 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:42.761471 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a54e7aa6-c852-47ac-8331-4f5a4546e610 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:42.764090 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a54e7aa6-c852-47ac-8331-4f5a4546e610 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:42.765514 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a54e7aa6-c852-47ac-8331-4f5a4546e610 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:42.767358 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a54e7aa6-c852-47ac-8331-4f5a4546e610 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:42.865432 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-57779dde-3ca6-4972-9a40-9fb1427aabcb tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f2445486430>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:42.985109 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-57779dde-3ca6-4972-9a40-9fb1427aabcb tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e" status: 200 len: 1413 microversion: 2.1 time: 0.129609 Jun 05 08:30:42.986558 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1014/2001] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:30:42 2022] GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e => generated 1413 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:43.199457 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-10bd5a36-f0fd-4fcf-929c-63bb02c25f6e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:43.201300 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-10bd5a36-f0fd-4fcf-929c-63bb02c25f6e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:43.213620 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10bd5a36-f0fd-4fcf-929c-63bb02c25f6e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:43.214618 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10bd5a36-f0fd-4fcf-929c-63bb02c25f6e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:43.216970 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10bd5a36-f0fd-4fcf-929c-63bb02c25f6e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:43.218212 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10bd5a36-f0fd-4fcf-929c-63bb02c25f6e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:43.245021 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a54e7aa6-c852-47ac-8331-4f5a4546e610 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:43.253038 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a54e7aa6-c852-47ac-8331-4f5a4546e610 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:43.255208 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a54e7aa6-c852-47ac-8331-4f5a4546e610 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:43.261752 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a54e7aa6-c852-47ac-8331-4f5a4546e610 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1292 microversion: 2.25 time: 0.529548 Jun 05 08:30:43.264217 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 988/2002] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:42 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1292 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:43.347049 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-10bd5a36-f0fd-4fcf-929c-63bb02c25f6e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:43.357178 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-10bd5a36-f0fd-4fcf-929c-63bb02c25f6e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.163419 Jun 05 08:30:43.361453 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1015/2003] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:43 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:30:43.391050 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0d4d5d02-3c75-48ad-88f3-5f37273730bd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:43.392015 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0d4d5d02-3c75-48ad-88f3-5f37273730bd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:43.405470 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0d4d5d02-3c75-48ad-88f3-5f37273730bd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:43.408970 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0d4d5d02-3c75-48ad-88f3-5f37273730bd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:43.416337 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0d4d5d02-3c75-48ad-88f3-5f37273730bd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:43.417090 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0d4d5d02-3c75-48ad-88f3-5f37273730bd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:43.705749 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-4ff5bec6-c8f7-463d-bc1e-505ae99f2a2f req-dafe5277-29f8-401d-aa20-2075c33358d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73be951-4be1-4f53-ab55-92c80bdc199d", "name": "network-vif-plugged", "status": "completed", "tag": "08bcdec3-4528-44c9-bd1e-24888f45cd2c"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:43.719877 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-4ff5bec6-c8f7-463d-bc1e-505ae99f2a2f req-dafe5277-29f8-401d-aa20-2075c33358d3 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:43.722757 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-4ff5bec6-c8f7-463d-bc1e-505ae99f2a2f req-dafe5277-29f8-401d-aa20-2075c33358d3 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:43.759345 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-4ff5bec6-c8f7-463d-bc1e-505ae99f2a2f req-dafe5277-29f8-401d-aa20-2075c33358d3 service nova] Creating event network-vif-plugged:08bcdec3-4528-44c9-bd1e-24888f45cd2c for instance d73be951-4be1-4f53-ab55-92c80bdc199d on n-h2-844739-1 Jun 05 08:30:43.775755 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-4ff5bec6-c8f7-463d-bc1e-505ae99f2a2f req-dafe5277-29f8-401d-aa20-2075c33358d3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074017 Jun 05 08:30:43.781613 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1016/2004] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:30:43.908305 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0d4d5d02-3c75-48ad-88f3-5f37273730bd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:43.938118 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0d4d5d02-3c75-48ad-88f3-5f37273730bd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:43.952455 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0d4d5d02-3c75-48ad-88f3-5f37273730bd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:43.956288 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0d4d5d02-3c75-48ad-88f3-5f37273730bd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.569308 Jun 05 08:30:43.970776 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 989/2005] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:43 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:44.003300 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-125d0396-9306-4b4e-9d01-6537d972fa5d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24454861f0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:44.110668 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-125d0396-9306-4b4e-9d01-6537d972fa5d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e" status: 200 len: 1413 microversion: 2.1 time: 0.106954 Jun 05 08:30:44.115571 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1017/2006] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:30:43 2022] GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e => generated 1413 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:44.282828 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5c57bc2a-5c97-4cca-9fbc-cb477b5803a7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:44.284209 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5c57bc2a-5c97-4cca-9fbc-cb477b5803a7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:44.306319 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5c57bc2a-5c97-4cca-9fbc-cb477b5803a7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:44.311312 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5c57bc2a-5c97-4cca-9fbc-cb477b5803a7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:44.313491 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5c57bc2a-5c97-4cca-9fbc-cb477b5803a7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:44.316501 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5c57bc2a-5c97-4cca-9fbc-cb477b5803a7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:44.379936 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d1449efc-0f4e-4af3-86ea-4906e66882a5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:44.380727 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d1449efc-0f4e-4af3-86ea-4906e66882a5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:44.407508 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d1449efc-0f4e-4af3-86ea-4906e66882a5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:44.407974 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d1449efc-0f4e-4af3-86ea-4906e66882a5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:44.408982 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d1449efc-0f4e-4af3-86ea-4906e66882a5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:44.413135 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d1449efc-0f4e-4af3-86ea-4906e66882a5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:44.434092 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:30:44.917996 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d1449efc-0f4e-4af3-86ea-4906e66882a5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:45.026394 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d1449efc-0f4e-4af3-86ea-4906e66882a5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.646594 Jun 05 08:30:45.038219 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1018/2007] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:44 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:30:45.061703 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5c57bc2a-5c97-4cca-9fbc-cb477b5803a7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:45.074392 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5c57bc2a-5c97-4cca-9fbc-cb477b5803a7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:45.086090 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5c57bc2a-5c97-4cca-9fbc-cb477b5803a7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:45.095061 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5c57bc2a-5c97-4cca-9fbc-cb477b5803a7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1292 microversion: 2.25 time: 0.817141 Jun 05 08:30:45.100452 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-dd3c5d74-2a61-4862-ac04-be6d41fd96f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-162623321", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4de3a7e-2405-4e59-8dfd-a93eda6fe430"}], "security_groups": [{"name": "tempest-securitygroup--674719953"}], "key_name": "tempest-keypair-818595835", "user_data": "}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:45.107539 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 990/2008] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:44 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1292 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:45.539607 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5dd0c934-56c2-4536-befb-297da5dbf3cb tempest-FlavorsExtraSpecsTestJSON-854789067 tempest-FlavorsExtraSpecsTestJSON-854789067-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1351126523", "ram": 512, "vcpus": 1, "disk": 10, "id": 1231070582, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:45.542260 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:30:45.542260 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:30:45.578619 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5dd0c934-56c2-4536-befb-297da5dbf3cb tempest-FlavorsExtraSpecsTestJSON-854789067 tempest-FlavorsExtraSpecsTestJSON-854789067-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.466655 Jun 05 08:30:45.579317 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 991/2009] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:30:45 2022] POST /compute/v2.1/flavors => generated 416 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:30:45.601963 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6eb95471-6016-4f23-b149-41f9b0c759d6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:45.603021 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6eb95471-6016-4f23-b149-41f9b0c759d6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:45.616769 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:30:45.632669 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6eb95471-6016-4f23-b149-41f9b0c759d6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:45.633683 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6eb95471-6016-4f23-b149-41f9b0c759d6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:45.634914 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6eb95471-6016-4f23-b149-41f9b0c759d6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:45.635648 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6eb95471-6016-4f23-b149-41f9b0c759d6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:45.639305 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-dd3c5d74-2a61-4862-ac04-be6d41fd96f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] validate_networks() for [('b4de3a7e-2405-4e59-8dfd-a93eda6fe430', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:30:46.086606 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6eb95471-6016-4f23-b149-41f9b0c759d6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:46.097379 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6eb95471-6016-4f23-b149-41f9b0c759d6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:46.115270 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6eb95471-6016-4f23-b149-41f9b0c759d6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:46.118655 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6eb95471-6016-4f23-b149-41f9b0c759d6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.530169 Jun 05 08:30:46.119525 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 992/2010] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:45 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:46.125772 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6e99ef05-7c05-4fd3-84ce-93a3c7e23f0e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24331a3d30>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:46.201648 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6e99ef05-7c05-4fd3-84ce-93a3c7e23f0e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e" status: 200 len: 1413 microversion: 2.1 time: 0.080017 Jun 05 08:30:46.202477 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 993/2011] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:30:46 2022] GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e => generated 1413 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:46.213019 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-35e7a941-6c33-4e46-8c19-6a5f790d9f52 tempest-FlavorsExtraSpecsTestJSON-854789067 tempest-FlavorsExtraSpecsTestJSON-854789067-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:46.219365 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:30:46.219365 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:30:46.279819 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-35e7a941-6c33-4e46-8c19-6a5f790d9f52 tempest-FlavorsExtraSpecsTestJSON-854789067 tempest-FlavorsExtraSpecsTestJSON-854789067-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1231070582/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.075985 Jun 05 08:30:46.281151 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 994/2012] 10.222.0.33 () {60 vars in 1223 bytes} [Sun Jun 5 08:30:46 2022] POST /compute/v2.1/flavors/1231070582/os-extra_specs => generated 66 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:30:46.304868 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a1c8b659-abd4-4e6a-ab33-3ce9d507aaeb tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:46.312191 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a1c8b659-abd4-4e6a-ab33-3ce9d507aaeb tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:46.331870 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a1c8b659-abd4-4e6a-ab33-3ce9d507aaeb tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:46.332808 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a1c8b659-abd4-4e6a-ab33-3ce9d507aaeb tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:46.339613 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a1c8b659-abd4-4e6a-ab33-3ce9d507aaeb tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:46.340271 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a1c8b659-abd4-4e6a-ab33-3ce9d507aaeb tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:46.486112 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a1c8b659-abd4-4e6a-ab33-3ce9d507aaeb tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:46.495556 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a1c8b659-abd4-4e6a-ab33-3ce9d507aaeb tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.196279 Jun 05 08:30:46.500915 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 995/2013] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:46 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:46.514904 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5674045e-ee2a-4a02-99d4-89332a28a2e5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:46.517027 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5674045e-ee2a-4a02-99d4-89332a28a2e5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:46.534372 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5674045e-ee2a-4a02-99d4-89332a28a2e5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:46.535375 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5674045e-ee2a-4a02-99d4-89332a28a2e5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:46.536632 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5674045e-ee2a-4a02-99d4-89332a28a2e5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:46.537079 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5674045e-ee2a-4a02-99d4-89332a28a2e5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:46.688756 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=4 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:30:47.078737 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-dd3c5d74-2a61-4862-ac04-be6d41fd96f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:30:47.079227 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-dd3c5d74-2a61-4862-ac04-be6d41fd96f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:30:47.079633 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-dd3c5d74-2a61-4862-ac04-be6d41fd96f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:30:47.080033 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-dd3c5d74-2a61-4862-ac04-be6d41fd96f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:30:47.080584 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-dd3c5d74-2a61-4862-ac04-be6d41fd96f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:30:47.104717 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dd3c5d74-2a61-4862-ac04-be6d41fd96f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:47.105170 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dd3c5d74-2a61-4862-ac04-be6d41fd96f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:47.105978 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dd3c5d74-2a61-4862-ac04-be6d41fd96f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:47.106417 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dd3c5d74-2a61-4862-ac04-be6d41fd96f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:47.160603 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-dd3c5d74-2a61-4862-ac04-be6d41fd96f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Getting quotas for project 2ed0e53a23984cea813890af8c283d0f. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:30:47.176792 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-dd3c5d74-2a61-4862-ac04-be6d41fd96f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Getting quotas for user 4ffd5630f41a48a694fc306c78712796 and project 2ed0e53a23984cea813890af8c283d0f. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:30:47.215865 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-dd3c5d74-2a61-4862-ac04-be6d41fd96f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:30:47.219234 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-dd3c5d74-2a61-4862-ac04-be6d41fd96f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:30:47.331081 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-dd3c5d74-2a61-4862-ac04-be6d41fd96f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.285629 Jun 05 08:30:47.338816 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1019/2014] 10.222.0.33 () {62 vars in 1187 bytes} [Sun Jun 5 08:30:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 2299 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 05 08:30:47.522419 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5674045e-ee2a-4a02-99d4-89332a28a2e5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:47.552388 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5674045e-ee2a-4a02-99d4-89332a28a2e5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:47.562219 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5674045e-ee2a-4a02-99d4-89332a28a2e5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:47.571329 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5674045e-ee2a-4a02-99d4-89332a28a2e5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1292 microversion: 2.25 time: 1.068773 Jun 05 08:30:47.580284 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 996/2015] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:46 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1292 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:47.587257 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6d4f0dd5-5c38-42c4-a642-a28bc6cf8a02 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:47.592420 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6d4f0dd5-5c38-42c4-a642-a28bc6cf8a02 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:47.606850 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6d4f0dd5-5c38-42c4-a642-a28bc6cf8a02 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:47.609928 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6d4f0dd5-5c38-42c4-a642-a28bc6cf8a02 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:47.611913 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6d4f0dd5-5c38-42c4-a642-a28bc6cf8a02 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:47.611913 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6d4f0dd5-5c38-42c4-a642-a28bc6cf8a02 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:47.840244 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d1a30066-615a-48d5-bac9-24019fd017a0 tempest-FlavorsExtraSpecsTestJSON-1550163570 tempest-FlavorsExtraSpecsTestJSON-1550163570-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:47.855396 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d1a30066-615a-48d5-bac9-24019fd017a0 tempest-FlavorsExtraSpecsTestJSON-1550163570 tempest-FlavorsExtraSpecsTestJSON-1550163570-project] 10.222.0.33 "GET /compute/v2.1/flavors/1231070582/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.515015 Jun 05 08:30:47.858426 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1020/2016] 10.222.0.33 () {58 vars in 1202 bytes} [Sun Jun 5 08:30:47 2022] GET /compute/v2.1/flavors/1231070582/os-extra_specs => generated 66 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:30:47.870516 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8807a68a-5799-4ede-bbce-fbd0a5815fba tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24453c0dc0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:47.947105 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8807a68a-5799-4ede-bbce-fbd0a5815fba tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e" status: 200 len: 1413 microversion: 2.1 time: 0.086733 Jun 05 08:30:47.948466 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1021/2017] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:30:47 2022] GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e => generated 1413 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:48.064275 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6d4f0dd5-5c38-42c4-a642-a28bc6cf8a02 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:48.064469 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3b43ad95-3fa0-43c3-80e3-f98b4243549d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:48.064908 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3b43ad95-3fa0-43c3-80e3-f98b4243549d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:48.080344 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6d4f0dd5-5c38-42c4-a642-a28bc6cf8a02 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:48.085223 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6d4f0dd5-5c38-42c4-a642-a28bc6cf8a02 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:48.088574 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6d4f0dd5-5c38-42c4-a642-a28bc6cf8a02 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.505481 Jun 05 08:30:48.090883 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 997/2018] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:47 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:48.100139 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-dc4a60bd-c75b-4d2a-8943-be9bcb4860ab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:48.103609 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-dc4a60bd-c75b-4d2a-8943-be9bcb4860ab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:48.118734 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc4a60bd-c75b-4d2a-8943-be9bcb4860ab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:48.119479 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc4a60bd-c75b-4d2a-8943-be9bcb4860ab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:48.120493 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc4a60bd-c75b-4d2a-8943-be9bcb4860ab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:48.121123 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc4a60bd-c75b-4d2a-8943-be9bcb4860ab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:48.372255 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:30:48.425919 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3b43ad95-3fa0-43c3-80e3-f98b4243549d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:48.437916 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3b43ad95-3fa0-43c3-80e3-f98b4243549d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:48.457014 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3b43ad95-3fa0-43c3-80e3-f98b4243549d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:48.459435 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3b43ad95-3fa0-43c3-80e3-f98b4243549d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1280 microversion: 2.20 time: 0.509736 Jun 05 08:30:48.466784 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1022/2019] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:47 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1280 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:48.469974 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-dc4a60bd-c75b-4d2a-8943-be9bcb4860ab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:48.481442 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2246d7dc-e538-45b5-86a8-9781cdeedd26 tempest-FlavorsExtraSpecsTestJSON-854789067 tempest-FlavorsExtraSpecsTestJSON-854789067-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:48.494422 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-dc4a60bd-c75b-4d2a-8943-be9bcb4860ab tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.401111 Jun 05 08:30:48.497051 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:30:48.497051 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:30:48.505616 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 998/2020] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:48 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:48.586270 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2246d7dc-e538-45b5-86a8-9781cdeedd26 tempest-FlavorsExtraSpecsTestJSON-854789067 tempest-FlavorsExtraSpecsTestJSON-854789067-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1231070582/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.117758 Jun 05 08:30:48.586892 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1023/2021] 10.222.0.33 () {60 vars in 1223 bytes} [Sun Jun 5 08:30:48 2022] POST /compute/v2.1/flavors/1231070582/os-extra_specs => generated 66 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:30:48.596352 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fa27e06d-35d7-44ff-b99c-a322b467c075 tempest-FlavorsExtraSpecsTestJSON-1550163570 tempest-FlavorsExtraSpecsTestJSON-1550163570-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:48.606754 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0b63d5b5-6020-4235-993d-3064a0690ad3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:48.619289 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0b63d5b5-6020-4235-993d-3064a0690ad3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:48.631279 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fa27e06d-35d7-44ff-b99c-a322b467c075 tempest-FlavorsExtraSpecsTestJSON-1550163570 tempest-FlavorsExtraSpecsTestJSON-1550163570-project] 10.222.0.33 "GET /compute/v2.1/flavors/1231070582/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.034231 Jun 05 08:30:48.640922 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 999/2022] 10.222.0.33 () {58 vars in 1244 bytes} [Sun Jun 5 08:30:48 2022] GET /compute/v2.1/flavors/1231070582/os-extra_specs/hw:numa_nodes => generated 22 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:30:48.646058 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0b63d5b5-6020-4235-993d-3064a0690ad3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:48.649890 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d04d613f-3db6-4544-af27-6c09ef838437 tempest-FlavorsExtraSpecsTestJSON-854789067 tempest-FlavorsExtraSpecsTestJSON-854789067-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:48.651768 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0b63d5b5-6020-4235-993d-3064a0690ad3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:48.657119 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:30:48.657119 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:30:48.657751 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0b63d5b5-6020-4235-993d-3064a0690ad3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:48.658546 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0b63d5b5-6020-4235-993d-3064a0690ad3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:48.733442 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d04d613f-3db6-4544-af27-6c09ef838437 tempest-FlavorsExtraSpecsTestJSON-854789067 tempest-FlavorsExtraSpecsTestJSON-854789067-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1231070582/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.090023 Jun 05 08:30:48.734682 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1000/2023] 10.222.0.33 () {60 vars in 1223 bytes} [Sun Jun 5 08:30:48 2022] POST /compute/v2.1/flavors/1231070582/os-extra_specs => generated 66 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:30:48.747605 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a22dbb01-b29b-4549-8277-1515052b686b tempest-FlavorsExtraSpecsTestJSON-854789067 tempest-FlavorsExtraSpecsTestJSON-854789067-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:48.786607 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a22dbb01-b29b-4549-8277-1515052b686b tempest-FlavorsExtraSpecsTestJSON-854789067 tempest-FlavorsExtraSpecsTestJSON-854789067-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/1231070582/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.044495 Jun 05 08:30:48.789289 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1001/2024] 10.222.0.33 () {58 vars in 1202 bytes} [Sun Jun 5 08:30:48 2022] GET /compute/v2.1/flavors/1231070582/os-extra_specs => generated 66 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:30:48.801205 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9f1dd9ee-c392-40b9-969c-79ace2f02c6d tempest-FlavorsExtraSpecsTestJSON-854789067 tempest-FlavorsExtraSpecsTestJSON-854789067-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:48.803595 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:30:48.803595 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:30:48.862474 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9f1dd9ee-c392-40b9-969c-79ace2f02c6d tempest-FlavorsExtraSpecsTestJSON-854789067 tempest-FlavorsExtraSpecsTestJSON-854789067-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/1231070582/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.068321 Jun 05 08:30:48.865546 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1002/2025] 10.222.0.33 () {60 vars in 1264 bytes} [Sun Jun 5 08:30:48 2022] PUT /compute/v2.1/flavors/1231070582/os-extra_specs/hw:numa_nodes => generated 22 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:30:48.875316 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b2b5012e-368d-4c7d-9ff9-413475df4897 tempest-FlavorsExtraSpecsTestJSON-854789067 tempest-FlavorsExtraSpecsTestJSON-854789067-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:48.900001 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b2b5012e-368d-4c7d-9ff9-413475df4897 tempest-FlavorsExtraSpecsTestJSON-854789067 tempest-FlavorsExtraSpecsTestJSON-854789067-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/1231070582/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.029361 Jun 05 08:30:48.902850 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1003/2026] 10.222.0.33 () {58 vars in 1202 bytes} [Sun Jun 5 08:30:48 2022] GET /compute/v2.1/flavors/1231070582/os-extra_specs => generated 66 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:30:48.911047 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4c9cb2d3-fba5-413a-ba5b-20d1641b1f35 tempest-FlavorsExtraSpecsTestJSON-854789067 tempest-FlavorsExtraSpecsTestJSON-854789067-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:48.912338 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:30:48.912338 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:30:48.963039 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4c9cb2d3-fba5-413a-ba5b-20d1641b1f35 tempest-FlavorsExtraSpecsTestJSON-854789067 tempest-FlavorsExtraSpecsTestJSON-854789067-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1231070582/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.056321 Jun 05 08:30:48.964077 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1004/2027] 10.222.0.33 () {58 vars in 1247 bytes} [Sun Jun 5 08:30:48 2022] DELETE /compute/v2.1/flavors/1231070582/os-extra_specs/hw:numa_nodes => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 05 08:30:48.971285 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-adf7aecc-fc70-45a0-a1b1-2771c6a65d27 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24331a80d0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:49.053649 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-adf7aecc-fc70-45a0-a1b1-2771c6a65d27 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e" status: 200 len: 1413 microversion: 2.1 time: 0.088187 Jun 05 08:30:49.056668 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1005/2028] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:30:48 2022] GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e => generated 1413 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:49.069376 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2e6eecc4-9258-4e43-8a71-d43d02062604 tempest-FlavorsExtraSpecsTestJSON-854789067 tempest-FlavorsExtraSpecsTestJSON-854789067-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:49.119954 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2e6eecc4-9258-4e43-8a71-d43d02062604 tempest-FlavorsExtraSpecsTestJSON-854789067 tempest-FlavorsExtraSpecsTestJSON-854789067-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1231070582/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.060772 Jun 05 08:30:49.123771 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1006/2029] 10.222.0.33 () {58 vars in 1247 bytes} [Sun Jun 5 08:30:49 2022] DELETE /compute/v2.1/flavors/1231070582/os-extra_specs/hw:cpu_policy => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 05 08:30:49.135091 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1baabb56-bf8c-4857-ad95-d4ef90198f8a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:49.135727 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1baabb56-bf8c-4857-ad95-d4ef90198f8a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:49.153109 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1baabb56-bf8c-4857-ad95-d4ef90198f8a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:49.153577 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1baabb56-bf8c-4857-ad95-d4ef90198f8a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:49.154380 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1baabb56-bf8c-4857-ad95-d4ef90198f8a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:49.154833 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1baabb56-bf8c-4857-ad95-d4ef90198f8a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:49.171970 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:30:49.839831 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0b63d5b5-6020-4235-993d-3064a0690ad3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:49.849505 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0b63d5b5-6020-4235-993d-3064a0690ad3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:49.866246 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0b63d5b5-6020-4235-993d-3064a0690ad3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:49.876992 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0b63d5b5-6020-4235-993d-3064a0690ad3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1292 microversion: 2.25 time: 1.276902 Jun 05 08:30:49.896481 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1024/2030] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:48 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1292 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:49.905562 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8a3905f1-b9f8-4f37-b9b8-4577d3e493f0 tempest-FlavorsExtraSpecsTestJSON-854789067 tempest-FlavorsExtraSpecsTestJSON-854789067-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:49.935862 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8a3905f1-b9f8-4f37-b9b8-4577d3e493f0 tempest-FlavorsExtraSpecsTestJSON-854789067 tempest-FlavorsExtraSpecsTestJSON-854789067-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/1231070582/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.037930 Jun 05 08:30:49.948223 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1025/2031] 10.222.0.33 () {58 vars in 1202 bytes} [Sun Jun 5 08:30:49 2022] GET /compute/v2.1/flavors/1231070582/os-extra_specs => generated 19 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:30:49.953679 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-293266b0-e07e-4b2c-b20c-03a2b9acec0a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:49.954436 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-293266b0-e07e-4b2c-b20c-03a2b9acec0a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:49.961247 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-293266b0-e07e-4b2c-b20c-03a2b9acec0a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:49.962087 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-293266b0-e07e-4b2c-b20c-03a2b9acec0a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:49.963107 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-293266b0-e07e-4b2c-b20c-03a2b9acec0a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:49.963770 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-293266b0-e07e-4b2c-b20c-03a2b9acec0a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:50.582730 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-1baabb56-bf8c-4857-ad95-d4ef90198f8a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:50.601766 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-1baabb56-bf8c-4857-ad95-d4ef90198f8a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:50.603702 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-1baabb56-bf8c-4857-ad95-d4ef90198f8a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:50.605105 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-293266b0-e07e-4b2c-b20c-03a2b9acec0a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:50.607775 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1baabb56-bf8c-4857-ad95-d4ef90198f8a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 1.484932 Jun 05 08:30:50.614596 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1007/2032] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:49 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:50.620342 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0d30eebf-bfaa-4342-9d73-8720226341ec tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:50.633351 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-293266b0-e07e-4b2c-b20c-03a2b9acec0a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:50.634607 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0d30eebf-bfaa-4342-9d73-8720226341ec tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:50.639190 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-293266b0-e07e-4b2c-b20c-03a2b9acec0a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:50.640521 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-293266b0-e07e-4b2c-b20c-03a2b9acec0a tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1338 microversion: 2.20 time: 0.690914 Jun 05 08:30:50.641082 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1026/2033] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:49 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1338 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:50.657612 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4ed27165-1cec-4670-9a6a-11b2f3015ab3 tempest-FlavorsExtraSpecsTestJSON-854789067 tempest-FlavorsExtraSpecsTestJSON-854789067-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:50.658415 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:30:50.658415 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:30:50.661140 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0d30eebf-bfaa-4342-9d73-8720226341ec tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:50.664290 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0d30eebf-bfaa-4342-9d73-8720226341ec tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:50.665425 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0d30eebf-bfaa-4342-9d73-8720226341ec tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:50.670504 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0d30eebf-bfaa-4342-9d73-8720226341ec tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:50.696303 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4ed27165-1cec-4670-9a6a-11b2f3015ab3 tempest-FlavorsExtraSpecsTestJSON-854789067 tempest-FlavorsExtraSpecsTestJSON-854789067-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1231070582" status: 202 len: 0 microversion: 2.1 time: 0.052515 Jun 05 08:30:50.701073 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1027/2034] 10.222.0.33 () {58 vars in 1160 bytes} [Sun Jun 5 08:30:50 2022] DELETE /compute/v2.1/flavors/1231070582 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:30:50.726493 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b0b276a5-ab86-4d2e-9448-2f17ebb012f2 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f244535e940>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:50.837693 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0d30eebf-bfaa-4342-9d73-8720226341ec tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:50.854519 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0d30eebf-bfaa-4342-9d73-8720226341ec tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.237894 Jun 05 08:30:50.856109 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b0b276a5-ab86-4d2e-9448-2f17ebb012f2 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e" status: 200 len: 1413 microversion: 2.1 time: 0.153689 Jun 05 08:30:50.857230 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1028/2035] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:30:50 2022] GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e => generated 1413 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:50.862310 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1008/2036] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:50 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:50.895935 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-08ab75ef-4510-4db4-af4a-36d15d8741bc tempest-FlavorsExtraSpecsTestJSON-854789067 tempest-FlavorsExtraSpecsTestJSON-854789067-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:50.897540 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-72ed37ba-62e2-45c3-80fa-20adc558824e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:50.898169 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-72ed37ba-62e2-45c3-80fa-20adc558824e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:50.913115 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-72ed37ba-62e2-45c3-80fa-20adc558824e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:50.913579 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-72ed37ba-62e2-45c3-80fa-20adc558824e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:50.914370 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-72ed37ba-62e2-45c3-80fa-20adc558824e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:50.914817 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-72ed37ba-62e2-45c3-80fa-20adc558824e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:50.986529 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-08ab75ef-4510-4db4-af4a-36d15d8741bc tempest-FlavorsExtraSpecsTestJSON-854789067 tempest-FlavorsExtraSpecsTestJSON-854789067-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.118292 Jun 05 08:30:50.998963 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1009/2037] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:30:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:51.401548 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-72ed37ba-62e2-45c3-80fa-20adc558824e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:51.418182 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-72ed37ba-62e2-45c3-80fa-20adc558824e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:51.419721 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-72ed37ba-62e2-45c3-80fa-20adc558824e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:51.420913 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-72ed37ba-62e2-45c3-80fa-20adc558824e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1292 microversion: 2.25 time: 0.527874 Jun 05 08:30:51.425088 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1029/2038] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:50 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1292 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:30:51.632225 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-12aaefe3-9005-4e7b-b74d-6641be49768f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:51.633602 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-12aaefe3-9005-4e7b-b74d-6641be49768f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:51.656369 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-12aaefe3-9005-4e7b-b74d-6641be49768f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:51.661312 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-12aaefe3-9005-4e7b-b74d-6641be49768f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:51.665467 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5c6a16ea-fcb8-4716-8164-e55a042fa125 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:51.666319 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-12aaefe3-9005-4e7b-b74d-6641be49768f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:51.667163 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5c6a16ea-fcb8-4716-8164-e55a042fa125 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:51.671132 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-12aaefe3-9005-4e7b-b74d-6641be49768f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:51.679990 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5c6a16ea-fcb8-4716-8164-e55a042fa125 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:51.682591 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5c6a16ea-fcb8-4716-8164-e55a042fa125 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:51.683732 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5c6a16ea-fcb8-4716-8164-e55a042fa125 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:51.687370 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5c6a16ea-fcb8-4716-8164-e55a042fa125 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:51.851201 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5c6a16ea-fcb8-4716-8164-e55a042fa125 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:51.864998 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5c6a16ea-fcb8-4716-8164-e55a042fa125 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:51.867649 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5c6a16ea-fcb8-4716-8164-e55a042fa125 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:51.875860 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5c6a16ea-fcb8-4716-8164-e55a042fa125 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1338 microversion: 2.20 time: 0.212383 Jun 05 08:30:51.877407 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1030/2039] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:51 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1338 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:51.891156 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-691da0b4-cffa-4ba4-9672-46cb6613228c tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f244535eca0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:51.998117 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-691da0b4-cffa-4ba4-9672-46cb6613228c tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e" status: 200 len: 1413 microversion: 2.1 time: 0.119277 Jun 05 08:30:51.999382 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1031/2040] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:30:51 2022] GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e => generated 1413 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:52.011661 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f9bde261-5145-49a7-8066-ddad6f8e1783 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:52.015727 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f9bde261-5145-49a7-8066-ddad6f8e1783 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:52.036260 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f9bde261-5145-49a7-8066-ddad6f8e1783 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:52.037231 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f9bde261-5145-49a7-8066-ddad6f8e1783 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:52.039114 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f9bde261-5145-49a7-8066-ddad6f8e1783 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:52.042108 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f9bde261-5145-49a7-8066-ddad6f8e1783 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:52.429214 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f9bde261-5145-49a7-8066-ddad6f8e1783 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:52.442330 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f9bde261-5145-49a7-8066-ddad6f8e1783 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.441498 Jun 05 08:30:52.443327 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1032/2041] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:51 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:52.448227 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-df95fa55-cc69-406b-91f8-01066084d92d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:52.467321 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-df95fa55-cc69-406b-91f8-01066084d92d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:52.485462 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-df95fa55-cc69-406b-91f8-01066084d92d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:52.488664 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-df95fa55-cc69-406b-91f8-01066084d92d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:52.489720 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-df95fa55-cc69-406b-91f8-01066084d92d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:52.494303 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-df95fa55-cc69-406b-91f8-01066084d92d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:53.029533 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-12aaefe3-9005-4e7b-b74d-6641be49768f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:53.042266 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-12aaefe3-9005-4e7b-b74d-6641be49768f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:53.043874 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-12aaefe3-9005-4e7b-b74d-6641be49768f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:53.049537 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-12aaefe3-9005-4e7b-b74d-6641be49768f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 1.423603 Jun 05 08:30:53.050145 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1010/2042] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:51 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:53.089548 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-027160a2-32c7-4b26-ab0b-8b268a1e0dbf tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:53.090280 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-027160a2-32c7-4b26-ab0b-8b268a1e0dbf tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:53.110245 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-027160a2-32c7-4b26-ab0b-8b268a1e0dbf tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:53.111111 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-027160a2-32c7-4b26-ab0b-8b268a1e0dbf tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:53.112260 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-027160a2-32c7-4b26-ab0b-8b268a1e0dbf tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:53.113575 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-027160a2-32c7-4b26-ab0b-8b268a1e0dbf tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:53.507268 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-df95fa55-cc69-406b-91f8-01066084d92d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:53.523450 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-df95fa55-cc69-406b-91f8-01066084d92d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:53.525844 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-df95fa55-cc69-406b-91f8-01066084d92d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:53.529876 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-df95fa55-cc69-406b-91f8-01066084d92d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1292 microversion: 2.25 time: 1.085242 Jun 05 08:30:53.533077 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1033/2043] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:52 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1292 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:53.546629 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-45c48251-8c31-4100-b020-8b8c3ff7f005 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f244535eee0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:53.631238 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-45c48251-8c31-4100-b020-8b8c3ff7f005 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e" status: 200 len: 1413 microversion: 2.1 time: 0.096731 Jun 05 08:30:53.632227 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1034/2044] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:30:53 2022] GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e => generated 1413 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:53.646274 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e4429289-4234-4dc5-82c7-829c65501c3b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:53.652548 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e4429289-4234-4dc5-82c7-829c65501c3b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:53.674333 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e4429289-4234-4dc5-82c7-829c65501c3b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:53.677860 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e4429289-4234-4dc5-82c7-829c65501c3b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:53.680173 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e4429289-4234-4dc5-82c7-829c65501c3b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:53.681972 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e4429289-4234-4dc5-82c7-829c65501c3b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:53.789216 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-027160a2-32c7-4b26-ab0b-8b268a1e0dbf tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:53.806752 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-027160a2-32c7-4b26-ab0b-8b268a1e0dbf tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:53.808788 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-027160a2-32c7-4b26-ab0b-8b268a1e0dbf tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:53.812473 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-027160a2-32c7-4b26-ab0b-8b268a1e0dbf tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1405 microversion: 2.20 time: 0.760773 Jun 05 08:30:53.816143 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1011/2045] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:53 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1405 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:54.001116 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e4429289-4234-4dc5-82c7-829c65501c3b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:54.013183 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e4429289-4234-4dc5-82c7-829c65501c3b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.377407 Jun 05 08:30:54.019923 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1035/2046] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:53 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:54.093285 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9c776900-8600-4674-a420-cd674c2b36dc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:54.094010 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9c776900-8600-4674-a420-cd674c2b36dc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:54.112193 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9c776900-8600-4674-a420-cd674c2b36dc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:54.119768 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9c776900-8600-4674-a420-cd674c2b36dc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:54.120959 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9c776900-8600-4674-a420-cd674c2b36dc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:54.124300 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9c776900-8600-4674-a420-cd674c2b36dc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:54.550827 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-32d1a928-0615-4caf-b050-cb3e568ba65b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:54.552098 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-32d1a928-0615-4caf-b050-cb3e568ba65b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:54.555475 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:30:54.568378 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-32d1a928-0615-4caf-b050-cb3e568ba65b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:54.595859 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-32d1a928-0615-4caf-b050-cb3e568ba65b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:54.597182 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-32d1a928-0615-4caf-b050-cb3e568ba65b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:54.597842 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-32d1a928-0615-4caf-b050-cb3e568ba65b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:55.434917 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9c776900-8600-4674-a420-cd674c2b36dc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:55.461415 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9c776900-8600-4674-a420-cd674c2b36dc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:55.463331 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9c776900-8600-4674-a420-cd674c2b36dc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:55.464994 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9c776900-8600-4674-a420-cd674c2b36dc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 1.376311 Jun 05 08:30:55.466922 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1012/2047] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:54 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:55.476649 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-88449d8b-b112-49a9-bdc6-9459dcd62e39 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24331f8ca0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:55.567232 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-88449d8b-b112-49a9-bdc6-9459dcd62e39 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e" status: 200 len: 1413 microversion: 2.1 time: 0.098777 Jun 05 08:30:55.568067 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1013/2048] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:30:55 2022] GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e => generated 1413 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:55.594257 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c9058068-ff21-47cd-a280-6f9d8b7e092c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:55.596772 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c9058068-ff21-47cd-a280-6f9d8b7e092c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:55.619847 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c9058068-ff21-47cd-a280-6f9d8b7e092c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:55.624121 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c9058068-ff21-47cd-a280-6f9d8b7e092c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:55.625199 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c9058068-ff21-47cd-a280-6f9d8b7e092c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:55.631600 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c9058068-ff21-47cd-a280-6f9d8b7e092c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:55.676504 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-32d1a928-0615-4caf-b050-cb3e568ba65b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:55.714705 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-32d1a928-0615-4caf-b050-cb3e568ba65b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:55.726630 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-32d1a928-0615-4caf-b050-cb3e568ba65b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:55.729794 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-32d1a928-0615-4caf-b050-cb3e568ba65b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1292 microversion: 2.25 time: 1.183944 Jun 05 08:30:55.746849 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1036/2049] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:54 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1292 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:55.759667 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-63d99b83-d8c4-4633-90b8-82dbb64f849a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:55.763657 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-63d99b83-d8c4-4633-90b8-82dbb64f849a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:55.784314 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-63d99b83-d8c4-4633-90b8-82dbb64f849a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:55.791077 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-63d99b83-d8c4-4633-90b8-82dbb64f849a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:55.793920 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-63d99b83-d8c4-4633-90b8-82dbb64f849a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:55.799957 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-63d99b83-d8c4-4633-90b8-82dbb64f849a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:56.090356 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-63d99b83-d8c4-4633-90b8-82dbb64f849a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:56.102316 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-63d99b83-d8c4-4633-90b8-82dbb64f849a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.353484 Jun 05 08:30:56.114958 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1037/2050] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:55 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:56.272062 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-47ab041d-f8f5-4611-9641-bdb7cbfc56f0 req-e8caa9be-8f0c-4fa2-9fc4-a2ceec96fa10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "040dd488-42f2-45c3-86de-1a675e78d7ca", "tag": "93d59181-26a5-451b-8871-ccba610464fd"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:56.289622 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-47ab041d-f8f5-4611-9641-bdb7cbfc56f0 req-e8caa9be-8f0c-4fa2-9fc4-a2ceec96fa10 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:56.290818 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-47ab041d-f8f5-4611-9641-bdb7cbfc56f0 req-e8caa9be-8f0c-4fa2-9fc4-a2ceec96fa10 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:56.322266 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-47ab041d-f8f5-4611-9641-bdb7cbfc56f0 req-e8caa9be-8f0c-4fa2-9fc4-a2ceec96fa10 service nova] Creating event network-changed:93d59181-26a5-451b-8871-ccba610464fd for instance 040dd488-42f2-45c3-86de-1a675e78d7ca on n-h1-844739-1 Jun 05 08:30:56.335801 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-47ab041d-f8f5-4611-9641-bdb7cbfc56f0 req-e8caa9be-8f0c-4fa2-9fc4-a2ceec96fa10 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067996 Jun 05 08:30:56.344232 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1038/2051] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:30:56.433334 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c9058068-ff21-47cd-a280-6f9d8b7e092c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:56.451858 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c9058068-ff21-47cd-a280-6f9d8b7e092c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:56.454248 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c9058068-ff21-47cd-a280-6f9d8b7e092c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:56.458097 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c9058068-ff21-47cd-a280-6f9d8b7e092c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1405 microversion: 2.20 time: 0.888569 Jun 05 08:30:56.476489 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1014/2052] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:55 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1405 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:56.485729 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b5a28a3a-1595-44a5-bf6a-430f7c1bff73 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:56.486764 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b5a28a3a-1595-44a5-bf6a-430f7c1bff73 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:56.525226 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b5a28a3a-1595-44a5-bf6a-430f7c1bff73 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:56.525698 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b5a28a3a-1595-44a5-bf6a-430f7c1bff73 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:56.526496 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b5a28a3a-1595-44a5-bf6a-430f7c1bff73 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:56.526931 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b5a28a3a-1595-44a5-bf6a-430f7c1bff73 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:56.581234 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9e650c06-9918-4014-9ae7-d069d8264dac tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f2433162f70>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:56.641624 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9e650c06-9918-4014-9ae7-d069d8264dac tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e" status: 200 len: 1413 microversion: 2.1 time: 0.064443 Jun 05 08:30:56.642318 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1015/2053] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:30:56 2022] GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e => generated 1413 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:56.760347 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8297e4b0-a36d-4fcc-8649-ab8b9f38b9d2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:56.760984 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8297e4b0-a36d-4fcc-8649-ab8b9f38b9d2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:56.778173 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8297e4b0-a36d-4fcc-8649-ab8b9f38b9d2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:56.778639 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8297e4b0-a36d-4fcc-8649-ab8b9f38b9d2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:56.779440 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8297e4b0-a36d-4fcc-8649-ab8b9f38b9d2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:56.779891 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8297e4b0-a36d-4fcc-8649-ab8b9f38b9d2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:57.131907 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:30:57.261107 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b5a28a3a-1595-44a5-bf6a-430f7c1bff73 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:57.277674 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8297e4b0-a36d-4fcc-8649-ab8b9f38b9d2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:57.278462 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b5a28a3a-1595-44a5-bf6a-430f7c1bff73 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:57.289788 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8297e4b0-a36d-4fcc-8649-ab8b9f38b9d2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:57.290552 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b5a28a3a-1595-44a5-bf6a-430f7c1bff73 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:57.292206 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b5a28a3a-1595-44a5-bf6a-430f7c1bff73 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.810719 Jun 05 08:30:57.292361 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8297e4b0-a36d-4fcc-8649-ab8b9f38b9d2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:57.293787 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1039/2054] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:56 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:57.303273 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8297e4b0-a36d-4fcc-8649-ab8b9f38b9d2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1292 microversion: 2.25 time: 0.553535 Jun 05 08:30:57.304370 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1016/2055] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:56 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1292 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:30:57.306671 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-aba39333-5033-456a-9e23-420140a956f1 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:57.308031 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-aba39333-5033-456a-9e23-420140a956f1 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:57.322334 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-aba39333-5033-456a-9e23-420140a956f1 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:57.325086 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-aba39333-5033-456a-9e23-420140a956f1 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:57.328250 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-aba39333-5033-456a-9e23-420140a956f1 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:57.328893 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-aba39333-5033-456a-9e23-420140a956f1 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:57.441901 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-aba39333-5033-456a-9e23-420140a956f1 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:57.451534 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-aba39333-5033-456a-9e23-420140a956f1 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.156318 Jun 05 08:30:57.454328 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1040/2056] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:57 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:57.488768 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b5e481fe-d18a-4f10-9a7a-123d2d0cea05 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:57.490040 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b5e481fe-d18a-4f10-9a7a-123d2d0cea05 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:57.521191 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b5e481fe-d18a-4f10-9a7a-123d2d0cea05 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:57.523047 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b5e481fe-d18a-4f10-9a7a-123d2d0cea05 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:57.528632 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b5e481fe-d18a-4f10-9a7a-123d2d0cea05 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:57.534106 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b5e481fe-d18a-4f10-9a7a-123d2d0cea05 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:57.661289 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d70b4359-26b5-42ff-a8df-3525f296c9ba tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24453c0310>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:57.768390 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d70b4359-26b5-42ff-a8df-3525f296c9ba tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e" status: 200 len: 1413 microversion: 2.1 time: 0.117269 Jun 05 08:30:57.769818 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1041/2057] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:30:57 2022] GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e => generated 1413 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:58.083037 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b5e481fe-d18a-4f10-9a7a-123d2d0cea05 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:58.091712 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b5e481fe-d18a-4f10-9a7a-123d2d0cea05 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:58.106949 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b5e481fe-d18a-4f10-9a7a-123d2d0cea05 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:58.108222 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b5e481fe-d18a-4f10-9a7a-123d2d0cea05 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1405 microversion: 2.20 time: 0.631247 Jun 05 08:30:58.122086 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1017/2058] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:57 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1405 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:58.317491 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-99b3bd2c-b242-4781-b171-8f03e8d2d6b1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:58.318136 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-99b3bd2c-b242-4781-b171-8f03e8d2d6b1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:58.333966 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-99b3bd2c-b242-4781-b171-8f03e8d2d6b1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:58.341469 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-99b3bd2c-b242-4781-b171-8f03e8d2d6b1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:58.342681 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-99b3bd2c-b242-4781-b171-8f03e8d2d6b1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:58.343303 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-99b3bd2c-b242-4781-b171-8f03e8d2d6b1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:58.430670 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=8 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:30:58.711628 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9cf29591-5a4b-431b-8c45-77b8d230c54d tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Action: 'create', calling method: .version_select at 0x7f244531f160>, body: {"keypair": {"name": "tempest-keypair-2107730819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzzJrVtGryiRNr9KGX5xRkkXlMSS9hPbGe+sm/ws9XU5d5nZ29/3Iyv5yX9QvPwQA9tKsP2ZZfd6QW1MUzqtUVBSsJx7ATI2zP2jFu1vCG7sNjPPzyPU5qT/zzQr43lFQ=="}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:30:58.772200 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-9cf29591-5a4b-431b-8c45-77b8d230c54d tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Getting quotas for project 109a1eb2427e453585c3e752af6a7eaf. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:30:58.796390 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-9cf29591-5a4b-431b-8c45-77b8d230c54d tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Getting quotas for user 615299cb9eb34ceca04c2864923a4724 and project 109a1eb2427e453585c3e752af6a7eaf. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:30:58.877204 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9cf29591-5a4b-431b-8c45-77b8d230c54d tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.814893 Jun 05 08:30:58.878309 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1042/2059] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:30:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:30:58.896784 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7e643fae-8caa-4426-842d-cf292b74115c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:58.897840 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7e643fae-8caa-4426-842d-cf292b74115c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:58.916310 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7e643fae-8caa-4426-842d-cf292b74115c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:58.917034 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7e643fae-8caa-4426-842d-cf292b74115c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:58.918242 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7e643fae-8caa-4426-842d-cf292b74115c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:58.919397 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7e643fae-8caa-4426-842d-cf292b74115c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:59.629264 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-99b3bd2c-b242-4781-b171-8f03e8d2d6b1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:59.644420 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-99b3bd2c-b242-4781-b171-8f03e8d2d6b1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:59.646386 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-99b3bd2c-b242-4781-b171-8f03e8d2d6b1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:59.654829 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-99b3bd2c-b242-4781-b171-8f03e8d2d6b1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 1.345369 Jun 05 08:30:59.661078 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1018/2060] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:58 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:30:59.677703 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b96aa654-6c4c-43e6-baf9-53b6873d8aa8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:59.678340 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b96aa654-6c4c-43e6-baf9-53b6873d8aa8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:59.713479 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b96aa654-6c4c-43e6-baf9-53b6873d8aa8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:59.714287 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b96aa654-6c4c-43e6-baf9-53b6873d8aa8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:59.717023 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b96aa654-6c4c-43e6-baf9-53b6873d8aa8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:59.717788 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b96aa654-6c4c-43e6-baf9-53b6873d8aa8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:59.737421 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7e643fae-8caa-4426-842d-cf292b74115c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:59.758975 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7e643fae-8caa-4426-842d-cf292b74115c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:59.769906 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7e643fae-8caa-4426-842d-cf292b74115c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:59.773439 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7e643fae-8caa-4426-842d-cf292b74115c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1292 microversion: 2.25 time: 0.892288 Jun 05 08:30:59.776799 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1043/2061] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:58 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1292 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:30:59.791266 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9722a51e-42f1-479a-bbcc-405f7f8da059 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24454ceb80>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:59.901582 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b96aa654-6c4c-43e6-baf9-53b6873d8aa8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:30:59.902675 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9722a51e-42f1-479a-bbcc-405f7f8da059 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e" status: 200 len: 1413 microversion: 2.1 time: 0.120706 Jun 05 08:30:59.904600 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1044/2062] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:30:59 2022] GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e => generated 1413 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:59.916082 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b96aa654-6c4c-43e6-baf9-53b6873d8aa8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.253100 Jun 05 08:30:59.917335 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1019/2063] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:30:59 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:30:59.930196 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-90ba81a9-df1f-421f-8a49-18eac73b61f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:30:59.932965 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-90ba81a9-df1f-421f-8a49-18eac73b61f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:30:59.955278 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-90ba81a9-df1f-421f-8a49-18eac73b61f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:59.955743 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-90ba81a9-df1f-421f-8a49-18eac73b61f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:30:59.959027 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-90ba81a9-df1f-421f-8a49-18eac73b61f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:30:59.959481 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-90ba81a9-df1f-421f-8a49-18eac73b61f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:00.422766 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b96aa654-6c4c-43e6-baf9-53b6873d8aa8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:00.423896 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b96aa654-6c4c-43e6-baf9-53b6873d8aa8 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001484 Jun 05 08:31:00.430438 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1020/2064] 10.222.0.33 () {56 vars in 885 bytes} [Sun Jun 5 08:31:00 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Jun 05 08:31:00.448139 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-90ba81a9-df1f-421f-8a49-18eac73b61f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:00.465014 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-90ba81a9-df1f-421f-8a49-18eac73b61f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:00.474147 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-90ba81a9-df1f-421f-8a49-18eac73b61f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:00.485463 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-90ba81a9-df1f-421f-8a49-18eac73b61f6 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1405 microversion: 2.20 time: 0.577898 Jun 05 08:31:00.489100 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1045/2065] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:30:59 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1405 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:00.679689 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ccac269e-81b1-4e65-af2b-2ca7dabc3466 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:00.680378 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ccac269e-81b1-4e65-af2b-2ca7dabc3466 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:00.698191 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ccac269e-81b1-4e65-af2b-2ca7dabc3466 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:00.698651 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ccac269e-81b1-4e65-af2b-2ca7dabc3466 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:00.699454 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ccac269e-81b1-4e65-af2b-2ca7dabc3466 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:00.699895 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ccac269e-81b1-4e65-af2b-2ca7dabc3466 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:00.793741 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-137e9ee9-2a4d-4bb4-b3d9-d26ee305792f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:00.794367 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-137e9ee9-2a4d-4bb4-b3d9-d26ee305792f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:00.809088 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-137e9ee9-2a4d-4bb4-b3d9-d26ee305792f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:00.820316 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-137e9ee9-2a4d-4bb4-b3d9-d26ee305792f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:00.824252 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-137e9ee9-2a4d-4bb4-b3d9-d26ee305792f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:00.825008 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-137e9ee9-2a4d-4bb4-b3d9-d26ee305792f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:01.836212 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-137e9ee9-2a4d-4bb4-b3d9-d26ee305792f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:01.851754 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-137e9ee9-2a4d-4bb4-b3d9-d26ee305792f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:01.854455 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-137e9ee9-2a4d-4bb4-b3d9-d26ee305792f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:01.858345 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-137e9ee9-2a4d-4bb4-b3d9-d26ee305792f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1292 microversion: 2.25 time: 1.068689 Jun 05 08:31:01.860014 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1046/2066] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:00 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1292 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:31:01.868834 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f8c02468-3757-421c-ab18-bbb74a586efc tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f244549d040>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:01.941329 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f8c02468-3757-421c-ab18-bbb74a586efc tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e" status: 200 len: 1413 microversion: 2.1 time: 0.079084 Jun 05 08:31:01.942265 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1047/2067] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:31:01 2022] GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e => generated 1413 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:01.954269 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b6f0bdc0-95fc-46c8-87c7-aafd4ca7de5c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:01.955689 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b6f0bdc0-95fc-46c8-87c7-aafd4ca7de5c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:01.963739 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b6f0bdc0-95fc-46c8-87c7-aafd4ca7de5c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:01.965092 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b6f0bdc0-95fc-46c8-87c7-aafd4ca7de5c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:01.966086 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b6f0bdc0-95fc-46c8-87c7-aafd4ca7de5c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:01.966690 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b6f0bdc0-95fc-46c8-87c7-aafd4ca7de5c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:01.993656 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ccac269e-81b1-4e65-af2b-2ca7dabc3466 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:02.009235 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ccac269e-81b1-4e65-af2b-2ca7dabc3466 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:02.019052 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ccac269e-81b1-4e65-af2b-2ca7dabc3466 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:02.023174 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ccac269e-81b1-4e65-af2b-2ca7dabc3466 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 1.348221 Jun 05 08:31:02.028297 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1021/2068] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:00 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:02.033842 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4de26f26-aa57-4343-b90b-b15d464fff60 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:02.040947 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4de26f26-aa57-4343-b90b-b15d464fff60 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:02.051334 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4de26f26-aa57-4343-b90b-b15d464fff60 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:02.052175 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4de26f26-aa57-4343-b90b-b15d464fff60 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:02.053199 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4de26f26-aa57-4343-b90b-b15d464fff60 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:02.053845 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4de26f26-aa57-4343-b90b-b15d464fff60 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:02.432870 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b6f0bdc0-95fc-46c8-87c7-aafd4ca7de5c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:02.444694 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b6f0bdc0-95fc-46c8-87c7-aafd4ca7de5c tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.501070 Jun 05 08:31:02.445398 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1048/2069] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:01 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:02.879141 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ffe69861-be4e-4c83-822a-b5d37098e3e4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:02.879765 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ffe69861-be4e-4c83-822a-b5d37098e3e4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:02.893336 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ffe69861-be4e-4c83-822a-b5d37098e3e4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:02.894032 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ffe69861-be4e-4c83-822a-b5d37098e3e4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:02.895844 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ffe69861-be4e-4c83-822a-b5d37098e3e4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:02.898628 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ffe69861-be4e-4c83-822a-b5d37098e3e4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:02.929106 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4de26f26-aa57-4343-b90b-b15d464fff60 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:02.953140 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4de26f26-aa57-4343-b90b-b15d464fff60 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:02.977670 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4de26f26-aa57-4343-b90b-b15d464fff60 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:02.979789 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4de26f26-aa57-4343-b90b-b15d464fff60 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1405 microversion: 2.20 time: 0.949647 Jun 05 08:31:02.982524 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=100 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:31:02.989408 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1022/2070] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:02 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1405 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:03.009548 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8bdf3baf-6bbe-4e16-bb11-957c3fc7d31a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f243317a8b0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:03.083553 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8bdf3baf-6bbe-4e16-bb11-957c3fc7d31a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e" status: 200 len: 1413 microversion: 2.1 time: 0.092673 Jun 05 08:31:03.084154 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1023/2071] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:31:02 2022] GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e => generated 1413 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:03.094834 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8107fa9d-5b7f-41ba-9ca2-5621c276f670 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:03.095450 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8107fa9d-5b7f-41ba-9ca2-5621c276f670 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:03.107648 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8107fa9d-5b7f-41ba-9ca2-5621c276f670 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:03.108148 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8107fa9d-5b7f-41ba-9ca2-5621c276f670 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:03.108945 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8107fa9d-5b7f-41ba-9ca2-5621c276f670 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:03.109396 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8107fa9d-5b7f-41ba-9ca2-5621c276f670 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:04.170370 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ffe69861-be4e-4c83-822a-b5d37098e3e4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:04.205388 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ffe69861-be4e-4c83-822a-b5d37098e3e4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:04.211388 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ffe69861-be4e-4c83-822a-b5d37098e3e4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:04.218218 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ffe69861-be4e-4c83-822a-b5d37098e3e4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1292 microversion: 2.25 time: 1.339116 Jun 05 08:31:04.245648 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1049/2072] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:02 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1292 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:31:04.267172 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-203e3e58-4d61-4fbe-9a13-38d022d3d612 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:04.267851 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-203e3e58-4d61-4fbe-9a13-38d022d3d612 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:04.288876 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-203e3e58-4d61-4fbe-9a13-38d022d3d612 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:04.289347 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-203e3e58-4d61-4fbe-9a13-38d022d3d612 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:04.292477 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-203e3e58-4d61-4fbe-9a13-38d022d3d612 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:04.292936 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-203e3e58-4d61-4fbe-9a13-38d022d3d612 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:05.056027 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8107fa9d-5b7f-41ba-9ca2-5621c276f670 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:05.069747 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8107fa9d-5b7f-41ba-9ca2-5621c276f670 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:05.078029 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8107fa9d-5b7f-41ba-9ca2-5621c276f670 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:05.080933 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8107fa9d-5b7f-41ba-9ca2-5621c276f670 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 1.995338 Jun 05 08:31:05.088972 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1024/2073] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:03 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 2004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:05.102483 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a0e6e0bf-7225-43d4-99c3-b436cce1ed5c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:05.105762 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a0e6e0bf-7225-43d4-99c3-b436cce1ed5c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:05.119824 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a0e6e0bf-7225-43d4-99c3-b436cce1ed5c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:05.125570 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a0e6e0bf-7225-43d4-99c3-b436cce1ed5c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:05.126845 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a0e6e0bf-7225-43d4-99c3-b436cce1ed5c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:05.133106 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a0e6e0bf-7225-43d4-99c3-b436cce1ed5c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:05.164700 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-203e3e58-4d61-4fbe-9a13-38d022d3d612 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:05.178912 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-203e3e58-4d61-4fbe-9a13-38d022d3d612 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.931417 Jun 05 08:31:05.189352 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1050/2074] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:04 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:05.204792 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e1510a5c-1bcd-4682-a392-0ec307e6a893 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24453909d0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:05.279230 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e1510a5c-1bcd-4682-a392-0ec307e6a893 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e" status: 200 len: 1413 microversion: 2.1 time: 0.087315 Jun 05 08:31:05.279815 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1051/2075] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:31:05 2022] GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e => generated 1413 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:05.285065 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-4632cfb0-8836-48fa-927e-6e341cc6499e req-7e7e050a-5f24-4352-8e92-6c36f527ae1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "040dd488-42f2-45c3-86de-1a675e78d7ca", "name": "network-vif-plugged", "status": "completed", "tag": "93d59181-26a5-451b-8871-ccba610464fd"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:31:05.320577 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-4632cfb0-8836-48fa-927e-6e341cc6499e req-7e7e050a-5f24-4352-8e92-6c36f527ae1e service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:05.329117 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-4632cfb0-8836-48fa-927e-6e341cc6499e req-7e7e050a-5f24-4352-8e92-6c36f527ae1e service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:05.352293 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-4632cfb0-8836-48fa-927e-6e341cc6499e req-7e7e050a-5f24-4352-8e92-6c36f527ae1e service nova] Creating event network-vif-plugged:93d59181-26a5-451b-8871-ccba610464fd for instance 040dd488-42f2-45c3-86de-1a675e78d7ca on n-h1-844739-1 Jun 05 08:31:05.363426 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-4632cfb0-8836-48fa-927e-6e341cc6499e req-7e7e050a-5f24-4352-8e92-6c36f527ae1e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081645 Jun 05 08:31:05.398360 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1052/2076] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:31:05.433683 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-742dc38f-f518-43c7-9a1f-8167a8aad30f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:05.437330 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-742dc38f-f518-43c7-9a1f-8167a8aad30f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:05.505883 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-742dc38f-f518-43c7-9a1f-8167a8aad30f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:05.508698 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-742dc38f-f518-43c7-9a1f-8167a8aad30f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:05.512840 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-742dc38f-f518-43c7-9a1f-8167a8aad30f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:05.513339 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-742dc38f-f518-43c7-9a1f-8167a8aad30f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:05.898626 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a0e6e0bf-7225-43d4-99c3-b436cce1ed5c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:05.921751 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a0e6e0bf-7225-43d4-99c3-b436cce1ed5c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:05.928575 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a0e6e0bf-7225-43d4-99c3-b436cce1ed5c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:05.930484 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a0e6e0bf-7225-43d4-99c3-b436cce1ed5c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1405 microversion: 2.20 time: 0.840160 Jun 05 08:31:05.933245 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1025/2077] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:05 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1405 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:06.106593 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f9abefcd-3c6c-4b4c-80c7-a6b22e69f58d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:06.113702 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f9abefcd-3c6c-4b4c-80c7-a6b22e69f58d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:06.123803 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f9abefcd-3c6c-4b4c-80c7-a6b22e69f58d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:06.125648 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f9abefcd-3c6c-4b4c-80c7-a6b22e69f58d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:06.129820 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f9abefcd-3c6c-4b4c-80c7-a6b22e69f58d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:06.130545 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f9abefcd-3c6c-4b4c-80c7-a6b22e69f58d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:06.332492 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-742dc38f-f518-43c7-9a1f-8167a8aad30f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:06.347811 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-742dc38f-f518-43c7-9a1f-8167a8aad30f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:06.349940 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-742dc38f-f518-43c7-9a1f-8167a8aad30f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:06.353521 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-742dc38f-f518-43c7-9a1f-8167a8aad30f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1292 microversion: 2.25 time: 0.944844 Jun 05 08:31:06.355340 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1053/2078] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:05 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1292 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:06.362297 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6187f12d-2341-451d-ba46-e25d828ae531 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:06.365031 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6187f12d-2341-451d-ba46-e25d828ae531 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:06.390650 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6187f12d-2341-451d-ba46-e25d828ae531 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:06.395267 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6187f12d-2341-451d-ba46-e25d828ae531 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:06.398386 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6187f12d-2341-451d-ba46-e25d828ae531 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:06.399124 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6187f12d-2341-451d-ba46-e25d828ae531 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:06.629699 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6187f12d-2341-451d-ba46-e25d828ae531 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:06.643838 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6187f12d-2341-451d-ba46-e25d828ae531 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.286679 Jun 05 08:31:06.653518 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1054/2079] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:06 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:06.673282 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1d354332-28f4-4796-92ec-d82d45f4d354 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f2433d739d0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:06.870166 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1d354332-28f4-4796-92ec-d82d45f4d354 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e" status: 200 len: 1413 microversion: 2.1 time: 0.214330 Jun 05 08:31:06.871112 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1055/2080] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:31:06 2022] GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e => generated 1413 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:06.953236 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0222f0b2-fd35-4d28-abeb-5744ebbe9f5d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:06.954023 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0222f0b2-fd35-4d28-abeb-5744ebbe9f5d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:06.969747 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0222f0b2-fd35-4d28-abeb-5744ebbe9f5d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:06.976511 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0222f0b2-fd35-4d28-abeb-5744ebbe9f5d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:06.979094 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f9abefcd-3c6c-4b4c-80c7-a6b22e69f58d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:06.980139 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0222f0b2-fd35-4d28-abeb-5744ebbe9f5d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:06.980701 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0222f0b2-fd35-4d28-abeb-5744ebbe9f5d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:07.017257 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f9abefcd-3c6c-4b4c-80c7-a6b22e69f58d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:07.018910 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f9abefcd-3c6c-4b4c-80c7-a6b22e69f58d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:07.020145 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f9abefcd-3c6c-4b4c-80c7-a6b22e69f58d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.917433 Jun 05 08:31:07.041100 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1026/2081] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:06 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:07.354300 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0222f0b2-fd35-4d28-abeb-5744ebbe9f5d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:07.366502 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0222f0b2-fd35-4d28-abeb-5744ebbe9f5d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:07.375237 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d8c698c2-0d53-4ac6-a68f-4614e822fdd5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:07.375976 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d8c698c2-0d53-4ac6-a68f-4614e822fdd5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:07.384183 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0222f0b2-fd35-4d28-abeb-5744ebbe9f5d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:07.386136 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d8c698c2-0d53-4ac6-a68f-4614e822fdd5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:07.387013 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d8c698c2-0d53-4ac6-a68f-4614e822fdd5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:07.387765 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0222f0b2-fd35-4d28-abeb-5744ebbe9f5d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1405 microversion: 2.20 time: 0.439832 Jun 05 08:31:07.390098 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d8c698c2-0d53-4ac6-a68f-4614e822fdd5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:07.401306 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1056/2082] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:06 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1405 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:31:07.403129 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d8c698c2-0d53-4ac6-a68f-4614e822fdd5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:07.660799 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-26d13c51-d74b-4857-be32-e47857f83c64 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:07.661708 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-26d13c51-d74b-4857-be32-e47857f83c64 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:07.675661 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-26d13c51-d74b-4857-be32-e47857f83c64 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:07.676452 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-26d13c51-d74b-4857-be32-e47857f83c64 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:07.677439 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-26d13c51-d74b-4857-be32-e47857f83c64 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:07.678049 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-26d13c51-d74b-4857-be32-e47857f83c64 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:07.757902 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d8c698c2-0d53-4ac6-a68f-4614e822fdd5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:07.770336 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d8c698c2-0d53-4ac6-a68f-4614e822fdd5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:07.772278 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d8c698c2-0d53-4ac6-a68f-4614e822fdd5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:07.773674 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d8c698c2-0d53-4ac6-a68f-4614e822fdd5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1292 microversion: 2.25 time: 0.402683 Jun 05 08:31:07.786390 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1027/2083] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:07 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1292 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:07.839434 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-26d13c51-d74b-4857-be32-e47857f83c64 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:07.847723 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-26d13c51-d74b-4857-be32-e47857f83c64 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.190844 Jun 05 08:31:07.865390 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1057/2084] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:07 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:07.887881 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fa1d9ce6-f575-46c8-b681-1227fcf98dd1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f244537a4c0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:07.982606 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fa1d9ce6-f575-46c8-b681-1227fcf98dd1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e" status: 200 len: 1413 microversion: 2.1 time: 0.103040 Jun 05 08:31:07.983492 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1058/2085] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:31:07 2022] GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e => generated 1413 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:31:08.006628 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-939f9094-224e-4d43-90a8-d6df816fcd61 tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] Calling method '.version_select at 0x7f243315c9d0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:08.017030 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:31:08.017030 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:31:08.030091 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-939f9094-224e-4d43-90a8-d6df816fcd61 tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:08.042067 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a3a79901-2f5b-4ade-acef-dcc537b084d7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:08.042980 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a3a79901-2f5b-4ade-acef-dcc537b084d7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:08.046094 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-939f9094-224e-4d43-90a8-d6df816fcd61 tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:08.047510 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-939f9094-224e-4d43-90a8-d6df816fcd61 tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:08.052716 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-939f9094-224e-4d43-90a8-d6df816fcd61 tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:08.057836 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a3a79901-2f5b-4ade-acef-dcc537b084d7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:08.058557 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a3a79901-2f5b-4ade-acef-dcc537b084d7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:08.060881 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a3a79901-2f5b-4ade-acef-dcc537b084d7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:08.064905 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a3a79901-2f5b-4ade-acef-dcc537b084d7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:08.094969 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=81,nova_api:SAVEPOINT=7,nova_api:INSERT=2,nova_api:RELEASE=7,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:31:08.128907 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-939f9094-224e-4d43-90a8-d6df816fcd61 tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.340143 Jun 05 08:31:08.130220 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1028/2086] 10.222.0.33 () {58 vars in 1127 bytes} [Sun Jun 5 08:31:07 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:31:08.404403 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9ad599e8-32a5-4767-a3c6-dab59905b927 tempest-HostsAdminNegativeTestJSON-612584076 tempest-HostsAdminNegativeTestJSON-612584076-project] Calling method '.version_select at 0x7f243315c310>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:08.409823 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:31:08.409823 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:31:08.413613 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9ad599e8-32a5-4767-a3c6-dab59905b927 tempest-HostsAdminNegativeTestJSON-612584076 tempest-HostsAdminNegativeTestJSON-612584076-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'a25e200a102b41e897b3684cd9a7e52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a81f9d43fad3420dbb55135612430caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9ad599e8-32a5-4767-a3c6-dab59905b927 tempest-HostsAdminNegativeTestJSON-612584076 tempest-HostsAdminNegativeTestJSON-612584076-project] Request method failure captured: Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGnKZ52k-4cIL3YsC_RHGTCJtS57DbVJqyrb-no6gigyVhrR2v1mtZ-u5Ys_EHCgSoZ5gYMrDyEnGkVv2dZife-_RQ7sh8RNmDCm0IehwUohDY47L28FU9bwFxwi3G6Uiknn2xzc8gH2b-FU8L53OSFD9pOOfI66MWt9RrbuAb2Hfh0 Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: a81f9d43fad3420dbb55135612430caa Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-612584076 Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a81f9d43fad3420dbb55135612430caa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a81f9d43fad3420dbb55135612430caa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a81f9d43fad3420dbb55135612430caa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a81f9d43fad3420dbb55135612430caa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-HostsAdminNegativeTestJSON-612584076 Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: a81f9d43fad3420dbb55135612430caa Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-612584076 Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-HostsAdminNegativeTestJSON-612584076-project Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: a25e200a102b41e897b3684cd9a7e52e Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-HostsAdminNegativeTestJSON-612584076-project Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: action_args: {} Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:08.420425 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:08.426632 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:08.426632 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:08.426632 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:08.426632 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:31:08.426632 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:31:08.426632 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jun 05 08:31:08.426632 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:08.448070 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9ad599e8-32a5-4767-a3c6-dab59905b927 tempest-HostsAdminNegativeTestJSON-612584076 tempest-HostsAdminNegativeTestJSON-612584076-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:31:08.452137 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9ad599e8-32a5-4767-a3c6-dab59905b927 tempest-HostsAdminNegativeTestJSON-612584076 tempest-HostsAdminNegativeTestJSON-612584076-project] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.314590 Jun 05 08:31:08.461061 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1029/2087] 10.222.0.33 () {58 vars in 1127 bytes} [Sun Jun 5 08:31:08 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 324 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:31:08.492477 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c75ba9ac-2ea4-47cd-b1c0-7c541d82e52c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:08.495276 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c75ba9ac-2ea4-47cd-b1c0-7c541d82e52c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:08.512270 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a3a79901-2f5b-4ade-acef-dcc537b084d7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:08.522617 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a3a79901-2f5b-4ade-acef-dcc537b084d7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:08.524176 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a3a79901-2f5b-4ade-acef-dcc537b084d7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:08.525365 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a3a79901-2f5b-4ade-acef-dcc537b084d7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.488924 Jun 05 08:31:08.526479 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c75ba9ac-2ea4-47cd-b1c0-7c541d82e52c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:08.530059 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c75ba9ac-2ea4-47cd-b1c0-7c541d82e52c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:08.531029 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c75ba9ac-2ea4-47cd-b1c0-7c541d82e52c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:08.532544 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c75ba9ac-2ea4-47cd-b1c0-7c541d82e52c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:08.534304 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1059/2088] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:08 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:31:08.542995 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e78b55b8-7cba-471d-8009-b4709a8b68d0 tempest-HostsAdminNegativeTestJSON-612584076 tempest-HostsAdminNegativeTestJSON-612584076-project] Calling method '.version_select at 0x7f244537ae50>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:08.543916 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:31:08.543916 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:31:08.545034 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e78b55b8-7cba-471d-8009-b4709a8b68d0 tempest-HostsAdminNegativeTestJSON-612584076 tempest-HostsAdminNegativeTestJSON-612584076-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'a25e200a102b41e897b3684cd9a7e52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a81f9d43fad3420dbb55135612430caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e78b55b8-7cba-471d-8009-b4709a8b68d0 tempest-HostsAdminNegativeTestJSON-612584076 tempest-HostsAdminNegativeTestJSON-612584076-project] Request method failure captured: Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-hosts/n-d-844739-1/reboot HTTP/1.1 Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGnKZ52k-4cIL3YsC_RHGTCJtS57DbVJqyrb-no6gigyVhrR2v1mtZ-u5Ys_EHCgSoZ5gYMrDyEnGkVv2dZife-_RQ7sh8RNmDCm0IehwUohDY47L28FU9bwFxwi3G6Uiknn2xzc8gH2b-FU8L53OSFD9pOOfI66MWt9RrbuAb2Hfh0 Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: a81f9d43fad3420dbb55135612430caa Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-612584076 Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a81f9d43fad3420dbb55135612430caa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a81f9d43fad3420dbb55135612430caa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a81f9d43fad3420dbb55135612430caa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a81f9d43fad3420dbb55135612430caa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-HostsAdminNegativeTestJSON-612584076 Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: a81f9d43fad3420dbb55135612430caa Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-612584076 Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-HostsAdminNegativeTestJSON-612584076-project Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: a25e200a102b41e897b3684cd9a7e52e Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-HostsAdminNegativeTestJSON-612584076-project Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'n-d-844739-1'} Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:08.568105 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:08.572492 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:08.572492 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:08.572492 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:31:08.572492 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:31:08.572492 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jun 05 08:31:08.572492 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:08.572492 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e78b55b8-7cba-471d-8009-b4709a8b68d0 tempest-HostsAdminNegativeTestJSON-612584076 tempest-HostsAdminNegativeTestJSON-612584076-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:31:08.572492 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e78b55b8-7cba-471d-8009-b4709a8b68d0 tempest-HostsAdminNegativeTestJSON-612584076 tempest-HostsAdminNegativeTestJSON-612584076-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/n-d-844739-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.036597 Jun 05 08:31:08.573105 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1060/2089] 10.222.0.33 () {58 vars in 1187 bytes} [Sun Jun 5 08:31:08 2022] GET /compute/v2.1/os-hosts/n-d-844739-1/reboot => generated 111 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:31:08.582468 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=100 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:31:08.583979 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4ac5a45a-a069-4053-baf8-0e245a313ea7 tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] Calling method '.version_select at 0x7f24453904c0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:08.619352 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-4ac5a45a-a069-4053-baf8-0e245a313ea7 tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4ac5a45a-a069-4053-baf8-0e245a313ea7 tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] Request method failure captured: Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGnLK1M2wjalGZlbwHCvyeIm-4stKQB4Qm6UYmVMzyIFeEpP3iQGtq7cB16aK5grtc8-q1QJpkXskG2yWrvYyNgE8TMXKqv-SCOxeoIgof0O1ZXzMF2yd5Sn2gk5BMt7--wUqIf9Q98n9VPs6Wb1HxO2jgTkY0nfiTeN_RKLqQh77jE Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 0473b6175cf646d2bff820ab22dc6404 Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1783502921 Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: X-Role: admin,reader,member Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: admin,reader,member Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0473b6175cf646d2bff820ab22dc6404"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0473b6175cf646d2bff820ab22dc6404"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0473b6175cf646d2bff820ab22dc6404", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0473b6175cf646d2bff820ab22dc6404"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1783502921 Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 0473b6175cf646d2bff820ab22dc6404 Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1783502921 Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-HostsAdminNegativeTestJSON-1783502921-project-admin Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: bead5843639b4088a0425997b77d6f0b Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1783502921-project-admin Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'nonexistent_hostname'} Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:08.621127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:31:08.625545 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:31:08.625545 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:31:08.625545 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:31:08.625545 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:31:08.625545 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:31:08.625545 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jun 05 08:31:08.625545 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jun 05 08:31:08.625545 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jun 05 08:31:08.625545 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:31:08.625545 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 05 08:31:08.625545 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:08.625545 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:08.625545 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:08.625545 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:08.625545 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:08.625545 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:08.625545 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:31:08.625545 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:31:08.625545 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 05 08:31:08.625545 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:08.625545 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4ac5a45a-a069-4053-baf8-0e245a313ea7 tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:31:08.625545 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4ac5a45a-a069-4053-baf8-0e245a313ea7 tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.042784 Jun 05 08:31:08.635470 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1061/2090] 10.222.0.33 () {58 vars in 1211 bytes} [Sun Jun 5 08:31:08 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:31:08.644810 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-92039898-ec24-4244-b0bb-1fc99b0a4195 tempest-HostsAdminNegativeTestJSON-612584076 tempest-HostsAdminNegativeTestJSON-612584076-project] Calling method '.version_select at 0x7f2445390ee0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:08.645621 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:31:08.645621 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:31:08.646705 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-92039898-ec24-4244-b0bb-1fc99b0a4195 tempest-HostsAdminNegativeTestJSON-612584076 tempest-HostsAdminNegativeTestJSON-612584076-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'a25e200a102b41e897b3684cd9a7e52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a81f9d43fad3420dbb55135612430caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-92039898-ec24-4244-b0bb-1fc99b0a4195 tempest-HostsAdminNegativeTestJSON-612584076 tempest-HostsAdminNegativeTestJSON-612584076-project] Request method failure captured: Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-hosts/n-d-844739-1 HTTP/1.1 Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGnKZ52k-4cIL3YsC_RHGTCJtS57DbVJqyrb-no6gigyVhrR2v1mtZ-u5Ys_EHCgSoZ5gYMrDyEnGkVv2dZife-_RQ7sh8RNmDCm0IehwUohDY47L28FU9bwFxwi3G6Uiknn2xzc8gH2b-FU8L53OSFD9pOOfI66MWt9RrbuAb2Hfh0 Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: a81f9d43fad3420dbb55135612430caa Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-612584076 Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a81f9d43fad3420dbb55135612430caa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a81f9d43fad3420dbb55135612430caa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a81f9d43fad3420dbb55135612430caa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a81f9d43fad3420dbb55135612430caa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-HostsAdminNegativeTestJSON-612584076 Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: a81f9d43fad3420dbb55135612430caa Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-612584076 Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-HostsAdminNegativeTestJSON-612584076-project Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: a25e200a102b41e897b3684cd9a7e52e Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-HostsAdminNegativeTestJSON-612584076-project Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'n-d-844739-1'} Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:08.666002 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:08.670762 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:08.670762 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:08.670762 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:31:08.670762 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:31:08.670762 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jun 05 08:31:08.670762 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:08.670762 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-92039898-ec24-4244-b0bb-1fc99b0a4195 tempest-HostsAdminNegativeTestJSON-612584076 tempest-HostsAdminNegativeTestJSON-612584076-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:31:08.670762 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-92039898-ec24-4244-b0bb-1fc99b0a4195 tempest-HostsAdminNegativeTestJSON-612584076 tempest-HostsAdminNegativeTestJSON-612584076-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/n-d-844739-1" status: 403 len: 109 microversion: 2.1 time: 0.030900 Jun 05 08:31:08.670762 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1062/2091] 10.222.0.33 () {58 vars in 1166 bytes} [Sun Jun 5 08:31:08 2022] GET /compute/v2.1/os-hosts/n-d-844739-1 => generated 109 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:31:08.692428 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6f3dc1ca-361d-4544-a164-c1bfd98144f0 tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] Calling method '.version_select at 0x7f244536eaf0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:08.718454 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-6f3dc1ca-361d-4544-a164-c1bfd98144f0 tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6f3dc1ca-361d-4544-a164-c1bfd98144f0 tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] Request method failure captured: Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGnLK1M2wjalGZlbwHCvyeIm-4stKQB4Qm6UYmVMzyIFeEpP3iQGtq7cB16aK5grtc8-q1QJpkXskG2yWrvYyNgE8TMXKqv-SCOxeoIgof0O1ZXzMF2yd5Sn2gk5BMt7--wUqIf9Q98n9VPs6Wb1HxO2jgTkY0nfiTeN_RKLqQh77jE Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 0473b6175cf646d2bff820ab22dc6404 Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1783502921 Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: X-Role: admin,reader,member Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: admin,reader,member Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0473b6175cf646d2bff820ab22dc6404"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0473b6175cf646d2bff820ab22dc6404"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0473b6175cf646d2bff820ab22dc6404", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0473b6175cf646d2bff820ab22dc6404"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1783502921 Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 0473b6175cf646d2bff820ab22dc6404 Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1783502921 Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-HostsAdminNegativeTestJSON-1783502921-project-admin Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: bead5843639b4088a0425997b77d6f0b Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1783502921-project-admin Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'nonexistent_hostname'} Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:08.725040 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:08.729388 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:08.729388 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:08.729388 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:08.729388 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:31:08.729388 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:31:08.729388 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 05 08:31:08.729388 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:08.729388 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6f3dc1ca-361d-4544-a164-c1bfd98144f0 tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:31:08.729388 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6f3dc1ca-361d-4544-a164-c1bfd98144f0 tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.038562 Jun 05 08:31:08.735262 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1063/2092] 10.222.0.33 () {58 vars in 1190 bytes} [Sun Jun 5 08:31:08 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:31:08.748878 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e077c658-f74e-40c5-b493-a7ca9fff39cc tempest-HostsAdminNegativeTestJSON-612584076 tempest-HostsAdminNegativeTestJSON-612584076-project] Calling method '.version_select at 0x7f244537a670>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:08.749857 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:31:08.749857 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:31:08.751096 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e077c658-f74e-40c5-b493-a7ca9fff39cc tempest-HostsAdminNegativeTestJSON-612584076 tempest-HostsAdminNegativeTestJSON-612584076-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'a25e200a102b41e897b3684cd9a7e52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a81f9d43fad3420dbb55135612430caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e077c658-f74e-40c5-b493-a7ca9fff39cc tempest-HostsAdminNegativeTestJSON-612584076 tempest-HostsAdminNegativeTestJSON-612584076-project] Request method failure captured: Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-hosts/n-d-844739-1/shutdown HTTP/1.1 Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGnKZ52k-4cIL3YsC_RHGTCJtS57DbVJqyrb-no6gigyVhrR2v1mtZ-u5Ys_EHCgSoZ5gYMrDyEnGkVv2dZife-_RQ7sh8RNmDCm0IehwUohDY47L28FU9bwFxwi3G6Uiknn2xzc8gH2b-FU8L53OSFD9pOOfI66MWt9RrbuAb2Hfh0 Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: a81f9d43fad3420dbb55135612430caa Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-612584076 Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a81f9d43fad3420dbb55135612430caa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a81f9d43fad3420dbb55135612430caa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a81f9d43fad3420dbb55135612430caa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a81f9d43fad3420dbb55135612430caa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-HostsAdminNegativeTestJSON-612584076 Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: a81f9d43fad3420dbb55135612430caa Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-612584076 Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-HostsAdminNegativeTestJSON-612584076-project Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: a25e200a102b41e897b3684cd9a7e52e Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-HostsAdminNegativeTestJSON-612584076-project Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'n-d-844739-1'} Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:08.752739 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:08.763244 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:08.763244 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:08.763244 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:31:08.763244 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:31:08.763244 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jun 05 08:31:08.763244 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:08.763244 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e077c658-f74e-40c5-b493-a7ca9fff39cc tempest-HostsAdminNegativeTestJSON-612584076 tempest-HostsAdminNegativeTestJSON-612584076-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:31:08.763244 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e077c658-f74e-40c5-b493-a7ca9fff39cc tempest-HostsAdminNegativeTestJSON-612584076 tempest-HostsAdminNegativeTestJSON-612584076-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/n-d-844739-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.018555 Jun 05 08:31:08.772811 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1064/2093] 10.222.0.33 () {58 vars in 1193 bytes} [Sun Jun 5 08:31:08 2022] GET /compute/v2.1/os-hosts/n-d-844739-1/shutdown => generated 113 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:31:08.788173 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8f7adfcc-f272-4c86-9282-9fe32f10c86b tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] Calling method '.version_select at 0x7f2445440a60>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:08.806573 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c75ba9ac-2ea4-47cd-b1c0-7c541d82e52c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:08.815507 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c75ba9ac-2ea4-47cd-b1c0-7c541d82e52c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:08.819744 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c75ba9ac-2ea4-47cd-b1c0-7c541d82e52c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:08.821260 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c75ba9ac-2ea4-47cd-b1c0-7c541d82e52c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1596 microversion: 2.20 time: 0.357654 Jun 05 08:31:08.822530 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1030/2094] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:08 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1596 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:08.825818 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=4 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:31:08.830185 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-8f7adfcc-f272-4c86-9282-9fe32f10c86b tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 05 08:31:08.833044 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bec137c4-d493-4dca-8117-4f5d8497b928 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8f7adfcc-f272-4c86-9282-9fe32f10c86b tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] Request method failure captured: Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGnLK1M2wjalGZlbwHCvyeIm-4stKQB4Qm6UYmVMzyIFeEpP3iQGtq7cB16aK5grtc8-q1QJpkXskG2yWrvYyNgE8TMXKqv-SCOxeoIgof0O1ZXzMF2yd5Sn2gk5BMt7--wUqIf9Q98n9VPs6Wb1HxO2jgTkY0nfiTeN_RKLqQh77jE Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 0473b6175cf646d2bff820ab22dc6404 Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1783502921 Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: X-Role: admin,reader,member Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: admin,reader,member Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0473b6175cf646d2bff820ab22dc6404"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0473b6175cf646d2bff820ab22dc6404"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0473b6175cf646d2bff820ab22dc6404", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0473b6175cf646d2bff820ab22dc6404"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1783502921 Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 0473b6175cf646d2bff820ab22dc6404 Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1783502921 Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-HostsAdminNegativeTestJSON-1783502921-project-admin Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: bead5843639b4088a0425997b77d6f0b Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1783502921-project-admin Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'nonexistent_hostname'} Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:08.834601 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:31:08.839281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:31:08.839281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:31:08.839281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:31:08.839281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:31:08.839281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:31:08.839281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jun 05 08:31:08.839281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jun 05 08:31:08.839281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jun 05 08:31:08.839281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:31:08.839281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 05 08:31:08.839281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:08.839281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:08.839281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:08.839281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:08.839281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:08.839281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:08.839281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:31:08.839281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:31:08.839281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 05 08:31:08.839281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:08.839281 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8f7adfcc-f272-4c86-9282-9fe32f10c86b tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:31:08.839281 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8f7adfcc-f272-4c86-9282-9fe32f10c86b tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.061613 Jun 05 08:31:08.839281 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1065/2095] 10.222.0.33 () {58 vars in 1217 bytes} [Sun Jun 5 08:31:08 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:31:08.853065 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-bec137c4-d493-4dca-8117-4f5d8497b928 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:08.856712 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c9d4a5a9-f548-4ea4-98e9-0215c32443ab tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:08.857242 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c9d4a5a9-f548-4ea4-98e9-0215c32443ab tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:08.873549 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bec137c4-d493-4dca-8117-4f5d8497b928 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:08.874301 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bec137c4-d493-4dca-8117-4f5d8497b928 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:08.875282 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bec137c4-d493-4dca-8117-4f5d8497b928 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:08.875914 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bec137c4-d493-4dca-8117-4f5d8497b928 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:08.884642 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c9d4a5a9-f548-4ea4-98e9-0215c32443ab tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:08.885129 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c9d4a5a9-f548-4ea4-98e9-0215c32443ab tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:08.888666 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c9d4a5a9-f548-4ea4-98e9-0215c32443ab tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:08.890708 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c9d4a5a9-f548-4ea4-98e9-0215c32443ab tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:09.113839 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c9d4a5a9-f548-4ea4-98e9-0215c32443ab tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.274992 Jun 05 08:31:09.115125 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1066/2096] 10.222.0.33 () {60 vars in 1315 bytes} [Sun Jun 5 08:31:08 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca/os-interface => generated 284 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:31:09.121230 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8f7c5f9d-0c7f-4150-8bbd-c0b24ccc59ba tempest-HostsAdminNegativeTestJSON-612584076 tempest-HostsAdminNegativeTestJSON-612584076-project] Calling method '.version_select at 0x7f2445390b80>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:09.123071 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:31:09.123071 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:31:09.126783 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8f7c5f9d-0c7f-4150-8bbd-c0b24ccc59ba tempest-HostsAdminNegativeTestJSON-612584076 tempest-HostsAdminNegativeTestJSON-612584076-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'a25e200a102b41e897b3684cd9a7e52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a81f9d43fad3420dbb55135612430caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8f7c5f9d-0c7f-4150-8bbd-c0b24ccc59ba tempest-HostsAdminNegativeTestJSON-612584076 tempest-HostsAdminNegativeTestJSON-612584076-project] Request method failure captured: Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-hosts/n-d-844739-1/startup HTTP/1.1 Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGnKZ52k-4cIL3YsC_RHGTCJtS57DbVJqyrb-no6gigyVhrR2v1mtZ-u5Ys_EHCgSoZ5gYMrDyEnGkVv2dZife-_RQ7sh8RNmDCm0IehwUohDY47L28FU9bwFxwi3G6Uiknn2xzc8gH2b-FU8L53OSFD9pOOfI66MWt9RrbuAb2Hfh0 Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: a81f9d43fad3420dbb55135612430caa Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-612584076 Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a81f9d43fad3420dbb55135612430caa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a81f9d43fad3420dbb55135612430caa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a81f9d43fad3420dbb55135612430caa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a81f9d43fad3420dbb55135612430caa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-HostsAdminNegativeTestJSON-612584076 Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: a81f9d43fad3420dbb55135612430caa Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-612584076 Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-HostsAdminNegativeTestJSON-612584076-project Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: a25e200a102b41e897b3684cd9a7e52e Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-HostsAdminNegativeTestJSON-612584076-project Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'n-d-844739-1'} Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.130653 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:09.136695 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:09.136695 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:09.136695 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:31:09.136695 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:31:09.136695 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jun 05 08:31:09.136695 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.140402 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8f7c5f9d-0c7f-4150-8bbd-c0b24ccc59ba tempest-HostsAdminNegativeTestJSON-612584076 tempest-HostsAdminNegativeTestJSON-612584076-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:31:09.141715 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8f7c5f9d-0c7f-4150-8bbd-c0b24ccc59ba tempest-HostsAdminNegativeTestJSON-612584076 tempest-HostsAdminNegativeTestJSON-612584076-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/n-d-844739-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.025079 Jun 05 08:31:09.149631 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1067/2097] 10.222.0.33 () {58 vars in 1190 bytes} [Sun Jun 5 08:31:09 2022] GET /compute/v2.1/os-hosts/n-d-844739-1/startup => generated 110 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:31:09.155080 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e54607ec-5686-495c-b37c-cb85f91f9a20 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:09.155705 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e54607ec-5686-495c-b37c-cb85f91f9a20 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:09.185435 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e54607ec-5686-495c-b37c-cb85f91f9a20 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:09.185898 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e54607ec-5686-495c-b37c-cb85f91f9a20 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:09.186703 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e54607ec-5686-495c-b37c-cb85f91f9a20 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:09.187157 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e54607ec-5686-495c-b37c-cb85f91f9a20 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:09.340514 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-bec137c4-d493-4dca-8117-4f5d8497b928 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:09.356227 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-bec137c4-d493-4dca-8117-4f5d8497b928 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:09.359794 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-bec137c4-d493-4dca-8117-4f5d8497b928 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:09.361472 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bec137c4-d493-4dca-8117-4f5d8497b928 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1292 microversion: 2.25 time: 0.537710 Jun 05 08:31:09.364576 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1031/2098] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:08 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1292 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:09.375248 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-39d1dd0a-270b-4b6f-b39e-a9f21e8f3103 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24453ce8b0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:09.427436 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e54607ec-5686-495c-b37c-cb85f91f9a20 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:09.450684 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e54607ec-5686-495c-b37c-cb85f91f9a20 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.299565 Jun 05 08:31:09.452182 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1068/2099] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:09 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:09.484967 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-39d1dd0a-270b-4b6f-b39e-a9f21e8f3103 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e" status: 200 len: 1413 microversion: 2.1 time: 0.118070 Jun 05 08:31:09.492111 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1032/2100] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:31:09 2022] GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e => generated 1413 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:09.493885 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7cac45d5-686b-4406-9236-45a9dfffe37f tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] Calling method '.version_select at 0x7f244535ea60>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:09.495107 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:31:09.495107 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:31:09.507401 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-7cac45d5-686b-4406-9236-45a9dfffe37f tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7cac45d5-686b-4406-9236-45a9dfffe37f tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] Request method failure captured: Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGnLK1M2wjalGZlbwHCvyeIm-4stKQB4Qm6UYmVMzyIFeEpP3iQGtq7cB16aK5grtc8-q1QJpkXskG2yWrvYyNgE8TMXKqv-SCOxeoIgof0O1ZXzMF2yd5Sn2gk5BMt7--wUqIf9Q98n9VPs6Wb1HxO2jgTkY0nfiTeN_RKLqQh77jE Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 0473b6175cf646d2bff820ab22dc6404 Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1783502921 Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: X-Role: admin,reader,member Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: admin,reader,member Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0473b6175cf646d2bff820ab22dc6404"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0473b6175cf646d2bff820ab22dc6404"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0473b6175cf646d2bff820ab22dc6404", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0473b6175cf646d2bff820ab22dc6404"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1783502921 Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 0473b6175cf646d2bff820ab22dc6404 Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1783502921 Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-HostsAdminNegativeTestJSON-1783502921-project-admin Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: bead5843639b4088a0425997b77d6f0b Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1783502921-project-admin Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'nonexistent_hostname'} Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:09.509862 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:31:09.515396 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:31:09.515396 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:31:09.515396 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:31:09.515396 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:31:09.515396 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:31:09.515396 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jun 05 08:31:09.515396 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jun 05 08:31:09.515396 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jun 05 08:31:09.515396 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:31:09.515396 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 05 08:31:09.515396 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.515396 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:09.515396 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.515396 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:09.515396 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:09.515396 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:09.515396 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:31:09.515396 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:31:09.515396 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 05 08:31:09.515396 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.518341 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7cac45d5-686b-4406-9236-45a9dfffe37f tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:31:09.520185 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7cac45d5-686b-4406-9236-45a9dfffe37f tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.066223 Jun 05 08:31:09.532992 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2452eba9-09e3-4f46-8a1c-32fd7aec9a33 tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] Action: 'update', calling method: .version_select at 0x7f2433a5f550>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2452eba9-09e3-4f46-8a1c-32fd7aec9a33 tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] Request method failure captured: Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: request: PUT /compute/v2.1/os-hosts/n-d-844739-1 HTTP/1.1 Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 51 Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGnLK1M2wjalGZlbwHCvyeIm-4stKQB4Qm6UYmVMzyIFeEpP3iQGtq7cB16aK5grtc8-q1QJpkXskG2yWrvYyNgE8TMXKqv-SCOxeoIgof0O1ZXzMF2yd5Sn2gk5BMt7--wUqIf9Q98n9VPs6Wb1HxO2jgTkY0nfiTeN_RKLqQh77jE Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 0473b6175cf646d2bff820ab22dc6404 Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1783502921 Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: X-Role: admin,reader,member Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: admin,reader,member Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0473b6175cf646d2bff820ab22dc6404"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0473b6175cf646d2bff820ab22dc6404"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0473b6175cf646d2bff820ab22dc6404", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0473b6175cf646d2bff820ab22dc6404"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1783502921 Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 0473b6175cf646d2bff820ab22dc6404 Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1783502921 Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-HostsAdminNegativeTestJSON-1783502921-project-admin Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: bead5843639b4088a0425997b77d6f0b Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1783502921-project-admin Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: {"status": "enable", "maintenance_mode": "invalid"} Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'n-d-844739-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise error Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi 'disable', Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi 'Enable', Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi 'Disable', Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi 'ENABLE', Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi On instance: Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi 'invalid' Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 05 08:31:09.540887 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 05 08:31:09.548362 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 05 08:31:09.548362 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 05 08:31:09.548362 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 05 08:31:09.548362 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 05 08:31:09.548362 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 05 08:31:09.548362 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.548362 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:09.548362 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.548362 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:09.548362 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:09.548362 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:09.548362 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 05 08:31:09.548362 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 05 08:31:09.548362 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 05 08:31:09.548362 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.551854 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2452eba9-09e3-4f46-8a1c-32fd7aec9a33 tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:31:09.552396 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1069/2101] 10.222.0.33 () {58 vars in 1214 bytes} [Sun Jun 5 08:31:09 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:31:09.555242 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2452eba9-09e3-4f46-8a1c-32fd7aec9a33 tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/n-d-844739-1" status: 400 len: 199 microversion: 2.1 time: 0.027552 Jun 05 08:31:09.564783 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1033/2102] 10.222.0.33 () {60 vars in 1186 bytes} [Sun Jun 5 08:31:09 2022] PUT /compute/v2.1/os-hosts/n-d-844739-1 => generated 199 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 05 08:31:09.572621 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0d556130-155c-46c3-9460-d91eb36ee690 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:09.573498 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0d556130-155c-46c3-9460-d91eb36ee690 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:09.577113 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7ad26fc5-362f-45f1-bad6-64b8b2094ee7 tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] Action: 'update', calling method: .version_select at 0x7f24331a3310>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7ad26fc5-362f-45f1-bad6-64b8b2094ee7 tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] Request method failure captured: Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: request: PUT /compute/v2.1/os-hosts/n-d-844739-1 HTTP/1.1 Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 51 Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGnLK1M2wjalGZlbwHCvyeIm-4stKQB4Qm6UYmVMzyIFeEpP3iQGtq7cB16aK5grtc8-q1QJpkXskG2yWrvYyNgE8TMXKqv-SCOxeoIgof0O1ZXzMF2yd5Sn2gk5BMt7--wUqIf9Q98n9VPs6Wb1HxO2jgTkY0nfiTeN_RKLqQh77jE Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 0473b6175cf646d2bff820ab22dc6404 Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1783502921 Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: X-Role: admin,reader,member Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: admin,reader,member Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0473b6175cf646d2bff820ab22dc6404"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0473b6175cf646d2bff820ab22dc6404"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0473b6175cf646d2bff820ab22dc6404", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0473b6175cf646d2bff820ab22dc6404"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1783502921 Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 0473b6175cf646d2bff820ab22dc6404 Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1783502921 Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-HostsAdminNegativeTestJSON-1783502921-project-admin Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: bead5843639b4088a0425997b77d6f0b Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1783502921-project-admin Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: {"status": "invalid", "maintenance_mode": "enable"} Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'n-d-844739-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise error Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi 'disable', Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi 'Enable', Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi 'Disable', Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi 'ENABLE', Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi On instance: Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi 'invalid' Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 05 08:31:09.587641 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 05 08:31:09.593553 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 05 08:31:09.593553 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 05 08:31:09.593553 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 05 08:31:09.593553 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 05 08:31:09.593553 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 05 08:31:09.593553 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.593553 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:09.593553 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.593553 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:09.593553 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:09.593553 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:09.593553 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 05 08:31:09.593553 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 05 08:31:09.593553 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 05 08:31:09.593553 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.599123 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7ad26fc5-362f-45f1-bad6-64b8b2094ee7 tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:31:09.601275 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0d556130-155c-46c3-9460-d91eb36ee690 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:09.601650 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7ad26fc5-362f-45f1-bad6-64b8b2094ee7 tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/n-d-844739-1" status: 400 len: 189 microversion: 2.1 time: 0.031700 Jun 05 08:31:09.611066 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0d556130-155c-46c3-9460-d91eb36ee690 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:09.611572 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1034/2103] 10.222.0.33 () {60 vars in 1186 bytes} [Sun Jun 5 08:31:09 2022] PUT /compute/v2.1/os-hosts/n-d-844739-1 => generated 189 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 05 08:31:09.615876 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0d556130-155c-46c3-9460-d91eb36ee690 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:09.616575 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0d556130-155c-46c3-9460-d91eb36ee690 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:09.631136 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f6987ee0-de24-46e8-b2f5-4a4b39cdfcd5 tempest-HostsAdminNegativeTestJSON-612584076 tempest-HostsAdminNegativeTestJSON-612584076-project] Action: 'update', calling method: .version_select at 0x7f2433a5f0d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:31:09.640442 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:31:09.640442 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:31:09.642033 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f6987ee0-de24-46e8-b2f5-4a4b39cdfcd5 tempest-HostsAdminNegativeTestJSON-612584076 tempest-HostsAdminNegativeTestJSON-612584076-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'a25e200a102b41e897b3684cd9a7e52e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a81f9d43fad3420dbb55135612430caa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f6987ee0-de24-46e8-b2f5-4a4b39cdfcd5 tempest-HostsAdminNegativeTestJSON-612584076 tempest-HostsAdminNegativeTestJSON-612584076-project] Request method failure captured: Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: request: PUT /compute/v2.1/os-hosts/n-d-844739-1 HTTP/1.1 Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 50 Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGnKZ52k-4cIL3YsC_RHGTCJtS57DbVJqyrb-no6gigyVhrR2v1mtZ-u5Ys_EHCgSoZ5gYMrDyEnGkVv2dZife-_RQ7sh8RNmDCm0IehwUohDY47L28FU9bwFxwi3G6Uiknn2xzc8gH2b-FU8L53OSFD9pOOfI66MWt9RrbuAb2Hfh0 Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: a81f9d43fad3420dbb55135612430caa Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-612584076 Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a81f9d43fad3420dbb55135612430caa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a81f9d43fad3420dbb55135612430caa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a81f9d43fad3420dbb55135612430caa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a81f9d43fad3420dbb55135612430caa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-HostsAdminNegativeTestJSON-612584076 Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: a81f9d43fad3420dbb55135612430caa Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-612584076 Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-HostsAdminNegativeTestJSON-612584076-project Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: a25e200a102b41e897b3684cd9a7e52e Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-HostsAdminNegativeTestJSON-612584076-project Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: {"status": "enable", "maintenance_mode": "enable"} Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'n-d-844739-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jun 05 08:31:09.646322 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.652863 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:09.652863 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.652863 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:09.652863 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:09.652863 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:09.652863 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:31:09.652863 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:31:09.652863 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jun 05 08:31:09.652863 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.652863 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f6987ee0-de24-46e8-b2f5-4a4b39cdfcd5 tempest-HostsAdminNegativeTestJSON-612584076 tempest-HostsAdminNegativeTestJSON-612584076-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:31:09.655983 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f6987ee0-de24-46e8-b2f5-4a4b39cdfcd5 tempest-HostsAdminNegativeTestJSON-612584076 tempest-HostsAdminNegativeTestJSON-612584076-project] 10.222.0.33 "PUT /compute/v2.1/os-hosts/n-d-844739-1" status: 403 len: 111 microversion: 2.1 time: 0.041039 Jun 05 08:31:09.665409 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1035/2104] 10.222.0.33 () {60 vars in 1186 bytes} [Sun Jun 5 08:31:09 2022] PUT /compute/v2.1/os-hosts/n-d-844739-1 => generated 111 bytes in 50 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:31:09.674663 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b2f90a8d-775b-4fb8-8190-800ee8146d15 tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] Action: 'update', calling method: .version_select at 0x7f243315c670>, body: {"status": null, "maintenance_mode": null} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b2f90a8d-775b-4fb8-8190-800ee8146d15 tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] Request method failure captured: Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: request: PUT /compute/v2.1/os-hosts/n-d-844739-1 HTTP/1.1 Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 42 Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGnLK1M2wjalGZlbwHCvyeIm-4stKQB4Qm6UYmVMzyIFeEpP3iQGtq7cB16aK5grtc8-q1QJpkXskG2yWrvYyNgE8TMXKqv-SCOxeoIgof0O1ZXzMF2yd5Sn2gk5BMt7--wUqIf9Q98n9VPs6Wb1HxO2jgTkY0nfiTeN_RKLqQh77jE Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 0473b6175cf646d2bff820ab22dc6404 Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1783502921 Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: X-Role: admin,reader,member Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: admin,reader,member Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0473b6175cf646d2bff820ab22dc6404"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0473b6175cf646d2bff820ab22dc6404"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0473b6175cf646d2bff820ab22dc6404", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0473b6175cf646d2bff820ab22dc6404"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1783502921 Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 0473b6175cf646d2bff820ab22dc6404 Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1783502921 Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-HostsAdminNegativeTestJSON-1783502921-project-admin Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: bead5843639b4088a0425997b77d6f0b Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1783502921-project-admin Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: {"status": null, "maintenance_mode": null} Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'n-d-844739-1', 'body': {'status': None, 'maintenance_mode': None}} Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise error Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi 'disable', Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi 'Enable', Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi 'Disable', Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi 'ENABLE', Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi On instance: Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi None Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 05 08:31:09.678257 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 05 08:31:09.682927 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 05 08:31:09.682927 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 05 08:31:09.682927 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jun 05 08:31:09.682927 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.682927 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:09.682927 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.682927 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:09.682927 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:09.682927 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:09.682927 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 05 08:31:09.682927 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 05 08:31:09.682927 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jun 05 08:31:09.682927 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.682927 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b2f90a8d-775b-4fb8-8190-800ee8146d15 tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:31:09.682927 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b2f90a8d-775b-4fb8-8190-800ee8146d15 tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/n-d-844739-1" status: 400 len: 127 microversion: 2.1 time: 0.010089 Jun 05 08:31:09.684359 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1036/2105] 10.222.0.33 () {60 vars in 1186 bytes} [Sun Jun 5 08:31:09 2022] PUT /compute/v2.1/os-hosts/n-d-844739-1 => generated 127 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 05 08:31:09.710627 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8f1b172e-f5d4-4b55-8c34-293d7392c2fb tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] Action: 'update', calling method: .version_select at 0x7f243315c3a0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:31:09.714848 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.hosts [None req-8f1b172e-f5d4-4b55-8c34-293d7392c2fb tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] Enabling host nonexistent_hostname. Jun 05 08:31:09.724656 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-8f1b172e-f5d4-4b55-8c34-293d7392c2fb tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8f1b172e-f5d4-4b55-8c34-293d7392c2fb tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] Request method failure captured: Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 50 Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGnLK1M2wjalGZlbwHCvyeIm-4stKQB4Qm6UYmVMzyIFeEpP3iQGtq7cB16aK5grtc8-q1QJpkXskG2yWrvYyNgE8TMXKqv-SCOxeoIgof0O1ZXzMF2yd5Sn2gk5BMt7--wUqIf9Q98n9VPs6Wb1HxO2jgTkY0nfiTeN_RKLqQh77jE Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 0473b6175cf646d2bff820ab22dc6404 Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1783502921 Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: X-Role: admin,reader,member Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: admin,reader,member Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0473b6175cf646d2bff820ab22dc6404"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0473b6175cf646d2bff820ab22dc6404"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0473b6175cf646d2bff820ab22dc6404", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0473b6175cf646d2bff820ab22dc6404"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1783502921 Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 0473b6175cf646d2bff820ab22dc6404 Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1783502921 Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-HostsAdminNegativeTestJSON-1783502921-project-admin Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: bead5843639b4088a0425997b77d6f0b Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1783502921-project-admin Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: {"status": "enable", "maintenance_mode": "enable"} Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:09.726633 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:09.731699 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:31:09.731699 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:31:09.731699 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:31:09.731699 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:31:09.731699 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:31:09.731699 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:31:09.731699 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:31:09.731699 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:31:09.731699 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jun 05 08:31:09.731699 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jun 05 08:31:09.731699 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jun 05 08:31:09.731699 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:31:09.731699 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 05 08:31:09.731699 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.731699 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:09.731699 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.731699 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:09.731699 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:09.731699 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:09.731699 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:31:09.731699 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:31:09.731699 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 05 08:31:09.731699 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:09.739349 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8f1b172e-f5d4-4b55-8c34-293d7392c2fb tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:31:09.739349 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8f1b172e-f5d4-4b55-8c34-293d7392c2fb tempest-HostsAdminNegativeTestJSON-1783502921 tempest-HostsAdminNegativeTestJSON-1783502921-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.050154 Jun 05 08:31:09.739807 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1037/2106] 10.222.0.33 () {60 vars in 1210 bytes} [Sun Jun 5 08:31:09 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:31:10.140362 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0d556130-155c-46c3-9460-d91eb36ee690 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:10.153936 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0d556130-155c-46c3-9460-d91eb36ee690 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:10.161267 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0d556130-155c-46c3-9460-d91eb36ee690 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:10.162876 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0d556130-155c-46c3-9460-d91eb36ee690 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.609256 Jun 05 08:31:10.164388 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1070/2107] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:09 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:10.388320 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a5913092-ff92-4936-9524-dd38293b8c8b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:10.388940 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a5913092-ff92-4936-9524-dd38293b8c8b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:10.402312 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a5913092-ff92-4936-9524-dd38293b8c8b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:10.403030 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a5913092-ff92-4936-9524-dd38293b8c8b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:10.407732 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a5913092-ff92-4936-9524-dd38293b8c8b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:10.408227 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a5913092-ff92-4936-9524-dd38293b8c8b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:10.471289 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6db14fe6-1cfd-4195-b7ee-90c39ee201c9 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:10.473240 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6db14fe6-1cfd-4195-b7ee-90c39ee201c9 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:10.492885 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6db14fe6-1cfd-4195-b7ee-90c39ee201c9 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:10.502948 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6db14fe6-1cfd-4195-b7ee-90c39ee201c9 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:10.505619 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6db14fe6-1cfd-4195-b7ee-90c39ee201c9 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:10.505619 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6db14fe6-1cfd-4195-b7ee-90c39ee201c9 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:10.709944 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6db14fe6-1cfd-4195-b7ee-90c39ee201c9 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:10.722837 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6db14fe6-1cfd-4195-b7ee-90c39ee201c9 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.255865 Jun 05 08:31:10.735679 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1071/2108] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:10 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:31:10.735679 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-85d046bb-2e69-4edc-b4d6-fe1bc1e6446e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f2445328c10>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:10.784735 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a5913092-ff92-4936-9524-dd38293b8c8b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:10.837709 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-85d046bb-2e69-4edc-b4d6-fe1bc1e6446e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e" status: 200 len: 1413 microversion: 2.1 time: 0.108546 Jun 05 08:31:10.838630 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1072/2109] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:31:10 2022] GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e => generated 1413 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:10.858731 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a5913092-ff92-4936-9524-dd38293b8c8b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:10.860985 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a5913092-ff92-4936-9524-dd38293b8c8b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:10.863164 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a5913092-ff92-4936-9524-dd38293b8c8b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1292 microversion: 2.25 time: 0.480167 Jun 05 08:31:10.864394 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1038/2110] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:10 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1292 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:11.183964 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4cbd020f-7f81-4011-8e49-7bd33c5bd733 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:11.184923 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4cbd020f-7f81-4011-8e49-7bd33c5bd733 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:11.203036 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4cbd020f-7f81-4011-8e49-7bd33c5bd733 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:11.203494 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4cbd020f-7f81-4011-8e49-7bd33c5bd733 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:11.204319 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4cbd020f-7f81-4011-8e49-7bd33c5bd733 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:11.204764 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4cbd020f-7f81-4011-8e49-7bd33c5bd733 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:11.745777 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e9b6c0ff-9ed8-482c-8f11-8a8e19b6d60a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:11.746620 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e9b6c0ff-9ed8-482c-8f11-8a8e19b6d60a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:11.759208 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e9b6c0ff-9ed8-482c-8f11-8a8e19b6d60a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:11.761023 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e9b6c0ff-9ed8-482c-8f11-8a8e19b6d60a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:11.764337 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e9b6c0ff-9ed8-482c-8f11-8a8e19b6d60a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:11.765293 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e9b6c0ff-9ed8-482c-8f11-8a8e19b6d60a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:12.479817 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e9b6c0ff-9ed8-482c-8f11-8a8e19b6d60a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:12.489607 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e9b6c0ff-9ed8-482c-8f11-8a8e19b6d60a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.748524 Jun 05 08:31:12.498782 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1039/2111] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:11 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:12.530469 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c0a9cc09-396a-4d39-b2b9-33064b6d5e87 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24331010d0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:12.689591 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c0a9cc09-396a-4d39-b2b9-33064b6d5e87 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e" status: 200 len: 1413 microversion: 2.1 time: 0.189516 Jun 05 08:31:12.691244 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1040/2112] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:31:12 2022] GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e => generated 1413 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:12.715895 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-16e21321-6a21-4e68-b1ce-c64dbf8d4516 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:12.732491 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-16e21321-6a21-4e68-b1ce-c64dbf8d4516 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:12.765169 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-16e21321-6a21-4e68-b1ce-c64dbf8d4516 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:12.772745 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-16e21321-6a21-4e68-b1ce-c64dbf8d4516 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:12.775476 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-16e21321-6a21-4e68-b1ce-c64dbf8d4516 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:12.777454 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-16e21321-6a21-4e68-b1ce-c64dbf8d4516 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:12.811459 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4cbd020f-7f81-4011-8e49-7bd33c5bd733 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:12.830894 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4cbd020f-7f81-4011-8e49-7bd33c5bd733 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:12.839470 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4cbd020f-7f81-4011-8e49-7bd33c5bd733 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:12.841353 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4cbd020f-7f81-4011-8e49-7bd33c5bd733 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 1.662755 Jun 05 08:31:12.845465 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1073/2113] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:11 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:13.397443 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-16e21321-6a21-4e68-b1ce-c64dbf8d4516 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:13.404719 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-3fe3d18c-08ec-491d-b74c-477e33dab508 req-9ac51c98-61c3-4b6c-a9ab-f2a7b7937812 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "040dd488-42f2-45c3-86de-1a675e78d7ca", "tag": "93d59181-26a5-451b-8871-ccba610464fd"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:31:13.416121 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-16e21321-6a21-4e68-b1ce-c64dbf8d4516 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:13.423181 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-16e21321-6a21-4e68-b1ce-c64dbf8d4516 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:13.424328 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-3fe3d18c-08ec-491d-b74c-477e33dab508 req-9ac51c98-61c3-4b6c-a9ab-f2a7b7937812 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:13.432097 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-3fe3d18c-08ec-491d-b74c-477e33dab508 req-9ac51c98-61c3-4b6c-a9ab-f2a7b7937812 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:13.432436 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-16e21321-6a21-4e68-b1ce-c64dbf8d4516 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1280 microversion: 2.25 time: 0.733679 Jun 05 08:31:13.433248 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1041/2114] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:12 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1280 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:13.477989 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-3fe3d18c-08ec-491d-b74c-477e33dab508 req-9ac51c98-61c3-4b6c-a9ab-f2a7b7937812 service nova] Creating event network-changed:93d59181-26a5-451b-8871-ccba610464fd for instance 040dd488-42f2-45c3-86de-1a675e78d7ca on n-h1-844739-1 Jun 05 08:31:13.499440 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-3fe3d18c-08ec-491d-b74c-477e33dab508 req-9ac51c98-61c3-4b6c-a9ab-f2a7b7937812 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098750 Jun 05 08:31:13.504764 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1074/2115] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:31:13.515006 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-05881805-ab0b-4c1e-b3bc-e40e01da9775 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:13.515690 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-05881805-ab0b-4c1e-b3bc-e40e01da9775 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:13.532417 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-05881805-ab0b-4c1e-b3bc-e40e01da9775 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:13.532972 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-05881805-ab0b-4c1e-b3bc-e40e01da9775 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:13.539703 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-05881805-ab0b-4c1e-b3bc-e40e01da9775 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:13.541219 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-05881805-ab0b-4c1e-b3bc-e40e01da9775 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:13.705750 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c54bd75e-242b-4d40-993f-9600530a96d7 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f244537a3a0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:13.764370 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-05881805-ab0b-4c1e-b3bc-e40e01da9775 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:13.784789 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-05881805-ab0b-4c1e-b3bc-e40e01da9775 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.270573 Jun 05 08:31:13.797365 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1042/2116] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:13 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:13.798152 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c54bd75e-242b-4d40-993f-9600530a96d7 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e" status: 200 len: 1422 microversion: 2.1 time: 0.097436 Jun 05 08:31:13.798837 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1075/2117] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:31:13 2022] GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e => generated 1422 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:13.810219 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5ab17ca4-100a-41aa-b6d1-978a3ea29efa tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f243316a310>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:13.866249 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-799e0c87-8ec9-4abc-9899-cd798c314da2 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:13.867635 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-799e0c87-8ec9-4abc-9899-cd798c314da2 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:13.897287 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-799e0c87-8ec9-4abc-9899-cd798c314da2 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:13.901695 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-799e0c87-8ec9-4abc-9899-cd798c314da2 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:13.908593 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-799e0c87-8ec9-4abc-9899-cd798c314da2 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:13.910894 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-799e0c87-8ec9-4abc-9899-cd798c314da2 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:13.941201 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5ab17ca4-100a-41aa-b6d1-978a3ea29efa tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e" status: 200 len: 1422 microversion: 2.1 time: 0.134318 Jun 05 08:31:13.953128 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1043/2118] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:31:13 2022] GET /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e => generated 1422 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:13.968230 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0e93591b-9990-49cc-8a9d-633f77d2c022 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f243317ac10>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:15.127045 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-799e0c87-8ec9-4abc-9899-cd798c314da2 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:15.153369 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-799e0c87-8ec9-4abc-9899-cd798c314da2 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:15.157226 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-799e0c87-8ec9-4abc-9899-cd798c314da2 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:15.166067 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-799e0c87-8ec9-4abc-9899-cd798c314da2 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 1.306935 Jun 05 08:31:15.170713 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1076/2119] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:13 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:31:15.179817 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ad74fcf5-296c-432b-b815-1053338fcd1b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:15.193302 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ad74fcf5-296c-432b-b815-1053338fcd1b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:15.197707 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0e93591b-9990-49cc-8a9d-633f77d2c022 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "DELETE /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e" status: 204 len: 0 microversion: 2.1 time: 1.243339 Jun 05 08:31:15.198441 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1044/2120] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:13 2022] DELETE /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e => generated 0 bytes in 1245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:31:15.209713 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-52166067-86e3-416f-a4b9-79c8f0806d38 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:15.211233 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-52166067-86e3-416f-a4b9-79c8f0806d38 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:15.227401 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ad74fcf5-296c-432b-b815-1053338fcd1b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:15.232725 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-52166067-86e3-416f-a4b9-79c8f0806d38 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:15.238388 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-52166067-86e3-416f-a4b9-79c8f0806d38 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:15.239061 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ad74fcf5-296c-432b-b815-1053338fcd1b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:15.239965 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ad74fcf5-296c-432b-b815-1053338fcd1b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:15.240478 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ad74fcf5-296c-432b-b815-1053338fcd1b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:15.240633 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-52166067-86e3-416f-a4b9-79c8f0806d38 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:15.241328 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-52166067-86e3-416f-a4b9-79c8f0806d38 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:15.615054 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-52166067-86e3-416f-a4b9-79c8f0806d38 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:15.634851 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-52166067-86e3-416f-a4b9-79c8f0806d38 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.429646 Jun 05 08:31:15.637432 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1045/2121] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:15 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:15.656933 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a0c8abf8-410c-4464-86de-baabed53229d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:15.658760 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a0c8abf8-410c-4464-86de-baabed53229d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:15.698756 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a0c8abf8-410c-4464-86de-baabed53229d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:15.700076 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a0c8abf8-410c-4464-86de-baabed53229d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:15.701131 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a0c8abf8-410c-4464-86de-baabed53229d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:15.702024 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a0c8abf8-410c-4464-86de-baabed53229d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:15.753194 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ad74fcf5-296c-432b-b815-1053338fcd1b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:15.762384 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a0c8abf8-410c-4464-86de-baabed53229d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:31:15.773034 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ad74fcf5-296c-432b-b815-1053338fcd1b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:15.783555 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ad74fcf5-296c-432b-b815-1053338fcd1b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:15.791178 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ad74fcf5-296c-432b-b815-1053338fcd1b tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1280 microversion: 2.25 time: 0.617170 Jun 05 08:31:15.792532 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1077/2122] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:15 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1280 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:15.976344 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a0c8abf8-410c-4464-86de-baabed53229d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 204 len: 0 microversion: 2.1 time: 0.334038 Jun 05 08:31:15.976990 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1046/2123] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:31:15 2022] DELETE /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:31:16.186774 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0f1bc8ed-616a-4f42-a83e-76bbc0dd2001 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:16.189174 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0f1bc8ed-616a-4f42-a83e-76bbc0dd2001 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:16.208829 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0f1bc8ed-616a-4f42-a83e-76bbc0dd2001 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:16.214396 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0f1bc8ed-616a-4f42-a83e-76bbc0dd2001 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:16.215982 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0f1bc8ed-616a-4f42-a83e-76bbc0dd2001 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:16.218070 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0f1bc8ed-616a-4f42-a83e-76bbc0dd2001 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:16.310966 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ab574d5a-6e4f-44e4-a33b-cff210e1fc37 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-995563812", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "78ad483b-a47a-44a2-8bc0-8789288467d5"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:31:16.469808 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-ab574d5a-6e4f-44e4-a33b-cff210e1fc37 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] validate_networks() for [('78ad483b-a47a-44a2-8bc0-8789288467d5', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:31:16.683463 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0f1bc8ed-616a-4f42-a83e-76bbc0dd2001 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:16.706043 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0f1bc8ed-616a-4f42-a83e-76bbc0dd2001 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:16.715595 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0f1bc8ed-616a-4f42-a83e-76bbc0dd2001 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:16.717572 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0f1bc8ed-616a-4f42-a83e-76bbc0dd2001 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.535341 Jun 05 08:31:16.718232 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1078/2124] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:16 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:16.723982 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-873435d9-98ad-4af6-ba9b-fed295b70cc4 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:16.730372 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-873435d9-98ad-4af6-ba9b-fed295b70cc4 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:16.751571 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-873435d9-98ad-4af6-ba9b-fed295b70cc4 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:16.752464 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-873435d9-98ad-4af6-ba9b-fed295b70cc4 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:16.754818 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-873435d9-98ad-4af6-ba9b-fed295b70cc4 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:16.757239 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-873435d9-98ad-4af6-ba9b-fed295b70cc4 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:16.895342 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-873435d9-98ad-4af6-ba9b-fed295b70cc4 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:16.903854 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-873435d9-98ad-4af6-ba9b-fed295b70cc4 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.184482 Jun 05 08:31:16.905105 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1079/2125] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:16 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:16.911232 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-47718372-2be8-4cac-8601-79f841e6c77d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:16.911866 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-47718372-2be8-4cac-8601-79f841e6c77d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:16.918758 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-47718372-2be8-4cac-8601-79f841e6c77d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:16.919458 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-47718372-2be8-4cac-8601-79f841e6c77d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:16.920733 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-47718372-2be8-4cac-8601-79f841e6c77d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:16.921356 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-47718372-2be8-4cac-8601-79f841e6c77d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:16.952856 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=100 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:31:17.385778 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-ab574d5a-6e4f-44e4-a33b-cff210e1fc37 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:31:17.386327 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-ab574d5a-6e4f-44e4-a33b-cff210e1fc37 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:31:17.387136 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-ab574d5a-6e4f-44e4-a33b-cff210e1fc37 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:31:17.387682 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-ab574d5a-6e4f-44e4-a33b-cff210e1fc37 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:31:17.388261 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-ab574d5a-6e4f-44e4-a33b-cff210e1fc37 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:31:17.410270 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ab574d5a-6e4f-44e4-a33b-cff210e1fc37 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:17.414607 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ab574d5a-6e4f-44e4-a33b-cff210e1fc37 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:17.418063 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ab574d5a-6e4f-44e4-a33b-cff210e1fc37 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:17.418989 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ab574d5a-6e4f-44e4-a33b-cff210e1fc37 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:17.475489 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-ab574d5a-6e4f-44e4-a33b-cff210e1fc37 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Getting quotas for project d7e0706485194d6ab0cf41ea0f651074. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:31:17.497567 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-ab574d5a-6e4f-44e4-a33b-cff210e1fc37 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Getting quotas for user 41b99bee0b35400281da332533850481 and project d7e0706485194d6ab0cf41ea0f651074. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:31:17.536345 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ab574d5a-6e4f-44e4-a33b-cff210e1fc37 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:31:17.547214 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ab574d5a-6e4f-44e4-a33b-cff210e1fc37 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: ed215a36-f621-4024-b3ba-57734be5c8bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:31:17.661104 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-47718372-2be8-4cac-8601-79f841e6c77d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:17.681984 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-47718372-2be8-4cac-8601-79f841e6c77d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:17.683545 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-47718372-2be8-4cac-8601-79f841e6c77d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:17.684724 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-47718372-2be8-4cac-8601-79f841e6c77d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1280 microversion: 2.25 time: 0.778670 Jun 05 08:31:17.685289 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1080/2126] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:16 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1280 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:17.711416 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ab574d5a-6e4f-44e4-a33b-cff210e1fc37 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.404557 Jun 05 08:31:17.717099 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1047/2127] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:31:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1411 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:31:17.736170 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-60671136-4a49-4481-a373-7561aca5507a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:17.737206 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-60671136-4a49-4481-a373-7561aca5507a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: ed215a36-f621-4024-b3ba-57734be5c8bd] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:17.895603 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-60671136-4a49-4481-a373-7561aca5507a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:17.908721 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-60671136-4a49-4481-a373-7561aca5507a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd" status: 200 len: 1207 microversion: 2.1 time: 0.182162 Jun 05 08:31:17.909410 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1048/2128] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:17 2022] GET /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd => generated 1207 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:17.923197 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b2bd7364-3645-4e63-9a94-78e065c49353 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:17.924345 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b2bd7364-3645-4e63-9a94-78e065c49353 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:17.941741 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b2bd7364-3645-4e63-9a94-78e065c49353 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:17.942208 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b2bd7364-3645-4e63-9a94-78e065c49353 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:17.947317 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b2bd7364-3645-4e63-9a94-78e065c49353 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:17.947868 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b2bd7364-3645-4e63-9a94-78e065c49353 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:18.187624 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5aa36813-46be-4feb-85b2-b8e05c01a55e tempest-HypervisorAdminNegativeTestJSON-1909672162 tempest-HypervisorAdminNegativeTestJSON-1909672162-project] Calling method '.version_select at 0x7f2445351040>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:18.189733 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:31:18.189733 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:31:18.195481 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5aa36813-46be-4feb-85b2-b8e05c01a55e tempest-HypervisorAdminNegativeTestJSON-1909672162 tempest-HypervisorAdminNegativeTestJSON-1909672162-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'd254c3bfc381403791392dc5109ae324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c8c81c6a8f4a5eadec34ccb98f36f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5aa36813-46be-4feb-85b2-b8e05c01a55e tempest-HypervisorAdminNegativeTestJSON-1909672162 tempest-HypervisorAdminNegativeTestJSON-1909672162-project] Request method failure captured: Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGnU3WcKm9IouURfcOUWqlqfcW4ZBwlnKhYKyG_1SmiQhs_hsW2iH9ZLeghj1TEVl94mskMF19ob2yZHXahnpjpUD23YjYpC4fjLrsfU67E8CmwnDSrd24blU8ZJiX8QBGpjY3pBo6LB-xwjKwOLbijLuU2-TY8y72qdtoMN2eisCZs Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 16c8c81c6a8f4a5eadec34ccb98f36f9 Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1909672162 Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/16c8c81c6a8f4a5eadec34ccb98f36f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16c8c81c6a8f4a5eadec34ccb98f36f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_16c8c81c6a8f4a5eadec34ccb98f36f9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16c8c81c6a8f4a5eadec34ccb98f36f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1909672162 Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 16c8c81c6a8f4a5eadec34ccb98f36f9 Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1909672162 Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-HypervisorAdminNegativeTestJSON-1909672162-project Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: d254c3bfc381403791392dc5109ae324 Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1909672162-project Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: action_args: {} Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._detail(req) Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jun 05 08:31:18.219082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:18.224560 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:18.224560 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:18.224560 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:18.224560 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:18.224560 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:18.224560 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:31:18.224560 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:31:18.224560 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jun 05 08:31:18.224560 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:18.224560 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5aa36813-46be-4feb-85b2-b8e05c01a55e tempest-HypervisorAdminNegativeTestJSON-1909672162 tempest-HypervisorAdminNegativeTestJSON-1909672162-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:31:18.224560 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5aa36813-46be-4feb-85b2-b8e05c01a55e tempest-HypervisorAdminNegativeTestJSON-1909672162 tempest-HypervisorAdminNegativeTestJSON-1909672162-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.526068 Jun 05 08:31:18.224560 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1081/2129] 10.222.0.33 () {58 vars in 1166 bytes} [Sun Jun 5 08:31:17 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 527 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:31:18.250271 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-359b8be4-5e1f-4e2d-829f-cbac7e89fc41 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:18.250897 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-359b8be4-5e1f-4e2d-829f-cbac7e89fc41 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:18.288552 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-359b8be4-5e1f-4e2d-829f-cbac7e89fc41 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:18.289383 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-359b8be4-5e1f-4e2d-829f-cbac7e89fc41 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:18.293511 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-359b8be4-5e1f-4e2d-829f-cbac7e89fc41 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:18.293511 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-359b8be4-5e1f-4e2d-829f-cbac7e89fc41 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:18.451448 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-359b8be4-5e1f-4e2d-829f-cbac7e89fc41 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:18.473741 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-359b8be4-5e1f-4e2d-829f-cbac7e89fc41 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.251930 Jun 05 08:31:18.477033 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1082/2130] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:18 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:18.494935 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-a39bac04-320a-469c-8698-734fda66b7ad req-8d8acb9c-1d45-46b3-8a65-0f3a38f5c943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73be951-4be1-4f53-ab55-92c80bdc199d", "name": "network-vif-unplugged", "status": "completed", "tag": "08bcdec3-4528-44c9-bd1e-24888f45cd2c"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:31:18.565202 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b2bd7364-3645-4e63-9a94-78e065c49353 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:18.574684 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-a39bac04-320a-469c-8698-734fda66b7ad req-8d8acb9c-1d45-46b3-8a65-0f3a38f5c943 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:18.576335 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-a39bac04-320a-469c-8698-734fda66b7ad req-8d8acb9c-1d45-46b3-8a65-0f3a38f5c943 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:18.593508 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b2bd7364-3645-4e63-9a94-78e065c49353 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:18.595342 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b2bd7364-3645-4e63-9a94-78e065c49353 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:18.596618 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b2bd7364-3645-4e63-9a94-78e065c49353 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.683857 Jun 05 08:31:18.598729 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1049/2131] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:17 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:18.619570 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-a39bac04-320a-469c-8698-734fda66b7ad req-8d8acb9c-1d45-46b3-8a65-0f3a38f5c943 service nova] Creating event network-vif-unplugged:08bcdec3-4528-44c9-bd1e-24888f45cd2c for instance d73be951-4be1-4f53-ab55-92c80bdc199d on n-h2-844739-1 Jun 05 08:31:18.620093 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2d1da9b8-f4a1-4cfb-aa70-dacca93035fe tempest-HypervisorAdminNegativeTestJSON-1909672162 tempest-HypervisorAdminNegativeTestJSON-1909672162-project] Calling method '.version_select at 0x7f24331a31f0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:18.621079 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:31:18.621079 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:31:18.622167 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2d1da9b8-f4a1-4cfb-aa70-dacca93035fe tempest-HypervisorAdminNegativeTestJSON-1909672162 tempest-HypervisorAdminNegativeTestJSON-1909672162-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'd254c3bfc381403791392dc5109ae324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c8c81c6a8f4a5eadec34ccb98f36f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2d1da9b8-f4a1-4cfb-aa70-dacca93035fe tempest-HypervisorAdminNegativeTestJSON-1909672162 tempest-HypervisorAdminNegativeTestJSON-1909672162-project] Request method failure captured: Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGnU3WcKm9IouURfcOUWqlqfcW4ZBwlnKhYKyG_1SmiQhs_hsW2iH9ZLeghj1TEVl94mskMF19ob2yZHXahnpjpUD23YjYpC4fjLrsfU67E8CmwnDSrd24blU8ZJiX8QBGpjY3pBo6LB-xwjKwOLbijLuU2-TY8y72qdtoMN2eisCZs Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 16c8c81c6a8f4a5eadec34ccb98f36f9 Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1909672162 Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/16c8c81c6a8f4a5eadec34ccb98f36f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16c8c81c6a8f4a5eadec34ccb98f36f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_16c8c81c6a8f4a5eadec34ccb98f36f9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16c8c81c6a8f4a5eadec34ccb98f36f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1909672162 Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 16c8c81c6a8f4a5eadec34ccb98f36f9 Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1909672162 Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-HypervisorAdminNegativeTestJSON-1909672162-project Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: d254c3bfc381403791392dc5109ae324 Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1909672162-project Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: action_args: {} Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._index(req) Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jun 05 08:31:18.625414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:18.632014 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:18.632014 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:18.632014 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:18.632014 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:18.632014 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:18.632014 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:31:18.632014 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:31:18.632014 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jun 05 08:31:18.632014 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:18.632014 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2d1da9b8-f4a1-4cfb-aa70-dacca93035fe tempest-HypervisorAdminNegativeTestJSON-1909672162 tempest-HypervisorAdminNegativeTestJSON-1909672162-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:31:18.632014 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2d1da9b8-f4a1-4cfb-aa70-dacca93035fe tempest-HypervisorAdminNegativeTestJSON-1909672162 tempest-HypervisorAdminNegativeTestJSON-1909672162-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.028089 Jun 05 08:31:18.634936 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1050/2132] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:31:18 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:31:18.644628 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-a39bac04-320a-469c-8698-734fda66b7ad req-8d8acb9c-1d45-46b3-8a65-0f3a38f5c943 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.164262 Jun 05 08:31:18.647322 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-395244a6-253a-4673-8819-2a47341e47bd tempest-HypervisorAdminNegativeTestJSON-1909672162 tempest-HypervisorAdminNegativeTestJSON-1909672162-project] Calling method '.version_select at 0x7f243319de50>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:18.650861 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:31:18.650861 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:31:18.651071 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1083/2133] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:31:18.652023 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-395244a6-253a-4673-8819-2a47341e47bd tempest-HypervisorAdminNegativeTestJSON-1909672162 tempest-HypervisorAdminNegativeTestJSON-1909672162-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'd254c3bfc381403791392dc5109ae324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c8c81c6a8f4a5eadec34ccb98f36f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-395244a6-253a-4673-8819-2a47341e47bd tempest-HypervisorAdminNegativeTestJSON-1909672162 tempest-HypervisorAdminNegativeTestJSON-1909672162-project] Request method failure captured: Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGnU3WcKm9IouURfcOUWqlqfcW4ZBwlnKhYKyG_1SmiQhs_hsW2iH9ZLeghj1TEVl94mskMF19ob2yZHXahnpjpUD23YjYpC4fjLrsfU67E8CmwnDSrd24blU8ZJiX8QBGpjY3pBo6LB-xwjKwOLbijLuU2-TY8y72qdtoMN2eisCZs Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 16c8c81c6a8f4a5eadec34ccb98f36f9 Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1909672162 Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/16c8c81c6a8f4a5eadec34ccb98f36f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16c8c81c6a8f4a5eadec34ccb98f36f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_16c8c81c6a8f4a5eadec34ccb98f36f9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16c8c81c6a8f4a5eadec34ccb98f36f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1909672162 Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 16c8c81c6a8f4a5eadec34ccb98f36f9 Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1909672162 Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-HypervisorAdminNegativeTestJSON-1909672162-project Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: d254c3bfc381403791392dc5109ae324 Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1909672162-project Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: action_args: {} Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:18.654196 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:18.659092 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:18.659092 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:18.659092 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:31:18.659092 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:31:18.659092 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jun 05 08:31:18.659092 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:18.659092 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-395244a6-253a-4673-8819-2a47341e47bd tempest-HypervisorAdminNegativeTestJSON-1909672162 tempest-HypervisorAdminNegativeTestJSON-1909672162-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:31:18.660694 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-395244a6-253a-4673-8819-2a47341e47bd tempest-HypervisorAdminNegativeTestJSON-1909672162 tempest-HypervisorAdminNegativeTestJSON-1909672162-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.019693 Jun 05 08:31:18.661647 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1051/2134] 10.222.0.33 () {58 vars in 1178 bytes} [Sun Jun 5 08:31:18 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:31:18.714076 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b65f29c8-326e-4f3e-97d3-880c9937062f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:18.714703 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b65f29c8-326e-4f3e-97d3-880c9937062f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:18.729040 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b65f29c8-326e-4f3e-97d3-880c9937062f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:18.734019 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b65f29c8-326e-4f3e-97d3-880c9937062f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:18.736430 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b65f29c8-326e-4f3e-97d3-880c9937062f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:18.738225 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b65f29c8-326e-4f3e-97d3-880c9937062f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:18.792575 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ed38e4ff-73b3-43ed-bc29-4f0c6b77aa45 tempest-HypervisorAdminNegativeTestJSON-317331142 tempest-HypervisorAdminNegativeTestJSON-317331142-project-admin] Calling method '.version_select at 0x7f244535e790>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:18.794376 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:31:18.794376 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:31:18.796196 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ed38e4ff-73b3-43ed-bc29-4f0c6b77aa45 tempest-HypervisorAdminNegativeTestJSON-317331142 tempest-HypervisorAdminNegativeTestJSON-317331142-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:18.798734 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ed38e4ff-73b3-43ed-bc29-4f0c6b77aa45 tempest-HypervisorAdminNegativeTestJSON-317331142 tempest-HypervisorAdminNegativeTestJSON-317331142-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:18.834516 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ed38e4ff-73b3-43ed-bc29-4f0c6b77aa45 tempest-HypervisorAdminNegativeTestJSON-317331142 tempest-HypervisorAdminNegativeTestJSON-317331142-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:18.836650 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ed38e4ff-73b3-43ed-bc29-4f0c6b77aa45 tempest-HypervisorAdminNegativeTestJSON-317331142 tempest-HypervisorAdminNegativeTestJSON-317331142-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:18.869585 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ed38e4ff-73b3-43ed-bc29-4f0c6b77aa45 tempest-HypervisorAdminNegativeTestJSON-317331142 tempest-HypervisorAdminNegativeTestJSON-317331142-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:18.870077 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ed38e4ff-73b3-43ed-bc29-4f0c6b77aa45 tempest-HypervisorAdminNegativeTestJSON-317331142 tempest-HypervisorAdminNegativeTestJSON-317331142-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:18.889750 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ed38e4ff-73b3-43ed-bc29-4f0c6b77aa45 tempest-HypervisorAdminNegativeTestJSON-317331142 tempest-HypervisorAdminNegativeTestJSON-317331142-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.219945 Jun 05 08:31:18.896939 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1084/2135] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:31:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:31:18.909048 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-41ecae20-4a39-45ce-8715-2e2da78e523b tempest-HypervisorAdminNegativeTestJSON-1909672162 tempest-HypervisorAdminNegativeTestJSON-1909672162-project] Calling method '.version_select at 0x7f244535eaf0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:18.913923 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:31:18.913923 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:31:18.921956 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-41ecae20-4a39-45ce-8715-2e2da78e523b tempest-HypervisorAdminNegativeTestJSON-1909672162 tempest-HypervisorAdminNegativeTestJSON-1909672162-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'd254c3bfc381403791392dc5109ae324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c8c81c6a8f4a5eadec34ccb98f36f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-41ecae20-4a39-45ce-8715-2e2da78e523b tempest-HypervisorAdminNegativeTestJSON-1909672162 tempest-HypervisorAdminNegativeTestJSON-1909672162-project] Request method failure captured: Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGnU3WcKm9IouURfcOUWqlqfcW4ZBwlnKhYKyG_1SmiQhs_hsW2iH9ZLeghj1TEVl94mskMF19ob2yZHXahnpjpUD23YjYpC4fjLrsfU67E8CmwnDSrd24blU8ZJiX8QBGpjY3pBo6LB-xwjKwOLbijLuU2-TY8y72qdtoMN2eisCZs Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 16c8c81c6a8f4a5eadec34ccb98f36f9 Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1909672162 Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/16c8c81c6a8f4a5eadec34ccb98f36f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16c8c81c6a8f4a5eadec34ccb98f36f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_16c8c81c6a8f4a5eadec34ccb98f36f9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16c8c81c6a8f4a5eadec34ccb98f36f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1909672162 Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 16c8c81c6a8f4a5eadec34ccb98f36f9 Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1909672162 Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-HypervisorAdminNegativeTestJSON-1909672162-project Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: d254c3bfc381403791392dc5109ae324 Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1909672162-project Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '1'} Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:18.923809 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:18.933132 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:18.933132 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:18.933132 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:31:18.933132 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:31:18.933132 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jun 05 08:31:18.933132 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:18.933132 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-41ecae20-4a39-45ce-8715-2e2da78e523b tempest-HypervisorAdminNegativeTestJSON-1909672162 tempest-HypervisorAdminNegativeTestJSON-1909672162-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:31:18.933132 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-41ecae20-4a39-45ce-8715-2e2da78e523b tempest-HypervisorAdminNegativeTestJSON-1909672162 tempest-HypervisorAdminNegativeTestJSON-1909672162-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.026866 Jun 05 08:31:18.933132 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1085/2136] 10.222.0.33 () {58 vars in 1172 bytes} [Sun Jun 5 08:31:18 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:31:18.936478 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-217119bf-c04f-4e9b-8b9e-671393bf398f tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:18.937298 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-217119bf-c04f-4e9b-8b9e-671393bf398f tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: ed215a36-f621-4024-b3ba-57734be5c8bd] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:18.945500 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-217119bf-c04f-4e9b-8b9e-671393bf398f tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:18.945990 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-217119bf-c04f-4e9b-8b9e-671393bf398f tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:18.948586 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-217119bf-c04f-4e9b-8b9e-671393bf398f tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:18.949045 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-217119bf-c04f-4e9b-8b9e-671393bf398f tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:19.207721 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-217119bf-c04f-4e9b-8b9e-671393bf398f tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:19.220490 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-217119bf-c04f-4e9b-8b9e-671393bf398f tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd" status: 200 len: 1203 microversion: 2.1 time: 0.293270 Jun 05 08:31:19.221076 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1086/2137] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:18 2022] GET /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd => generated 1203 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:19.231502 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-860412cc-c921-40f5-995a-d1d9c699667f tempest-HypervisorAdminNegativeTestJSON-317331142 tempest-HypervisorAdminNegativeTestJSON-317331142-project-admin] Calling method '.version_select at 0x7f24454a8940>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:19.235132 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:31:19.235132 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:31:19.235823 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-860412cc-c921-40f5-995a-d1d9c699667f tempest-HypervisorAdminNegativeTestJSON-317331142 tempest-HypervisorAdminNegativeTestJSON-317331142-project-admin] HTTP exception thrown: Hypervisor with ID '9b3c7b8e-13d5-4249-ad16-ea8462180c6c' could not be found. Jun 05 08:31:19.242292 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b65f29c8-326e-4f3e-97d3-880c9937062f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-860412cc-c921-40f5-995a-d1d9c699667f tempest-HypervisorAdminNegativeTestJSON-317331142 tempest-HypervisorAdminNegativeTestJSON-317331142-project-admin] Request method failure captured: Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-hypervisors/9b3c7b8e-13d5-4249-ad16-ea8462180c6c/uptime HTTP/1.1 Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGnVNQHXpqZJU7rGG1d7OsbWN4Jx3hIz1ejXgh_SGHGA6uGB50NGz8HXK9Cke-hXXqRFWW0nd1gJjqXNSwoD1XtwSs5oMwyTOc0kxk9HIQujT2dkOU77kBfozPeWLixrRCvfplcTx5RC9LwbtBx4whY56BvHuSfPRN_xoUo3ULbnELU Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: a8a74810e5ce49c1a5d95e3156ff7811 Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-317331142 Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: X-Role: admin,reader,member Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: admin,reader,member Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a8a74810e5ce49c1a5d95e3156ff7811"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a8a74810e5ce49c1a5d95e3156ff7811"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a8a74810e5ce49c1a5d95e3156ff7811", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a8a74810e5ce49c1a5d95e3156ff7811"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-317331142 Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: a8a74810e5ce49c1a5d95e3156ff7811 Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-317331142 Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-HypervisorAdminNegativeTestJSON-317331142-project-admin Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: b37019c888b44f97b138069c8aa4bcea Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-317331142-project-admin Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: exception: Hypervisor with ID '9b3c7b8e-13d5-4249-ad16-ea8462180c6c' could not be found. Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '9b3c7b8e-13d5-4249-ad16-ea8462180c6c'} Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '9b3c7b8e-13d5-4249-ad16-ea8462180c6c' Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 509, in validate_integer Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:31:19.266176 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:31:19.273286 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:31:19.273286 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:31:19.273286 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jun 05 08:31:19.273286 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jun 05 08:31:19.273286 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jun 05 08:31:19.273286 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 05 08:31:19.273286 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '9b3c7b8e-13d5-4249-ad16-ea8462180c6c' could not be found. Jun 05 08:31:19.273286 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:19.273286 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:19.273286 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:19.273286 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:19.273286 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:19.273286 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:19.273286 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:31:19.273286 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:31:19.273286 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '9b3c7b8e-13d5-4249-ad16-ea8462180c6c' could not be found. Jun 05 08:31:19.273286 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:19.275676 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b65f29c8-326e-4f3e-97d3-880c9937062f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:19.275676 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b65f29c8-326e-4f3e-97d3-880c9937062f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:19.275676 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b65f29c8-326e-4f3e-97d3-880c9937062f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1280 microversion: 2.25 time: 0.574403 Jun 05 08:31:19.280296 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-860412cc-c921-40f5-995a-d1d9c699667f tempest-HypervisorAdminNegativeTestJSON-317331142 tempest-HypervisorAdminNegativeTestJSON-317331142-project-admin] Returning 404 to user: Hypervisor with ID '9b3c7b8e-13d5-4249-ad16-ea8462180c6c' could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:31:19.281748 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-860412cc-c921-40f5-995a-d1d9c699667f tempest-HypervisorAdminNegativeTestJSON-317331142 tempest-HypervisorAdminNegativeTestJSON-317331142-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/9b3c7b8e-13d5-4249-ad16-ea8462180c6c/uptime" status: 404 len: 123 microversion: 2.1 time: 0.059491 Jun 05 08:31:19.282598 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1087/2138] 10.222.0.33 () {58 vars in 1277 bytes} [Sun Jun 5 08:31:19 2022] GET /compute/v2.1/os-hypervisors/9b3c7b8e-13d5-4249-ad16-ea8462180c6c/uptime => generated 123 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:31:19.287900 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1052/2139] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:18 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1280 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:19.293389 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-d2d4895d-f01f-42bb-9e74-4c9439b23167 req-3954aed7-ae7d-4866-9cec-65bf33926ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73be951-4be1-4f53-ab55-92c80bdc199d", "name": "network-vif-deleted", "tag": "08bcdec3-4528-44c9-bd1e-24888f45cd2c"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:31:19.294038 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2fae770f-6363-4118-8a93-7da838e71f65 tempest-HypervisorAdminNegativeTestJSON-317331142 tempest-HypervisorAdminNegativeTestJSON-317331142-project-admin] Calling method '.version_select at 0x7f24453ed820>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:19.295184 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:31:19.295184 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:31:19.296812 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2fae770f-6363-4118-8a93-7da838e71f65 tempest-HypervisorAdminNegativeTestJSON-317331142 tempest-HypervisorAdminNegativeTestJSON-317331142-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:19.297652 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2fae770f-6363-4118-8a93-7da838e71f65 tempest-HypervisorAdminNegativeTestJSON-317331142 tempest-HypervisorAdminNegativeTestJSON-317331142-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:19.323950 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-d2d4895d-f01f-42bb-9e74-4c9439b23167 req-3954aed7-ae7d-4866-9cec-65bf33926ffc service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:19.324726 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-d2d4895d-f01f-42bb-9e74-4c9439b23167 req-3954aed7-ae7d-4866-9cec-65bf33926ffc service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:19.384660 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-d2d4895d-f01f-42bb-9e74-4c9439b23167 req-3954aed7-ae7d-4866-9cec-65bf33926ffc service nova] Creating event network-vif-deleted:08bcdec3-4528-44c9-bd1e-24888f45cd2c for instance d73be951-4be1-4f53-ab55-92c80bdc199d on n-h2-844739-1 Jun 05 08:31:19.401869 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-d2d4895d-f01f-42bb-9e74-4c9439b23167 req-3954aed7-ae7d-4866-9cec-65bf33926ffc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113774 Jun 05 08:31:19.413307 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1053/2140] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:31:19.493973 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-cb1306d3-5a93-4e37-8aee-0a66162a7c21 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:19.495061 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-cb1306d3-5a93-4e37-8aee-0a66162a7c21 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:19.525614 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cb1306d3-5a93-4e37-8aee-0a66162a7c21 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:19.526070 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cb1306d3-5a93-4e37-8aee-0a66162a7c21 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:19.536219 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cb1306d3-5a93-4e37-8aee-0a66162a7c21 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:19.536931 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cb1306d3-5a93-4e37-8aee-0a66162a7c21 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:19.804809 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-cb1306d3-5a93-4e37-8aee-0a66162a7c21 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:19.814886 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-cb1306d3-5a93-4e37-8aee-0a66162a7c21 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.328696 Jun 05 08:31:19.831658 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1054/2141] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:19 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:19.852146 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-50a11029-09c8-4ae7-950c-fbbf105240a4 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:19.865139 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-50a11029-09c8-4ae7-950c-fbbf105240a4 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:19.872176 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-50a11029-09c8-4ae7-950c-fbbf105240a4 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:19.872900 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-50a11029-09c8-4ae7-950c-fbbf105240a4 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:19.873891 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-50a11029-09c8-4ae7-950c-fbbf105240a4 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:19.874494 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-50a11029-09c8-4ae7-950c-fbbf105240a4 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:19.983412 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2fae770f-6363-4118-8a93-7da838e71f65 tempest-HypervisorAdminNegativeTestJSON-317331142 tempest-HypervisorAdminNegativeTestJSON-317331142-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:19.984525 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2fae770f-6363-4118-8a93-7da838e71f65 tempest-HypervisorAdminNegativeTestJSON-317331142 tempest-HypervisorAdminNegativeTestJSON-317331142-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:19.997132 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2fae770f-6363-4118-8a93-7da838e71f65 tempest-HypervisorAdminNegativeTestJSON-317331142 tempest-HypervisorAdminNegativeTestJSON-317331142-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:19.997966 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2fae770f-6363-4118-8a93-7da838e71f65 tempest-HypervisorAdminNegativeTestJSON-317331142 tempest-HypervisorAdminNegativeTestJSON-317331142-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:20.005587 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2fae770f-6363-4118-8a93-7da838e71f65 tempest-HypervisorAdminNegativeTestJSON-317331142 tempest-HypervisorAdminNegativeTestJSON-317331142-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.715962 Jun 05 08:31:20.016262 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1088/2142] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:31:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:31:20.023596 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-35b3ea47-4b13-4f65-9661-3a229aec1513 tempest-HypervisorAdminNegativeTestJSON-1909672162 tempest-HypervisorAdminNegativeTestJSON-1909672162-project] Calling method '.version_select at 0x7f24453a7550>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:20.024552 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:31:20.024552 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:31:20.025906 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-35b3ea47-4b13-4f65-9661-3a229aec1513 tempest-HypervisorAdminNegativeTestJSON-1909672162 tempest-HypervisorAdminNegativeTestJSON-1909672162-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'd254c3bfc381403791392dc5109ae324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16c8c81c6a8f4a5eadec34ccb98f36f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-35b3ea47-4b13-4f65-9661-3a229aec1513 tempest-HypervisorAdminNegativeTestJSON-1909672162 tempest-HypervisorAdminNegativeTestJSON-1909672162-project] Request method failure captured: Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGnU3WcKm9IouURfcOUWqlqfcW4ZBwlnKhYKyG_1SmiQhs_hsW2iH9ZLeghj1TEVl94mskMF19ob2yZHXahnpjpUD23YjYpC4fjLrsfU67E8CmwnDSrd24blU8ZJiX8QBGpjY3pBo6LB-xwjKwOLbijLuU2-TY8y72qdtoMN2eisCZs Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 16c8c81c6a8f4a5eadec34ccb98f36f9 Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1909672162 Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/16c8c81c6a8f4a5eadec34ccb98f36f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16c8c81c6a8f4a5eadec34ccb98f36f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_16c8c81c6a8f4a5eadec34ccb98f36f9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16c8c81c6a8f4a5eadec34ccb98f36f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1909672162 Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 16c8c81c6a8f4a5eadec34ccb98f36f9 Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1909672162 Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-HypervisorAdminNegativeTestJSON-1909672162-project Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: d254c3bfc381403791392dc5109ae324 Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1909672162-project Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '1'} Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jun 05 08:31:20.027694 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:20.033068 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:20.033068 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:20.033068 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:20.033068 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:20.033068 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:20.033068 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:31:20.033068 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:31:20.033068 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jun 05 08:31:20.033068 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:20.033068 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-35b3ea47-4b13-4f65-9661-3a229aec1513 tempest-HypervisorAdminNegativeTestJSON-1909672162 tempest-HypervisorAdminNegativeTestJSON-1909672162-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:31:20.035221 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-35b3ea47-4b13-4f65-9661-3a229aec1513 tempest-HypervisorAdminNegativeTestJSON-1909672162 tempest-HypervisorAdminNegativeTestJSON-1909672162-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.016711 Jun 05 08:31:20.036548 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1089/2143] 10.222.0.33 () {58 vars in 1151 bytes} [Sun Jun 5 08:31:20 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:31:20.045306 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-de3ab6aa-8e15-4f23-b9d8-17ce22d1502a tempest-HypervisorAdminNegativeTestJSON-317331142 tempest-HypervisorAdminNegativeTestJSON-317331142-project-admin] Calling method '.version_select at 0x7f24453edaf0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:20.047622 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-de3ab6aa-8e15-4f23-b9d8-17ce22d1502a tempest-HypervisorAdminNegativeTestJSON-317331142 tempest-HypervisorAdminNegativeTestJSON-317331142-project-admin] HTTP exception thrown: Hypervisor with ID 'a14f7617-bd5f-4e5e-8298-e86d7fa78de7' could not be found. Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-de3ab6aa-8e15-4f23-b9d8-17ce22d1502a tempest-HypervisorAdminNegativeTestJSON-317331142 tempest-HypervisorAdminNegativeTestJSON-317331142-project-admin] Request method failure captured: Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-hypervisors/a14f7617-bd5f-4e5e-8298-e86d7fa78de7 HTTP/1.1 Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGnVNQHXpqZJU7rGG1d7OsbWN4Jx3hIz1ejXgh_SGHGA6uGB50NGz8HXK9Cke-hXXqRFWW0nd1gJjqXNSwoD1XtwSs5oMwyTOc0kxk9HIQujT2dkOU77kBfozPeWLixrRCvfplcTx5RC9LwbtBx4whY56BvHuSfPRN_xoUo3ULbnELU Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: a8a74810e5ce49c1a5d95e3156ff7811 Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-317331142 Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: X-Role: admin,reader,member Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: admin,reader,member Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a8a74810e5ce49c1a5d95e3156ff7811"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a8a74810e5ce49c1a5d95e3156ff7811"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a8a74810e5ce49c1a5d95e3156ff7811", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a8a74810e5ce49c1a5d95e3156ff7811"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-317331142 Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: a8a74810e5ce49c1a5d95e3156ff7811 Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-317331142 Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-HypervisorAdminNegativeTestJSON-317331142-project-admin Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: b37019c888b44f97b138069c8aa4bcea Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-317331142-project-admin Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: exception: Hypervisor with ID 'a14f7617-bd5f-4e5e-8298-e86d7fa78de7' could not be found. Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'a14f7617-bd5f-4e5e-8298-e86d7fa78de7'} Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'a14f7617-bd5f-4e5e-8298-e86d7fa78de7' Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 509, in validate_integer Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:31:20.049828 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:31:20.055121 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:31:20.055121 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:31:20.055121 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jun 05 08:31:20.055121 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jun 05 08:31:20.055121 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jun 05 08:31:20.055121 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jun 05 08:31:20.055121 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jun 05 08:31:20.055121 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 05 08:31:20.055121 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'a14f7617-bd5f-4e5e-8298-e86d7fa78de7' could not be found. Jun 05 08:31:20.055121 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:20.055121 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:20.055121 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:20.055121 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:20.055121 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:20.055121 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:20.055121 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:31:20.055121 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:31:20.055121 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'a14f7617-bd5f-4e5e-8298-e86d7fa78de7' could not be found. Jun 05 08:31:20.055121 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:20.055121 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-de3ab6aa-8e15-4f23-b9d8-17ce22d1502a tempest-HypervisorAdminNegativeTestJSON-317331142 tempest-HypervisorAdminNegativeTestJSON-317331142-project-admin] Returning 404 to user: Hypervisor with ID 'a14f7617-bd5f-4e5e-8298-e86d7fa78de7' could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:31:20.057532 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-de3ab6aa-8e15-4f23-b9d8-17ce22d1502a tempest-HypervisorAdminNegativeTestJSON-317331142 tempest-HypervisorAdminNegativeTestJSON-317331142-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/a14f7617-bd5f-4e5e-8298-e86d7fa78de7" status: 404 len: 123 microversion: 2.1 time: 0.015948 Jun 05 08:31:20.062644 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1090/2144] 10.222.0.33 () {58 vars in 1256 bytes} [Sun Jun 5 08:31:20 2022] GET /compute/v2.1/os-hypervisors/a14f7617-bd5f-4e5e-8298-e86d7fa78de7 => generated 123 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 05 08:31:20.241020 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8f8e563a-aba8-4944-9d60-cda17c538348 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:20.241687 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8f8e563a-aba8-4944-9d60-cda17c538348 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: ed215a36-f621-4024-b3ba-57734be5c8bd] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:20.259518 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8f8e563a-aba8-4944-9d60-cda17c538348 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:20.260990 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8f8e563a-aba8-4944-9d60-cda17c538348 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:20.263926 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8f8e563a-aba8-4944-9d60-cda17c538348 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:20.272869 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8f8e563a-aba8-4944-9d60-cda17c538348 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:20.287533 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-50a11029-09c8-4ae7-950c-fbbf105240a4 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:20.305180 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-50a11029-09c8-4ae7-950c-fbbf105240a4 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:20.306870 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-50a11029-09c8-4ae7-950c-fbbf105240a4 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:20.308091 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-50a11029-09c8-4ae7-950c-fbbf105240a4 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.470809 Jun 05 08:31:20.313926 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1055/2145] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:19 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:20.322889 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e5ecea7c-be5e-43e0-ae39-7763244c6885 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:20.323878 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e5ecea7c-be5e-43e0-ae39-7763244c6885 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:20.333783 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e5ecea7c-be5e-43e0-ae39-7763244c6885 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:20.337700 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e5ecea7c-be5e-43e0-ae39-7763244c6885 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:20.340186 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e5ecea7c-be5e-43e0-ae39-7763244c6885 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:20.340891 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e5ecea7c-be5e-43e0-ae39-7763244c6885 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:20.474140 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8f8e563a-aba8-4944-9d60-cda17c538348 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:20.498365 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8f8e563a-aba8-4944-9d60-cda17c538348 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd" status: 200 len: 1265 microversion: 2.1 time: 0.263759 Jun 05 08:31:20.501218 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1091/2146] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:20 2022] GET /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd => generated 1265 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:31:20.724174 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e5ecea7c-be5e-43e0-ae39-7763244c6885 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:20.739015 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e5ecea7c-be5e-43e0-ae39-7763244c6885 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:20.744618 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e5ecea7c-be5e-43e0-ae39-7763244c6885 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:20.748421 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e5ecea7c-be5e-43e0-ae39-7763244c6885 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1280 microversion: 2.25 time: 0.433026 Jun 05 08:31:20.749000 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1056/2147] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:20 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1280 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:20.850824 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f41f7e48-e8ab-41e3-8212-ac38bab98fcc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:20.851690 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f41f7e48-e8ab-41e3-8212-ac38bab98fcc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:20.865457 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f41f7e48-e8ab-41e3-8212-ac38bab98fcc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:20.865944 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f41f7e48-e8ab-41e3-8212-ac38bab98fcc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:20.871885 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f41f7e48-e8ab-41e3-8212-ac38bab98fcc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:20.872756 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f41f7e48-e8ab-41e3-8212-ac38bab98fcc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:21.039634 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f41f7e48-e8ab-41e3-8212-ac38bab98fcc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:21.056441 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f41f7e48-e8ab-41e3-8212-ac38bab98fcc tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.208522 Jun 05 08:31:21.071105 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1092/2148] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:20 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:21.336259 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-17207601-0684-4f71-811b-80f6c2a30f9f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:21.336976 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-17207601-0684-4f71-811b-80f6c2a30f9f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:21.343979 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-17207601-0684-4f71-811b-80f6c2a30f9f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:21.345468 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-17207601-0684-4f71-811b-80f6c2a30f9f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:21.351773 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-17207601-0684-4f71-811b-80f6c2a30f9f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:21.352766 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-17207601-0684-4f71-811b-80f6c2a30f9f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:21.523656 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-23d80ca2-e3b7-471b-87eb-29ba5d70c516 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:21.525660 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-23d80ca2-e3b7-471b-87eb-29ba5d70c516 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: ed215a36-f621-4024-b3ba-57734be5c8bd] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:21.544081 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-23d80ca2-e3b7-471b-87eb-29ba5d70c516 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:21.544947 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-23d80ca2-e3b7-471b-87eb-29ba5d70c516 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:21.547182 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-23d80ca2-e3b7-471b-87eb-29ba5d70c516 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:21.547859 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-23d80ca2-e3b7-471b-87eb-29ba5d70c516 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:21.792879 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-23d80ca2-e3b7-471b-87eb-29ba5d70c516 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:21.807456 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-23d80ca2-e3b7-471b-87eb-29ba5d70c516 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd" status: 200 len: 1265 microversion: 2.1 time: 0.293164 Jun 05 08:31:21.814758 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1093/2149] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:21 2022] GET /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd => generated 1265 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:31:21.829724 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cf6b2bdd-7b67-4e13-8ddc-21f4420fb3a5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:21.833800 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-cf6b2bdd-7b67-4e13-8ddc-21f4420fb3a5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:21.859263 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cf6b2bdd-7b67-4e13-8ddc-21f4420fb3a5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:21.859725 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cf6b2bdd-7b67-4e13-8ddc-21f4420fb3a5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:21.860553 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cf6b2bdd-7b67-4e13-8ddc-21f4420fb3a5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:21.865228 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cf6b2bdd-7b67-4e13-8ddc-21f4420fb3a5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:21.902408 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-17207601-0684-4f71-811b-80f6c2a30f9f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:21.916290 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-17207601-0684-4f71-811b-80f6c2a30f9f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:21.918014 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-17207601-0684-4f71-811b-80f6c2a30f9f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:21.919203 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-17207601-0684-4f71-811b-80f6c2a30f9f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.588241 Jun 05 08:31:21.919759 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1057/2150] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:21 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:22.074168 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d1cd3593-efed-4d93-9366-384dbbf6935b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:22.074789 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d1cd3593-efed-4d93-9366-384dbbf6935b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:22.085563 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d1cd3593-efed-4d93-9366-384dbbf6935b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:22.085998 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d1cd3593-efed-4d93-9366-384dbbf6935b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:22.087035 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d1cd3593-efed-4d93-9366-384dbbf6935b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:22.087671 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d1cd3593-efed-4d93-9366-384dbbf6935b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:22.195794 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-cf6b2bdd-7b67-4e13-8ddc-21f4420fb3a5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:22.215756 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-cf6b2bdd-7b67-4e13-8ddc-21f4420fb3a5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:22.219846 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-cf6b2bdd-7b67-4e13-8ddc-21f4420fb3a5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:22.222377 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-cf6b2bdd-7b67-4e13-8ddc-21f4420fb3a5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1280 microversion: 2.25 time: 0.405307 Jun 05 08:31:22.236068 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1094/2151] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:21 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1280 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:22.251293 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d1cd3593-efed-4d93-9366-384dbbf6935b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:22.255811 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:31:22.265690 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d1cd3593-efed-4d93-9366-384dbbf6935b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.195280 Jun 05 08:31:22.275463 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1058/2152] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:22 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:22.837367 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2dcc391c-49ca-4a67-b4b0-94da2ac9bfcf tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:22.840189 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2dcc391c-49ca-4a67-b4b0-94da2ac9bfcf tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: ed215a36-f621-4024-b3ba-57734be5c8bd] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:22.854735 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2dcc391c-49ca-4a67-b4b0-94da2ac9bfcf tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:22.856317 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2dcc391c-49ca-4a67-b4b0-94da2ac9bfcf tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:22.859862 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2dcc391c-49ca-4a67-b4b0-94da2ac9bfcf tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:22.860786 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2dcc391c-49ca-4a67-b4b0-94da2ac9bfcf tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:22.943231 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0a5bbadb-0fc2-4988-a0b4-c15aa50e0a06 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:22.943917 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0a5bbadb-0fc2-4988-a0b4-c15aa50e0a06 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:22.974952 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0a5bbadb-0fc2-4988-a0b4-c15aa50e0a06 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:22.976864 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0a5bbadb-0fc2-4988-a0b4-c15aa50e0a06 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:22.980166 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0a5bbadb-0fc2-4988-a0b4-c15aa50e0a06 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:22.981010 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0a5bbadb-0fc2-4988-a0b4-c15aa50e0a06 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:23.488330 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2dcc391c-49ca-4a67-b4b0-94da2ac9bfcf tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:23.505789 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2dcc391c-49ca-4a67-b4b0-94da2ac9bfcf tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd" status: 200 len: 1307 microversion: 2.1 time: 0.678644 Jun 05 08:31:23.506777 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1095/2153] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:22 2022] GET /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd => generated 1307 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:23.519347 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-aa991f0f-95a1-4990-a2dc-4cea396dc913 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:23.523318 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-aa991f0f-95a1-4990-a2dc-4cea396dc913 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:23.539222 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:31:23.542817 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-aa991f0f-95a1-4990-a2dc-4cea396dc913 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:23.545453 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-aa991f0f-95a1-4990-a2dc-4cea396dc913 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:23.546863 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-aa991f0f-95a1-4990-a2dc-4cea396dc913 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:23.547602 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-aa991f0f-95a1-4990-a2dc-4cea396dc913 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:24.095511 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0a5bbadb-0fc2-4988-a0b4-c15aa50e0a06 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:24.119530 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0a5bbadb-0fc2-4988-a0b4-c15aa50e0a06 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:24.125256 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0a5bbadb-0fc2-4988-a0b4-c15aa50e0a06 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:24.127735 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0a5bbadb-0fc2-4988-a0b4-c15aa50e0a06 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 1.189641 Jun 05 08:31:24.130079 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1059/2154] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:22 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:31:24.140686 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-abb05fe4-6b63-4095-96c6-aac63bfcb57e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:24.142980 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-abb05fe4-6b63-4095-96c6-aac63bfcb57e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:24.161702 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-abb05fe4-6b63-4095-96c6-aac63bfcb57e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:24.162151 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-abb05fe4-6b63-4095-96c6-aac63bfcb57e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:24.168475 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-abb05fe4-6b63-4095-96c6-aac63bfcb57e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:24.168939 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-abb05fe4-6b63-4095-96c6-aac63bfcb57e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:24.505321 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-abb05fe4-6b63-4095-96c6-aac63bfcb57e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:24.516203 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-aa991f0f-95a1-4990-a2dc-4cea396dc913 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:24.519279 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-abb05fe4-6b63-4095-96c6-aac63bfcb57e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.382969 Jun 05 08:31:24.534905 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1060/2155] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:24 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:24.547199 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-12aa8e1b-3042-4181-93f9-7e850a2c556e req-bf028cd4-a716-4774-af9d-e56c2cb2de29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed215a36-f621-4024-b3ba-57734be5c8bd", "tag": "b0df87c8-f87b-4cb2-93b1-fa25266d8016"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:31:24.559910 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-aa991f0f-95a1-4990-a2dc-4cea396dc913 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:24.561166 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-12aa8e1b-3042-4181-93f9-7e850a2c556e req-bf028cd4-a716-4774-af9d-e56c2cb2de29 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:24.561807 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-12aa8e1b-3042-4181-93f9-7e850a2c556e req-bf028cd4-a716-4774-af9d-e56c2cb2de29 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:24.568836 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-aa991f0f-95a1-4990-a2dc-4cea396dc913 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:24.570728 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-aa991f0f-95a1-4990-a2dc-4cea396dc913 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1280 microversion: 2.25 time: 1.060267 Jun 05 08:31:24.579225 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1096/2156] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:23 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1280 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:24.596439 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-12aa8e1b-3042-4181-93f9-7e850a2c556e req-bf028cd4-a716-4774-af9d-e56c2cb2de29 service nova] Creating event network-changed:b0df87c8-f87b-4cb2-93b1-fa25266d8016 for instance ed215a36-f621-4024-b3ba-57734be5c8bd on n-h1-844739-1 Jun 05 08:31:24.602946 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-7ee7890e-11f7-49b0-acc5-29dceb3f2a13 req-662eba0f-44f2-48ce-bd22-63e6d133d8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12ef7912-7054-4457-b1a4-c266b5bcb3e5", "name": "network-vif-plugged", "status": "completed", "tag": "25cc4210-356d-47b2-9e15-cf3ee146a37b"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:31:24.614917 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-12aa8e1b-3042-4181-93f9-7e850a2c556e req-bf028cd4-a716-4774-af9d-e56c2cb2de29 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078168 Jun 05 08:31:24.618655 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1061/2157] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:31:24.626948 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-7ee7890e-11f7-49b0-acc5-29dceb3f2a13 req-662eba0f-44f2-48ce-bd22-63e6d133d8d7 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:24.627393 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-7ee7890e-11f7-49b0-acc5-29dceb3f2a13 req-662eba0f-44f2-48ce-bd22-63e6d133d8d7 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:24.634395 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ef2a4fb1-a894-4208-ba02-653457f8f4e5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:24.635093 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ef2a4fb1-a894-4208-ba02-653457f8f4e5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: ed215a36-f621-4024-b3ba-57734be5c8bd] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:24.650912 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ef2a4fb1-a894-4208-ba02-653457f8f4e5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:24.653698 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ef2a4fb1-a894-4208-ba02-653457f8f4e5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:24.654533 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ef2a4fb1-a894-4208-ba02-653457f8f4e5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:24.656486 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-7ee7890e-11f7-49b0-acc5-29dceb3f2a13 req-662eba0f-44f2-48ce-bd22-63e6d133d8d7 service nova] Creating event network-vif-plugged:25cc4210-356d-47b2-9e15-cf3ee146a37b for instance 12ef7912-7054-4457-b1a4-c266b5bcb3e5 on n-h1-844739-1 Jun 05 08:31:24.656833 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ef2a4fb1-a894-4208-ba02-653457f8f4e5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:24.669298 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-7ee7890e-11f7-49b0-acc5-29dceb3f2a13 req-662eba0f-44f2-48ce-bd22-63e6d133d8d7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088391 Jun 05 08:31:24.672453 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1097/2158] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:31:25.045170 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ef2a4fb1-a894-4208-ba02-653457f8f4e5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:25.058315 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ef2a4fb1-a894-4208-ba02-653457f8f4e5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd" status: 200 len: 1307 microversion: 2.1 time: 0.437281 Jun 05 08:31:25.059180 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1062/2159] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:24 2022] GET /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd => generated 1307 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:25.151789 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-51c9282e-a702-43cd-8489-30ac516a2bfd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:25.152522 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-51c9282e-a702-43cd-8489-30ac516a2bfd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:25.173110 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-51c9282e-a702-43cd-8489-30ac516a2bfd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:25.173569 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-51c9282e-a702-43cd-8489-30ac516a2bfd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:25.174360 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-51c9282e-a702-43cd-8489-30ac516a2bfd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:25.175821 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-51c9282e-a702-43cd-8489-30ac516a2bfd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:25.537888 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-db7844b1-7473-4f0a-97fe-0f1220313de7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:25.538729 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-db7844b1-7473-4f0a-97fe-0f1220313de7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:25.549680 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-db7844b1-7473-4f0a-97fe-0f1220313de7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:25.552595 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-db7844b1-7473-4f0a-97fe-0f1220313de7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:25.553532 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-db7844b1-7473-4f0a-97fe-0f1220313de7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:25.556191 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-db7844b1-7473-4f0a-97fe-0f1220313de7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:25.744782 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-db7844b1-7473-4f0a-97fe-0f1220313de7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:25.751049 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-51c9282e-a702-43cd-8489-30ac516a2bfd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:25.754168 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-db7844b1-7473-4f0a-97fe-0f1220313de7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.221311 Jun 05 08:31:25.755871 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1063/2160] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:25 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:25.760586 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e3933720-897b-40f5-aac7-c6cc17528c50 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:25.761442 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e3933720-897b-40f5-aac7-c6cc17528c50 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:25.766048 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-51c9282e-a702-43cd-8489-30ac516a2bfd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:25.767557 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-51c9282e-a702-43cd-8489-30ac516a2bfd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:25.768656 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e3933720-897b-40f5-aac7-c6cc17528c50 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:25.768896 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-51c9282e-a702-43cd-8489-30ac516a2bfd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.622667 Jun 05 08:31:25.769494 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e3933720-897b-40f5-aac7-c6cc17528c50 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:25.770478 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e3933720-897b-40f5-aac7-c6cc17528c50 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:25.771103 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e3933720-897b-40f5-aac7-c6cc17528c50 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:25.781045 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1098/2161] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:25 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:26.077480 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-757e7ead-aff6-46ba-a44e-12acf7bac6e9 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:26.078414 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-757e7ead-aff6-46ba-a44e-12acf7bac6e9 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: ed215a36-f621-4024-b3ba-57734be5c8bd] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:26.089170 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-757e7ead-aff6-46ba-a44e-12acf7bac6e9 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:26.090793 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-757e7ead-aff6-46ba-a44e-12acf7bac6e9 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:26.093839 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-757e7ead-aff6-46ba-a44e-12acf7bac6e9 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:26.096530 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-757e7ead-aff6-46ba-a44e-12acf7bac6e9 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:26.118318 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e3933720-897b-40f5-aac7-c6cc17528c50 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:26.130949 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e3933720-897b-40f5-aac7-c6cc17528c50 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:26.134840 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e3933720-897b-40f5-aac7-c6cc17528c50 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:26.139479 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e3933720-897b-40f5-aac7-c6cc17528c50 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1280 microversion: 2.25 time: 0.379442 Jun 05 08:31:26.151653 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1064/2162] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:25 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1280 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:26.357108 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-757e7ead-aff6-46ba-a44e-12acf7bac6e9 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:26.380596 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-757e7ead-aff6-46ba-a44e-12acf7bac6e9 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd" status: 200 len: 1307 microversion: 2.1 time: 0.306942 Jun 05 08:31:26.391698 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1099/2163] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:26 2022] GET /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd => generated 1307 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:26.770849 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-934c6e54-72cc-4368-b867-b34a01c3decd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:26.771526 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-934c6e54-72cc-4368-b867-b34a01c3decd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:26.785417 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-934c6e54-72cc-4368-b867-b34a01c3decd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:26.785899 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-934c6e54-72cc-4368-b867-b34a01c3decd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:26.786666 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-934c6e54-72cc-4368-b867-b34a01c3decd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:26.787108 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-934c6e54-72cc-4368-b867-b34a01c3decd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:26.799621 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3a1b59f2-be2f-437e-bcab-54853f56e8bd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:26.802069 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3a1b59f2-be2f-437e-bcab-54853f56e8bd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:26.817087 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3a1b59f2-be2f-437e-bcab-54853f56e8bd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:26.818158 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3a1b59f2-be2f-437e-bcab-54853f56e8bd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:26.819134 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3a1b59f2-be2f-437e-bcab-54853f56e8bd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:26.819754 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3a1b59f2-be2f-437e-bcab-54853f56e8bd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:26.995472 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-934c6e54-72cc-4368-b867-b34a01c3decd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:27.009929 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-934c6e54-72cc-4368-b867-b34a01c3decd tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.242922 Jun 05 08:31:27.011040 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1065/2164] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:26 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:31:27.157792 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-38bf0c6f-c92c-44d5-8e0b-f0b0cb5e7fd6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:27.158535 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-38bf0c6f-c92c-44d5-8e0b-f0b0cb5e7fd6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:27.169487 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-38bf0c6f-c92c-44d5-8e0b-f0b0cb5e7fd6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:27.169946 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-38bf0c6f-c92c-44d5-8e0b-f0b0cb5e7fd6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:27.171987 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-38bf0c6f-c92c-44d5-8e0b-f0b0cb5e7fd6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:27.178609 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-38bf0c6f-c92c-44d5-8e0b-f0b0cb5e7fd6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:27.444417 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=4 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:31:27.608520 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3a1b59f2-be2f-437e-bcab-54853f56e8bd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:27.624398 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3a1b59f2-be2f-437e-bcab-54853f56e8bd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:27.626538 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3a1b59f2-be2f-437e-bcab-54853f56e8bd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:27.628318 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3a1b59f2-be2f-437e-bcab-54853f56e8bd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.832651 Jun 05 08:31:27.630956 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1100/2165] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:26 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:27.637708 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a057930a-ffcd-4d39-92b2-f3f98b4e2c3a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:27.638535 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a057930a-ffcd-4d39-92b2-f3f98b4e2c3a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: ed215a36-f621-4024-b3ba-57734be5c8bd] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:27.648838 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a057930a-ffcd-4d39-92b2-f3f98b4e2c3a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:27.651815 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a057930a-ffcd-4d39-92b2-f3f98b4e2c3a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:27.652926 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a057930a-ffcd-4d39-92b2-f3f98b4e2c3a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:27.654028 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a057930a-ffcd-4d39-92b2-f3f98b4e2c3a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:27.827248 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-38bf0c6f-c92c-44d5-8e0b-f0b0cb5e7fd6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:27.843508 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-38bf0c6f-c92c-44d5-8e0b-f0b0cb5e7fd6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:27.848303 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-38bf0c6f-c92c-44d5-8e0b-f0b0cb5e7fd6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:27.853349 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-38bf0c6f-c92c-44d5-8e0b-f0b0cb5e7fd6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1280 microversion: 2.25 time: 0.699251 Jun 05 08:31:27.855113 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1066/2166] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:27 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1280 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:31:27.903845 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=8 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:31:27.941806 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a057930a-ffcd-4d39-92b2-f3f98b4e2c3a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:27.965714 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a057930a-ffcd-4d39-92b2-f3f98b4e2c3a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd" status: 200 len: 1307 microversion: 2.1 time: 0.332875 Jun 05 08:31:27.997570 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1101/2167] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:27 2022] GET /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd => generated 1307 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:28.033417 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3da87b00-6204-4966-acb4-ec22d76076d5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:28.036311 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3da87b00-6204-4966-acb4-ec22d76076d5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:28.049522 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3da87b00-6204-4966-acb4-ec22d76076d5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:28.050190 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3da87b00-6204-4966-acb4-ec22d76076d5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:28.051204 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3da87b00-6204-4966-acb4-ec22d76076d5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:28.051966 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3da87b00-6204-4966-acb4-ec22d76076d5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:28.105290 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7f3937cb-18c7-4598-b3cc-4a71406f678b tempest-InstanceUsageAuditLogNegativeTestJSON-2013344588 tempest-InstanceUsageAuditLogNegativeTestJSON-2013344588-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:28.107431 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:31:28.107431 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:31:28.109720 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-7f3937cb-18c7-4598-b3cc-4a71406f678b tempest-InstanceUsageAuditLogNegativeTestJSON-2013344588 tempest-InstanceUsageAuditLogNegativeTestJSON-2013344588-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7f3937cb-18c7-4598-b3cc-4a71406f678b tempest-InstanceUsageAuditLogNegativeTestJSON-2013344588 tempest-InstanceUsageAuditLogNegativeTestJSON-2013344588-project-admin] Request method failure captured: Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGnfl19Z-n--3EqmDJQ9TAJafbUPO9z1GoYkby19sWxSILQnNil_yJqrrJoDPgcC-PovKDV7tizROojauJNIC2nBMEWhdHn2B7yuvu3OCjHLV12RtWrQRYJubE5FQT4_fsuCGNYYKv6KUGG41SMj88T7-glduOQNpw4jKLbSEwIbDVk Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 82e6184005cf4be5a207909a6474295a Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2013344588 Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: X-Role: admin,reader,member Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: admin,reader,member Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/82e6184005cf4be5a207909a6474295a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82e6184005cf4be5a207909a6474295a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_82e6184005cf4be5a207909a6474295a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82e6184005cf4be5a207909a6474295a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2013344588 Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 82e6184005cf4be5a207909a6474295a Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2013344588 Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2013344588-project-admin Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 6ecd0e4711734692a83e5320b7bbea2a Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2013344588-project-admin Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: exception: Invalid timestamp for date invalid_time Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'invalid_time'} Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:31:28.124026 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:31:28.129286 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jun 05 08:31:28.129286 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:28.130845 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7f3937cb-18c7-4598-b3cc-4a71406f678b tempest-InstanceUsageAuditLogNegativeTestJSON-2013344588 tempest-InstanceUsageAuditLogNegativeTestJSON-2013344588-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:31:28.131898 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7f3937cb-18c7-4598-b3cc-4a71406f678b tempest-InstanceUsageAuditLogNegativeTestJSON-2013344588 tempest-InstanceUsageAuditLogNegativeTestJSON-2013344588-project-admin] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.274368 Jun 05 08:31:28.132681 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1067/2168] 10.222.0.33 () {58 vars in 1223 bytes} [Sun Jun 5 08:31:27 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 277 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 05 08:31:28.264484 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3da87b00-6204-4966-acb4-ec22d76076d5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:28.277521 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3da87b00-6204-4966-acb4-ec22d76076d5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.254646 Jun 05 08:31:28.278774 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1102/2169] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:28 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:31:28.449544 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5c997618-0ccd-4944-93c8-3d16864109d7 tempest-InstanceUsageAuditLogNegativeTestJSON-1025337327 tempest-InstanceUsageAuditLogNegativeTestJSON-1025337327-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:28.469794 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:31:28.469794 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:31:28.473226 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5c997618-0ccd-4944-93c8-3d16864109d7 tempest-InstanceUsageAuditLogNegativeTestJSON-1025337327 tempest-InstanceUsageAuditLogNegativeTestJSON-1025337327-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'b9607384c0a34b34ae642bf3fef12c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd493f6700140b3a380186a9abb5cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5c997618-0ccd-4944-93c8-3d16864109d7 tempest-InstanceUsageAuditLogNegativeTestJSON-1025337327 tempest-InstanceUsageAuditLogNegativeTestJSON-1025337327-project] Request method failure captured: Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGnezHLShDgFPC9Fh9_BeullJqiZmbC_yWiqWBZ12D2ZD80sfYTP7j-v344Ng5CercIDgebRsH7XQBseQh17HtvbLkL2EHEfdCaUyH9hifw8sWB87eByDff-JLE1u7xEWtmYFS969otW_p_iGkRnxB4LBxqbCFpoPEJDiKucW06Ma3k Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: dcd493f6700140b3a380186a9abb5cc3 Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1025337327 Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dcd493f6700140b3a380186a9abb5cc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcd493f6700140b3a380186a9abb5cc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dcd493f6700140b3a380186a9abb5cc3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcd493f6700140b3a380186a9abb5cc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1025337327 Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: dcd493f6700140b3a380186a9abb5cc3 Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1025337327 Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1025337327-project Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: b9607384c0a34b34ae642bf3fef12c0d Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1025337327-project Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: action_args: {} Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:28.478852 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:28.483210 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:28.483210 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:28.483210 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:31:28.483210 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:31:28.483210 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jun 05 08:31:28.483210 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:28.485679 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5c997618-0ccd-4944-93c8-3d16864109d7 tempest-InstanceUsageAuditLogNegativeTestJSON-1025337327 tempest-InstanceUsageAuditLogNegativeTestJSON-1025337327-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:31:28.487281 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5c997618-0ccd-4944-93c8-3d16864109d7 tempest-InstanceUsageAuditLogNegativeTestJSON-1025337327 tempest-InstanceUsageAuditLogNegativeTestJSON-1025337327-project] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.347343 Jun 05 08:31:28.489623 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1068/2170] 10.222.0.33 () {58 vars in 1184 bytes} [Sun Jun 5 08:31:28 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 350 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:31:28.497771 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-87f19666-d26f-4573-b85d-77a40c0d4a90 tempest-InstanceUsageAuditLogNegativeTestJSON-1025337327 tempest-InstanceUsageAuditLogNegativeTestJSON-1025337327-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:28.498635 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:31:28.498635 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:31:28.499870 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-87f19666-d26f-4573-b85d-77a40c0d4a90 tempest-InstanceUsageAuditLogNegativeTestJSON-1025337327 tempest-InstanceUsageAuditLogNegativeTestJSON-1025337327-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'b9607384c0a34b34ae642bf3fef12c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd493f6700140b3a380186a9abb5cc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-87f19666-d26f-4573-b85d-77a40c0d4a90 tempest-InstanceUsageAuditLogNegativeTestJSON-1025337327 tempest-InstanceUsageAuditLogNegativeTestJSON-1025337327-project] Request method failure captured: Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-06-05%2008:31:28 HTTP/1.1 Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGnezHLShDgFPC9Fh9_BeullJqiZmbC_yWiqWBZ12D2ZD80sfYTP7j-v344Ng5CercIDgebRsH7XQBseQh17HtvbLkL2EHEfdCaUyH9hifw8sWB87eByDff-JLE1u7xEWtmYFS969otW_p_iGkRnxB4LBxqbCFpoPEJDiKucW06Ma3k Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: dcd493f6700140b3a380186a9abb5cc3 Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1025337327 Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dcd493f6700140b3a380186a9abb5cc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcd493f6700140b3a380186a9abb5cc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dcd493f6700140b3a380186a9abb5cc3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcd493f6700140b3a380186a9abb5cc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1025337327 Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: dcd493f6700140b3a380186a9abb5cc3 Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1025337327 Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1025337327-project Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: b9607384c0a34b34ae642bf3fef12c0d Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1025337327-project Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '2022-06-05 08:31:28'} Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:28.501861 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:28.508571 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:28.508571 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:28.508571 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:31:28.508571 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:31:28.508571 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jun 05 08:31:28.508571 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:28.508571 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-87f19666-d26f-4573-b85d-77a40c0d4a90 tempest-InstanceUsageAuditLogNegativeTestJSON-1025337327 tempest-InstanceUsageAuditLogNegativeTestJSON-1025337327-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:31:28.508571 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-87f19666-d26f-4573-b85d-77a40c0d4a90 tempest-InstanceUsageAuditLogNegativeTestJSON-1025337327 tempest-InstanceUsageAuditLogNegativeTestJSON-1025337327-project] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log/2022-06-05 08:31:28" status: 403 len: 128 microversion: 2.1 time: 0.009914 Jun 05 08:31:28.514942 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1103/2171] 10.222.0.33 () {58 vars in 1250 bytes} [Sun Jun 5 08:31:28 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-06-05%2008%3A31%3A28 => generated 128 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:31:28.655286 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-81cddb1c-738a-4d35-8ccd-96191859d4cd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:28.656101 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-81cddb1c-738a-4d35-8ccd-96191859d4cd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:28.676477 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-81cddb1c-738a-4d35-8ccd-96191859d4cd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:28.676994 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-81cddb1c-738a-4d35-8ccd-96191859d4cd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:28.677802 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-81cddb1c-738a-4d35-8ccd-96191859d4cd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:28.678251 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-81cddb1c-738a-4d35-8ccd-96191859d4cd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:28.873097 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cb8d3bf7-597f-4366-96dc-01297a0ef3fa tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:28.873717 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-cb8d3bf7-597f-4366-96dc-01297a0ef3fa tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:28.896171 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cb8d3bf7-597f-4366-96dc-01297a0ef3fa tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:28.900017 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cb8d3bf7-597f-4366-96dc-01297a0ef3fa tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:28.901153 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cb8d3bf7-597f-4366-96dc-01297a0ef3fa tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:28.904687 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cb8d3bf7-597f-4366-96dc-01297a0ef3fa tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:28.982754 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=100 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:31:29.460467 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-81cddb1c-738a-4d35-8ccd-96191859d4cd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:29.472603 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-cb8d3bf7-597f-4366-96dc-01297a0ef3fa tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:29.487134 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-81cddb1c-738a-4d35-8ccd-96191859d4cd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:29.488743 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-cb8d3bf7-597f-4366-96dc-01297a0ef3fa tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:29.490781 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-81cddb1c-738a-4d35-8ccd-96191859d4cd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:29.492014 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-81cddb1c-738a-4d35-8ccd-96191859d4cd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.846592 Jun 05 08:31:29.494066 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-cb8d3bf7-597f-4366-96dc-01297a0ef3fa tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:29.495521 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-cb8d3bf7-597f-4366-96dc-01297a0ef3fa tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1280 microversion: 2.25 time: 0.626670 Jun 05 08:31:29.497077 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1104/2172] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:28 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1280 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:29.502248 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ef0a916a-5057-45b7-b83c-23a817dfcd98 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:29.502523 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1069/2173] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:28 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:29.508206 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fc9dc42f-1ceb-421c-81be-54cc45af6f25 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:29.509348 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ef0a916a-5057-45b7-b83c-23a817dfcd98 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: ed215a36-f621-4024-b3ba-57734be5c8bd] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:29.510234 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-fc9dc42f-1ceb-421c-81be-54cc45af6f25 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:29.522378 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ef0a916a-5057-45b7-b83c-23a817dfcd98 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:29.524458 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fc9dc42f-1ceb-421c-81be-54cc45af6f25 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:29.525004 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ef0a916a-5057-45b7-b83c-23a817dfcd98 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:29.525514 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fc9dc42f-1ceb-421c-81be-54cc45af6f25 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:29.526575 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ef0a916a-5057-45b7-b83c-23a817dfcd98 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:29.527635 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fc9dc42f-1ceb-421c-81be-54cc45af6f25 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:29.528611 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ef0a916a-5057-45b7-b83c-23a817dfcd98 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:29.529293 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fc9dc42f-1ceb-421c-81be-54cc45af6f25 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:29.716218 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-fc9dc42f-1ceb-421c-81be-54cc45af6f25 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:29.731874 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fc9dc42f-1ceb-421c-81be-54cc45af6f25 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1183 microversion: 2.1 time: 0.225396 Jun 05 08:31:29.734453 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1070/2174] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:29 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:29.863869 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ef0a916a-5057-45b7-b83c-23a817dfcd98 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:29.882870 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ef0a916a-5057-45b7-b83c-23a817dfcd98 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd" status: 200 len: 1307 microversion: 2.1 time: 0.384224 Jun 05 08:31:29.899191 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1105/2175] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:29 2022] GET /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd => generated 1307 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:30.368487 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-8f451f68-5010-4c9c-94be-8f4261ee6d30 req-b597c751-e8d7-43ac-a6bd-0c96bbc5ff55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed215a36-f621-4024-b3ba-57734be5c8bd", "name": "network-vif-plugged", "status": "completed", "tag": "b0df87c8-f87b-4cb2-93b1-fa25266d8016"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:31:30.394455 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-8f451f68-5010-4c9c-94be-8f4261ee6d30 req-b597c751-e8d7-43ac-a6bd-0c96bbc5ff55 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:30.395012 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-8f451f68-5010-4c9c-94be-8f4261ee6d30 req-b597c751-e8d7-43ac-a6bd-0c96bbc5ff55 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:30.409065 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-8f451f68-5010-4c9c-94be-8f4261ee6d30 req-b597c751-e8d7-43ac-a6bd-0c96bbc5ff55 service nova] Creating event network-vif-plugged:b0df87c8-f87b-4cb2-93b1-fa25266d8016 for instance ed215a36-f621-4024-b3ba-57734be5c8bd on n-h1-844739-1 Jun 05 08:31:30.417578 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-8f451f68-5010-4c9c-94be-8f4261ee6d30 req-b597c751-e8d7-43ac-a6bd-0c96bbc5ff55 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052696 Jun 05 08:31:30.421485 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1071/2176] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:31:30.519178 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-df384507-118b-40a7-affd-3d2b1f5e1bb1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:30.519908 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-df384507-118b-40a7-affd-3d2b1f5e1bb1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:30.527659 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c0e33d70-42e7-4834-8051-ffd3d27f08d2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:30.532540 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c0e33d70-42e7-4834-8051-ffd3d27f08d2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:30.542240 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-df384507-118b-40a7-affd-3d2b1f5e1bb1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:30.544381 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-df384507-118b-40a7-affd-3d2b1f5e1bb1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:30.547366 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-df384507-118b-40a7-affd-3d2b1f5e1bb1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:30.551211 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-df384507-118b-40a7-affd-3d2b1f5e1bb1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:30.553600 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c0e33d70-42e7-4834-8051-ffd3d27f08d2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:30.557296 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c0e33d70-42e7-4834-8051-ffd3d27f08d2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:30.558427 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c0e33d70-42e7-4834-8051-ffd3d27f08d2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:30.561072 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c0e33d70-42e7-4834-8051-ffd3d27f08d2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:31.031986 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-df384507-118b-40a7-affd-3d2b1f5e1bb1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:31.045895 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-df384507-118b-40a7-affd-3d2b1f5e1bb1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:31.049423 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-df384507-118b-40a7-affd-3d2b1f5e1bb1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:31.049423 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-df384507-118b-40a7-affd-3d2b1f5e1bb1 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.533812 Jun 05 08:31:31.051103 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1106/2177] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:30 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:31.057039 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2804ea9d-17c5-4a3d-a36e-c90e544fe622 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:31.058068 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2804ea9d-17c5-4a3d-a36e-c90e544fe622 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 0b732c5a-d12e-4ca7-aa45-dbe571de1c37] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:31.069197 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2804ea9d-17c5-4a3d-a36e-c90e544fe622 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:31.070340 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2804ea9d-17c5-4a3d-a36e-c90e544fe622 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:31.071820 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2804ea9d-17c5-4a3d-a36e-c90e544fe622 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:31.072545 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2804ea9d-17c5-4a3d-a36e-c90e544fe622 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:31.136653 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2804ea9d-17c5-4a3d-a36e-c90e544fe622 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:31.137494 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2804ea9d-17c5-4a3d-a36e-c90e544fe622 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:31.138205 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-2804ea9d-17c5-4a3d-a36e-c90e544fe622 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lazy-loading 'fault' on Instance uuid 0b732c5a-d12e-4ca7-aa45-dbe571de1c37 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:31:31.164979 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c0e33d70-42e7-4834-8051-ffd3d27f08d2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:31.178807 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c0e33d70-42e7-4834-8051-ffd3d27f08d2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:31.181111 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c0e33d70-42e7-4834-8051-ffd3d27f08d2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:31.183111 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c0e33d70-42e7-4834-8051-ffd3d27f08d2 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1476 microversion: 2.25 time: 0.659739 Jun 05 08:31:31.184302 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1072/2178] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:30 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1476 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:31.209514 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-31616628-dc5f-4961-8d43-80022a6e75e1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:31.211460 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-31616628-dc5f-4961-8d43-80022a6e75e1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: ed215a36-f621-4024-b3ba-57734be5c8bd] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:31.220075 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-31616628-dc5f-4961-8d43-80022a6e75e1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:31.222382 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-31616628-dc5f-4961-8d43-80022a6e75e1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:31.223547 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-31616628-dc5f-4961-8d43-80022a6e75e1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:31.224846 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-31616628-dc5f-4961-8d43-80022a6e75e1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:31.288373 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2804ea9d-17c5-4a3d-a36e-c90e544fe622 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:31.299247 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2804ea9d-17c5-4a3d-a36e-c90e544fe622 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37" status: 200 len: 1243 microversion: 2.1 time: 0.246181 Jun 05 08:31:31.302331 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1107/2179] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:31 2022] GET /compute/v2.1/servers/0b732c5a-d12e-4ca7-aa45-dbe571de1c37 => generated 1243 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:31.621315 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-31616628-dc5f-4961-8d43-80022a6e75e1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:31.630856 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-31616628-dc5f-4961-8d43-80022a6e75e1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd" status: 200 len: 1307 microversion: 2.1 time: 0.445199 Jun 05 08:31:31.635319 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1073/2180] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:31 2022] GET /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd => generated 1307 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:31.878758 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4afe7d4e-a6b5-4980-bfed-752a386d57bf tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:31.880299 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4afe7d4e-a6b5-4980-bfed-752a386d57bf tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:31.888280 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4afe7d4e-a6b5-4980-bfed-752a386d57bf tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:31.889081 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4afe7d4e-a6b5-4980-bfed-752a386d57bf tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:31.890482 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4afe7d4e-a6b5-4980-bfed-752a386d57bf tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:31.891169 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4afe7d4e-a6b5-4980-bfed-752a386d57bf tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:32.069140 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-04e359da-d7fb-46fe-9ca0-490dcf58c9e7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:32.069696 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-04e359da-d7fb-46fe-9ca0-490dcf58c9e7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:32.083685 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-04e359da-d7fb-46fe-9ca0-490dcf58c9e7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:32.084559 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-04e359da-d7fb-46fe-9ca0-490dcf58c9e7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:32.086223 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-04e359da-d7fb-46fe-9ca0-490dcf58c9e7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:32.086855 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-04e359da-d7fb-46fe-9ca0-490dcf58c9e7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:32.408061 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-4afe7d4e-a6b5-4980-bfed-752a386d57bf tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lazy-loading 'services' on Instance uuid 12ef7912-7054-4457-b1a4-c266b5bcb3e5 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:31:32.434153 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4afe7d4e-a6b5-4980-bfed-752a386d57bf tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1968 microversion: 2.25 time: 1.130456 Jun 05 08:31:32.439169 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1108/2181] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:31 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1968 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:32.462034 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d8f0b7fd-7d57-43d6-b86b-afdaa3ae9d2f tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:32.462987 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d8f0b7fd-7d57-43d6-b86b-afdaa3ae9d2f tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:32.470130 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d8f0b7fd-7d57-43d6-b86b-afdaa3ae9d2f tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:32.470879 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d8f0b7fd-7d57-43d6-b86b-afdaa3ae9d2f tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:32.472503 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d8f0b7fd-7d57-43d6-b86b-afdaa3ae9d2f tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:32.473370 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d8f0b7fd-7d57-43d6-b86b-afdaa3ae9d2f tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:32.536482 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-04e359da-d7fb-46fe-9ca0-490dcf58c9e7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:32.553629 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-04e359da-d7fb-46fe-9ca0-490dcf58c9e7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:32.568441 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-04e359da-d7fb-46fe-9ca0-490dcf58c9e7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:32.574342 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-04e359da-d7fb-46fe-9ca0-490dcf58c9e7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.509570 Jun 05 08:31:32.574930 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1074/2182] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:32 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:32.649486 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4fca49b7-c627-42a8-89ea-99cea9f4e3be tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:32.650779 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4fca49b7-c627-42a8-89ea-99cea9f4e3be tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: ed215a36-f621-4024-b3ba-57734be5c8bd] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:32.681578 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4fca49b7-c627-42a8-89ea-99cea9f4e3be tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:32.682234 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4fca49b7-c627-42a8-89ea-99cea9f4e3be tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:32.683555 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4fca49b7-c627-42a8-89ea-99cea9f4e3be tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:32.685735 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4fca49b7-c627-42a8-89ea-99cea9f4e3be tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:32.905681 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-d8f0b7fd-7d57-43d6-b86b-afdaa3ae9d2f tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lazy-loading 'services' on Instance uuid 12ef7912-7054-4457-b1a4-c266b5bcb3e5 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:31:32.962582 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d8f0b7fd-7d57-43d6-b86b-afdaa3ae9d2f tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1968 microversion: 2.25 time: 0.504737 Jun 05 08:31:32.970356 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1109/2183] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:32 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1968 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:31:32.985575 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-69d010f9-271d-4637-85b7-fdabd4e3f5bb tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:32.991785 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:31:32.991785 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:31:32.993194 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-69d010f9-271d-4637-85b7-fdabd4e3f5bb tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:32.993656 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-69d010f9-271d-4637-85b7-fdabd4e3f5bb tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:33.004428 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-69d010f9-271d-4637-85b7-fdabd4e3f5bb tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:33.008281 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-69d010f9-271d-4637-85b7-fdabd4e3f5bb tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:33.074310 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4fca49b7-c627-42a8-89ea-99cea9f4e3be tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:33.088202 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4fca49b7-c627-42a8-89ea-99cea9f4e3be tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd" status: 200 len: 1486 microversion: 2.1 time: 0.443399 Jun 05 08:31:33.088805 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1075/2184] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:32 2022] GET /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd => generated 1486 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:33.105626 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-69d010f9-271d-4637-85b7-fdabd4e3f5bb tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.124276 Jun 05 08:31:33.108093 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2e2bf4e5-5c16-4705-8910-d21555c6af08 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:31:33.109264 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2e2bf4e5-5c16-4705-8910-d21555c6af08 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: ed215a36-f621-4024-b3ba-57734be5c8bd] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:33.117172 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2e2bf4e5-5c16-4705-8910-d21555c6af08 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:33.117899 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2e2bf4e5-5c16-4705-8910-d21555c6af08 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:33.119466 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2e2bf4e5-5c16-4705-8910-d21555c6af08 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:33.120877 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1110/2185] 10.222.0.33 () {60 vars in 1216 bytes} [Sun Jun 5 08:31:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 05 08:31:33.121670 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2e2bf4e5-5c16-4705-8910-d21555c6af08 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:33.134593 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6ce6441b-1f2b-4324-84b8-fc41e85bf806 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-844739-1", "block_migration": "auto"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:31:33.143109 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6ce6441b-1f2b-4324-84b8-fc41e85bf806 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:33.170497 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6ce6441b-1f2b-4324-84b8-fc41e85bf806 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:33.171195 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6ce6441b-1f2b-4324-84b8-fc41e85bf806 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:33.172211 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6ce6441b-1f2b-4324-84b8-fc41e85bf806 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:33.173570 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-2e2bf4e5-5c16-4705-8910-d21555c6af08 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lazy-loading 'flavor' on Instance uuid ed215a36-f621-4024-b3ba-57734be5c8bd {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:31:33.182132 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6ce6441b-1f2b-4324-84b8-fc41e85bf806 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:33.234996 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-6ce6441b-1f2b-4324-84b8-fc41e85bf806 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Lazy-loading 'flavor' on Instance uuid 12ef7912-7054-4457-b1a4-c266b5bcb3e5 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:31:33.262894 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6ce6441b-1f2b-4324-84b8-fc41e85bf806 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Going to try to live migrate instance to n-h2-844739-1 {{(pid=119050) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 05 08:31:33.328404 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2e2bf4e5-5c16-4705-8910-d21555c6af08 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "POST /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd/action" status: 202 len: 0 microversion: 2.1 time: 0.226159 Jun 05 08:31:33.334223 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1076/2186] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Jun 5 08:31:33 2022] POST /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 05 08:31:33.342428 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-dc3eaae1-2b4c-49df-af76-b4564f974ce1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:33.350311 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-dc3eaae1-2b4c-49df-af76-b4564f974ce1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: ed215a36-f621-4024-b3ba-57734be5c8bd] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:33.362695 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc3eaae1-2b4c-49df-af76-b4564f974ce1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:33.365841 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc3eaae1-2b4c-49df-af76-b4564f974ce1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:33.367113 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc3eaae1-2b4c-49df-af76-b4564f974ce1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:33.368568 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dc3eaae1-2b4c-49df-af76-b4564f974ce1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:33.376235 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:31:33.957837 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-dc3eaae1-2b4c-49df-af76-b4564f974ce1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:33.967206 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-dc3eaae1-2b4c-49df-af76-b4564f974ce1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd" status: 200 len: 1494 microversion: 2.1 time: 0.631338 Jun 05 08:31:33.967789 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1077/2187] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:33 2022] GET /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd => generated 1494 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:33.981285 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-98ea0ef7-b516-4e2b-86fd-03b58772ff0c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:33.985112 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-98ea0ef7-b516-4e2b-86fd-03b58772ff0c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:33.997736 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-98ea0ef7-b516-4e2b-86fd-03b58772ff0c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:34.001051 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-98ea0ef7-b516-4e2b-86fd-03b58772ff0c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:34.002263 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-98ea0ef7-b516-4e2b-86fd-03b58772ff0c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:34.005262 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-98ea0ef7-b516-4e2b-86fd-03b58772ff0c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:34.665887 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-98ea0ef7-b516-4e2b-86fd-03b58772ff0c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:34.680226 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-98ea0ef7-b516-4e2b-86fd-03b58772ff0c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:34.690722 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-98ea0ef7-b516-4e2b-86fd-03b58772ff0c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:34.692910 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-98ea0ef7-b516-4e2b-86fd-03b58772ff0c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.720356 Jun 05 08:31:34.708326 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1078/2188] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:33 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:34.985335 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5cc2017c-a306-466e-94bd-a8bdf78ea6a4 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:34.986347 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5cc2017c-a306-466e-94bd-a8bdf78ea6a4 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: ed215a36-f621-4024-b3ba-57734be5c8bd] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:34.990437 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:31:35.005687 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5cc2017c-a306-466e-94bd-a8bdf78ea6a4 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:35.019882 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5cc2017c-a306-466e-94bd-a8bdf78ea6a4 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:35.023196 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5cc2017c-a306-466e-94bd-a8bdf78ea6a4 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:35.025870 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5cc2017c-a306-466e-94bd-a8bdf78ea6a4 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:35.034409 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-6ce6441b-1f2b-4324-84b8-fc41e85bf806 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] HTTP exception thrown: Migration pre-check error: Unable to migrate 12ef7912-7054-4457-b1a4-c266b5bcb3e5 to n-h2-844739-1: Lack of memory(host:510.5 <= instance:1024) Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6ce6441b-1f2b-4324-84b8-fc41e85bf806 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Request method failure captured: Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5/action HTTP/1.1 Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 72 Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGhHaLwnJOtl-KVEXE19cudifhrNzZWrlt1Z7HGe7eEnuGmYQ4HQz6j-5AK-gy10856uR_LQapNk-LKhzch3QMOw21lvEC5jPCF5pghRx5FBQ73I8_kb71wcSdPOb4uescXjuSuJj9tqbUOZMk28tgbl9DtNSG7l1t_pUjjKU2hNYTE Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: X-Openstack-Nova-Api-Version: 2.25 Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: f47caa7435494beda11c6538e024dbec Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1799505993 Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: X-Role: admin,reader,member Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: admin,reader,member Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f47caa7435494beda11c6538e024dbec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f47caa7435494beda11c6538e024dbec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f47caa7435494beda11c6538e024dbec", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f47caa7435494beda11c6538e024dbec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1799505993 Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: f47caa7435494beda11c6538e024dbec Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1799505993 Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: f6809c19924041358ca5b3ff7ff11972 Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: {"os-migrateLive": {"host": "n-h2-844739-1", "block_migration": "auto"}} Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: exception: Migration pre-check error: Unable to migrate 12ef7912-7054-4457-b1a4-c266b5bcb3e5 to n-h2-844739-1: Lack of memory(host:510.5 <= instance:1024) Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '12ef7912-7054-4457-b1a4-c266b5bcb3e5', 'body': {'os-migrateLive': {'host': 'n-h2-844739-1', 'block_migration': 'auto'}}} Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5385, in live_migrate Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.compute_task_api.live_migrate_instance(context, instance, Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/conductor/api.py", line 110, in live_migrate_instance Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.conductor_compute_rpcapi.migrate_server( Jun 05 08:31:35.056281 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/conductor/rpcapi.py", line 350, in migrate_server Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return cctxt.call(context, 'migrate_server', **kw) Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = self.transport._send( Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._driver.send(target, ctxt, message, Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._send(target, ctxt, message, wait_for_reply, timeout, Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise result Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception_Remote.MigrationPreCheckError_Remote: Migration pre-check error: Unable to migrate 12ef7912-7054-4457-b1a4-c266b5bcb3e5 to n-h2-844739-1: Lack of memory(host:510.5 <= instance:1024) Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/conductor/manager.py", line 99, in wrapper Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return fn(self, context, *args, **kwargs) Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1440, in decorated_function Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return function(self, context, *args, **kwargs) Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/conductor/manager.py", line 293, in migrate_server Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._live_migrate(context, instance, scheduler_hint, Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/conductor/manager.py", line 488, in _live_migrate Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi migration.save() Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/conductor/manager.py", line 471, in _live_migrate Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi task.execute() Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/conductor/tasks/base.py", line 26, in wrap Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.rollback(ex) Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/conductor/tasks/base.py", line 23, in wrap Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return original(self) Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/conductor/tasks/base.py", line 40, in execute Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._execute() Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/conductor/tasks/live_migrate.py", line 108, in _execute Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._check_destination_has_enough_memory() Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/conductor/tasks/live_migrate.py", line 331, in _check_destination_has_enough_memory Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.MigrationPreCheckError(reason=reason % dict( Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.MigrationPreCheckError: Migration pre-check error: Unable to migrate 12ef7912-7054-4457-b1a4-c266b5bcb3e5 to n-h2-844739-1: Lack of memory(host:510.5 <= instance:1024) Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:31:35.061645 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:31:35.070272 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:31:35.070272 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:31:35.070272 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:31:35.070272 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:31:35.070272 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:31:35.070272 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:31:35.070272 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:31:35.070272 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:31:35.070272 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 05 08:31:35.070272 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 143, in _migrate_live Jun 05 08:31:35.070272 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=ex.format_message()) Jun 05 08:31:35.070272 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Migration pre-check error: Unable to migrate 12ef7912-7054-4457-b1a4-c266b5bcb3e5 to n-h2-844739-1: Lack of memory(host:510.5 <= instance:1024) Jun 05 08:31:35.070272 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:35.070272 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:35.070272 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:35.070272 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:35.070272 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:35.070272 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:35.070272 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:31:35.070272 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:31:35.070272 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Migration pre-check error: Unable to migrate 12ef7912-7054-4457-b1a4-c266b5bcb3e5 to n-h2-844739-1: Lack of memory(host:510.5 <= instance:1024) Jun 05 08:31:35.070272 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:35.070272 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6ce6441b-1f2b-4324-84b8-fc41e85bf806 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] Returning 400 to user: Migration pre-check error: Unable to migrate 12ef7912-7054-4457-b1a4-c266b5bcb3e5 to n-h2-844739-1: Lack of memory(host:510.5 <= instance:1024) {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:31:35.070272 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6ce6441b-1f2b-4324-84b8-fc41e85bf806 tempest-LiveAutoBlockMigrationV225Test-1799505993 tempest-LiveAutoBlockMigrationV225Test-1799505993-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5/action" status: 400 len: 187 microversion: 2.25 time: 1.927938 Jun 05 08:31:35.070272 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1111/2189] 10.222.0.33 () {62 vars in 1318 bytes} [Sun Jun 5 08:31:33 2022] POST /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5/action => generated 187 bytes in 1931 msecs (HTTP/1.1 400) 9 headers in 383 bytes (2 switches on core 0) Jun 05 08:31:35.086090 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-df917188-f366-481e-a0ea-5f85a22d3e3a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:35.086608 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-df917188-f366-481e-a0ea-5f85a22d3e3a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:35.110924 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-df917188-f366-481e-a0ea-5f85a22d3e3a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:35.111419 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-df917188-f366-481e-a0ea-5f85a22d3e3a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:35.113588 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-df917188-f366-481e-a0ea-5f85a22d3e3a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:35.114995 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-df917188-f366-481e-a0ea-5f85a22d3e3a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:35.181409 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-df917188-f366-481e-a0ea-5f85a22d3e3a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:31:35.379260 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-df917188-f366-481e-a0ea-5f85a22d3e3a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "DELETE /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 204 len: 0 microversion: 2.25 time: 0.298674 Jun 05 08:31:35.380523 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1112/2190] 10.222.0.33 () {60 vars in 1279 bytes} [Sun Jun 5 08:31:35 2022] DELETE /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:31:35.390091 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b6cff582-3e81-47ca-80a6-4ec5d12665e4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:35.391032 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b6cff582-3e81-47ca-80a6-4ec5d12665e4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:35.400531 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b6cff582-3e81-47ca-80a6-4ec5d12665e4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:35.400980 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b6cff582-3e81-47ca-80a6-4ec5d12665e4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:35.402180 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b6cff582-3e81-47ca-80a6-4ec5d12665e4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:35.402950 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b6cff582-3e81-47ca-80a6-4ec5d12665e4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:35.619765 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5cc2017c-a306-466e-94bd-a8bdf78ea6a4 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:35.632860 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5cc2017c-a306-466e-94bd-a8bdf78ea6a4 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd" status: 200 len: 1477 microversion: 2.1 time: 0.651588 Jun 05 08:31:35.637429 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1079/2191] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:31:34 2022] GET /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd => generated 1477 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:35.665972 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3833f493-ba99-45c9-8110-ce8342121e21 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-67943711"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:31:35.667930 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3833f493-ba99-45c9-8110-ce8342121e21 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: ed215a36-f621-4024-b3ba-57734be5c8bd] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:35.680896 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3833f493-ba99-45c9-8110-ce8342121e21 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:35.683014 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3833f493-ba99-45c9-8110-ce8342121e21 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:35.686827 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3833f493-ba99-45c9-8110-ce8342121e21 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:35.687710 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3833f493-ba99-45c9-8110-ce8342121e21 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:36.147067 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b6cff582-3e81-47ca-80a6-4ec5d12665e4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:36.163704 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b6cff582-3e81-47ca-80a6-4ec5d12665e4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:36.165563 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b6cff582-3e81-47ca-80a6-4ec5d12665e4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:36.167749 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b6cff582-3e81-47ca-80a6-4ec5d12665e4 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1482 microversion: 2.25 time: 0.781380 Jun 05 08:31:36.170193 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1113/2192] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:35 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1482 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:31:36.178358 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5b5dacda-0efa-42e2-a6eb-6033b9c667bf tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:36.187547 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5b5dacda-0efa-42e2-a6eb-6033b9c667bf tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:36.206561 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5b5dacda-0efa-42e2-a6eb-6033b9c667bf tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:36.210840 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5b5dacda-0efa-42e2-a6eb-6033b9c667bf tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:36.211874 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5b5dacda-0efa-42e2-a6eb-6033b9c667bf tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:36.215353 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5b5dacda-0efa-42e2-a6eb-6033b9c667bf tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:36.370694 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3833f493-ba99-45c9-8110-ce8342121e21 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "POST /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd/action" status: 202 len: 0 microversion: 2.1 time: 0.709088 Jun 05 08:31:36.372337 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1080/2193] 10.222.0.33 () {60 vars in 1277 bytes} [Sun Jun 5 08:31:35 2022] POST /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd/action => generated 0 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jun 05 08:31:36.382513 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a6e28bcc-4c08-40f7-9094-aaa6d32de747 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f2433101310>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:36.490499 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a6e28bcc-4c08-40f7-9094-aaa6d32de747 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.112627 Jun 05 08:31:36.504674 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1081/2194] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:31:36 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:31:36.946833 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5b5dacda-0efa-42e2-a6eb-6033b9c667bf tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:36.958654 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5b5dacda-0efa-42e2-a6eb-6033b9c667bf tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:36.961244 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5b5dacda-0efa-42e2-a6eb-6033b9c667bf tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:36.963019 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5b5dacda-0efa-42e2-a6eb-6033b9c667bf tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.791689 Jun 05 08:31:36.965184 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1114/2195] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:36 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:37.187134 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fced3d68-98cb-48f0-9131-cb0f4ff424e1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:37.188014 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-fced3d68-98cb-48f0-9131-cb0f4ff424e1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:37.199562 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fced3d68-98cb-48f0-9131-cb0f4ff424e1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:37.200016 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fced3d68-98cb-48f0-9131-cb0f4ff424e1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:37.200813 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fced3d68-98cb-48f0-9131-cb0f4ff424e1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:37.201249 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fced3d68-98cb-48f0-9131-cb0f4ff424e1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:37.509354 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-fced3d68-98cb-48f0-9131-cb0f4ff424e1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:37.512867 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2f52b4c2-1385-427e-80bc-03c22f445202 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f244537ae50>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:37.533096 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-fced3d68-98cb-48f0-9131-cb0f4ff424e1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:37.537342 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-fced3d68-98cb-48f0-9131-cb0f4ff424e1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:37.544178 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fced3d68-98cb-48f0-9131-cb0f4ff424e1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1482 microversion: 2.25 time: 0.361023 Jun 05 08:31:37.545530 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1082/2196] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:37 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1482 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:37.632710 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2f52b4c2-1385-427e-80bc-03c22f445202 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.132604 Jun 05 08:31:37.639083 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1115/2197] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:31:37 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:37.989313 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9a7fea39-7a5d-4a03-a04e-8cdb5ce9c32d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:37.990075 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9a7fea39-7a5d-4a03-a04e-8cdb5ce9c32d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:38.004808 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9a7fea39-7a5d-4a03-a04e-8cdb5ce9c32d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:38.006330 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9a7fea39-7a5d-4a03-a04e-8cdb5ce9c32d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:38.008349 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9a7fea39-7a5d-4a03-a04e-8cdb5ce9c32d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:38.013078 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9a7fea39-7a5d-4a03-a04e-8cdb5ce9c32d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:38.125810 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-bc1089f0-e27e-4a0a-acbf-36934df0f293 req-6e0310b2-75fe-4666-8b6a-04227191958e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12ef7912-7054-4457-b1a4-c266b5bcb3e5", "name": "network-vif-deleted", "tag": "25cc4210-356d-47b2-9e15-cf3ee146a37b"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:31:38.141811 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-bc1089f0-e27e-4a0a-acbf-36934df0f293 req-6e0310b2-75fe-4666-8b6a-04227191958e service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:38.150357 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-bc1089f0-e27e-4a0a-acbf-36934df0f293 req-6e0310b2-75fe-4666-8b6a-04227191958e service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:38.191423 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-bc1089f0-e27e-4a0a-acbf-36934df0f293 req-6e0310b2-75fe-4666-8b6a-04227191958e service nova] Creating event network-vif-deleted:25cc4210-356d-47b2-9e15-cf3ee146a37b for instance 12ef7912-7054-4457-b1a4-c266b5bcb3e5 on n-h1-844739-1 Jun 05 08:31:38.223073 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-bc1089f0-e27e-4a0a-acbf-36934df0f293 req-6e0310b2-75fe-4666-8b6a-04227191958e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101462 Jun 05 08:31:38.230100 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1116/2198] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:31:38.373311 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9a7fea39-7a5d-4a03-a04e-8cdb5ce9c32d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:38.385943 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9a7fea39-7a5d-4a03-a04e-8cdb5ce9c32d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:38.392152 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9a7fea39-7a5d-4a03-a04e-8cdb5ce9c32d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:38.394955 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9a7fea39-7a5d-4a03-a04e-8cdb5ce9c32d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.414396 Jun 05 08:31:38.396001 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1083/2199] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:37 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:38.570994 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-037ae398-e314-4f8a-a117-e259ae73a2c7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:38.572514 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-037ae398-e314-4f8a-a117-e259ae73a2c7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:38.588121 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-037ae398-e314-4f8a-a117-e259ae73a2c7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:38.590214 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-037ae398-e314-4f8a-a117-e259ae73a2c7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:38.592708 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-037ae398-e314-4f8a-a117-e259ae73a2c7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:38.593884 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-037ae398-e314-4f8a-a117-e259ae73a2c7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:38.647286 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-49f96a86-c69f-46a5-8eb0-6f73f4f9acd2 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24330cdaf0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:38.740674 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-49f96a86-c69f-46a5-8eb0-6f73f4f9acd2 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.099081 Jun 05 08:31:38.741823 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1084/2200] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:31:38 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:31:38.822915 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-037ae398-e314-4f8a-a117-e259ae73a2c7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:38.846592 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-037ae398-e314-4f8a-a117-e259ae73a2c7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:38.851878 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-037ae398-e314-4f8a-a117-e259ae73a2c7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:38.857400 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-037ae398-e314-4f8a-a117-e259ae73a2c7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1265 microversion: 2.25 time: 0.298022 Jun 05 08:31:38.861820 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1117/2201] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:38 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1265 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:39.416869 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7438d2ed-7363-49f8-9b60-546009c63784 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:39.417946 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7438d2ed-7363-49f8-9b60-546009c63784 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:39.434300 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7438d2ed-7363-49f8-9b60-546009c63784 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:39.435970 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7438d2ed-7363-49f8-9b60-546009c63784 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:39.438742 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7438d2ed-7363-49f8-9b60-546009c63784 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:39.444440 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7438d2ed-7363-49f8-9b60-546009c63784 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:39.754960 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cbe85898-90d0-4f2d-a66e-0b3a950a0cb0 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24454b3ee0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:39.859226 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-cbe85898-90d0-4f2d-a66e-0b3a950a0cb0 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.108421 Jun 05 08:31:39.860419 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1118/2202] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:31:39 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:39.882020 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b51d6972-2ee1-41a1-8189-bdcbcb1c43f6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:39.890342 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b51d6972-2ee1-41a1-8189-bdcbcb1c43f6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:39.912807 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b51d6972-2ee1-41a1-8189-bdcbcb1c43f6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:39.913586 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b51d6972-2ee1-41a1-8189-bdcbcb1c43f6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:39.914585 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b51d6972-2ee1-41a1-8189-bdcbcb1c43f6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:39.920886 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b51d6972-2ee1-41a1-8189-bdcbcb1c43f6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:39.965710 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7438d2ed-7363-49f8-9b60-546009c63784 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:39.985706 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7438d2ed-7363-49f8-9b60-546009c63784 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:39.992511 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7438d2ed-7363-49f8-9b60-546009c63784 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:39.996506 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7438d2ed-7363-49f8-9b60-546009c63784 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.585322 Jun 05 08:31:39.997580 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1085/2203] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:39 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:31:40.274326 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b51d6972-2ee1-41a1-8189-bdcbcb1c43f6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:40.278615 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:31:40.285469 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b51d6972-2ee1-41a1-8189-bdcbcb1c43f6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:40.302555 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b51d6972-2ee1-41a1-8189-bdcbcb1c43f6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:40.304259 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b51d6972-2ee1-41a1-8189-bdcbcb1c43f6 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1265 microversion: 2.25 time: 0.427343 Jun 05 08:31:40.305140 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1119/2204] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:39 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1265 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:31:40.872645 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ea9b3842-7b34-40ec-9344-678f44272b02 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24330e5e50>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:40.963720 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ea9b3842-7b34-40ec-9344-678f44272b02 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.094820 Jun 05 08:31:40.979414 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1086/2205] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:31:40 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:41.020885 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-346980b2-42df-4730-b14a-c09b66a5e4ca tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:41.023910 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-346980b2-42df-4730-b14a-c09b66a5e4ca tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:41.040782 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-346980b2-42df-4730-b14a-c09b66a5e4ca tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:41.042111 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-346980b2-42df-4730-b14a-c09b66a5e4ca tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:41.043713 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-346980b2-42df-4730-b14a-c09b66a5e4ca tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:41.044500 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-346980b2-42df-4730-b14a-c09b66a5e4ca tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:41.322995 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e0fe249c-1ce9-411d-a8d6-62841d56bd82 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:41.323847 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e0fe249c-1ce9-411d-a8d6-62841d56bd82 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:41.341400 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e0fe249c-1ce9-411d-a8d6-62841d56bd82 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:41.342073 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e0fe249c-1ce9-411d-a8d6-62841d56bd82 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:41.346309 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e0fe249c-1ce9-411d-a8d6-62841d56bd82 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:41.348398 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e0fe249c-1ce9-411d-a8d6-62841d56bd82 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:41.510036 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e0fe249c-1ce9-411d-a8d6-62841d56bd82 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:41.529856 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e0fe249c-1ce9-411d-a8d6-62841d56bd82 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:41.531373 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e0fe249c-1ce9-411d-a8d6-62841d56bd82 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:41.532575 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e0fe249c-1ce9-411d-a8d6-62841d56bd82 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1265 microversion: 2.25 time: 0.213790 Jun 05 08:31:41.533142 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1087/2206] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:41 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:31:41.646822 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-346980b2-42df-4730-b14a-c09b66a5e4ca tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:41.684829 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-346980b2-42df-4730-b14a-c09b66a5e4ca tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:41.687649 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-346980b2-42df-4730-b14a-c09b66a5e4ca tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:41.691490 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-346980b2-42df-4730-b14a-c09b66a5e4ca tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.675982 Jun 05 08:31:41.692441 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1120/2207] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:41 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:31:41.996776 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-120c922c-447e-436c-8b5a-599978f4bdcb tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24330ed0d0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:42.059717 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-120c922c-447e-436c-8b5a-599978f4bdcb tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.072949 Jun 05 08:31:42.060524 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1088/2208] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:31:41 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:42.259602 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-115358e2-99e0-4e8d-bb0c-9bf5c3f62b58 req-aa2b8f9f-1af3-48fb-b504-a689daa77da0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed215a36-f621-4024-b3ba-57734be5c8bd", "name": "network-vif-plugged", "status": "completed", "tag": "b0df87c8-f87b-4cb2-93b1-fa25266d8016"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:31:42.287515 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-115358e2-99e0-4e8d-bb0c-9bf5c3f62b58 req-aa2b8f9f-1af3-48fb-b504-a689daa77da0 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:42.288304 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-115358e2-99e0-4e8d-bb0c-9bf5c3f62b58 req-aa2b8f9f-1af3-48fb-b504-a689daa77da0 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:42.306978 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-115358e2-99e0-4e8d-bb0c-9bf5c3f62b58 req-aa2b8f9f-1af3-48fb-b504-a689daa77da0 service nova] Creating event network-vif-plugged:b0df87c8-f87b-4cb2-93b1-fa25266d8016 for instance ed215a36-f621-4024-b3ba-57734be5c8bd on n-h1-844739-1 Jun 05 08:31:42.320628 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-115358e2-99e0-4e8d-bb0c-9bf5c3f62b58 req-aa2b8f9f-1af3-48fb-b504-a689daa77da0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064945 Jun 05 08:31:42.328977 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1121/2209] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:31:42.552591 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-842daff3-cf50-4043-bea2-b36b2b0fafe9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:42.553503 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-842daff3-cf50-4043-bea2-b36b2b0fafe9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:42.574185 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-842daff3-cf50-4043-bea2-b36b2b0fafe9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:42.575460 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-842daff3-cf50-4043-bea2-b36b2b0fafe9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:42.576104 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-842daff3-cf50-4043-bea2-b36b2b0fafe9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:42.577238 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-842daff3-cf50-4043-bea2-b36b2b0fafe9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:42.713823 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-54b15896-0e16-4007-89ba-76cf14b7b79b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:42.715277 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-54b15896-0e16-4007-89ba-76cf14b7b79b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:42.738282 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-54b15896-0e16-4007-89ba-76cf14b7b79b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:42.739214 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-54b15896-0e16-4007-89ba-76cf14b7b79b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:42.740451 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-54b15896-0e16-4007-89ba-76cf14b7b79b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:42.741134 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-54b15896-0e16-4007-89ba-76cf14b7b79b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:42.821714 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-842daff3-cf50-4043-bea2-b36b2b0fafe9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:42.836026 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-842daff3-cf50-4043-bea2-b36b2b0fafe9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:42.839410 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-842daff3-cf50-4043-bea2-b36b2b0fafe9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:42.841793 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-842daff3-cf50-4043-bea2-b36b2b0fafe9 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1265 microversion: 2.25 time: 0.296074 Jun 05 08:31:42.844805 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1089/2210] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:42 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1265 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:43.017315 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:31:43.082304 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-187dbca5-0e3d-4b9f-a568-ba19b561b5dd tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24330ed040>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:43.196847 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-187dbca5-0e3d-4b9f-a568-ba19b561b5dd tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.119316 Jun 05 08:31:43.197442 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1090/2211] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:31:43 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:43.494527 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-54b15896-0e16-4007-89ba-76cf14b7b79b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:43.507162 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-54b15896-0e16-4007-89ba-76cf14b7b79b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:43.520141 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-54b15896-0e16-4007-89ba-76cf14b7b79b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:43.546410 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-54b15896-0e16-4007-89ba-76cf14b7b79b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.837809 Jun 05 08:31:43.547052 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1122/2212] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:42 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:43.870617 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b999edb0-b7e7-476c-a79d-80de57ccbd54 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:43.873070 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b999edb0-b7e7-476c-a79d-80de57ccbd54 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:43.889818 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b999edb0-b7e7-476c-a79d-80de57ccbd54 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:43.893488 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b999edb0-b7e7-476c-a79d-80de57ccbd54 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:43.898746 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b999edb0-b7e7-476c-a79d-80de57ccbd54 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:43.901696 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b999edb0-b7e7-476c-a79d-80de57ccbd54 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:44.211917 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8c450a33-a39f-4c2f-bf12-fd01c674d2cd tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24454a84c0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:44.216980 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b999edb0-b7e7-476c-a79d-80de57ccbd54 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:44.234839 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b999edb0-b7e7-476c-a79d-80de57ccbd54 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:44.251032 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b999edb0-b7e7-476c-a79d-80de57ccbd54 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:44.260348 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b999edb0-b7e7-476c-a79d-80de57ccbd54 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1265 microversion: 2.25 time: 0.396764 Jun 05 08:31:44.262782 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1091/2213] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:43 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1265 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:44.344632 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8c450a33-a39f-4c2f-bf12-fd01c674d2cd tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.138607 Jun 05 08:31:44.350811 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1123/2214] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:31:44 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:44.566751 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c0c38710-996d-4eb0-96aa-f22c437b1595 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:44.571572 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c0c38710-996d-4eb0-96aa-f22c437b1595 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:44.601167 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c0c38710-996d-4eb0-96aa-f22c437b1595 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:44.602086 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c0c38710-996d-4eb0-96aa-f22c437b1595 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:44.603136 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c0c38710-996d-4eb0-96aa-f22c437b1595 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:44.603761 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c0c38710-996d-4eb0-96aa-f22c437b1595 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:45.321153 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a21a181a-bdc6-4a85-9e6c-2b0e82dde68d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:45.324293 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a21a181a-bdc6-4a85-9e6c-2b0e82dde68d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:45.346450 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a21a181a-bdc6-4a85-9e6c-2b0e82dde68d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:45.351072 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a21a181a-bdc6-4a85-9e6c-2b0e82dde68d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:45.358320 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a21a181a-bdc6-4a85-9e6c-2b0e82dde68d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:45.359089 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a21a181a-bdc6-4a85-9e6c-2b0e82dde68d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:45.809832 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c0c38710-996d-4eb0-96aa-f22c437b1595 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:45.825828 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a21a181a-bdc6-4a85-9e6c-2b0e82dde68d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:45.842843 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a21a181a-bdc6-4a85-9e6c-2b0e82dde68d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:45.849277 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a21a181a-bdc6-4a85-9e6c-2b0e82dde68d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:45.852083 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a21a181a-bdc6-4a85-9e6c-2b0e82dde68d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1265 microversion: 2.25 time: 0.560441 Jun 05 08:31:45.857150 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c0c38710-996d-4eb0-96aa-f22c437b1595 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:45.863471 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1124/2215] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:45 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1265 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:31:45.871127 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c0c38710-996d-4eb0-96aa-f22c437b1595 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:45.875481 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c0c38710-996d-4eb0-96aa-f22c437b1595 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 1.313654 Jun 05 08:31:45.883199 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c18da4db-49ed-41d4-a371-bb7c4b1045c9 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24454a88b0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:45.890911 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1092/2216] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:44 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:46.014264 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c18da4db-49ed-41d4-a371-bb7c4b1045c9 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.148969 Jun 05 08:31:46.015013 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1125/2217] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:31:45 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:46.874272 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ce5e2c0b-d59c-4373-9362-175837ea051c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:46.875669 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ce5e2c0b-d59c-4373-9362-175837ea051c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:46.897795 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7f70885d-238b-4839-a995-abd77d270b19 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:46.899196 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7f70885d-238b-4839-a995-abd77d270b19 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:46.903746 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ce5e2c0b-d59c-4373-9362-175837ea051c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:46.913035 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ce5e2c0b-d59c-4373-9362-175837ea051c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:46.920013 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ce5e2c0b-d59c-4373-9362-175837ea051c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:46.922197 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ce5e2c0b-d59c-4373-9362-175837ea051c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:46.924313 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7f70885d-238b-4839-a995-abd77d270b19 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:46.932804 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7f70885d-238b-4839-a995-abd77d270b19 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:46.934161 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7f70885d-238b-4839-a995-abd77d270b19 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:46.936514 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7f70885d-238b-4839-a995-abd77d270b19 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:47.132604 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ce5e2c0b-d59c-4373-9362-175837ea051c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:47.142321 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ce5e2c0b-d59c-4373-9362-175837ea051c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:47.148901 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ce5e2c0b-d59c-4373-9362-175837ea051c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:47.154568 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ce5e2c0b-d59c-4373-9362-175837ea051c tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1265 microversion: 2.25 time: 0.288149 Jun 05 08:31:47.170256 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1093/2218] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:46 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1265 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:47.177517 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-52b76118-d268-4999-b13b-043ba4382d2f tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24331a38b0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:47.301755 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-52b76118-d268-4999-b13b-043ba4382d2f tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.129805 Jun 05 08:31:47.302434 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1094/2219] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:31:47 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:47.518889 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7f70885d-238b-4839-a995-abd77d270b19 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:47.529075 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7f70885d-238b-4839-a995-abd77d270b19 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:47.535283 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7f70885d-238b-4839-a995-abd77d270b19 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:47.550588 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7f70885d-238b-4839-a995-abd77d270b19 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.659515 Jun 05 08:31:47.562715 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1126/2220] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:46 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:31:48.185224 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ee32fdb3-2cd2-4097-bc0d-1bcfb4ef936f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:48.185978 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ee32fdb3-2cd2-4097-bc0d-1bcfb4ef936f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:48.221904 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ee32fdb3-2cd2-4097-bc0d-1bcfb4ef936f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:48.238158 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ee32fdb3-2cd2-4097-bc0d-1bcfb4ef936f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:48.241507 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ee32fdb3-2cd2-4097-bc0d-1bcfb4ef936f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:48.242224 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ee32fdb3-2cd2-4097-bc0d-1bcfb4ef936f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:48.316300 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3a4f78a5-35c8-4630-9cc5-4f2d0eab28bd tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f2433b31c10>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:48.456886 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3a4f78a5-35c8-4630-9cc5-4f2d0eab28bd tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.145795 Jun 05 08:31:48.464101 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1127/2221] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:31:48 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:31:48.495909 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ee32fdb3-2cd2-4097-bc0d-1bcfb4ef936f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:48.514751 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ee32fdb3-2cd2-4097-bc0d-1bcfb4ef936f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:48.516334 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ee32fdb3-2cd2-4097-bc0d-1bcfb4ef936f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:48.539958 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ee32fdb3-2cd2-4097-bc0d-1bcfb4ef936f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1265 microversion: 2.25 time: 0.365670 Jun 05 08:31:48.540598 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1095/2222] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:48 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1265 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:48.571046 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3d320162-9573-4711-8b71-fbd6cc78091c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:48.572942 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3d320162-9573-4711-8b71-fbd6cc78091c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:48.594368 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3d320162-9573-4711-8b71-fbd6cc78091c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:48.600084 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3d320162-9573-4711-8b71-fbd6cc78091c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:48.602466 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3d320162-9573-4711-8b71-fbd6cc78091c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:48.603667 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3d320162-9573-4711-8b71-fbd6cc78091c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:48.953320 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-86161658-07ab-493f-b349-81485978e32f tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Action: 'update', calling method: .version_select at 0x7f24330e5280>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:31:48.955217 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:31:48.955217 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:31:48.957778 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-86161658-07ab-493f-b349-81485978e32f tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:48.968824 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-86161658-07ab-493f-b349-81485978e32f tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:48.993439 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-86161658-07ab-493f-b349-81485978e32f tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:48.993903 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-86161658-07ab-493f-b349-81485978e32f tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:49.010571 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-86161658-07ab-493f-b349-81485978e32f tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] HTTP exception thrown: Service 8198e460-22b7-4a9b-afe8-048c9c92e5ad could not be found. Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-86161658-07ab-493f-b349-81485978e32f tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Request method failure captured: Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: request: PUT /compute/v2.1/os-services/8198e460-22b7-4a9b-afe8-048c9c92e5ad HTTP/1.1 Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 56 Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGn0_XVnEMxsG_bv9G189mv3qQoieGegq6wiiCnXq2jNkbeO1m7_RjdjEogbrr4C4qbyRkK1u0-7HvwxupE6fTBfi8fOuybIDk2TbnslE1P2N-H1S_uri_cLuOxkFLaytH3Yyi6s6qM0sfMHQicX_dbX_VepEZCcCfzm7wMdDHJ0b7M Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: X-Openstack-Nova-Api-Version: 2.53 Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: b2050206bea0417c9ff3aa61a6c87171 Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1495104753 Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: X-Role: admin,reader,member Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: admin,reader,member Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b2050206bea0417c9ff3aa61a6c87171"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b2050206bea0417c9ff3aa61a6c87171"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b2050206bea0417c9ff3aa61a6c87171", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b2050206bea0417c9ff3aa61a6c87171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1495104753 Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: b2050206bea0417c9ff3aa61a6c87171 Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1495104753 Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 45cabc6f27ba4736a6cf4a45d410e095 Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: {"status": "disabled", "disabled_reason": "maintenance"} Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: exception: Service 8198e460-22b7-4a9b-afe8-048c9c92e5ad could not be found. Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '8198e460-22b7-4a9b-afe8-048c9c92e5ad', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 8198e460-22b7-4a9b-afe8-048c9c92e5ad could not be found. Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:31:49.019967 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:31:49.027074 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jun 05 08:31:49.027074 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:31:49.027074 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 8198e460-22b7-4a9b-afe8-048c9c92e5ad could not be found. Jun 05 08:31:49.027074 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:49.027074 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:49.027074 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:49.027074 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:49.027074 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:49.027074 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:49.027074 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:31:49.027074 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:31:49.027074 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 8198e460-22b7-4a9b-afe8-048c9c92e5ad could not be found. Jun 05 08:31:49.027074 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:49.027074 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-86161658-07ab-493f-b349-81485978e32f tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Returning 404 to user: Service 8198e460-22b7-4a9b-afe8-048c9c92e5ad could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:31:49.027074 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-86161658-07ab-493f-b349-81485978e32f tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-services/8198e460-22b7-4a9b-afe8-048c9c92e5ad" status: 404 len: 110 microversion: 2.53 time: 0.356770 Jun 05 08:31:49.027074 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1096/2223] 10.222.0.33 () {62 vars in 1308 bytes} [Sun Jun 5 08:31:48 2022] PUT /compute/v2.1/os-services/8198e460-22b7-4a9b-afe8-048c9c92e5ad => generated 110 bytes in 360 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 05 08:31:49.037081 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-40b76b3b-2733-4cf5-928b-6427d9743669 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Action: 'update', calling method: .version_select at 0x7f243319de50>, body: {"status": "disabled"} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:31:49.039439 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-40b76b3b-2733-4cf5-928b-6427d9743669 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:49.039898 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-40b76b3b-2733-4cf5-928b-6427d9743669 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:49.062939 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-40b76b3b-2733-4cf5-928b-6427d9743669 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:49.063514 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-40b76b3b-2733-4cf5-928b-6427d9743669 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:49.079767 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-40b76b3b-2733-4cf5-928b-6427d9743669 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] HTTP exception thrown: Service 8198e460-22b7-4a9b-afe8-048c9c92e5ad could not be found. Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-40b76b3b-2733-4cf5-928b-6427d9743669 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Request method failure captured: Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: request: PUT /compute/v2.1/os-services/8198e460-22b7-4a9b-afe8-048c9c92e5ad HTTP/1.1 Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 22 Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGn0_XVnEMxsG_bv9G189mv3qQoieGegq6wiiCnXq2jNkbeO1m7_RjdjEogbrr4C4qbyRkK1u0-7HvwxupE6fTBfi8fOuybIDk2TbnslE1P2N-H1S_uri_cLuOxkFLaytH3Yyi6s6qM0sfMHQicX_dbX_VepEZCcCfzm7wMdDHJ0b7M Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: X-Openstack-Nova-Api-Version: 2.53 Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: b2050206bea0417c9ff3aa61a6c87171 Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1495104753 Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: X-Role: admin,reader,member Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: admin,reader,member Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b2050206bea0417c9ff3aa61a6c87171"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b2050206bea0417c9ff3aa61a6c87171"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b2050206bea0417c9ff3aa61a6c87171", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b2050206bea0417c9ff3aa61a6c87171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1495104753 Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: b2050206bea0417c9ff3aa61a6c87171 Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1495104753 Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 45cabc6f27ba4736a6cf4a45d410e095 Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: {"status": "disabled"} Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: exception: Service 8198e460-22b7-4a9b-afe8-048c9c92e5ad could not be found. Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '8198e460-22b7-4a9b-afe8-048c9c92e5ad', 'body': {'status': 'disabled'}} Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 8198e460-22b7-4a9b-afe8-048c9c92e5ad could not be found. Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:31:49.082042 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:31:49.087510 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jun 05 08:31:49.087510 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:31:49.087510 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 8198e460-22b7-4a9b-afe8-048c9c92e5ad could not be found. Jun 05 08:31:49.087510 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:49.087510 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:49.087510 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:49.087510 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:49.087510 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:49.087510 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:49.087510 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:31:49.087510 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:31:49.087510 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 8198e460-22b7-4a9b-afe8-048c9c92e5ad could not be found. Jun 05 08:31:49.087510 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:49.094534 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-40b76b3b-2733-4cf5-928b-6427d9743669 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Returning 404 to user: Service 8198e460-22b7-4a9b-afe8-048c9c92e5ad could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:31:49.095698 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-40b76b3b-2733-4cf5-928b-6427d9743669 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-services/8198e460-22b7-4a9b-afe8-048c9c92e5ad" status: 404 len: 110 microversion: 2.53 time: 0.066326 Jun 05 08:31:49.097871 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3d320162-9573-4711-8b71-fbd6cc78091c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:49.099013 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1097/2224] 10.222.0.33 () {62 vars in 1308 bytes} [Sun Jun 5 08:31:49 2022] PUT /compute/v2.1/os-services/8198e460-22b7-4a9b-afe8-048c9c92e5ad => generated 110 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 05 08:31:49.118868 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3d320162-9573-4711-8b71-fbd6cc78091c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:49.121973 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-252f8d3c-b416-4fff-a3a9-1dc8147dc395 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Action: 'update', calling method: .version_select at 0x7f24331f8820>, body: {"status": "enabled"} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:31:49.124881 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3d320162-9573-4711-8b71-fbd6cc78091c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:49.127836 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-252f8d3c-b416-4fff-a3a9-1dc8147dc395 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:49.129611 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3d320162-9573-4711-8b71-fbd6cc78091c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.562863 Jun 05 08:31:49.133036 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-252f8d3c-b416-4fff-a3a9-1dc8147dc395 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:49.133495 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1128/2225] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:48 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:49.139427 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-252f8d3c-b416-4fff-a3a9-1dc8147dc395 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:49.140622 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-252f8d3c-b416-4fff-a3a9-1dc8147dc395 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:49.148457 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-252f8d3c-b416-4fff-a3a9-1dc8147dc395 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] HTTP exception thrown: Service 8198e460-22b7-4a9b-afe8-048c9c92e5ad could not be found. Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-252f8d3c-b416-4fff-a3a9-1dc8147dc395 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Request method failure captured: Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: request: PUT /compute/v2.1/os-services/8198e460-22b7-4a9b-afe8-048c9c92e5ad HTTP/1.1 Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 21 Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGn0_XVnEMxsG_bv9G189mv3qQoieGegq6wiiCnXq2jNkbeO1m7_RjdjEogbrr4C4qbyRkK1u0-7HvwxupE6fTBfi8fOuybIDk2TbnslE1P2N-H1S_uri_cLuOxkFLaytH3Yyi6s6qM0sfMHQicX_dbX_VepEZCcCfzm7wMdDHJ0b7M Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: X-Openstack-Nova-Api-Version: 2.53 Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: b2050206bea0417c9ff3aa61a6c87171 Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1495104753 Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: X-Role: admin,reader,member Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: admin,reader,member Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b2050206bea0417c9ff3aa61a6c87171"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b2050206bea0417c9ff3aa61a6c87171"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b2050206bea0417c9ff3aa61a6c87171", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b2050206bea0417c9ff3aa61a6c87171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1495104753 Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: b2050206bea0417c9ff3aa61a6c87171 Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1495104753 Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 45cabc6f27ba4736a6cf4a45d410e095 Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: {"status": "enabled"} Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: exception: Service 8198e460-22b7-4a9b-afe8-048c9c92e5ad could not be found. Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '8198e460-22b7-4a9b-afe8-048c9c92e5ad', 'body': {'status': 'enabled'}} Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 8198e460-22b7-4a9b-afe8-048c9c92e5ad could not be found. Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:31:49.151339 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:31:49.157278 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jun 05 08:31:49.157278 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:31:49.157278 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 8198e460-22b7-4a9b-afe8-048c9c92e5ad could not be found. Jun 05 08:31:49.157278 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:49.157278 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:49.157278 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:49.157278 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:49.157278 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:49.157278 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:49.157278 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:31:49.157278 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:31:49.157278 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 8198e460-22b7-4a9b-afe8-048c9c92e5ad could not be found. Jun 05 08:31:49.157278 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:31:49.160466 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-252f8d3c-b416-4fff-a3a9-1dc8147dc395 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Returning 404 to user: Service 8198e460-22b7-4a9b-afe8-048c9c92e5ad could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:31:49.162179 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-252f8d3c-b416-4fff-a3a9-1dc8147dc395 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-services/8198e460-22b7-4a9b-afe8-048c9c92e5ad" status: 404 len: 110 microversion: 2.53 time: 0.053246 Jun 05 08:31:49.163386 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1098/2226] 10.222.0.33 () {62 vars in 1308 bytes} [Sun Jun 5 08:31:49 2022] PUT /compute/v2.1/os-services/8198e460-22b7-4a9b-afe8-048c9c92e5ad => generated 110 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 05 08:31:49.173529 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0fd7c1b6-ca0e-4110-8e01-ae4f2fcd4548 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:49.180699 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:31:49.180699 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:31:49.183817 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0fd7c1b6-ca0e-4110-8e01-ae4f2fcd4548 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:49.184519 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0fd7c1b6-ca0e-4110-8e01-ae4f2fcd4548 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:49.186885 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0fd7c1b6-ca0e-4110-8e01-ae4f2fcd4548 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:49.187568 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0fd7c1b6-ca0e-4110-8e01-ae4f2fcd4548 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:49.241702 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0fd7c1b6-ca0e-4110-8e01-ae4f2fcd4548 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.072922 Jun 05 08:31:49.248268 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1129/2227] 10.222.0.33 () {60 vars in 1177 bytes} [Sun Jun 5 08:31:49 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:49.271183 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3c873f56-2a3f-4fda-a44c-6a4fcba882d2 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:49.279324 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:31:49.279324 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:31:49.284590 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3c873f56-2a3f-4fda-a44c-6a4fcba882d2 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:49.285596 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3c873f56-2a3f-4fda-a44c-6a4fcba882d2 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:49.288404 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3c873f56-2a3f-4fda-a44c-6a4fcba882d2 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:49.288931 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3c873f56-2a3f-4fda-a44c-6a4fcba882d2 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:49.380227 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3c873f56-2a3f-4fda-a44c-6a4fcba882d2 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.130361 Jun 05 08:31:49.404318 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-bfa4912c-122c-4cc7-b858-a5fbfa7770cb tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:49.406281 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:31:49.406281 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:31:49.407921 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bfa4912c-122c-4cc7-b858-a5fbfa7770cb tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:49.408923 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bfa4912c-122c-4cc7-b858-a5fbfa7770cb tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:49.409815 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bfa4912c-122c-4cc7-b858-a5fbfa7770cb tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:49.410292 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bfa4912c-122c-4cc7-b858-a5fbfa7770cb tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:49.418568 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1099/2228] 10.222.0.33 () {60 vars in 1210 bytes} [Sun Jun 5 08:31:49 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:49.473391 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-03d1e13b-43d4-4b90-8c82-062627736c1e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24330ed160>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:49.528424 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-bfa4912c-122c-4cc7-b858-a5fbfa7770cb tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.127954 Jun 05 08:31:49.554400 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1130/2229] 10.222.0.33 () {60 vars in 1177 bytes} [Sun Jun 5 08:31:49 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:49.560718 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-271858d8-d9be-454c-b252-2a4e0134721b tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:49.577262 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-03d1e13b-43d4-4b90-8c82-062627736c1e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.110487 Jun 05 08:31:49.579953 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:31:49.579953 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:31:49.580520 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1100/2230] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:31:49 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:49.583384 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-271858d8-d9be-454c-b252-2a4e0134721b tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:49.586899 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-271858d8-d9be-454c-b252-2a4e0134721b tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:49.588337 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-271858d8-d9be-454c-b252-2a4e0134721b tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:49.590907 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-271858d8-d9be-454c-b252-2a4e0134721b tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:49.594829 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7740b125-edcc-4e31-b44d-74dd99536a6d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:49.596013 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7740b125-edcc-4e31-b44d-74dd99536a6d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:49.614497 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7740b125-edcc-4e31-b44d-74dd99536a6d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:49.615459 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7740b125-edcc-4e31-b44d-74dd99536a6d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:49.616826 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7740b125-edcc-4e31-b44d-74dd99536a6d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:49.617491 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7740b125-edcc-4e31-b44d-74dd99536a6d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:49.666285 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-271858d8-d9be-454c-b252-2a4e0134721b tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=n-d-844739-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.109843 Jun 05 08:31:49.670010 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1131/2231] 10.222.0.33 () {60 vars in 1234 bytes} [Sun Jun 5 08:31:49 2022] GET /compute/v2.1/os-services?host=n-d-844739-1&binary=xxx => generated 16 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:49.702462 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c82f7157-e1cc-4358-a12f-88e09ff033dc tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:49.704365 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:31:49.704365 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:31:49.707006 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c82f7157-e1cc-4358-a12f-88e09ff033dc tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:49.707811 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c82f7157-e1cc-4358-a12f-88e09ff033dc tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:49.709157 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c82f7157-e1cc-4358-a12f-88e09ff033dc tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:49.709925 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c82f7157-e1cc-4358-a12f-88e09ff033dc tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:49.751206 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c82f7157-e1cc-4358-a12f-88e09ff033dc tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.071568 Jun 05 08:31:49.754201 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1132/2232] 10.222.0.33 () {60 vars in 1177 bytes} [Sun Jun 5 08:31:49 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:49.766524 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cf8396d3-24b4-4c0a-81a6-2cbb159f2402 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:49.768226 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:31:49.768226 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:31:49.770379 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cf8396d3-24b4-4c0a-81a6-2cbb159f2402 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:49.770963 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cf8396d3-24b4-4c0a-81a6-2cbb159f2402 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:49.771832 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cf8396d3-24b4-4c0a-81a6-2cbb159f2402 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:49.772335 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cf8396d3-24b4-4c0a-81a6-2cbb159f2402 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:49.844168 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-cf8396d3-24b4-4c0a-81a6-2cbb159f2402 tempest-ServicesAdminNegativeV253TestJSON-1495104753 tempest-ServicesAdminNegativeV253TestJSON-1495104753-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.082930 Jun 05 08:31:49.852961 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1133/2233] 10.222.0.33 () {60 vars in 1238 bytes} [Sun Jun 5 08:31:49 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:31:49.925964 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7740b125-edcc-4e31-b44d-74dd99536a6d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:49.941851 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7740b125-edcc-4e31-b44d-74dd99536a6d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:49.953977 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7740b125-edcc-4e31-b44d-74dd99536a6d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:49.967352 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7740b125-edcc-4e31-b44d-74dd99536a6d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1265 microversion: 2.25 time: 0.385453 Jun 05 08:31:49.973228 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1101/2234] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:49 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1265 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:50.150813 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5ebf135f-89e7-44f5-bb71-da521169c93d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:50.151823 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5ebf135f-89e7-44f5-bb71-da521169c93d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:50.173338 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5ebf135f-89e7-44f5-bb71-da521169c93d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:50.180563 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5ebf135f-89e7-44f5-bb71-da521169c93d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:50.186092 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5ebf135f-89e7-44f5-bb71-da521169c93d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:50.191904 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5ebf135f-89e7-44f5-bb71-da521169c93d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:50.252897 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d8346a0a-2baa-4538-9021-3d827649efc4 tempest-ServicesAdminNegativeV253TestJSON-953062061 tempest-ServicesAdminNegativeV253TestJSON-953062061-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:50.254206 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:31:50.254206 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:31:50.256962 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d8346a0a-2baa-4538-9021-3d827649efc4 tempest-ServicesAdminNegativeV253TestJSON-953062061 tempest-ServicesAdminNegativeV253TestJSON-953062061-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '23b425f959d646498db1465a9ab7fd98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eac0928aaed48ff80f403e1c44cb630', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d8346a0a-2baa-4538-9021-3d827649efc4 tempest-ServicesAdminNegativeV253TestJSON-953062061 tempest-ServicesAdminNegativeV253TestJSON-953062061-project] Request method failure captured: Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-services HTTP/1.1 Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGnyprFtfKAi5-rtjNxLmBJAZP25FR3e7ydh-aRPhFVfv-Ko9o3e6CJ8Aj-VCyWqVFWyuBdzpf8y-_YapO6LmZQJGhfmQXrScJXOz0LrqV-QpOpvu8DDbLO_qol8-jvjieu6HbbWPdkEUtCMt-kUq646Aj1VsqQd8RocKUasavsMwNg Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: X-Openstack-Nova-Api-Version: 2.53 Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 2eac0928aaed48ff80f403e1c44cb630 Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-953062061 Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2eac0928aaed48ff80f403e1c44cb630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2eac0928aaed48ff80f403e1c44cb630"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2eac0928aaed48ff80f403e1c44cb630", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2eac0928aaed48ff80f403e1c44cb630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-953062061 Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 2eac0928aaed48ff80f403e1c44cb630 Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-953062061 Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ServicesAdminNegativeV253TestJSON-953062061-project Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 23b425f959d646498db1465a9ab7fd98 Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-953062061-project Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: action_args: {} Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 05 08:31:50.263891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:50.270066 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:31:50.270066 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:50.270066 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:31:50.270066 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:31:50.270066 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:31:50.270066 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:31:50.270066 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:31:50.270066 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 05 08:31:50.270066 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:31:50.276490 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d8346a0a-2baa-4538-9021-3d827649efc4 tempest-ServicesAdminNegativeV253TestJSON-953062061 tempest-ServicesAdminNegativeV253TestJSON-953062061-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:31:50.289436 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d8346a0a-2baa-4538-9021-3d827649efc4 tempest-ServicesAdminNegativeV253TestJSON-953062061 tempest-ServicesAdminNegativeV253TestJSON-953062061-project] 10.222.0.33 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.426399 Jun 05 08:31:50.290093 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1134/2235] 10.222.0.33 () {60 vars in 1177 bytes} [Sun Jun 5 08:31:49 2022] GET /compute/v2.1/os-services => generated 112 bytes in 431 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jun 05 08:31:50.294315 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:31:50.592149 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-894605db-3c31-4676-b68c-03edfb1e6a07 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f244537a430>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:50.665096 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-894605db-3c31-4676-b68c-03edfb1e6a07 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.077575 Jun 05 08:31:50.670907 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1135/2236] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:31:50 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:50.990264 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4aa932e4-dd2d-48b1-82e3-a62b9c9e2b77 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:50.991206 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4aa932e4-dd2d-48b1-82e3-a62b9c9e2b77 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:51.006681 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4aa932e4-dd2d-48b1-82e3-a62b9c9e2b77 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:51.007445 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4aa932e4-dd2d-48b1-82e3-a62b9c9e2b77 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:51.011113 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4aa932e4-dd2d-48b1-82e3-a62b9c9e2b77 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:51.012817 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4aa932e4-dd2d-48b1-82e3-a62b9c9e2b77 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:51.016344 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5ebf135f-89e7-44f5-bb71-da521169c93d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:51.026375 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5ebf135f-89e7-44f5-bb71-da521169c93d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:51.027897 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5ebf135f-89e7-44f5-bb71-da521169c93d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:51.047836 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5ebf135f-89e7-44f5-bb71-da521169c93d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.901811 Jun 05 08:31:51.059097 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1102/2237] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:50 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:31:51.214318 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4aa932e4-dd2d-48b1-82e3-a62b9c9e2b77 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:51.229676 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4aa932e4-dd2d-48b1-82e3-a62b9c9e2b77 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:51.237516 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4aa932e4-dd2d-48b1-82e3-a62b9c9e2b77 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:51.238991 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4aa932e4-dd2d-48b1-82e3-a62b9c9e2b77 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1265 microversion: 2.25 time: 0.253590 Jun 05 08:31:51.242599 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1136/2238] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:50 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:31:51.689496 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f8dca920-3fb5-42e7-ab8e-52858e4ee48f tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24330ed790>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:51.806064 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f8dca920-3fb5-42e7-ab8e-52858e4ee48f tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.131124 Jun 05 08:31:51.807337 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1103/2239] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:31:51 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:52.067314 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a163bb88-2469-4c51-bdf7-17b51265a7c2 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:52.068189 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a163bb88-2469-4c51-bdf7-17b51265a7c2 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:52.078358 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a163bb88-2469-4c51-bdf7-17b51265a7c2 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:52.078820 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a163bb88-2469-4c51-bdf7-17b51265a7c2 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:52.096147 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a163bb88-2469-4c51-bdf7-17b51265a7c2 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:52.097453 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a163bb88-2469-4c51-bdf7-17b51265a7c2 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:52.261166 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9fe1558f-22dc-4de6-afb8-201155843302 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:52.261802 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9fe1558f-22dc-4de6-afb8-201155843302 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:52.279293 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9fe1558f-22dc-4de6-afb8-201155843302 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:52.279767 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9fe1558f-22dc-4de6-afb8-201155843302 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:52.280572 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9fe1558f-22dc-4de6-afb8-201155843302 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:52.281024 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9fe1558f-22dc-4de6-afb8-201155843302 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:53.504165 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9fe1558f-22dc-4de6-afb8-201155843302 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:53.522936 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9fe1558f-22dc-4de6-afb8-201155843302 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:53.537393 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a163bb88-2469-4c51-bdf7-17b51265a7c2 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:53.538884 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9fe1558f-22dc-4de6-afb8-201155843302 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:53.543434 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9fe1558f-22dc-4de6-afb8-201155843302 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1265 microversion: 2.25 time: 1.287318 Jun 05 08:31:53.553327 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1104/2240] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:52 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1265 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:53.566110 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-cee55f87-5c8d-434b-b7b9-786204b3cf9c tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24331a38b0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:53.570769 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a163bb88-2469-4c51-bdf7-17b51265a7c2 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:53.607750 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a163bb88-2469-4c51-bdf7-17b51265a7c2 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:53.609803 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a163bb88-2469-4c51-bdf7-17b51265a7c2 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 1.546826 Jun 05 08:31:53.610391 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1137/2241] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:52 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:31:53.742280 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-cee55f87-5c8d-434b-b7b9-786204b3cf9c tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.186800 Jun 05 08:31:53.742901 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1105/2242] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:31:53 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:54.564698 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2d9f1aaa-4bcd-43cf-8342-7414ebc0eafe tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:54.566436 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2d9f1aaa-4bcd-43cf-8342-7414ebc0eafe tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:54.590066 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:31:54.630690 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-14ecfd27-df73-4bdb-a66d-6660b46ebbde tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:54.631364 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-14ecfd27-df73-4bdb-a66d-6660b46ebbde tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:54.684548 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2d9f1aaa-4bcd-43cf-8342-7414ebc0eafe tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:54.694002 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2d9f1aaa-4bcd-43cf-8342-7414ebc0eafe tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:54.712148 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2d9f1aaa-4bcd-43cf-8342-7414ebc0eafe tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:54.713124 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-14ecfd27-df73-4bdb-a66d-6660b46ebbde tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:54.718984 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-14ecfd27-df73-4bdb-a66d-6660b46ebbde tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:54.722459 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2d9f1aaa-4bcd-43cf-8342-7414ebc0eafe tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:54.744471 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-14ecfd27-df73-4bdb-a66d-6660b46ebbde tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:54.756822 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-14ecfd27-df73-4bdb-a66d-6660b46ebbde tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:55.178710 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2d9f1aaa-4bcd-43cf-8342-7414ebc0eafe tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:55.192479 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2d9f1aaa-4bcd-43cf-8342-7414ebc0eafe tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:55.194355 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2d9f1aaa-4bcd-43cf-8342-7414ebc0eafe tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:55.199620 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2d9f1aaa-4bcd-43cf-8342-7414ebc0eafe tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1265 microversion: 2.25 time: 0.640056 Jun 05 08:31:55.200896 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1138/2243] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:54 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1265 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:55.215805 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-14fa87ca-1414-4179-9965-1a713a2b4d77 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24454ce9d0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:55.353729 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-14fa87ca-1414-4179-9965-1a713a2b4d77 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.151273 Jun 05 08:31:55.354620 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1139/2244] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:31:55 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:56.078334 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-14ecfd27-df73-4bdb-a66d-6660b46ebbde tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:56.099852 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-14ecfd27-df73-4bdb-a66d-6660b46ebbde tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:56.106147 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-14ecfd27-df73-4bdb-a66d-6660b46ebbde tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:56.115324 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-14ecfd27-df73-4bdb-a66d-6660b46ebbde tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 1.489798 Jun 05 08:31:56.120884 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1106/2245] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:54 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:31:56.219930 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-32954714-95d0-41fa-b037-dad5d3b07981 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:56.220592 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-32954714-95d0-41fa-b037-dad5d3b07981 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:56.238833 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-32954714-95d0-41fa-b037-dad5d3b07981 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:56.239289 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-32954714-95d0-41fa-b037-dad5d3b07981 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:56.240661 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-32954714-95d0-41fa-b037-dad5d3b07981 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:56.241290 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-32954714-95d0-41fa-b037-dad5d3b07981 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:56.370762 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-29426491-bd02-4e05-9c66-e2aa8bd8bb6a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24330e58b0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:56.447540 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-29426491-bd02-4e05-9c66-e2aa8bd8bb6a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.083128 Jun 05 08:31:56.448451 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1107/2246] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:31:56 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:56.505853 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-32954714-95d0-41fa-b037-dad5d3b07981 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:56.531186 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-32954714-95d0-41fa-b037-dad5d3b07981 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:56.532889 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-32954714-95d0-41fa-b037-dad5d3b07981 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:56.534747 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-32954714-95d0-41fa-b037-dad5d3b07981 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1265 microversion: 2.25 time: 0.320516 Jun 05 08:31:56.565352 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1140/2247] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:56 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1265 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:57.146596 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4d2f006b-068d-498d-9168-cbdf636e9999 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:57.147230 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4d2f006b-068d-498d-9168-cbdf636e9999 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:57.167413 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4d2f006b-068d-498d-9168-cbdf636e9999 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:57.167882 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4d2f006b-068d-498d-9168-cbdf636e9999 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:57.168721 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4d2f006b-068d-498d-9168-cbdf636e9999 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:57.175385 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4d2f006b-068d-498d-9168-cbdf636e9999 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:57.464768 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-aed90aec-640a-48c6-8887-71c3108f1f81 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f244537a5e0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:57.568510 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-aed90aec-640a-48c6-8887-71c3108f1f81 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.109580 Jun 05 08:31:57.575266 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1141/2248] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:31:57 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:57.591729 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f45d2a73-f623-4299-a0e9-083c03eac53e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:57.602379 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f45d2a73-f623-4299-a0e9-083c03eac53e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:57.626423 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f45d2a73-f623-4299-a0e9-083c03eac53e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:57.626887 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f45d2a73-f623-4299-a0e9-083c03eac53e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:57.631581 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f45d2a73-f623-4299-a0e9-083c03eac53e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:57.634223 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f45d2a73-f623-4299-a0e9-083c03eac53e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:57.913641 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f45d2a73-f623-4299-a0e9-083c03eac53e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:57.933403 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f45d2a73-f623-4299-a0e9-083c03eac53e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:57.943488 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f45d2a73-f623-4299-a0e9-083c03eac53e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:57.950976 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f45d2a73-f623-4299-a0e9-083c03eac53e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1265 microversion: 2.25 time: 0.374291 Jun 05 08:31:57.961038 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1142/2249] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:57 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1265 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:58.077367 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4d2f006b-068d-498d-9168-cbdf636e9999 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:58.090092 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4d2f006b-068d-498d-9168-cbdf636e9999 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:58.091617 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4d2f006b-068d-498d-9168-cbdf636e9999 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:58.092816 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4d2f006b-068d-498d-9168-cbdf636e9999 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.952878 Jun 05 08:31:58.110913 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1108/2250] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:57 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:58.583410 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-271a2195-8232-4348-ad70-85492bebb6a9 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f244537af70>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:58.685727 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-271a2195-8232-4348-ad70-85492bebb6a9 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.107247 Jun 05 08:31:58.686942 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1143/2251] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:31:58 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:31:58.980375 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-af55222d-0ee9-4dbd-928d-1a5ed27215e3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:58.980999 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-af55222d-0ee9-4dbd-928d-1a5ed27215e3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:59.008353 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-af55222d-0ee9-4dbd-928d-1a5ed27215e3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:59.009806 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-af55222d-0ee9-4dbd-928d-1a5ed27215e3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:59.012692 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-af55222d-0ee9-4dbd-928d-1a5ed27215e3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:59.017094 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-af55222d-0ee9-4dbd-928d-1a5ed27215e3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:59.118206 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ca0cb0f1-f0f6-4342-9b07-9c104d88636c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:31:59.119185 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ca0cb0f1-f0f6-4342-9b07-9c104d88636c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:31:59.130221 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ca0cb0f1-f0f6-4342-9b07-9c104d88636c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:59.135523 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ca0cb0f1-f0f6-4342-9b07-9c104d88636c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:59.138732 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ca0cb0f1-f0f6-4342-9b07-9c104d88636c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:31:59.142073 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ca0cb0f1-f0f6-4342-9b07-9c104d88636c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:31:59.224948 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-af55222d-0ee9-4dbd-928d-1a5ed27215e3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:59.239546 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-af55222d-0ee9-4dbd-928d-1a5ed27215e3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:59.253156 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-af55222d-0ee9-4dbd-928d-1a5ed27215e3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:31:59.259862 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-af55222d-0ee9-4dbd-928d-1a5ed27215e3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1265 microversion: 2.25 time: 0.286124 Jun 05 08:31:59.261098 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1109/2252] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:58 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1265 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:31:59.527063 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=8 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:31:59.745097 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-df32e911-fa04-4949-92eb-8ae038804f6a tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-944670283", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:31:59.794402 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=10 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:31:59.866648 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-df32e911-fa04-4949-92eb-8ae038804f6a tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] validate_networks() for None {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:31:59.986434 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ca0cb0f1-f0f6-4342-9b07-9c104d88636c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:00.013763 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ca0cb0f1-f0f6-4342-9b07-9c104d88636c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:00.017080 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ca0cb0f1-f0f6-4342-9b07-9c104d88636c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:00.020473 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ca0cb0f1-f0f6-4342-9b07-9c104d88636c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.906629 Jun 05 08:32:00.021394 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1144/2253] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:31:59 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:00.041691 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-679a420b-6be4-44c6-a861-60743a15e595 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f2433ad6040>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:00.122857 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-679a420b-6be4-44c6-a861-60743a15e595 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.085628 Jun 05 08:32:00.124500 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1145/2254] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:32:00 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:00.278299 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-505b47b5-2be5-412f-8e2d-b702df491d74 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:00.279258 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-505b47b5-2be5-412f-8e2d-b702df491d74 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:00.289229 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-505b47b5-2be5-412f-8e2d-b702df491d74 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:00.289951 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-505b47b5-2be5-412f-8e2d-b702df491d74 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:00.290998 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-505b47b5-2be5-412f-8e2d-b702df491d74 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:00.291673 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-505b47b5-2be5-412f-8e2d-b702df491d74 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:00.462976 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-df32e911-fa04-4949-92eb-8ae038804f6a tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:32:00.464944 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-df32e911-fa04-4949-92eb-8ae038804f6a tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:32:00.465874 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-df32e911-fa04-4949-92eb-8ae038804f6a tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:32:00.467047 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-df32e911-fa04-4949-92eb-8ae038804f6a tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:32:00.469563 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-df32e911-fa04-4949-92eb-8ae038804f6a tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:32:00.476999 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-505b47b5-2be5-412f-8e2d-b702df491d74 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:00.493019 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-505b47b5-2be5-412f-8e2d-b702df491d74 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:00.494774 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-505b47b5-2be5-412f-8e2d-b702df491d74 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:00.497230 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-df32e911-fa04-4949-92eb-8ae038804f6a tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:00.497626 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-505b47b5-2be5-412f-8e2d-b702df491d74 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1265 microversion: 2.25 time: 0.221980 Jun 05 08:32:00.497905 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-df32e911-fa04-4949-92eb-8ae038804f6a tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:00.502933 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-df32e911-fa04-4949-92eb-8ae038804f6a tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:00.503772 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-df32e911-fa04-4949-92eb-8ae038804f6a tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:00.510723 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1146/2255] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:00 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:00.543406 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-df32e911-fa04-4949-92eb-8ae038804f6a tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Getting quotas for project d3273ac973724a00a74d00689d99aef4. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:32:00.550400 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-df32e911-fa04-4949-92eb-8ae038804f6a tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Getting quotas for user d8ab927b60d8451da78b5f8180a10ef6 and project d3273ac973724a00a74d00689d99aef4. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:32:00.605213 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-df32e911-fa04-4949-92eb-8ae038804f6a tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:32:00.614916 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-df32e911-fa04-4949-92eb-8ae038804f6a tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] [instance: a16d052a-235e-46a1-8a93-da823e2d880a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:32:00.730202 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-df32e911-fa04-4949-92eb-8ae038804f6a tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.207619 Jun 05 08:32:00.733238 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1110/2256] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:31:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:32:00.743476 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9af9f3ae-c708-432d-9796-028f8e7887e8 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:00.747867 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9af9f3ae-c708-432d-9796-028f8e7887e8 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] [instance: a16d052a-235e-46a1-8a93-da823e2d880a] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:00.914558 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-9af9f3ae-c708-432d-9796-028f8e7887e8 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ab927b60d8451da78b5f8180a10ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3273ac973724a00a74d00689d99aef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:00.928914 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9af9f3ae-c708-432d-9796-028f8e7887e8 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] 10.222.0.33 "GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a" status: 200 len: 1213 microversion: 2.1 time: 0.186287 Jun 05 08:32:00.938984 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1147/2257] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:00 2022] GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a => generated 1213 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:01.042125 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-df727288-fd61-446c-b58a-9953c2d65452 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:01.042939 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-df727288-fd61-446c-b58a-9953c2d65452 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:01.057234 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-df727288-fd61-446c-b58a-9953c2d65452 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:01.060315 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-df727288-fd61-446c-b58a-9953c2d65452 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:01.061964 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-df727288-fd61-446c-b58a-9953c2d65452 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:01.068880 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-df727288-fd61-446c-b58a-9953c2d65452 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:01.138806 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2ce559fb-de35-4ab3-9d46-7203ea3ae5d3 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f2433db44c0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:01.249747 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2ce559fb-de35-4ab3-9d46-7203ea3ae5d3 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.111375 Jun 05 08:32:01.252996 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1148/2258] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:32:01 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:01.518490 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-718d252d-4c03-4e04-a113-7153acaa5cd0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:01.519540 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-718d252d-4c03-4e04-a113-7153acaa5cd0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:01.531070 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-718d252d-4c03-4e04-a113-7153acaa5cd0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:01.534283 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-718d252d-4c03-4e04-a113-7153acaa5cd0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:01.540921 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-718d252d-4c03-4e04-a113-7153acaa5cd0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:01.541377 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-718d252d-4c03-4e04-a113-7153acaa5cd0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:01.562623 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-df727288-fd61-446c-b58a-9953c2d65452 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:01.572540 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-df727288-fd61-446c-b58a-9953c2d65452 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:01.575245 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-df727288-fd61-446c-b58a-9953c2d65452 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:01.576756 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-df727288-fd61-446c-b58a-9953c2d65452 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.540045 Jun 05 08:32:01.577956 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1111/2259] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:01 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:01.725542 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-718d252d-4c03-4e04-a113-7153acaa5cd0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:01.736530 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-718d252d-4c03-4e04-a113-7153acaa5cd0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:01.744493 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-718d252d-4c03-4e04-a113-7153acaa5cd0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:01.755138 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-718d252d-4c03-4e04-a113-7153acaa5cd0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1265 microversion: 2.25 time: 0.240912 Jun 05 08:32:01.772835 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1149/2260] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:01 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:01.946297 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-51863d7b-e88d-475e-85cd-e9b315bdf830 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:01.947168 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-51863d7b-e88d-475e-85cd-e9b315bdf830 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] [instance: a16d052a-235e-46a1-8a93-da823e2d880a] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:01.958500 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-51863d7b-e88d-475e-85cd-e9b315bdf830 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:01.968703 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-51863d7b-e88d-475e-85cd-e9b315bdf830 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:01.969724 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-51863d7b-e88d-475e-85cd-e9b315bdf830 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:01.970297 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-51863d7b-e88d-475e-85cd-e9b315bdf830 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:02.141311 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-51863d7b-e88d-475e-85cd-e9b315bdf830 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ab927b60d8451da78b5f8180a10ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3273ac973724a00a74d00689d99aef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:02.156013 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-51863d7b-e88d-475e-85cd-e9b315bdf830 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] 10.222.0.33 "GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a" status: 200 len: 1209 microversion: 2.1 time: 0.205965 Jun 05 08:32:02.157469 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1112/2261] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:01 2022] GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a => generated 1209 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:02.275882 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f95cabd7-47f2-4418-bcb6-126db7c5979b tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f2433b1e550>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:02.381157 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f95cabd7-47f2-4418-bcb6-126db7c5979b tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.120669 Jun 05 08:32:02.382952 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1150/2262] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:32:02 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:02.601460 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bd77c92a-5fb4-4bba-8575-5d418d017f13 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:02.602091 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-bd77c92a-5fb4-4bba-8575-5d418d017f13 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:02.613075 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bd77c92a-5fb4-4bba-8575-5d418d017f13 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:02.615665 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bd77c92a-5fb4-4bba-8575-5d418d017f13 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:02.618081 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bd77c92a-5fb4-4bba-8575-5d418d017f13 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:02.626458 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bd77c92a-5fb4-4bba-8575-5d418d017f13 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:02.774250 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a5044cdb-6c41-454e-8a1f-125982533f6a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:02.775116 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a5044cdb-6c41-454e-8a1f-125982533f6a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:02.791301 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a5044cdb-6c41-454e-8a1f-125982533f6a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:02.792105 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a5044cdb-6c41-454e-8a1f-125982533f6a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:02.793101 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a5044cdb-6c41-454e-8a1f-125982533f6a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:02.793722 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a5044cdb-6c41-454e-8a1f-125982533f6a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:03.223317 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a5044cdb-6c41-454e-8a1f-125982533f6a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:03.232025 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a5044cdb-6c41-454e-8a1f-125982533f6a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:03.240283 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a5044cdb-6c41-454e-8a1f-125982533f6a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:03.241758 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a5044cdb-6c41-454e-8a1f-125982533f6a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1265 microversion: 2.25 time: 0.472319 Jun 05 08:32:03.244413 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1151/2263] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:02 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1265 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:32:03.251758 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c9125176-a3a9-4e05-96d4-7c216b4dcaaa tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:03.252703 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c9125176-a3a9-4e05-96d4-7c216b4dcaaa tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] [instance: a16d052a-235e-46a1-8a93-da823e2d880a] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:03.272927 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c9125176-a3a9-4e05-96d4-7c216b4dcaaa tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:03.275987 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c9125176-a3a9-4e05-96d4-7c216b4dcaaa tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:03.281290 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c9125176-a3a9-4e05-96d4-7c216b4dcaaa tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:03.282342 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c9125176-a3a9-4e05-96d4-7c216b4dcaaa tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:03.325750 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=100 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:32:03.445901 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c9125176-a3a9-4e05-96d4-7c216b4dcaaa tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ab927b60d8451da78b5f8180a10ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3273ac973724a00a74d00689d99aef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:03.454001 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c9125176-a3a9-4e05-96d4-7c216b4dcaaa tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] 10.222.0.33 "GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a" status: 200 len: 1271 microversion: 2.1 time: 0.208230 Jun 05 08:32:03.457225 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1152/2264] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:03 2022] GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a => generated 1271 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:03.466269 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-bd77c92a-5fb4-4bba-8575-5d418d017f13 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:03.477701 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-bd77c92a-5fb4-4bba-8575-5d418d017f13 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:03.484653 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5cef795e-66c3-4890-a709-fc791bab4a7c tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24454a8e50>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:03.488778 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-bd77c92a-5fb4-4bba-8575-5d418d017f13 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:03.491928 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bd77c92a-5fb4-4bba-8575-5d418d017f13 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.900225 Jun 05 08:32:03.506213 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1113/2265] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:02 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:03.576240 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5cef795e-66c3-4890-a709-fc791bab4a7c tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.117374 Jun 05 08:32:03.583276 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1153/2266] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:32:03 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:04.263171 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5e6be05b-cf40-405b-b129-00d425098246 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:04.263951 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5e6be05b-cf40-405b-b129-00d425098246 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:04.277224 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5e6be05b-cf40-405b-b129-00d425098246 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:04.281049 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5e6be05b-cf40-405b-b129-00d425098246 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:04.297560 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5e6be05b-cf40-405b-b129-00d425098246 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:04.304900 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5e6be05b-cf40-405b-b129-00d425098246 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:04.419093 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5e6be05b-cf40-405b-b129-00d425098246 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:04.431838 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5e6be05b-cf40-405b-b129-00d425098246 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:04.433669 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5e6be05b-cf40-405b-b129-00d425098246 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:04.435908 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5e6be05b-cf40-405b-b129-00d425098246 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1265 microversion: 2.25 time: 0.176491 Jun 05 08:32:04.437468 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1114/2267] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:04 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:04.475850 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4bea0f9e-938c-4c59-b84e-39872fe7cbc1 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:04.477107 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4bea0f9e-938c-4c59-b84e-39872fe7cbc1 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] [instance: a16d052a-235e-46a1-8a93-da823e2d880a] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:04.484862 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4bea0f9e-938c-4c59-b84e-39872fe7cbc1 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:04.485574 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4bea0f9e-938c-4c59-b84e-39872fe7cbc1 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:04.486544 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4bea0f9e-938c-4c59-b84e-39872fe7cbc1 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:04.489423 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4bea0f9e-938c-4c59-b84e-39872fe7cbc1 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:04.513260 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c23fe82d-a53f-458b-8688-1917e7bd804b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:04.515016 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c23fe82d-a53f-458b-8688-1917e7bd804b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:04.526587 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c23fe82d-a53f-458b-8688-1917e7bd804b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:04.530014 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c23fe82d-a53f-458b-8688-1917e7bd804b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:04.531463 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c23fe82d-a53f-458b-8688-1917e7bd804b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:04.536295 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c23fe82d-a53f-458b-8688-1917e7bd804b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:04.614577 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4bea0f9e-938c-4c59-b84e-39872fe7cbc1 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ab927b60d8451da78b5f8180a10ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3273ac973724a00a74d00689d99aef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:04.632992 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4bea0f9e-938c-4c59-b84e-39872fe7cbc1 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] 10.222.0.33 "GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a" status: 200 len: 1271 microversion: 2.1 time: 0.163105 Jun 05 08:32:04.638594 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1154/2268] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:04 2022] GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:04.662293 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-75714e2b-efee-475d-95f2-e9a9ce95de0d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24454b38b0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:04.844867 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-75714e2b-efee-475d-95f2-e9a9ce95de0d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.202812 Jun 05 08:32:04.846910 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1155/2269] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:32:04 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:05.016276 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c23fe82d-a53f-458b-8688-1917e7bd804b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:05.034430 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c23fe82d-a53f-458b-8688-1917e7bd804b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:05.037529 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c23fe82d-a53f-458b-8688-1917e7bd804b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:05.040621 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c23fe82d-a53f-458b-8688-1917e7bd804b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.531008 Jun 05 08:32:05.053956 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1115/2270] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:04 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:32:05.454744 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b29a6635-3e82-450e-83d0-c9218eb4b6e0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:05.455721 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b29a6635-3e82-450e-83d0-c9218eb4b6e0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:05.470227 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b29a6635-3e82-450e-83d0-c9218eb4b6e0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:05.471567 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b29a6635-3e82-450e-83d0-c9218eb4b6e0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:05.472759 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b29a6635-3e82-450e-83d0-c9218eb4b6e0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:05.473395 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b29a6635-3e82-450e-83d0-c9218eb4b6e0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:05.573165 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b29a6635-3e82-450e-83d0-c9218eb4b6e0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:05.584297 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b29a6635-3e82-450e-83d0-c9218eb4b6e0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:05.586181 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b29a6635-3e82-450e-83d0-c9218eb4b6e0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:05.587618 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b29a6635-3e82-450e-83d0-c9218eb4b6e0 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1265 microversion: 2.25 time: 0.136835 Jun 05 08:32:05.588742 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1156/2271] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:05 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1265 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:05.654762 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9272aa4b-5edb-4c41-ae73-c8a54f8c5187 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:05.655376 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9272aa4b-5edb-4c41-ae73-c8a54f8c5187 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] [instance: a16d052a-235e-46a1-8a93-da823e2d880a] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:05.658629 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:32:05.672327 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9272aa4b-5edb-4c41-ae73-c8a54f8c5187 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:05.673185 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9272aa4b-5edb-4c41-ae73-c8a54f8c5187 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:05.675093 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9272aa4b-5edb-4c41-ae73-c8a54f8c5187 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:05.675791 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9272aa4b-5edb-4c41-ae73-c8a54f8c5187 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:05.859911 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-dbaa8fd3-4a93-459c-8a81-f0d5b5363212 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24454b3b80>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:05.930627 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-dbaa8fd3-4a93-459c-8a81-f0d5b5363212 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.074510 Jun 05 08:32:05.931206 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1157/2272] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:32:05 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:06.013297 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9272aa4b-5edb-4c41-ae73-c8a54f8c5187 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ab927b60d8451da78b5f8180a10ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3273ac973724a00a74d00689d99aef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:06.022160 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9272aa4b-5edb-4c41-ae73-c8a54f8c5187 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] 10.222.0.33 "GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a" status: 200 len: 1313 microversion: 2.1 time: 0.371404 Jun 05 08:32:06.024549 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1116/2273] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:05 2022] GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a => generated 1313 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:06.062243 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-da2941a0-fb44-4a38-b65a-27ec5346b2f4 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:06.063539 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-da2941a0-fb44-4a38-b65a-27ec5346b2f4 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:06.075280 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-da2941a0-fb44-4a38-b65a-27ec5346b2f4 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:06.077722 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-da2941a0-fb44-4a38-b65a-27ec5346b2f4 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:06.079782 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-da2941a0-fb44-4a38-b65a-27ec5346b2f4 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:06.082370 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-da2941a0-fb44-4a38-b65a-27ec5346b2f4 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:06.397358 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-da2941a0-fb44-4a38-b65a-27ec5346b2f4 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:06.411755 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-da2941a0-fb44-4a38-b65a-27ec5346b2f4 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:06.416752 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-da2941a0-fb44-4a38-b65a-27ec5346b2f4 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:06.419153 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-da2941a0-fb44-4a38-b65a-27ec5346b2f4 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.361315 Jun 05 08:32:06.421011 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1158/2274] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:06 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:06.605116 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5ceb7291-64a7-42cb-a7b3-290217c23af1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:06.605741 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5ceb7291-64a7-42cb-a7b3-290217c23af1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:06.620755 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5ceb7291-64a7-42cb-a7b3-290217c23af1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:06.621288 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5ceb7291-64a7-42cb-a7b3-290217c23af1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:06.622938 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5ceb7291-64a7-42cb-a7b3-290217c23af1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:06.623391 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5ceb7291-64a7-42cb-a7b3-290217c23af1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:06.945483 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c3a1333e-b654-4219-8b94-4ed5d9a9710a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24454b33a0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:07.020623 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c3a1333e-b654-4219-8b94-4ed5d9a9710a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.079304 Jun 05 08:32:07.027725 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1159/2275] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:32:06 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:07.050716 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1dab5b53-204a-4015-ad90-9b3b4f652553 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:07.051358 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1dab5b53-204a-4015-ad90-9b3b4f652553 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] [instance: a16d052a-235e-46a1-8a93-da823e2d880a] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:07.091217 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1dab5b53-204a-4015-ad90-9b3b4f652553 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:07.091684 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1dab5b53-204a-4015-ad90-9b3b4f652553 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:07.092716 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1dab5b53-204a-4015-ad90-9b3b4f652553 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:07.093362 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1dab5b53-204a-4015-ad90-9b3b4f652553 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:07.368024 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1dab5b53-204a-4015-ad90-9b3b4f652553 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ab927b60d8451da78b5f8180a10ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3273ac973724a00a74d00689d99aef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:07.383961 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5ceb7291-64a7-42cb-a7b3-290217c23af1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:07.394022 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1dab5b53-204a-4015-ad90-9b3b4f652553 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] 10.222.0.33 "GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a" status: 200 len: 1313 microversion: 2.1 time: 0.355109 Jun 05 08:32:07.394651 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1160/2276] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:07 2022] GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a => generated 1313 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:07.397493 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5ceb7291-64a7-42cb-a7b3-290217c23af1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:07.399500 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5ceb7291-64a7-42cb-a7b3-290217c23af1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:07.400885 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5ceb7291-64a7-42cb-a7b3-290217c23af1 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1265 microversion: 2.25 time: 0.799652 Jun 05 08:32:07.401942 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1117/2277] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:06 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1265 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:07.443218 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2e1c09b5-b10a-4822-ba3b-0b99fef0d9fc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:07.444144 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2e1c09b5-b10a-4822-ba3b-0b99fef0d9fc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:07.452108 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2e1c09b5-b10a-4822-ba3b-0b99fef0d9fc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:07.452814 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2e1c09b5-b10a-4822-ba3b-0b99fef0d9fc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:07.454032 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2e1c09b5-b10a-4822-ba3b-0b99fef0d9fc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:07.454650 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2e1c09b5-b10a-4822-ba3b-0b99fef0d9fc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:07.838559 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2e1c09b5-b10a-4822-ba3b-0b99fef0d9fc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:07.852069 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2e1c09b5-b10a-4822-ba3b-0b99fef0d9fc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:07.854512 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2e1c09b5-b10a-4822-ba3b-0b99fef0d9fc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:07.855851 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2e1c09b5-b10a-4822-ba3b-0b99fef0d9fc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.416934 Jun 05 08:32:07.856882 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1161/2278] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:07 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:08.035241 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-aac74f23-b9e8-4f5d-a69f-3aa7aa127111 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24330cd4c0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:08.129353 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-aac74f23-b9e8-4f5d-a69f-3aa7aa127111 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.098906 Jun 05 08:32:08.130264 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1118/2279] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:32:08 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:08.413097 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0616a685-f64a-4081-b348-cda7db272ce4 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:08.414564 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0616a685-f64a-4081-b348-cda7db272ce4 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] [instance: a16d052a-235e-46a1-8a93-da823e2d880a] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:08.424573 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0616a685-f64a-4081-b348-cda7db272ce4 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:08.425400 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0616a685-f64a-4081-b348-cda7db272ce4 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:08.425996 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-91d8efa6-d3b3-40e4-a915-38183848805f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:08.426629 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-91d8efa6-d3b3-40e4-a915-38183848805f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:08.428030 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0616a685-f64a-4081-b348-cda7db272ce4 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:08.428753 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0616a685-f64a-4081-b348-cda7db272ce4 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:08.444171 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-91d8efa6-d3b3-40e4-a915-38183848805f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:08.444633 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-91d8efa6-d3b3-40e4-a915-38183848805f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:08.445436 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-91d8efa6-d3b3-40e4-a915-38183848805f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:08.445883 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-91d8efa6-d3b3-40e4-a915-38183848805f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:08.566577 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-91d8efa6-d3b3-40e4-a915-38183848805f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:08.578009 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-91d8efa6-d3b3-40e4-a915-38183848805f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:08.585789 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-91d8efa6-d3b3-40e4-a915-38183848805f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:08.587202 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-91d8efa6-d3b3-40e4-a915-38183848805f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1265 microversion: 2.25 time: 0.172125 Jun 05 08:32:08.589712 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1119/2280] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:08 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:08.760859 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0616a685-f64a-4081-b348-cda7db272ce4 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ab927b60d8451da78b5f8180a10ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3273ac973724a00a74d00689d99aef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:08.772869 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-3866ae4c-825c-46ee-9ae5-5eb820066dbe req-e7f2ab73-b487-40e4-8760-f5001cf70899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a16d052a-235e-46a1-8a93-da823e2d880a", "tag": "e510e94a-0940-403c-890f-f41d1183fe9d"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:32:08.789271 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0616a685-f64a-4081-b348-cda7db272ce4 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] 10.222.0.33 "GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a" status: 200 len: 1313 microversion: 2.1 time: 0.382746 Jun 05 08:32:08.790526 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1162/2281] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:08 2022] GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a => generated 1313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:08.802261 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-3866ae4c-825c-46ee-9ae5-5eb820066dbe req-e7f2ab73-b487-40e4-8760-f5001cf70899 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:08.803004 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-3866ae4c-825c-46ee-9ae5-5eb820066dbe req-e7f2ab73-b487-40e4-8760-f5001cf70899 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:08.849203 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-3866ae4c-825c-46ee-9ae5-5eb820066dbe req-e7f2ab73-b487-40e4-8760-f5001cf70899 service nova] Creating event network-changed:e510e94a-0940-403c-890f-f41d1183fe9d for instance a16d052a-235e-46a1-8a93-da823e2d880a on n-h1-844739-1 Jun 05 08:32:08.881186 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2741f7b2-c6a2-4373-9af3-b3aa18ac6697 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:08.881884 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2741f7b2-c6a2-4373-9af3-b3aa18ac6697 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:08.896152 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-3866ae4c-825c-46ee-9ae5-5eb820066dbe req-e7f2ab73-b487-40e4-8760-f5001cf70899 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124803 Jun 05 08:32:08.899927 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1120/2282] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:32:08.904506 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2741f7b2-c6a2-4373-9af3-b3aa18ac6697 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:08.910715 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2741f7b2-c6a2-4373-9af3-b3aa18ac6697 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:08.915038 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2741f7b2-c6a2-4373-9af3-b3aa18ac6697 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:08.915513 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2741f7b2-c6a2-4373-9af3-b3aa18ac6697 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:09.144860 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7b0e916c-f6e8-42b6-b439-d13281d2123c tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f243310c3a0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:09.278373 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7b0e916c-f6e8-42b6-b439-d13281d2123c tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.139580 Jun 05 08:32:09.284777 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1121/2283] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:32:09 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:09.337322 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2741f7b2-c6a2-4373-9af3-b3aa18ac6697 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:09.348794 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2741f7b2-c6a2-4373-9af3-b3aa18ac6697 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:09.350947 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2741f7b2-c6a2-4373-9af3-b3aa18ac6697 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:09.353713 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2741f7b2-c6a2-4373-9af3-b3aa18ac6697 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.477794 Jun 05 08:32:09.354893 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1163/2284] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:08 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:32:09.609625 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7e2c328b-e417-4d3c-8558-5da5714628c7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:09.610410 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7e2c328b-e417-4d3c-8558-5da5714628c7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:09.655164 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7e2c328b-e417-4d3c-8558-5da5714628c7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:09.657925 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7e2c328b-e417-4d3c-8558-5da5714628c7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:09.664232 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7e2c328b-e417-4d3c-8558-5da5714628c7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:09.664726 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7e2c328b-e417-4d3c-8558-5da5714628c7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:09.806373 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7944816f-922a-4d12-859e-4fc64872d0fe tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:09.807763 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7944816f-922a-4d12-859e-4fc64872d0fe tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] [instance: a16d052a-235e-46a1-8a93-da823e2d880a] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:09.829067 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7e2c328b-e417-4d3c-8558-5da5714628c7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:09.835875 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7944816f-922a-4d12-859e-4fc64872d0fe tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:09.836374 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7944816f-922a-4d12-859e-4fc64872d0fe tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:09.837641 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7944816f-922a-4d12-859e-4fc64872d0fe tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:09.837641 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7944816f-922a-4d12-859e-4fc64872d0fe tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:09.840467 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7e2c328b-e417-4d3c-8558-5da5714628c7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:09.842120 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7e2c328b-e417-4d3c-8558-5da5714628c7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:09.843392 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7e2c328b-e417-4d3c-8558-5da5714628c7 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1265 microversion: 2.25 time: 0.239133 Jun 05 08:32:09.844823 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1122/2285] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:09 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:10.223148 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7944816f-922a-4d12-859e-4fc64872d0fe tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ab927b60d8451da78b5f8180a10ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3273ac973724a00a74d00689d99aef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:10.244699 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7944816f-922a-4d12-859e-4fc64872d0fe tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] 10.222.0.33 "GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a" status: 200 len: 1313 microversion: 2.1 time: 0.440614 Jun 05 08:32:10.258835 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1164/2286] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:09 2022] GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a => generated 1313 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:32:10.293901 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f4604715-1f47-4495-8ffc-e50b0fadf0b9 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24330cd280>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:10.373509 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f4604715-1f47-4495-8ffc-e50b0fadf0b9 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.084908 Jun 05 08:32:10.374285 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1123/2287] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:32:10 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:10.375486 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-92caf554-a144-4e82-9b9d-1a0e151d98a7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:10.376466 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-92caf554-a144-4e82-9b9d-1a0e151d98a7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:10.384865 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-92caf554-a144-4e82-9b9d-1a0e151d98a7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:10.385684 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-92caf554-a144-4e82-9b9d-1a0e151d98a7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:10.386723 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-92caf554-a144-4e82-9b9d-1a0e151d98a7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:10.387505 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-92caf554-a144-4e82-9b9d-1a0e151d98a7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:10.865738 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4f040413-9977-4b88-820b-eca911abae37 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:10.867024 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4f040413-9977-4b88-820b-eca911abae37 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:10.874902 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-92caf554-a144-4e82-9b9d-1a0e151d98a7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:10.878724 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:32:10.880469 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=6 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:32:10.888027 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-92caf554-a144-4e82-9b9d-1a0e151d98a7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:10.890172 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4f040413-9977-4b88-820b-eca911abae37 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:10.891696 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4f040413-9977-4b88-820b-eca911abae37 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:10.893335 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-92caf554-a144-4e82-9b9d-1a0e151d98a7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:10.898715 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-92caf554-a144-4e82-9b9d-1a0e151d98a7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.528769 Jun 05 08:32:10.899334 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1165/2288] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:10 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:10.908233 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4f040413-9977-4b88-820b-eca911abae37 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:10.908233 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4f040413-9977-4b88-820b-eca911abae37 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:11.005564 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4f040413-9977-4b88-820b-eca911abae37 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:11.025242 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4f040413-9977-4b88-820b-eca911abae37 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:11.027219 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4f040413-9977-4b88-820b-eca911abae37 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:11.035591 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4f040413-9977-4b88-820b-eca911abae37 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1265 microversion: 2.25 time: 0.169802 Jun 05 08:32:11.037014 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1124/2289] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:10 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:11.068804 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d6faf9c8-45f4-4173-98eb-bbb847a10e90 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-37648482", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "838b09a9-1b36-4e3b-9a9c-3ab7d74078c8"}], "security_groups": [{"name": "tempest-securitygroup--1657824599"}], "key_name": "tempest-keypair-2107730819", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "7976081e-4ce4-47c2-8e34-d8eaffb7d41a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:32:11.094817 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:32:11.106314 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-aa1b9ab8-e152-4afb-9b44-a3063d91740a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:11.106965 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-aa1b9ab8-e152-4afb-9b44-a3063d91740a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:11.118826 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aa1b9ab8-e152-4afb-9b44-a3063d91740a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:11.133932 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aa1b9ab8-e152-4afb-9b44-a3063d91740a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:11.137515 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aa1b9ab8-e152-4afb-9b44-a3063d91740a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:11.140760 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aa1b9ab8-e152-4afb-9b44-a3063d91740a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:11.280472 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-aa1b9ab8-e152-4afb-9b44-a3063d91740a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:32:11.373732 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=100 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:32:11.465663 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-d6faf9c8-45f4-4173-98eb-bbb847a10e90 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] validate_networks() for [('838b09a9-1b36-4e3b-9a9c-3ab7d74078c8', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:32:11.644018 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-aa1b9ab8-e152-4afb-9b44-a3063d91740a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "DELETE /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 204 len: 0 microversion: 2.1 time: 0.541430 Jun 05 08:32:11.646041 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1125/2290] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:32:11 2022] DELETE /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:32:11.652657 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fd264ce1-ca2a-4295-8154-93b1977ca70e tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:11.659710 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-fd264ce1-ca2a-4295-8154-93b1977ca70e tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] [instance: a16d052a-235e-46a1-8a93-da823e2d880a] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:11.671668 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fd264ce1-ca2a-4295-8154-93b1977ca70e tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:11.676144 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fd264ce1-ca2a-4295-8154-93b1977ca70e tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:11.681845 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fd264ce1-ca2a-4295-8154-93b1977ca70e tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:11.685932 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fd264ce1-ca2a-4295-8154-93b1977ca70e tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:12.590756 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-fd264ce1-ca2a-4295-8154-93b1977ca70e tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ab927b60d8451da78b5f8180a10ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3273ac973724a00a74d00689d99aef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:12.624943 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fd264ce1-ca2a-4295-8154-93b1977ca70e tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] 10.222.0.33 "GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a" status: 200 len: 1313 microversion: 2.1 time: 0.976732 Jun 05 08:32:12.632636 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1126/2291] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:11 2022] GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a => generated 1313 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:12.653685 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-90ab2710-c45e-420e-868e-7c326ce2794d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f2433177280>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:12.766131 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-d6faf9c8-45f4-4173-98eb-bbb847a10e90 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Getting quotas for project 109a1eb2427e453585c3e752af6a7eaf. Resources: dict_keys(['metadata_items']) {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:32:12.800702 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-d6faf9c8-45f4-4173-98eb-bbb847a10e90 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Getting quotas for user 615299cb9eb34ceca04c2864923a4724 and project 109a1eb2427e453585c3e752af6a7eaf. Resources: dict_keys(['metadata_items']) {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:32:12.862451 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-d6faf9c8-45f4-4173-98eb-bbb847a10e90 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:32:12.863319 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-d6faf9c8-45f4-4173-98eb-bbb847a10e90 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:32:12.864431 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-d6faf9c8-45f4-4173-98eb-bbb847a10e90 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:32:12.865816 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-d6faf9c8-45f4-4173-98eb-bbb847a10e90 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:32:12.866425 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-d6faf9c8-45f4-4173-98eb-bbb847a10e90 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:32:12.884170 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d6faf9c8-45f4-4173-98eb-bbb847a10e90 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:12.885541 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d6faf9c8-45f4-4173-98eb-bbb847a10e90 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:12.886417 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d6faf9c8-45f4-4173-98eb-bbb847a10e90 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:12.890667 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d6faf9c8-45f4-4173-98eb-bbb847a10e90 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:12.919843 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-90ab2710-c45e-420e-868e-7c326ce2794d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.272981 Jun 05 08:32:12.920929 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1127/2292] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:32:12 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:12.966638 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-75eefa14-babd-4d00-9ccb-963b02a266f7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:12.968299 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-75eefa14-babd-4d00-9ccb-963b02a266f7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:13.009882 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-d6faf9c8-45f4-4173-98eb-bbb847a10e90 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Getting quotas for project 109a1eb2427e453585c3e752af6a7eaf. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:32:13.011980 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-75eefa14-babd-4d00-9ccb-963b02a266f7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:13.013291 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-75eefa14-babd-4d00-9ccb-963b02a266f7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:13.014964 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-75eefa14-babd-4d00-9ccb-963b02a266f7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:13.015757 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-75eefa14-babd-4d00-9ccb-963b02a266f7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:13.017094 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-d6faf9c8-45f4-4173-98eb-bbb847a10e90 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Getting quotas for user 615299cb9eb34ceca04c2864923a4724 and project 109a1eb2427e453585c3e752af6a7eaf. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:32:13.134181 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d6faf9c8-45f4-4173-98eb-bbb847a10e90 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:32:13.136534 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d6faf9c8-45f4-4173-98eb-bbb847a10e90 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] [instance: 3af92159-069a-44f1-90ed-5d90bf69d9ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7976081e-4ce4-47c2-8e34-d8eaffb7d41a',volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:32:13.431487 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-75eefa14-babd-4d00-9ccb-963b02a266f7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:13.443410 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-75eefa14-babd-4d00-9ccb-963b02a266f7 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1500 microversion: 2.1 time: 0.516094 Jun 05 08:32:13.458945 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1128/2293] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:12 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1500 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:13.479225 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5218a088-5f60-4029-8c03-563e1b5b0fbd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:13.480991 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5218a088-5f60-4029-8c03-563e1b5b0fbd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:13.497243 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5218a088-5f60-4029-8c03-563e1b5b0fbd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:13.498071 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5218a088-5f60-4029-8c03-563e1b5b0fbd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:13.500933 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5218a088-5f60-4029-8c03-563e1b5b0fbd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:13.501691 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5218a088-5f60-4029-8c03-563e1b5b0fbd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:13.509393 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d6faf9c8-45f4-4173-98eb-bbb847a10e90 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.447873 Jun 05 08:32:13.510447 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1166/2294] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:32:11 2022] POST /compute/v2.1/servers => generated 407 bytes in 2450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:32:13.526434 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e91d9c08-4a26-4383-875d-70cedeb23dc3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:13.527423 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e91d9c08-4a26-4383-875d-70cedeb23dc3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 12ef7912-7054-4457-b1a4-c266b5bcb3e5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:13.541034 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e91d9c08-4a26-4383-875d-70cedeb23dc3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:13.541907 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e91d9c08-4a26-4383-875d-70cedeb23dc3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:13.542914 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e91d9c08-4a26-4383-875d-70cedeb23dc3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:13.543583 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e91d9c08-4a26-4383-875d-70cedeb23dc3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:13.633558 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e91d9c08-4a26-4383-875d-70cedeb23dc3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:13.644392 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e91d9c08-4a26-4383-875d-70cedeb23dc3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:13.645238 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-e91d9c08-4a26-4383-875d-70cedeb23dc3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lazy-loading 'fault' on Instance uuid 12ef7912-7054-4457-b1a4-c266b5bcb3e5 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:32:13.799557 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e91d9c08-4a26-4383-875d-70cedeb23dc3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:13.814087 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e91d9c08-4a26-4383-875d-70cedeb23dc3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:13.828618 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e91d9c08-4a26-4383-875d-70cedeb23dc3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:13.834670 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e91d9c08-4a26-4383-875d-70cedeb23dc3 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5" status: 200 len: 1325 microversion: 2.25 time: 0.320679 Jun 05 08:32:13.837030 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1167/2295] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:13 2022] GET /compute/v2.1/servers/12ef7912-7054-4457-b1a4-c266b5bcb3e5 => generated 1325 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:13.853381 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2f3028e4-fe53-4792-8316-9d5d007e3b8c tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:13.857889 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2f3028e4-fe53-4792-8316-9d5d007e3b8c tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] [instance: 3af92159-069a-44f1-90ed-5d90bf69d9ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:14.228106 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2f3028e4-fe53-4792-8316-9d5d007e3b8c tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '615299cb9eb34ceca04c2864923a4724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109a1eb2427e453585c3e752af6a7eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:14.241712 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2f3028e4-fe53-4792-8316-9d5d007e3b8c tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] 10.222.0.33 "GET /compute/v2.1/servers/3af92159-069a-44f1-90ed-5d90bf69d9ca" status: 200 len: 1166 microversion: 2.1 time: 0.402923 Jun 05 08:32:14.243988 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1168/2296] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:13 2022] GET /compute/v2.1/servers/3af92159-069a-44f1-90ed-5d90bf69d9ca => generated 1166 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:14.249311 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2f9b5abc-a224-42e0-a111-4167a2a38f4d tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:14.266493 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2f9b5abc-a224-42e0-a111-4167a2a38f4d tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] [instance: a16d052a-235e-46a1-8a93-da823e2d880a] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:14.290032 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2f9b5abc-a224-42e0-a111-4167a2a38f4d tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:14.297527 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2f9b5abc-a224-42e0-a111-4167a2a38f4d tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:14.305112 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2f9b5abc-a224-42e0-a111-4167a2a38f4d tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:14.311564 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2f9b5abc-a224-42e0-a111-4167a2a38f4d tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:14.470652 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5218a088-5f60-4029-8c03-563e1b5b0fbd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:14.489353 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5218a088-5f60-4029-8c03-563e1b5b0fbd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:14.498070 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5218a088-5f60-4029-8c03-563e1b5b0fbd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:14.499418 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5218a088-5f60-4029-8c03-563e1b5b0fbd tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 1.038362 Jun 05 08:32:14.500002 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1129/2297] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:13 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:14.514433 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-69aaf8a7-f257-4092-8965-2c44d50543dc tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f2433177940>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:14.599648 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-69aaf8a7-f257-4092-8965-2c44d50543dc tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1438 microversion: 2.1 time: 0.098257 Jun 05 08:32:14.600680 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1130/2298] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:32:14 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1438 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:14.608118 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-53174650-acb3-4189-b3e4-cd37215b13a4 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:14.608996 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-53174650-acb3-4189-b3e4-cd37215b13a4 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:14.627708 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-53174650-acb3-4189-b3e4-cd37215b13a4 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:14.629491 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-53174650-acb3-4189-b3e4-cd37215b13a4 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:14.630816 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-53174650-acb3-4189-b3e4-cd37215b13a4 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:14.631864 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-53174650-acb3-4189-b3e4-cd37215b13a4 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:14.699852 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2f9b5abc-a224-42e0-a111-4167a2a38f4d tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ab927b60d8451da78b5f8180a10ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3273ac973724a00a74d00689d99aef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:14.712847 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2f9b5abc-a224-42e0-a111-4167a2a38f4d tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] 10.222.0.33 "GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a" status: 200 len: 1313 microversion: 2.1 time: 0.467279 Jun 05 08:32:14.713687 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1169/2299] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:14 2022] GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a => generated 1313 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:14.921215 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-53174650-acb3-4189-b3e4-cd37215b13a4 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:14.940693 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-53174650-acb3-4189-b3e4-cd37215b13a4 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1500 microversion: 2.1 time: 0.333783 Jun 05 08:32:14.941687 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1131/2300] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:14 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1500 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:15.260864 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-55ccbeb6-4444-42ff-97aa-59519e24b39d tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:15.262424 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-55ccbeb6-4444-42ff-97aa-59519e24b39d tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] [instance: 3af92159-069a-44f1-90ed-5d90bf69d9ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:15.269631 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-55ccbeb6-4444-42ff-97aa-59519e24b39d tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:15.270414 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-55ccbeb6-4444-42ff-97aa-59519e24b39d tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:15.271437 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-55ccbeb6-4444-42ff-97aa-59519e24b39d tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:15.272141 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-55ccbeb6-4444-42ff-97aa-59519e24b39d tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:15.369300 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-55ccbeb6-4444-42ff-97aa-59519e24b39d tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:15.370136 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-55ccbeb6-4444-42ff-97aa-59519e24b39d tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:15.370875 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-55ccbeb6-4444-42ff-97aa-59519e24b39d tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Lazy-loading 'fault' on Instance uuid 3af92159-069a-44f1-90ed-5d90bf69d9ca {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:32:15.420812 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-55ccbeb6-4444-42ff-97aa-59519e24b39d tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '615299cb9eb34ceca04c2864923a4724', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109a1eb2427e453585c3e752af6a7eaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:15.434934 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-55ccbeb6-4444-42ff-97aa-59519e24b39d tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] 10.222.0.33 "GET /compute/v2.1/servers/3af92159-069a-44f1-90ed-5d90bf69d9ca" status: 200 len: 1239 microversion: 2.1 time: 0.177867 Jun 05 08:32:15.436312 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1170/2301] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:15 2022] GET /compute/v2.1/servers/3af92159-069a-44f1-90ed-5d90bf69d9ca => generated 1239 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:15.453872 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7907e6f2-290e-48f2-9472-6be221c5e881 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:15.454686 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7907e6f2-290e-48f2-9472-6be221c5e881 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] [instance: 3af92159-069a-44f1-90ed-5d90bf69d9ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:15.465782 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7907e6f2-290e-48f2-9472-6be221c5e881 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:15.466702 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7907e6f2-290e-48f2-9472-6be221c5e881 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:15.468499 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7907e6f2-290e-48f2-9472-6be221c5e881 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:15.481355 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7907e6f2-290e-48f2-9472-6be221c5e881 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:15.522312 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-32034759-ab2a-45c6-8488-1feb5c887acc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:15.523303 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-32034759-ab2a-45c6-8488-1feb5c887acc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:15.535445 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-32034759-ab2a-45c6-8488-1feb5c887acc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:15.538639 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-32034759-ab2a-45c6-8488-1feb5c887acc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:15.540385 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-32034759-ab2a-45c6-8488-1feb5c887acc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:15.542654 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-32034759-ab2a-45c6-8488-1feb5c887acc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:15.645203 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7907e6f2-290e-48f2-9472-6be221c5e881 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] [instance: 3af92159-069a-44f1-90ed-5d90bf69d9ca] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:32:15.829764 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7907e6f2-290e-48f2-9472-6be221c5e881 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] [instance: 3af92159-069a-44f1-90ed-5d90bf69d9ca] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:32:15.830897 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7907e6f2-290e-48f2-9472-6be221c5e881 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:15.831358 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7907e6f2-290e-48f2-9472-6be221c5e881 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:15.831814 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-7907e6f2-290e-48f2-9472-6be221c5e881 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] [instance: 3af92159-069a-44f1-90ed-5d90bf69d9ca] instance's host None is down, deleting from database Jun 05 08:32:15.837754 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-7907e6f2-290e-48f2-9472-6be221c5e881 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] [instance: 3af92159-069a-44f1-90ed-5d90bf69d9ca] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:32:15.941860 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-7907e6f2-290e-48f2-9472-6be221c5e881 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] [instance: 3af92159-069a-44f1-90ed-5d90bf69d9ca] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:32:15.958904 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-32034759-ab2a-45c6-8488-1feb5c887acc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:15.962539 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-7907e6f2-290e-48f2-9472-6be221c5e881 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] [instance: 3af92159-069a-44f1-90ed-5d90bf69d9ca] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:32:15.977991 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-32034759-ab2a-45c6-8488-1feb5c887acc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:15.979719 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-32034759-ab2a-45c6-8488-1feb5c887acc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:15.981070 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-32034759-ab2a-45c6-8488-1feb5c887acc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.466079 Jun 05 08:32:15.982545 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1171/2302] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:15 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:32:15.989508 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-bb541fd8-5127-453f-8108-053303fb2f7f tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24454ce8b0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:16.106204 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-bb541fd8-5127-453f-8108-053303fb2f7f tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1447 microversion: 2.1 time: 0.121350 Jun 05 08:32:16.113880 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1172/2303] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:32:15 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1447 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:16.121877 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-66d30c25-e673-4ece-92bd-21ba88e6d48f tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:16.121877 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-66d30c25-e673-4ece-92bd-21ba88e6d48f tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] [instance: a16d052a-235e-46a1-8a93-da823e2d880a] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:16.144343 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-66d30c25-e673-4ece-92bd-21ba88e6d48f tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:16.144892 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-66d30c25-e673-4ece-92bd-21ba88e6d48f tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:16.145684 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-66d30c25-e673-4ece-92bd-21ba88e6d48f tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:16.146638 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-66d30c25-e673-4ece-92bd-21ba88e6d48f tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:16.549861 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-66d30c25-e673-4ece-92bd-21ba88e6d48f tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ab927b60d8451da78b5f8180a10ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3273ac973724a00a74d00689d99aef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:16.562149 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-66d30c25-e673-4ece-92bd-21ba88e6d48f tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] 10.222.0.33 "GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a" status: 200 len: 1313 microversion: 2.1 time: 0.452806 Jun 05 08:32:16.581260 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1173/2304] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:16 2022] GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:16.592968 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-525959f8-18a4-4732-b7bc-6c06a2e7f67e req-72352d47-b054-4330-8753-5e2448bdf087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "984c9830-3956-48fd-ab9e-8aad63a9cd97", "name": "network-vif-deleted", "tag": "4128ae0a-58ff-43c8-ad0a-94d8da88b8dc"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:32:16.604078 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-525959f8-18a4-4732-b7bc-6c06a2e7f67e req-72352d47-b054-4330-8753-5e2448bdf087 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:16.607055 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-525959f8-18a4-4732-b7bc-6c06a2e7f67e req-72352d47-b054-4330-8753-5e2448bdf087 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:16.634233 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-525959f8-18a4-4732-b7bc-6c06a2e7f67e req-72352d47-b054-4330-8753-5e2448bdf087 service nova] Creating event network-vif-deleted:4128ae0a-58ff-43c8-ad0a-94d8da88b8dc for instance 984c9830-3956-48fd-ab9e-8aad63a9cd97 on n-h1-844739-1 Jun 05 08:32:16.648418 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-525959f8-18a4-4732-b7bc-6c06a2e7f67e req-72352d47-b054-4330-8753-5e2448bdf087 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063396 Jun 05 08:32:16.651662 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1174/2305] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:16.658498 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a1e52aa8-882f-4511-a623-69aca11a4cac tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:16.665494 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a1e52aa8-882f-4511-a623-69aca11a4cac tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 984c9830-3956-48fd-ab9e-8aad63a9cd97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:16.693967 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a1e52aa8-882f-4511-a623-69aca11a4cac tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:16.705933 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a1e52aa8-882f-4511-a623-69aca11a4cac tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:16.713057 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a1e52aa8-882f-4511-a623-69aca11a4cac tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:16.713637 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a1e52aa8-882f-4511-a623-69aca11a4cac tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:16.793853 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a1e52aa8-882f-4511-a623-69aca11a4cac tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:16.794307 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a1e52aa8-882f-4511-a623-69aca11a4cac tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:16.794763 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-a1e52aa8-882f-4511-a623-69aca11a4cac tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lazy-loading 'fault' on Instance uuid 984c9830-3956-48fd-ab9e-8aad63a9cd97 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:32:16.906833 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a1e52aa8-882f-4511-a623-69aca11a4cac tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:16.981250 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a1e52aa8-882f-4511-a623-69aca11a4cac tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97" status: 200 len: 1356 microversion: 2.1 time: 0.327051 Jun 05 08:32:16.988315 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1175/2306] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:16 2022] GET /compute/v2.1/servers/984c9830-3956-48fd-ab9e-8aad63a9cd97 => generated 1356 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:16.999532 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2c477ca8-d1f5-43ea-96b9-4722228f1479 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f2433ad6c10>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:17.095637 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2c477ca8-d1f5-43ea-96b9-4722228f1479 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 200 len: 1447 microversion: 2.1 time: 0.104939 Jun 05 08:32:17.097333 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1176/2307] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:32:16 2022] GET /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 1447 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:17.115089 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-86013269-b058-49c2-a520-e8e40eca6ca9 req-3e8d4f8e-8025-4572-a7d7-46381dacc750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a16d052a-235e-46a1-8a93-da823e2d880a", "name": "network-vif-plugged", "status": "completed", "tag": "e510e94a-0940-403c-890f-f41d1183fe9d"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:32:17.137372 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-86013269-b058-49c2-a520-e8e40eca6ca9 req-3e8d4f8e-8025-4572-a7d7-46381dacc750 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:17.140756 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-86013269-b058-49c2-a520-e8e40eca6ca9 req-3e8d4f8e-8025-4572-a7d7-46381dacc750 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:17.176010 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-86013269-b058-49c2-a520-e8e40eca6ca9 req-3e8d4f8e-8025-4572-a7d7-46381dacc750 service nova] Creating event network-vif-plugged:e510e94a-0940-403c-890f-f41d1183fe9d for instance a16d052a-235e-46a1-8a93-da823e2d880a on n-h1-844739-1 Jun 05 08:32:17.191713 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-86013269-b058-49c2-a520-e8e40eca6ca9 req-3e8d4f8e-8025-4572-a7d7-46381dacc750 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093091 Jun 05 08:32:17.195647 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1177/2308] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:17.231667 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-31a571ec-378c-41c3-9289-f97e230e6cfc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:17.234538 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-31a571ec-378c-41c3-9289-f97e230e6cfc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:17.260539 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-31a571ec-378c-41c3-9289-f97e230e6cfc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:17.262966 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-31a571ec-378c-41c3-9289-f97e230e6cfc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:17.264821 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-31a571ec-378c-41c3-9289-f97e230e6cfc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:17.267093 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-31a571ec-378c-41c3-9289-f97e230e6cfc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:17.311005 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=100 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:32:17.341928 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7907e6f2-290e-48f2-9472-6be221c5e881 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3af92159-069a-44f1-90ed-5d90bf69d9ca" status: 204 len: 0 microversion: 2.1 time: 1.892279 Jun 05 08:32:17.343002 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1132/2309] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:32:15 2022] DELETE /compute/v2.1/servers/3af92159-069a-44f1-90ed-5d90bf69d9ca => generated 0 bytes in 1895 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:32:17.366879 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-523e2b30-badd-4952-b897-8039208e580f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:17.368780 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-523e2b30-badd-4952-b897-8039208e580f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:17.390470 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-523e2b30-badd-4952-b897-8039208e580f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:17.390942 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-523e2b30-badd-4952-b897-8039208e580f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:17.391742 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-523e2b30-badd-4952-b897-8039208e580f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:17.392221 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-523e2b30-badd-4952-b897-8039208e580f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:17.473991 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-523e2b30-badd-4952-b897-8039208e580f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:32:17.660834 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-523e2b30-badd-4952-b897-8039208e580f tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21" status: 204 len: 0 microversion: 2.1 time: 0.315036 Jun 05 08:32:17.661747 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1133/2310] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:32:17 2022] DELETE /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:32:17.662882 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-31a571ec-378c-41c3-9289-f97e230e6cfc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:17.679174 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-31a571ec-378c-41c3-9289-f97e230e6cfc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:17.681557 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-31a571ec-378c-41c3-9289-f97e230e6cfc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:17.682870 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-31a571ec-378c-41c3-9289-f97e230e6cfc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 0.470056 Jun 05 08:32:17.683548 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1178/2311] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:17 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:17.684009 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5fbae195-6fef-4f30-a54c-873acd011f18 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24453fac10>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:17.697457 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f4affbfd-0540-4f98-aa6f-19cc1f3e15e3 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:17.698533 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f4affbfd-0540-4f98-aa6f-19cc1f3e15e3 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] [instance: 3af92159-069a-44f1-90ed-5d90bf69d9ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:17.707437 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f4affbfd-0540-4f98-aa6f-19cc1f3e15e3 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:17.708855 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f4affbfd-0540-4f98-aa6f-19cc1f3e15e3 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:17.712241 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f4affbfd-0540-4f98-aa6f-19cc1f3e15e3 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:17.713224 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f4affbfd-0540-4f98-aa6f-19cc1f3e15e3 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:17.751241 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-f4affbfd-0540-4f98-aa6f-19cc1f3e15e3 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] HTTP exception thrown: Instance 3af92159-069a-44f1-90ed-5d90bf69d9ca could not be found. Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f4affbfd-0540-4f98-aa6f-19cc1f3e15e3 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Request method failure captured: Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/3af92159-069a-44f1-90ed-5d90bf69d9ca HTTP/1.1 Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGnB9cbZwmROHJmaXloKUf3uETGqqXw3ASOlIuhWbAmQBHaVb0EQGcplvEC2dahYfT2RztPiKv42Op2TgPRctmujbUuc5ktW2pdcTPD50hpQyWw4R2JX0AwvKHrqz9kQYapjIBsO3ArmfEUFhOkvbufKJukv2h5eyi12EMmwSflh17o Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 109a1eb2427e453585c3e752af6a7eaf Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ServersTestBootFromVolume-1985951892 Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/109a1eb2427e453585c3e752af6a7eaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/109a1eb2427e453585c3e752af6a7eaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_109a1eb2427e453585c3e752af6a7eaf", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/109a1eb2427e453585c3e752af6a7eaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ServersTestBootFromVolume-1985951892 Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 109a1eb2427e453585c3e752af6a7eaf Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1985951892 Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ServersTestBootFromVolume-1985951892-project Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 615299cb9eb34ceca04c2864923a4724 Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ServersTestBootFromVolume-1985951892-project Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 3af92159-069a-44f1-90ed-5d90bf69d9ca could not be found. Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '3af92159-069a-44f1-90ed-5d90bf69d9ca'} Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3af92159-069a-44f1-90ed-5d90bf69d9ca could not be found. Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3af92159-069a-44f1-90ed-5d90bf69d9ca could not be found. Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:32:17.753757 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:17.761046 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:17.761046 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:32:17.761046 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:32:17.761046 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:32:17.761046 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:32:17.761046 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3af92159-069a-44f1-90ed-5d90bf69d9ca could not be found. Jun 05 08:32:17.761046 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:17.765826 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f4affbfd-0540-4f98-aa6f-19cc1f3e15e3 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Returning 404 to user: Instance 3af92159-069a-44f1-90ed-5d90bf69d9ca could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:32:17.768230 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f4affbfd-0540-4f98-aa6f-19cc1f3e15e3 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] 10.222.0.33 "GET /compute/v2.1/servers/3af92159-069a-44f1-90ed-5d90bf69d9ca" status: 404 len: 111 microversion: 2.1 time: 0.082228 Jun 05 08:32:17.769631 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1179/2312] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:17 2022] GET /compute/v2.1/servers/3af92159-069a-44f1-90ed-5d90bf69d9ca => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:32:17.778214 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fa687f4f-0257-4d9d-9f48-545bcee19810 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:17.780965 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-fa687f4f-0257-4d9d-9f48-545bcee19810 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] [instance: a16d052a-235e-46a1-8a93-da823e2d880a] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:17.794150 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fa687f4f-0257-4d9d-9f48-545bcee19810 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:17.795328 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fa687f4f-0257-4d9d-9f48-545bcee19810 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:17.797633 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fa687f4f-0257-4d9d-9f48-545bcee19810 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:17.798455 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fa687f4f-0257-4d9d-9f48-545bcee19810 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:18.272425 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-fa687f4f-0257-4d9d-9f48-545bcee19810 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ab927b60d8451da78b5f8180a10ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3273ac973724a00a74d00689d99aef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:18.291088 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fa687f4f-0257-4d9d-9f48-545bcee19810 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] 10.222.0.33 "GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a" status: 200 len: 1313 microversion: 2.1 time: 0.519565 Jun 05 08:32:18.291691 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1180/2313] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:17 2022] GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a => generated 1313 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:18.308208 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-56262814-c801-4c25-b050-3cf1eafac72e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:18.309190 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-56262814-c801-4c25-b050-3cf1eafac72e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:18.316882 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-56262814-c801-4c25-b050-3cf1eafac72e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:18.321427 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-56262814-c801-4c25-b050-3cf1eafac72e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:18.322795 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-56262814-c801-4c25-b050-3cf1eafac72e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:18.323405 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-56262814-c801-4c25-b050-3cf1eafac72e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:18.846586 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5fbae195-6fef-4f30-a54c-873acd011f18 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "DELETE /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 204 len: 0 microversion: 2.1 time: 1.167566 Jun 05 08:32:18.847252 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1134/2314] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:17 2022] DELETE /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 0 bytes in 1185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:32:18.852667 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2fd104a7-1331-40ca-bde0-fd95fb6445d2 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] Calling method '.version_select at 0x7f24453e3dc0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:18.899955 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2fd104a7-1331-40ca-bde0-fd95fb6445d2 tempest-ServersTestBootFromVolume-1985951892 tempest-ServersTestBootFromVolume-1985951892-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2107730819" status: 202 len: 0 microversion: 2.1 time: 0.050654 Jun 05 08:32:18.901000 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1135/2315] 10.222.0.33 () {58 vars in 1220 bytes} [Sun Jun 5 08:32:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2107730819 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:32:18.917329 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-77fdff46-64b2-4573-a755-b8ce97aeed4b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:18.919836 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-77fdff46-64b2-4573-a755-b8ce97aeed4b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:18.938322 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-77fdff46-64b2-4573-a755-b8ce97aeed4b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:18.939062 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-77fdff46-64b2-4573-a755-b8ce97aeed4b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:18.942093 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-77fdff46-64b2-4573-a755-b8ce97aeed4b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:18.943520 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-77fdff46-64b2-4573-a755-b8ce97aeed4b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:18.965226 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-56262814-c801-4c25-b050-3cf1eafac72e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:18.980714 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-56262814-c801-4c25-b050-3cf1eafac72e tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21" status: 200 len: 1485 microversion: 2.1 time: 0.677603 Jun 05 08:32:18.981956 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1181/2316] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:18 2022] GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21 => generated 1485 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:18.987030 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-dcb2ff7b-a6c1-4004-b147-db7bbb0d2214 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:18.992712 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-dcb2ff7b-a6c1-4004-b147-db7bbb0d2214 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: ed215a36-f621-4024-b3ba-57734be5c8bd] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:19.002939 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dcb2ff7b-a6c1-4004-b147-db7bbb0d2214 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:19.008733 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dcb2ff7b-a6c1-4004-b147-db7bbb0d2214 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:19.009842 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dcb2ff7b-a6c1-4004-b147-db7bbb0d2214 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:19.010455 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dcb2ff7b-a6c1-4004-b147-db7bbb0d2214 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:19.068865 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-dcb2ff7b-a6c1-4004-b147-db7bbb0d2214 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: ed215a36-f621-4024-b3ba-57734be5c8bd] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:32:19.229004 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:32:19.265139 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-dcb2ff7b-a6c1-4004-b147-db7bbb0d2214 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd" status: 204 len: 0 microversion: 2.1 time: 0.281385 Jun 05 08:32:19.267444 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1182/2317] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:32:18 2022] DELETE /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:32:19.311244 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6dd85e20-5f7e-4ba6-94e4-1565b9f33867 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:19.311969 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6dd85e20-5f7e-4ba6-94e4-1565b9f33867 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] [instance: a16d052a-235e-46a1-8a93-da823e2d880a] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:19.322365 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6dd85e20-5f7e-4ba6-94e4-1565b9f33867 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:19.326758 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6dd85e20-5f7e-4ba6-94e4-1565b9f33867 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:19.327813 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6dd85e20-5f7e-4ba6-94e4-1565b9f33867 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:19.333334 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6dd85e20-5f7e-4ba6-94e4-1565b9f33867 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:20.272203 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6dd85e20-5f7e-4ba6-94e4-1565b9f33867 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ab927b60d8451da78b5f8180a10ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3273ac973724a00a74d00689d99aef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:20.287074 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6dd85e20-5f7e-4ba6-94e4-1565b9f33867 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] 10.222.0.33 "GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a" status: 200 len: 1463 microversion: 2.1 time: 0.979506 Jun 05 08:32:20.305571 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-77fdff46-64b2-4573-a755-b8ce97aeed4b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:20.314932 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1183/2318] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:19 2022] GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a => generated 1463 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:20.323508 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-77fdff46-64b2-4573-a755-b8ce97aeed4b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:20.329178 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-77fdff46-64b2-4573-a755-b8ce97aeed4b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:20.333516 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-9711112f-dfc9-44d0-bca2-ff2035539d2a req-e203d1ea-0d4b-4c97-b63a-ab1442922ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed215a36-f621-4024-b3ba-57734be5c8bd", "name": "network-vif-unplugged", "status": "completed", "tag": "b0df87c8-f87b-4cb2-93b1-fa25266d8016"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:32:20.335749 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-77fdff46-64b2-4573-a755-b8ce97aeed4b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1881 microversion: 2.42 time: 1.432944 Jun 05 08:32:20.336679 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1136/2319] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:18 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1881 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:20.357232 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5e2f2213-064a-4f5e-9bc4-e0076992651d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-667447867", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "78ad483b-a47a-44a2-8bc0-8789288467d5"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:32:20.364181 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-9711112f-dfc9-44d0-bca2-ff2035539d2a req-e203d1ea-0d4b-4c97-b63a-ab1442922ed8 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:20.366186 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-9711112f-dfc9-44d0-bca2-ff2035539d2a req-e203d1ea-0d4b-4c97-b63a-ab1442922ed8 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:20.397712 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-9711112f-dfc9-44d0-bca2-ff2035539d2a req-e203d1ea-0d4b-4c97-b63a-ab1442922ed8 service nova] Creating event network-vif-unplugged:b0df87c8-f87b-4cb2-93b1-fa25266d8016 for instance ed215a36-f621-4024-b3ba-57734be5c8bd on n-h1-844739-1 Jun 05 08:32:20.420466 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-9711112f-dfc9-44d0-bca2-ff2035539d2a req-e203d1ea-0d4b-4c97-b63a-ab1442922ed8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101613 Jun 05 08:32:20.427099 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1184/2320] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:20.437180 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b0005a88-c067-4a7c-8d30-a5d4a629c61a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:20.439279 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b0005a88-c067-4a7c-8d30-a5d4a629c61a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:20.469677 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b0005a88-c067-4a7c-8d30-a5d4a629c61a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:20.470157 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b0005a88-c067-4a7c-8d30-a5d4a629c61a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:20.472083 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b0005a88-c067-4a7c-8d30-a5d4a629c61a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:20.472841 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-5e2f2213-064a-4f5e-9bc4-e0076992651d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] validate_networks() for [('78ad483b-a47a-44a2-8bc0-8789288467d5', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:32:20.473827 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b0005a88-c067-4a7c-8d30-a5d4a629c61a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:20.680552 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b0005a88-c067-4a7c-8d30-a5d4a629c61a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:20.695842 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b0005a88-c067-4a7c-8d30-a5d4a629c61a tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21" status: 200 len: 1281 microversion: 2.1 time: 0.265534 Jun 05 08:32:20.697887 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1185/2321] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:20 2022] GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21 => generated 1281 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:20.832224 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-49b0f19b-4925-49a2-8674-52e494dadca4 tempest-TenantUsagesTestJSON-1933911522 tempest-TenantUsagesTestJSON-1933911522-project-admin] Calling method '.version_select at 0x7f24454a7c10>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:20.850426 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-49b0f19b-4925-49a2-8674-52e494dadca4 tempest-TenantUsagesTestJSON-1933911522 tempest-TenantUsagesTestJSON-1933911522-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:20.850877 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-49b0f19b-4925-49a2-8674-52e494dadca4 tempest-TenantUsagesTestJSON-1933911522 tempest-TenantUsagesTestJSON-1933911522-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:20.893084 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-49b0f19b-4925-49a2-8674-52e494dadca4 tempest-TenantUsagesTestJSON-1933911522 tempest-TenantUsagesTestJSON-1933911522-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:20.895570 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-49b0f19b-4925-49a2-8674-52e494dadca4 tempest-TenantUsagesTestJSON-1933911522 tempest-TenantUsagesTestJSON-1933911522-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:20.949271 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-49b0f19b-4925-49a2-8674-52e494dadca4 tempest-TenantUsagesTestJSON-1933911522 tempest-TenantUsagesTestJSON-1933911522-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/d3273ac973724a00a74d00689d99aef4?start=2022-06-04T08%3A32%3A20.297220&end=2022-06-06T08%3A32%3A20.297220" status: 200 len: 694 microversion: 2.1 time: 0.247977 Jun 05 08:32:20.951453 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1186/2322] 10.222.0.33 () {58 vars in 1411 bytes} [Sun Jun 5 08:32:20 2022] GET /compute/v2.1/os-simple-tenant-usage/d3273ac973724a00a74d00689d99aef4?start=2022-06-04T08%3A32%3A20.297220&end=2022-06-06T08%3A32%3A20.297220 => generated 694 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:20.957472 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-7764cb83-ee70-4070-9720-54218a417be6 req-b57856e8-350f-48e7-9341-bdab53d45801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef99ada2-1c39-422e-8a61-e4f7d00cbe21", "name": "network-vif-deleted", "tag": "252d7f78-09ea-4658-a0fc-b18556671cf4"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:32:20.981333 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-7764cb83-ee70-4070-9720-54218a417be6 req-b57856e8-350f-48e7-9341-bdab53d45801 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:20.983763 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-7764cb83-ee70-4070-9720-54218a417be6 req-b57856e8-350f-48e7-9341-bdab53d45801 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:21.015100 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-7764cb83-ee70-4070-9720-54218a417be6 req-b57856e8-350f-48e7-9341-bdab53d45801 service nova] Creating event network-vif-deleted:252d7f78-09ea-4658-a0fc-b18556671cf4 for instance ef99ada2-1c39-422e-8a61-e4f7d00cbe21 on n-h2-844739-1 Jun 05 08:32:21.029386 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-7764cb83-ee70-4070-9720-54218a417be6 req-b57856e8-350f-48e7-9341-bdab53d45801 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075925 Jun 05 08:32:21.030580 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1187/2323] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:21.041749 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4bcd9ad3-e321-4ef9-a020-29f786f35e90 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Calling method '.version_select at 0x7f2433ab2c10>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:21.067279 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4bcd9ad3-e321-4ef9-a020-29f786f35e90 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:21.068745 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4bcd9ad3-e321-4ef9-a020-29f786f35e90 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:21.097042 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4bcd9ad3-e321-4ef9-a020-29f786f35e90 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:21.097695 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4bcd9ad3-e321-4ef9-a020-29f786f35e90 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:21.130712 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4bcd9ad3-e321-4ef9-a020-29f786f35e90 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/d3273ac973724a00a74d00689d99aef4?start=2022-06-04T08%3A32%3A20.297220&end=2022-06-06T08%3A32%3A20.297220" status: 200 len: 694 microversion: 2.1 time: 0.095216 Jun 05 08:32:21.139668 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1188/2324] 10.222.0.33 () {58 vars in 1411 bytes} [Sun Jun 5 08:32:21 2022] GET /compute/v2.1/os-simple-tenant-usage/d3273ac973724a00a74d00689d99aef4?start=2022-06-04T08%3A32%3A20.297220&end=2022-06-06T08%3A32%3A20.297220 => generated 694 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:21.150823 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-02430844-9eed-4b3c-9177-b9981a47c18c tempest-TenantUsagesTestJSON-1933911522 tempest-TenantUsagesTestJSON-1933911522-project-admin] Calling method '.version_select at 0x7f24454e8310>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:21.172843 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-02430844-9eed-4b3c-9177-b9981a47c18c tempest-TenantUsagesTestJSON-1933911522 tempest-TenantUsagesTestJSON-1933911522-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:21.173746 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-02430844-9eed-4b3c-9177-b9981a47c18c tempest-TenantUsagesTestJSON-1933911522 tempest-TenantUsagesTestJSON-1933911522-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:21.217349 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-02430844-9eed-4b3c-9177-b9981a47c18c tempest-TenantUsagesTestJSON-1933911522 tempest-TenantUsagesTestJSON-1933911522-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:21.223397 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-02430844-9eed-4b3c-9177-b9981a47c18c tempest-TenantUsagesTestJSON-1933911522 tempest-TenantUsagesTestJSON-1933911522-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:21.436982 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-5e2f2213-064a-4f5e-9bc4-e0076992651d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:32:21.437463 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-02430844-9eed-4b3c-9177-b9981a47c18c tempest-TenantUsagesTestJSON-1933911522 tempest-TenantUsagesTestJSON-1933911522-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-04T08%3A32%3A20.297220&end=2022-06-06T08%3A32%3A20.297220&detailed=1" status: 200 len: 22475 microversion: 2.1 time: 0.296121 Jun 05 08:32:21.437851 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-5e2f2213-064a-4f5e-9bc4-e0076992651d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:32:21.437851 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-5e2f2213-064a-4f5e-9bc4-e0076992651d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:32:21.438271 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-5e2f2213-064a-4f5e-9bc4-e0076992651d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:32:21.438687 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-5e2f2213-064a-4f5e-9bc4-e0076992651d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:32:21.454423 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5e2f2213-064a-4f5e-9bc4-e0076992651d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:21.454874 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5e2f2213-064a-4f5e-9bc4-e0076992651d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:21.466813 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1189/2325] 10.222.0.33 () {58 vars in 1334 bytes} [Sun Jun 5 08:32:21 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-04T08%3A32%3A20.297220&end=2022-06-06T08%3A32%3A20.297220&detailed=1 => generated 22475 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 05 08:32:21.467621 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5e2f2213-064a-4f5e-9bc4-e0076992651d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:21.469134 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5e2f2213-064a-4f5e-9bc4-e0076992651d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:21.471927 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3ccbccba-b811-40f7-a758-b78c96909465 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:21.472714 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3ccbccba-b811-40f7-a758-b78c96909465 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:21.480725 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3ccbccba-b811-40f7-a758-b78c96909465 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:21.481175 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3ccbccba-b811-40f7-a758-b78c96909465 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:21.481953 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3ccbccba-b811-40f7-a758-b78c96909465 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:21.482389 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3ccbccba-b811-40f7-a758-b78c96909465 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:21.538944 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-5e2f2213-064a-4f5e-9bc4-e0076992651d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Getting quotas for project d7e0706485194d6ab0cf41ea0f651074. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:32:21.548666 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-5e2f2213-064a-4f5e-9bc4-e0076992651d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Getting quotas for user 41b99bee0b35400281da332533850481 and project d7e0706485194d6ab0cf41ea0f651074. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:32:21.587962 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5e2f2213-064a-4f5e-9bc4-e0076992651d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:32:21.590341 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5e2f2213-064a-4f5e-9bc4-e0076992651d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 904526ef-2fc6-4c43-997d-df2989b692c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:32:21.700434 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5e2f2213-064a-4f5e-9bc4-e0076992651d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.358034 Jun 05 08:32:21.703490 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1137/2326] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:32:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:32:21.714114 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-44d5afa3-b45b-4b2e-8a2c-b0559170e9af tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:21.715987 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-44d5afa3-b45b-4b2e-8a2c-b0559170e9af tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] [instance: a16d052a-235e-46a1-8a93-da823e2d880a] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:21.754011 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-44d5afa3-b45b-4b2e-8a2c-b0559170e9af tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:21.754908 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-44d5afa3-b45b-4b2e-8a2c-b0559170e9af tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:21.759373 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-44d5afa3-b45b-4b2e-8a2c-b0559170e9af tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:21.759890 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-44d5afa3-b45b-4b2e-8a2c-b0559170e9af tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:21.830968 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-44d5afa3-b45b-4b2e-8a2c-b0559170e9af tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] [instance: a16d052a-235e-46a1-8a93-da823e2d880a] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:32:21.981502 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3ccbccba-b811-40f7-a758-b78c96909465 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:21.996992 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3ccbccba-b811-40f7-a758-b78c96909465 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:21.999357 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3ccbccba-b811-40f7-a758-b78c96909465 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:22.005015 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3ccbccba-b811-40f7-a758-b78c96909465 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1869 microversion: 2.42 time: 0.537059 Jun 05 08:32:22.017600 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1190/2327] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:21 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1869 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:22.030726 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-233bc826-80e4-4ba6-a081-ccabbdf58f8e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:22.032102 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-233bc826-80e4-4ba6-a081-ccabbdf58f8e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 904526ef-2fc6-4c43-997d-df2989b692c1] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:22.040191 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-44d5afa3-b45b-4b2e-8a2c-b0559170e9af tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a" status: 204 len: 0 microversion: 2.1 time: 0.334758 Jun 05 08:32:22.041005 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1138/2328] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:32:21 2022] DELETE /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:32:22.056858 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-cce4db19-db28-4f98-9580-62f0e037f9e5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:22.059969 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-cce4db19-db28-4f98-9580-62f0e037f9e5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: ef99ada2-1c39-422e-8a61-e4f7d00cbe21] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:22.079612 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cce4db19-db28-4f98-9580-62f0e037f9e5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:22.082308 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cce4db19-db28-4f98-9580-62f0e037f9e5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:22.083435 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cce4db19-db28-4f98-9580-62f0e037f9e5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:22.084917 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cce4db19-db28-4f98-9580-62f0e037f9e5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:22.122489 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-233bc826-80e4-4ba6-a081-ccabbdf58f8e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:22.131992 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-233bc826-80e4-4ba6-a081-ccabbdf58f8e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/904526ef-2fc6-4c43-997d-df2989b692c1" status: 200 len: 1207 microversion: 2.1 time: 0.112417 Jun 05 08:32:22.133529 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1191/2329] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:22 2022] GET /compute/v2.1/servers/904526ef-2fc6-4c43-997d-df2989b692c1 => generated 1207 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:22.138696 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-76450a1a-d9fb-483e-a0fc-fff3dda6d203 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:22.148631 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-76450a1a-d9fb-483e-a0fc-fff3dda6d203 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] [instance: a16d052a-235e-46a1-8a93-da823e2d880a] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:22.162692 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-76450a1a-d9fb-483e-a0fc-fff3dda6d203 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:22.165228 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-76450a1a-d9fb-483e-a0fc-fff3dda6d203 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:22.170983 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-76450a1a-d9fb-483e-a0fc-fff3dda6d203 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:22.171679 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-76450a1a-d9fb-483e-a0fc-fff3dda6d203 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:22.198114 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cce4db19-db28-4f98-9580-62f0e037f9e5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:22.198847 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cce4db19-db28-4f98-9580-62f0e037f9e5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:22.199490 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-cce4db19-db28-4f98-9580-62f0e037f9e5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lazy-loading 'fault' on Instance uuid ef99ada2-1c39-422e-8a61-e4f7d00cbe21 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:32:22.359698 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-cce4db19-db28-4f98-9580-62f0e037f9e5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:22.370720 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-cce4db19-db28-4f98-9580-62f0e037f9e5 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21" status: 200 len: 1356 microversion: 2.1 time: 0.327984 Jun 05 08:32:22.376251 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1139/2330] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:22 2022] GET /compute/v2.1/servers/ef99ada2-1c39-422e-8a61-e4f7d00cbe21 => generated 1356 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:22.390723 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2d6ad2b4-21b3-405f-8c93-bb750628e414 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:22.391242 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2d6ad2b4-21b3-405f-8c93-bb750628e414 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:22.411995 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2d6ad2b4-21b3-405f-8c93-bb750628e414 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:22.411995 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2d6ad2b4-21b3-405f-8c93-bb750628e414 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:22.411995 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2d6ad2b4-21b3-405f-8c93-bb750628e414 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:22.422027 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2d6ad2b4-21b3-405f-8c93-bb750628e414 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:22.511352 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-76450a1a-d9fb-483e-a0fc-fff3dda6d203 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ab927b60d8451da78b5f8180a10ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3273ac973724a00a74d00689d99aef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:22.522065 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-76450a1a-d9fb-483e-a0fc-fff3dda6d203 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] 10.222.0.33 "GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a" status: 200 len: 1469 microversion: 2.1 time: 0.387035 Jun 05 08:32:22.528641 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2d6ad2b4-21b3-405f-8c93-bb750628e414 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:32:22.535303 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1192/2331] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:22 2022] GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a => generated 1469 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:22.724915 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2d6ad2b4-21b3-405f-8c93-bb750628e414 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "DELETE /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 204 len: 0 microversion: 2.1 time: 0.341892 Jun 05 08:32:22.725885 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1140/2332] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:32:22 2022] DELETE /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:32:22.733970 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a22a91af-6f2d-4119-a10c-1c6325eb5ad1 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:22.734905 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a22a91af-6f2d-4119-a10c-1c6325eb5ad1 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:22.746916 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a22a91af-6f2d-4119-a10c-1c6325eb5ad1 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:22.747721 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a22a91af-6f2d-4119-a10c-1c6325eb5ad1 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:22.761241 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a22a91af-6f2d-4119-a10c-1c6325eb5ad1 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:22.762226 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a22a91af-6f2d-4119-a10c-1c6325eb5ad1 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:23.025625 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-cbf3da51-4b69-42bc-b97c-18db24b63112 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:23.026622 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-cbf3da51-4b69-42bc-b97c-18db24b63112 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:23.041597 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cbf3da51-4b69-42bc-b97c-18db24b63112 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:23.046568 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cbf3da51-4b69-42bc-b97c-18db24b63112 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:23.047646 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cbf3da51-4b69-42bc-b97c-18db24b63112 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:23.050778 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cbf3da51-4b69-42bc-b97c-18db24b63112 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:23.087009 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a22a91af-6f2d-4119-a10c-1c6325eb5ad1 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:23.101237 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a22a91af-6f2d-4119-a10c-1c6325eb5ad1 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1500 microversion: 2.1 time: 0.365513 Jun 05 08:32:23.101237 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1193/2333] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:22 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1500 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:23.112230 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:32:23.152086 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ea1d8fda-ddf7-42eb-a92e-621b5daf2b30 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:23.152712 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ea1d8fda-ddf7-42eb-a92e-621b5daf2b30 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 904526ef-2fc6-4c43-997d-df2989b692c1] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:23.164441 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ea1d8fda-ddf7-42eb-a92e-621b5daf2b30 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:23.165055 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ea1d8fda-ddf7-42eb-a92e-621b5daf2b30 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:23.169182 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ea1d8fda-ddf7-42eb-a92e-621b5daf2b30 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:23.171470 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ea1d8fda-ddf7-42eb-a92e-621b5daf2b30 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:23.250575 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ea1d8fda-ddf7-42eb-a92e-621b5daf2b30 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:23.250575 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ea1d8fda-ddf7-42eb-a92e-621b5daf2b30 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:23.250941 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-ea1d8fda-ddf7-42eb-a92e-621b5daf2b30 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lazy-loading 'fault' on Instance uuid 904526ef-2fc6-4c43-997d-df2989b692c1 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:32:23.627099 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-cbf3da51-4b69-42bc-b97c-18db24b63112 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:23.639711 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-cbf3da51-4b69-42bc-b97c-18db24b63112 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:23.643114 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-cbf3da51-4b69-42bc-b97c-18db24b63112 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:23.645068 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-cbf3da51-4b69-42bc-b97c-18db24b63112 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1869 microversion: 2.42 time: 0.624376 Jun 05 08:32:23.647645 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1141/2334] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:23 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1869 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:23.656486 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-259493b8-5796-46a5-937f-73879d35f350 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:23.659837 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-259493b8-5796-46a5-937f-73879d35f350 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] [instance: a16d052a-235e-46a1-8a93-da823e2d880a] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:23.676911 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-259493b8-5796-46a5-937f-73879d35f350 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:23.688305 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-259493b8-5796-46a5-937f-73879d35f350 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:23.692579 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-259493b8-5796-46a5-937f-73879d35f350 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:23.693679 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-259493b8-5796-46a5-937f-73879d35f350 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:23.700808 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ea1d8fda-ddf7-42eb-a92e-621b5daf2b30 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:23.731371 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ea1d8fda-ddf7-42eb-a92e-621b5daf2b30 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/904526ef-2fc6-4c43-997d-df2989b692c1" status: 200 len: 1280 microversion: 2.1 time: 0.584448 Jun 05 08:32:23.736071 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1194/2335] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:23 2022] GET /compute/v2.1/servers/904526ef-2fc6-4c43-997d-df2989b692c1 => generated 1280 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:23.751732 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9e2a93a3-8d22-46ca-8494-0fadae546f3d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:23.754147 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9e2a93a3-8d22-46ca-8494-0fadae546f3d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 904526ef-2fc6-4c43-997d-df2989b692c1] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:23.768951 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9e2a93a3-8d22-46ca-8494-0fadae546f3d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:23.770343 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9e2a93a3-8d22-46ca-8494-0fadae546f3d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:23.771360 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9e2a93a3-8d22-46ca-8494-0fadae546f3d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:23.772152 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9e2a93a3-8d22-46ca-8494-0fadae546f3d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:23.843663 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9e2a93a3-8d22-46ca-8494-0fadae546f3d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 904526ef-2fc6-4c43-997d-df2989b692c1] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:32:24.120475 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9e2a93a3-8d22-46ca-8494-0fadae546f3d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 904526ef-2fc6-4c43-997d-df2989b692c1] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:32:24.124410 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9e2a93a3-8d22-46ca-8494-0fadae546f3d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:24.124410 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9e2a93a3-8d22-46ca-8494-0fadae546f3d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:24.124410 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-9e2a93a3-8d22-46ca-8494-0fadae546f3d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 904526ef-2fc6-4c43-997d-df2989b692c1] instance's host None is down, deleting from database Jun 05 08:32:24.135642 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-9e2a93a3-8d22-46ca-8494-0fadae546f3d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 904526ef-2fc6-4c43-997d-df2989b692c1] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:32:24.214402 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-9e2a93a3-8d22-46ca-8494-0fadae546f3d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 904526ef-2fc6-4c43-997d-df2989b692c1] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:32:24.230554 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-259493b8-5796-46a5-937f-73879d35f350 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ab927b60d8451da78b5f8180a10ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3273ac973724a00a74d00689d99aef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:24.232635 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-9e2a93a3-8d22-46ca-8494-0fadae546f3d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 904526ef-2fc6-4c43-997d-df2989b692c1] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:32:24.239581 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-259493b8-5796-46a5-937f-73879d35f350 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] 10.222.0.33 "GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a" status: 200 len: 1469 microversion: 2.1 time: 0.590347 Jun 05 08:32:24.245342 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1142/2336] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:23 2022] GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a => generated 1469 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:24.251741 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b9f9294d-e703-4f87-bf1a-6e8a0bd599d2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:24.255898 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b9f9294d-e703-4f87-bf1a-6e8a0bd599d2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:24.270411 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b9f9294d-e703-4f87-bf1a-6e8a0bd599d2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:24.271278 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b9f9294d-e703-4f87-bf1a-6e8a0bd599d2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:24.274926 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b9f9294d-e703-4f87-bf1a-6e8a0bd599d2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:24.275658 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b9f9294d-e703-4f87-bf1a-6e8a0bd599d2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:24.537511 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b9f9294d-e703-4f87-bf1a-6e8a0bd599d2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:24.545435 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b9f9294d-e703-4f87-bf1a-6e8a0bd599d2 tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1458 microversion: 2.1 time: 0.298670 Jun 05 08:32:24.552177 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1143/2337] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:24 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1458 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:24.665871 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7cb5abda-1a6d-43d4-88f9-8d381a7a18f3 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:24.665871 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7cb5abda-1a6d-43d4-88f9-8d381a7a18f3 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:24.674325 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7cb5abda-1a6d-43d4-88f9-8d381a7a18f3 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:24.687405 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7cb5abda-1a6d-43d4-88f9-8d381a7a18f3 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:24.688310 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7cb5abda-1a6d-43d4-88f9-8d381a7a18f3 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:24.689034 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7cb5abda-1a6d-43d4-88f9-8d381a7a18f3 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:25.026944 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9e2a93a3-8d22-46ca-8494-0fadae546f3d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "DELETE /compute/v2.1/servers/904526ef-2fc6-4c43-997d-df2989b692c1" status: 204 len: 0 microversion: 2.1 time: 1.279694 Jun 05 08:32:25.032267 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1195/2338] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:32:23 2022] DELETE /compute/v2.1/servers/904526ef-2fc6-4c43-997d-df2989b692c1 => generated 0 bytes in 1282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 05 08:32:25.038812 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-dbfd31b7-5dbd-4146-a899-309c74b9530b req-cdead12e-7840-411f-be13-e1d5df8a2385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "969237ff-17eb-4838-9c3d-68dcbc1f94ca", "name": "network-vif-deleted", "tag": "b5f2e58e-0349-480d-8927-484d2f39dee5"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:32:25.051085 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-dbfd31b7-5dbd-4146-a899-309c74b9530b req-cdead12e-7840-411f-be13-e1d5df8a2385 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:25.053058 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-dbfd31b7-5dbd-4146-a899-309c74b9530b req-cdead12e-7840-411f-be13-e1d5df8a2385 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:25.068002 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-dbfd31b7-5dbd-4146-a899-309c74b9530b req-cdead12e-7840-411f-be13-e1d5df8a2385 service nova] Creating event network-vif-deleted:b5f2e58e-0349-480d-8927-484d2f39dee5 for instance 969237ff-17eb-4838-9c3d-68dcbc1f94ca on n-h2-844739-1 Jun 05 08:32:25.076757 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-dbfd31b7-5dbd-4146-a899-309c74b9530b req-cdead12e-7840-411f-be13-e1d5df8a2385 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041876 Jun 05 08:32:25.077970 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1196/2339] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:25.084376 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-59fdf125-dc35-48f0-9493-7cc69199817e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:25.085600 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-59fdf125-dc35-48f0-9493-7cc69199817e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 904526ef-2fc6-4c43-997d-df2989b692c1] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:25.092667 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-59fdf125-dc35-48f0-9493-7cc69199817e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:25.093481 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-59fdf125-dc35-48f0-9493-7cc69199817e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:25.094749 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-59fdf125-dc35-48f0-9493-7cc69199817e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:25.095436 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-59fdf125-dc35-48f0-9493-7cc69199817e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:25.117453 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-59fdf125-dc35-48f0-9493-7cc69199817e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] HTTP exception thrown: Instance 904526ef-2fc6-4c43-997d-df2989b692c1 could not be found. Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-59fdf125-dc35-48f0-9493-7cc69199817e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Request method failure captured: Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/904526ef-2fc6-4c43-997d-df2989b692c1 HTTP/1.1 Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGku0_-S5j4dTLFjbNtjOJABEYiEwuYiqAxBcA9X334FwwI0CgT2rI36cBXcoKgfjlfbmia7LbP8MfyA9dUTzkR-iGHCfXuhdDc4Lot6ZUoSXCjM0lgr0vl2RLGdVDCc8FuE84nr6MQWJu_zqA5SS9qFtGTeLxeotX7R3eWd-9Sgpes Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: d7e0706485194d6ab0cf41ea0f651074 Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ImagesTestJSON-1138117227 Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d7e0706485194d6ab0cf41ea0f651074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7e0706485194d6ab0cf41ea0f651074"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d7e0706485194d6ab0cf41ea0f651074", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7e0706485194d6ab0cf41ea0f651074"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ImagesTestJSON-1138117227 Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: d7e0706485194d6ab0cf41ea0f651074 Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ImagesTestJSON-1138117227 Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ImagesTestJSON-1138117227-project Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 41b99bee0b35400281da332533850481 Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ImagesTestJSON-1138117227-project Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 904526ef-2fc6-4c43-997d-df2989b692c1 could not be found. Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '904526ef-2fc6-4c43-997d-df2989b692c1'} Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 904526ef-2fc6-4c43-997d-df2989b692c1 could not be found. Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 904526ef-2fc6-4c43-997d-df2989b692c1 could not be found. Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:25.119822 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:25.124539 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:32:25.124539 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:32:25.124539 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:32:25.124539 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:32:25.124539 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 904526ef-2fc6-4c43-997d-df2989b692c1 could not be found. Jun 05 08:32:25.124539 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:25.129244 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-59fdf125-dc35-48f0-9493-7cc69199817e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Returning 404 to user: Instance 904526ef-2fc6-4c43-997d-df2989b692c1 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:32:25.130835 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-59fdf125-dc35-48f0-9493-7cc69199817e tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/904526ef-2fc6-4c43-997d-df2989b692c1" status: 404 len: 111 microversion: 2.1 time: 0.050918 Jun 05 08:32:25.139247 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1197/2340] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:25 2022] GET /compute/v2.1/servers/904526ef-2fc6-4c43-997d-df2989b692c1 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:32:25.150350 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5ae3fda2-1aaa-425d-91db-87de40644689 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f244048fc10>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:25.178038 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-5ae3fda2-1aaa-425d-91db-87de40644689 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] HTTP exception thrown: Image not found. Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5ae3fda2-1aaa-425d-91db-87de40644689 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Request method failure captured: Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: request: DELETE /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c HTTP/1.1 Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGku0_-S5j4dTLFjbNtjOJABEYiEwuYiqAxBcA9X334FwwI0CgT2rI36cBXcoKgfjlfbmia7LbP8MfyA9dUTzkR-iGHCfXuhdDc4Lot6ZUoSXCjM0lgr0vl2RLGdVDCc8FuE84nr6MQWJu_zqA5SS9qFtGTeLxeotX7R3eWd-9Sgpes Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: d7e0706485194d6ab0cf41ea0f651074 Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ImagesTestJSON-1138117227 Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d7e0706485194d6ab0cf41ea0f651074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7e0706485194d6ab0cf41ea0f651074"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d7e0706485194d6ab0cf41ea0f651074", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7e0706485194d6ab0cf41ea0f651074"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ImagesTestJSON-1138117227 Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: d7e0706485194d6ab0cf41ea0f651074 Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ImagesTestJSON-1138117227 Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ImagesTestJSON-1138117227-project Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 41b99bee0b35400281da332533850481 Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ImagesTestJSON-1138117227-project Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: exception: Image not found. Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'e3efa027-aa76-4bad-962f-002956ad192c'} Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e3efa027-aa76-4bad-962f-002956ad192c to delete Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e3efa027-aa76-4bad-962f-002956ad192c could not be found. Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:25.180295 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:25.187514 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:32:25.187514 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:32:25.187514 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:32:25.187514 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:32:25.187514 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:32:25.187514 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:32:25.187514 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:32:25.187514 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:32:25.187514 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 05 08:32:25.187514 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 05 08:32:25.187514 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 05 08:32:25.187514 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:25.187514 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:32:25.187514 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:25.187514 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:25.187514 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:32:25.187514 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:32:25.187514 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:32:25.187514 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:32:25.187514 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 05 08:32:25.187514 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:25.191968 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5ae3fda2-1aaa-425d-91db-87de40644689 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Returning 404 to user: Image not found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:32:25.193207 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5ae3fda2-1aaa-425d-91db-87de40644689 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "DELETE /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c" status: 404 len: 62 microversion: 2.1 time: 0.049364 Jun 05 08:32:25.197122 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1198/2341] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:25 2022] DELETE /compute/v2.1/images/e3efa027-aa76-4bad-962f-002956ad192c => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:32:25.199501 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7cb5abda-1a6d-43d4-88f9-8d381a7a18f3 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:25.203036 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-385b1a51-8e94-468b-9979-dbddcdee8d0a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:25.203853 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-385b1a51-8e94-468b-9979-dbddcdee8d0a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: ed215a36-f621-4024-b3ba-57734be5c8bd] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:25.212899 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-385b1a51-8e94-468b-9979-dbddcdee8d0a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:25.213605 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-385b1a51-8e94-468b-9979-dbddcdee8d0a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:25.214625 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-385b1a51-8e94-468b-9979-dbddcdee8d0a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:25.215359 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-385b1a51-8e94-468b-9979-dbddcdee8d0a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:25.215511 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7cb5abda-1a6d-43d4-88f9-8d381a7a18f3 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:25.217389 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7cb5abda-1a6d-43d4-88f9-8d381a7a18f3 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:25.218961 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7cb5abda-1a6d-43d4-88f9-8d381a7a18f3 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1869 microversion: 2.42 time: 0.557874 Jun 05 08:32:25.232864 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1144/2342] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:24 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1869 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:25.263286 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-385b1a51-8e94-468b-9979-dbddcdee8d0a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: ed215a36-f621-4024-b3ba-57734be5c8bd] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:32:25.264373 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f6b5556f-7e52-4282-b92c-78e290edb6f6 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:25.265011 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f6b5556f-7e52-4282-b92c-78e290edb6f6 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] [instance: a16d052a-235e-46a1-8a93-da823e2d880a] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:25.278984 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f6b5556f-7e52-4282-b92c-78e290edb6f6 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:25.279750 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f6b5556f-7e52-4282-b92c-78e290edb6f6 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:25.280609 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f6b5556f-7e52-4282-b92c-78e290edb6f6 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:25.281059 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f6b5556f-7e52-4282-b92c-78e290edb6f6 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:25.338149 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.compute.api [None req-385b1a51-8e94-468b-9979-dbddcdee8d0a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: ed215a36-f621-4024-b3ba-57734be5c8bd] Instance is already in deleting state, ignoring this request Jun 05 08:32:25.339216 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-385b1a51-8e94-468b-9979-dbddcdee8d0a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd" status: 204 len: 0 microversion: 2.1 time: 0.140839 Jun 05 08:32:25.340102 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1199/2343] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:32:25 2022] DELETE /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:32:25.350845 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-48ea0417-327c-4f1a-983b-9fac5c467f60 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:25.351482 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-48ea0417-327c-4f1a-983b-9fac5c467f60 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: ed215a36-f621-4024-b3ba-57734be5c8bd] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:25.368885 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-48ea0417-327c-4f1a-983b-9fac5c467f60 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:25.369348 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-48ea0417-327c-4f1a-983b-9fac5c467f60 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:25.370141 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-48ea0417-327c-4f1a-983b-9fac5c467f60 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:25.370586 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-48ea0417-327c-4f1a-983b-9fac5c467f60 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:25.741392 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f6b5556f-7e52-4282-b92c-78e290edb6f6 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ab927b60d8451da78b5f8180a10ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3273ac973724a00a74d00689d99aef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:25.760692 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f6b5556f-7e52-4282-b92c-78e290edb6f6 tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] 10.222.0.33 "GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a" status: 200 len: 1469 microversion: 2.1 time: 0.498345 Jun 05 08:32:25.772007 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1145/2344] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:25 2022] GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a => generated 1469 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:32:25.775922 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1f8ba9f6-c3f1-48db-8a70-2a705941337b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:25.779429 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1f8ba9f6-c3f1-48db-8a70-2a705941337b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] [instance: 969237ff-17eb-4838-9c3d-68dcbc1f94ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:25.794283 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-48ea0417-327c-4f1a-983b-9fac5c467f60 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:25.795090 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1f8ba9f6-c3f1-48db-8a70-2a705941337b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:25.797252 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1f8ba9f6-c3f1-48db-8a70-2a705941337b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:25.801214 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1f8ba9f6-c3f1-48db-8a70-2a705941337b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:25.802483 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-48ea0417-327c-4f1a-983b-9fac5c467f60 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd" status: 200 len: 1483 microversion: 2.1 time: 0.456629 Jun 05 08:32:25.802650 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1f8ba9f6-c3f1-48db-8a70-2a705941337b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:25.807774 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1200/2345] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:25 2022] GET /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd => generated 1483 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:25.888176 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=5,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:32:25.894748 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1f8ba9f6-c3f1-48db-8a70-2a705941337b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:25.895446 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1f8ba9f6-c3f1-48db-8a70-2a705941337b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:25.896245 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-1f8ba9f6-c3f1-48db-8a70-2a705941337b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Lazy-loading 'fault' on Instance uuid 969237ff-17eb-4838-9c3d-68dcbc1f94ca {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:32:25.991997 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-1f8ba9f6-c3f1-48db-8a70-2a705941337b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a93651985b4efaa4b0b2fde0f91010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d03f2fd71b942c58157558bc37213b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:26.000959 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1f8ba9f6-c3f1-48db-8a70-2a705941337b tempest-LiveMigrationTest-1398373990 tempest-LiveMigrationTest-1398373990-project] 10.222.0.33 "GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca" status: 200 len: 1355 microversion: 2.1 time: 0.236256 Jun 05 08:32:26.001561 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1146/2346] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:25 2022] GET /compute/v2.1/servers/969237ff-17eb-4838-9c3d-68dcbc1f94ca => generated 1355 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:26.085718 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-c6ea590f-ad42-4bf6-a31e-80a64c5a2ff4 req-639ec5a2-456b-4481-92ef-bd7eb47b975c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed215a36-f621-4024-b3ba-57734be5c8bd", "name": "network-vif-deleted", "tag": "b0df87c8-f87b-4cb2-93b1-fa25266d8016"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:32:26.120872 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-c6ea590f-ad42-4bf6-a31e-80a64c5a2ff4 req-639ec5a2-456b-4481-92ef-bd7eb47b975c service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:26.128347 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-c6ea590f-ad42-4bf6-a31e-80a64c5a2ff4 req-639ec5a2-456b-4481-92ef-bd7eb47b975c service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:26.205777 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-c6ea590f-ad42-4bf6-a31e-80a64c5a2ff4 req-639ec5a2-456b-4481-92ef-bd7eb47b975c service nova] Creating event network-vif-deleted:b0df87c8-f87b-4cb2-93b1-fa25266d8016 for instance ed215a36-f621-4024-b3ba-57734be5c8bd on n-h1-844739-1 Jun 05 08:32:26.215259 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-c6ea590f-ad42-4bf6-a31e-80a64c5a2ff4 req-639ec5a2-456b-4481-92ef-bd7eb47b975c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134153 Jun 05 08:32:26.216337 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1201/2347] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:26.246861 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ffd5fd00-d525-4cc5-b22d-c627edc69c05 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:26.247774 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ffd5fd00-d525-4cc5-b22d-c627edc69c05 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:26.267508 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ffd5fd00-d525-4cc5-b22d-c627edc69c05 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:26.276933 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ffd5fd00-d525-4cc5-b22d-c627edc69c05 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:26.281825 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ffd5fd00-d525-4cc5-b22d-c627edc69c05 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:26.286343 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ffd5fd00-d525-4cc5-b22d-c627edc69c05 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:26.781165 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4f4a9dcc-6995-4588-a696-0c1efebe436d tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:26.783971 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4f4a9dcc-6995-4588-a696-0c1efebe436d tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] [instance: a16d052a-235e-46a1-8a93-da823e2d880a] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:26.817229 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4f4a9dcc-6995-4588-a696-0c1efebe436d tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:26.817997 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4f4a9dcc-6995-4588-a696-0c1efebe436d tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:26.818995 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4f4a9dcc-6995-4588-a696-0c1efebe436d tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:26.826385 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4f4a9dcc-6995-4588-a696-0c1efebe436d tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:26.903968 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4f4a9dcc-6995-4588-a696-0c1efebe436d tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:26.904753 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4f4a9dcc-6995-4588-a696-0c1efebe436d tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:26.908446 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-4f4a9dcc-6995-4588-a696-0c1efebe436d tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Lazy-loading 'fault' on Instance uuid a16d052a-235e-46a1-8a93-da823e2d880a {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:32:26.920845 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:32:27.324265 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ffd5fd00-d525-4cc5-b22d-c627edc69c05 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:27.337906 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ffd5fd00-d525-4cc5-b22d-c627edc69c05 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:27.339576 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ffd5fd00-d525-4cc5-b22d-c627edc69c05 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:27.345592 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ffd5fd00-d525-4cc5-b22d-c627edc69c05 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1869 microversion: 2.42 time: 1.109830 Jun 05 08:32:27.358476 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1147/2348] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:26 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1869 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:27.364761 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8a7d20d6-7696-4ad0-b49f-a8ef7bdc9495 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:27.365583 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8a7d20d6-7696-4ad0-b49f-a8ef7bdc9495 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: ed215a36-f621-4024-b3ba-57734be5c8bd] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:27.375190 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8a7d20d6-7696-4ad0-b49f-a8ef7bdc9495 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:27.378811 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8a7d20d6-7696-4ad0-b49f-a8ef7bdc9495 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:27.379829 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8a7d20d6-7696-4ad0-b49f-a8ef7bdc9495 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:27.380472 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8a7d20d6-7696-4ad0-b49f-a8ef7bdc9495 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:27.409205 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4f4a9dcc-6995-4588-a696-0c1efebe436d tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ab927b60d8451da78b5f8180a10ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3273ac973724a00a74d00689d99aef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:27.418188 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4f4a9dcc-6995-4588-a696-0c1efebe436d tempest-TenantUsagesTestJSON-1380119707 tempest-TenantUsagesTestJSON-1380119707-project] 10.222.0.33 "GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a" status: 200 len: 1358 microversion: 2.1 time: 0.642723 Jun 05 08:32:27.430467 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1202/2349] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:26 2022] GET /compute/v2.1/servers/a16d052a-235e-46a1-8a93-da823e2d880a => generated 1358 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:27.504290 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8a7d20d6-7696-4ad0-b49f-a8ef7bdc9495 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:27.508981 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8a7d20d6-7696-4ad0-b49f-a8ef7bdc9495 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:27.522047 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-8a7d20d6-7696-4ad0-b49f-a8ef7bdc9495 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lazy-loading 'fault' on Instance uuid ed215a36-f621-4024-b3ba-57734be5c8bd {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:32:27.821599 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8a7d20d6-7696-4ad0-b49f-a8ef7bdc9495 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:27.833856 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8a7d20d6-7696-4ad0-b49f-a8ef7bdc9495 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd" status: 200 len: 1352 microversion: 2.1 time: 0.473879 Jun 05 08:32:27.839845 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1148/2350] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:27 2022] GET /compute/v2.1/servers/ed215a36-f621-4024-b3ba-57734be5c8bd => generated 1352 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:27.853765 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-95cd7270-4d90-417e-b003-a7f34200d5f1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f24336873a0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:27.893504 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-95cd7270-4d90-417e-b003-a7f34200d5f1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] HTTP exception thrown: Image not found. Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-95cd7270-4d90-417e-b003-a7f34200d5f1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Request method failure captured: Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: request: DELETE /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e HTTP/1.1 Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGku0_-S5j4dTLFjbNtjOJABEYiEwuYiqAxBcA9X334FwwI0CgT2rI36cBXcoKgfjlfbmia7LbP8MfyA9dUTzkR-iGHCfXuhdDc4Lot6ZUoSXCjM0lgr0vl2RLGdVDCc8FuE84nr6MQWJu_zqA5SS9qFtGTeLxeotX7R3eWd-9Sgpes Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: d7e0706485194d6ab0cf41ea0f651074 Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ImagesTestJSON-1138117227 Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d7e0706485194d6ab0cf41ea0f651074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7e0706485194d6ab0cf41ea0f651074"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d7e0706485194d6ab0cf41ea0f651074", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7e0706485194d6ab0cf41ea0f651074"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ImagesTestJSON-1138117227 Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: d7e0706485194d6ab0cf41ea0f651074 Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ImagesTestJSON-1138117227 Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ImagesTestJSON-1138117227-project Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 41b99bee0b35400281da332533850481 Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ImagesTestJSON-1138117227-project Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: exception: Image not found. Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '7d85658f-5d6a-4c68-b96e-3bfb12bd243e'} Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7d85658f-5d6a-4c68-b96e-3bfb12bd243e to delete Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7d85658f-5d6a-4c68-b96e-3bfb12bd243e could not be found. Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:27.895925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:27.901427 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:32:27.901427 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:32:27.901427 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:32:27.901427 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:32:27.901427 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:32:27.901427 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:32:27.901427 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:32:27.901427 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:32:27.901427 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 05 08:32:27.901427 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 05 08:32:27.901427 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 05 08:32:27.901427 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:27.901427 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:32:27.901427 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:27.901427 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:27.901427 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:32:27.901427 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:32:27.901427 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:32:27.901427 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:32:27.901427 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 05 08:32:27.901427 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:27.903953 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-95cd7270-4d90-417e-b003-a7f34200d5f1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Returning 404 to user: Image not found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:32:27.905298 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-95cd7270-4d90-417e-b003-a7f34200d5f1 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "DELETE /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e" status: 404 len: 62 microversion: 2.1 time: 0.055485 Jun 05 08:32:27.906049 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1203/2351] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:27 2022] DELETE /compute/v2.1/images/7d85658f-5d6a-4c68-b96e-3bfb12bd243e => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:32:27.915377 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bab968be-b24e-489e-941e-f0239d6e8927 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:27.916266 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-bab968be-b24e-489e-941e-f0239d6e8927 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:27.925728 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bab968be-b24e-489e-941e-f0239d6e8927 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:27.926923 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bab968be-b24e-489e-941e-f0239d6e8927 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:27.929391 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bab968be-b24e-489e-941e-f0239d6e8927 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:27.932598 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bab968be-b24e-489e-941e-f0239d6e8927 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:28.005837 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-bab968be-b24e-489e-941e-f0239d6e8927 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:32:28.048108 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8116856c-f4f1-465e-be1e-74b16ffa9fbc tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:28.049633 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8116856c-f4f1-465e-be1e-74b16ffa9fbc tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:28.071424 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8116856c-f4f1-465e-be1e-74b16ffa9fbc tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:28.073309 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8116856c-f4f1-465e-be1e-74b16ffa9fbc tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:28.074411 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8116856c-f4f1-465e-be1e-74b16ffa9fbc tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:28.082430 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8116856c-f4f1-465e-be1e-74b16ffa9fbc tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:28.192145 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8116856c-f4f1-465e-be1e-74b16ffa9fbc tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca/ips" status: 200 len: 151 microversion: 2.20 time: 0.148807 Jun 05 08:32:28.193880 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1204/2352] 10.222.0.33 () {60 vars in 1288 bytes} [Sun Jun 5 08:32:28 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca/ips => generated 151 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 05 08:32:28.200919 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bab968be-b24e-489e-941e-f0239d6e8927 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 204 len: 0 microversion: 2.1 time: 0.289530 Jun 05 08:32:28.210923 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1149/2353] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:32:27 2022] DELETE /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:32:28.217024 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f931a0c2-860c-4e43-a22b-6cbcbb37c8cf tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:28.232959 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f931a0c2-860c-4e43-a22b-6cbcbb37c8cf tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:28.268645 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f931a0c2-860c-4e43-a22b-6cbcbb37c8cf tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:28.273786 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f931a0c2-860c-4e43-a22b-6cbcbb37c8cf tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:28.277870 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f931a0c2-860c-4e43-a22b-6cbcbb37c8cf tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:28.280772 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f931a0c2-860c-4e43-a22b-6cbcbb37c8cf tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:28.373118 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f931a0c2-860c-4e43-a22b-6cbcbb37c8cf tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:28.373833 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f931a0c2-860c-4e43-a22b-6cbcbb37c8cf tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:28.375157 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-f931a0c2-860c-4e43-a22b-6cbcbb37c8cf tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lazy-loading 'fault' on Instance uuid d73be951-4be1-4f53-ab55-92c80bdc199d {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:32:28.378240 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-75661e38-a249-4394-a96e-1305b44df1e3 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:28.379544 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-75661e38-a249-4394-a96e-1305b44df1e3 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:28.389080 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-75661e38-a249-4394-a96e-1305b44df1e3 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:28.391462 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-75661e38-a249-4394-a96e-1305b44df1e3 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:28.395796 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-75661e38-a249-4394-a96e-1305b44df1e3 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:28.396691 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-75661e38-a249-4394-a96e-1305b44df1e3 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:28.754902 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f931a0c2-860c-4e43-a22b-6cbcbb37c8cf tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:28.762736 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f931a0c2-860c-4e43-a22b-6cbcbb37c8cf tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 200 len: 1358 microversion: 2.1 time: 0.549656 Jun 05 08:32:28.776365 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1205/2354] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:28 2022] GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 1358 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:28.964913 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-d41a786c-0913-48d8-bc5b-5a7a9f74eda9 req-c550a6b6-ec11-4533-ba17-facf6ff2c62b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a16d052a-235e-46a1-8a93-da823e2d880a", "name": "network-vif-deleted", "tag": "e510e94a-0940-403c-890f-f41d1183fe9d"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:32:28.988988 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-d41a786c-0913-48d8-bc5b-5a7a9f74eda9 req-c550a6b6-ec11-4533-ba17-facf6ff2c62b service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:28.989446 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-d41a786c-0913-48d8-bc5b-5a7a9f74eda9 req-c550a6b6-ec11-4533-ba17-facf6ff2c62b service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:29.031536 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-d41a786c-0913-48d8-bc5b-5a7a9f74eda9 req-c550a6b6-ec11-4533-ba17-facf6ff2c62b service nova] Creating event network-vif-deleted:e510e94a-0940-403c-890f-f41d1183fe9d for instance a16d052a-235e-46a1-8a93-da823e2d880a on n-h1-844739-1 Jun 05 08:32:29.047356 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-d41a786c-0913-48d8-bc5b-5a7a9f74eda9 req-c550a6b6-ec11-4533-ba17-facf6ff2c62b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086300 Jun 05 08:32:29.055049 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1206/2355] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:32:29.781922 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2bbc745b-aac5-4ee2-8b41-8948917fb367 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:29.783405 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2bbc745b-aac5-4ee2-8b41-8948917fb367 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: d73be951-4be1-4f53-ab55-92c80bdc199d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:29.823527 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2bbc745b-aac5-4ee2-8b41-8948917fb367 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:29.824067 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2bbc745b-aac5-4ee2-8b41-8948917fb367 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:29.824940 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2bbc745b-aac5-4ee2-8b41-8948917fb367 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:29.825390 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2bbc745b-aac5-4ee2-8b41-8948917fb367 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:29.878447 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2bbc745b-aac5-4ee2-8b41-8948917fb367 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:29.879048 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2bbc745b-aac5-4ee2-8b41-8948917fb367 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:29.879510 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-2bbc745b-aac5-4ee2-8b41-8948917fb367 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lazy-loading 'fault' on Instance uuid d73be951-4be1-4f53-ab55-92c80bdc199d {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:32:30.428673 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2bbc745b-aac5-4ee2-8b41-8948917fb367 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:30.451323 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2bbc745b-aac5-4ee2-8b41-8948917fb367 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d" status: 200 len: 1358 microversion: 2.1 time: 0.672433 Jun 05 08:32:30.456431 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1207/2356] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:29 2022] GET /compute/v2.1/servers/d73be951-4be1-4f53-ab55-92c80bdc199d => generated 1358 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:30.478237 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6880ef55-f192-4469-a248-7a2a94fe1e4d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '.version_select at 0x7f2433aebe50>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:30.551487 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-6880ef55-f192-4469-a248-7a2a94fe1e4d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] HTTP exception thrown: Image not found. Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6880ef55-f192-4469-a248-7a2a94fe1e4d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Request method failure captured: Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: request: DELETE /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201 HTTP/1.1 Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGku0_-S5j4dTLFjbNtjOJABEYiEwuYiqAxBcA9X334FwwI0CgT2rI36cBXcoKgfjlfbmia7LbP8MfyA9dUTzkR-iGHCfXuhdDc4Lot6ZUoSXCjM0lgr0vl2RLGdVDCc8FuE84nr6MQWJu_zqA5SS9qFtGTeLxeotX7R3eWd-9Sgpes Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: d7e0706485194d6ab0cf41ea0f651074 Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ImagesTestJSON-1138117227 Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d7e0706485194d6ab0cf41ea0f651074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7e0706485194d6ab0cf41ea0f651074"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d7e0706485194d6ab0cf41ea0f651074", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7e0706485194d6ab0cf41ea0f651074"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ImagesTestJSON-1138117227 Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: d7e0706485194d6ab0cf41ea0f651074 Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ImagesTestJSON-1138117227 Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ImagesTestJSON-1138117227-project Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 41b99bee0b35400281da332533850481 Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ImagesTestJSON-1138117227-project Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: exception: Image not found. Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'fe11be9d-85b4-436d-bf0c-6fdc4cfc1201'} Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fe11be9d-85b4-436d-bf0c-6fdc4cfc1201 to delete Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fe11be9d-85b4-436d-bf0c-6fdc4cfc1201 could not be found. Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:30.553579 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:30.558866 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:32:30.558866 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:32:30.558866 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:32:30.558866 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:32:30.558866 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:32:30.558866 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:32:30.558866 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:32:30.558866 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:32:30.558866 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 05 08:32:30.558866 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 05 08:32:30.558866 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 05 08:32:30.558866 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:30.558866 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:32:30.558866 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:30.558866 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:30.558866 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:32:30.558866 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:32:30.558866 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:32:30.558866 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:32:30.558866 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 05 08:32:30.558866 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:30.561534 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6880ef55-f192-4469-a248-7a2a94fe1e4d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Returning 404 to user: Image not found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:32:30.562574 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6880ef55-f192-4469-a248-7a2a94fe1e4d tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "DELETE /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201" status: 404 len: 62 microversion: 2.1 time: 0.093830 Jun 05 08:32:30.563640 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1208/2357] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:30 2022] DELETE /compute/v2.1/images/fe11be9d-85b4-436d-bf0c-6fdc4cfc1201 => generated 62 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:32:30.572191 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3f722afb-4806-4299-a94d-9dc8ec3affa4 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:30.572946 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3f722afb-4806-4299-a94d-9dc8ec3affa4 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 54c464ac-f10b-4558-a1ef-24c9319d7364] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:30.589245 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3f722afb-4806-4299-a94d-9dc8ec3affa4 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:30.600821 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3f722afb-4806-4299-a94d-9dc8ec3affa4 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:30.601685 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3f722afb-4806-4299-a94d-9dc8ec3affa4 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:30.602326 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3f722afb-4806-4299-a94d-9dc8ec3affa4 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:30.651518 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3f722afb-4806-4299-a94d-9dc8ec3affa4 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 54c464ac-f10b-4558-a1ef-24c9319d7364] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:32:30.829335 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3f722afb-4806-4299-a94d-9dc8ec3affa4 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "DELETE /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364" status: 204 len: 0 microversion: 2.1 time: 0.258170 Jun 05 08:32:30.832020 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1209/2358] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:32:30 2022] DELETE /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 05 08:32:30.844264 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9777000d-7d6f-4021-a86e-500119d6a1f5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:30.845302 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9777000d-7d6f-4021-a86e-500119d6a1f5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 54c464ac-f10b-4558-a1ef-24c9319d7364] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:30.871659 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9777000d-7d6f-4021-a86e-500119d6a1f5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:30.872124 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9777000d-7d6f-4021-a86e-500119d6a1f5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:30.872907 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9777000d-7d6f-4021-a86e-500119d6a1f5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:30.873342 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9777000d-7d6f-4021-a86e-500119d6a1f5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:30.945940 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9777000d-7d6f-4021-a86e-500119d6a1f5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:30.946718 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9777000d-7d6f-4021-a86e-500119d6a1f5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:30.947346 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-9777000d-7d6f-4021-a86e-500119d6a1f5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lazy-loading 'fault' on Instance uuid 54c464ac-f10b-4558-a1ef-24c9319d7364 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:32:31.053392 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-75661e38-a249-4394-a96e-1305b44df1e3 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:31.075097 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-75661e38-a249-4394-a96e-1305b44df1e3 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:31.080592 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-75661e38-a249-4394-a96e-1305b44df1e3 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:31.101198 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-75661e38-a249-4394-a96e-1305b44df1e3 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1869 microversion: 2.42 time: 2.727327 Jun 05 08:32:31.106599 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1150/2359] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:28 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1869 bytes in 2734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:31.123867 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-dd296cd3-0995-4cf9-983f-8d4a807c5c80 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:31.124420 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-dd296cd3-0995-4cf9-983f-8d4a807c5c80 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:31.147392 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dd296cd3-0995-4cf9-983f-8d4a807c5c80 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:31.147859 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dd296cd3-0995-4cf9-983f-8d4a807c5c80 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:31.154675 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dd296cd3-0995-4cf9-983f-8d4a807c5c80 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:31.155199 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dd296cd3-0995-4cf9-983f-8d4a807c5c80 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:31.256260 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-dd296cd3-0995-4cf9-983f-8d4a807c5c80 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:32:31.452686 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-dd296cd3-0995-4cf9-983f-8d4a807c5c80 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 204 len: 0 microversion: 2.25 time: 0.343364 Jun 05 08:32:31.458636 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1151/2360] 10.222.0.33 () {60 vars in 1279 bytes} [Sun Jun 5 08:32:31 2022] DELETE /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:32:31.469921 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5a1fce6f-9de8-4d0e-b25d-2d77e355f47e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:31.471725 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-9777000d-7d6f-4021-a86e-500119d6a1f5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:31.474557 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5a1fce6f-9de8-4d0e-b25d-2d77e355f47e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:31.481489 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9777000d-7d6f-4021-a86e-500119d6a1f5 tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364" status: 200 len: 1358 microversion: 2.1 time: 0.645124 Jun 05 08:32:31.481917 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1210/2361] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:30 2022] GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364 => generated 1358 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:32:31.497093 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a1fce6f-9de8-4d0e-b25d-2d77e355f47e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:31.498053 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a1fce6f-9de8-4d0e-b25d-2d77e355f47e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:31.501063 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a1fce6f-9de8-4d0e-b25d-2d77e355f47e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:31.502911 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a1fce6f-9de8-4d0e-b25d-2d77e355f47e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:31.558262 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=26,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:32:31.593350 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=6 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:32:32.044655 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5a1fce6f-9de8-4d0e-b25d-2d77e355f47e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:32.066892 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5a1fce6f-9de8-4d0e-b25d-2d77e355f47e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:32.069787 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5a1fce6f-9de8-4d0e-b25d-2d77e355f47e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:32.071553 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5a1fce6f-9de8-4d0e-b25d-2d77e355f47e tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1564 microversion: 2.25 time: 0.611475 Jun 05 08:32:32.072866 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1152/2362] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:31 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1564 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:32.120727 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-bbbf95bf-e3a8-459b-9eb6-e9d5bf76bb73 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:32.122358 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-bbbf95bf-e3a8-459b-9eb6-e9d5bf76bb73 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:32.134270 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=14 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:32:32.140574 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bbbf95bf-e3a8-459b-9eb6-e9d5bf76bb73 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:32.141488 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bbbf95bf-e3a8-459b-9eb6-e9d5bf76bb73 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:32.149023 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bbbf95bf-e3a8-459b-9eb6-e9d5bf76bb73 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:32.150056 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bbbf95bf-e3a8-459b-9eb6-e9d5bf76bb73 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:32.498932 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-948b050d-9234-4993-b304-4329b3efab0a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:32.499561 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-948b050d-9234-4993-b304-4329b3efab0a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] [instance: 54c464ac-f10b-4558-a1ef-24c9319d7364] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:32.506196 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-948b050d-9234-4993-b304-4329b3efab0a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:32.512792 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-948b050d-9234-4993-b304-4329b3efab0a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:32.515290 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-948b050d-9234-4993-b304-4329b3efab0a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:32.517404 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-948b050d-9234-4993-b304-4329b3efab0a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:32.610883 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-948b050d-9234-4993-b304-4329b3efab0a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:32.613176 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-948b050d-9234-4993-b304-4329b3efab0a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:32.614845 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-948b050d-9234-4993-b304-4329b3efab0a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Lazy-loading 'fault' on Instance uuid 54c464ac-f10b-4558-a1ef-24c9319d7364 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:32:32.742817 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-948b050d-9234-4993-b304-4329b3efab0a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b99bee0b35400281da332533850481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e0706485194d6ab0cf41ea0f651074', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:32.747086 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:32:32.756057 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-948b050d-9234-4993-b304-4329b3efab0a tempest-ImagesTestJSON-1138117227 tempest-ImagesTestJSON-1138117227-project] 10.222.0.33 "GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364" status: 200 len: 1358 microversion: 2.1 time: 0.261066 Jun 05 08:32:32.763489 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1153/2363] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:32 2022] GET /compute/v2.1/servers/54c464ac-f10b-4558-a1ef-24c9319d7364 => generated 1358 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:33.090844 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a0346427-72dd-4e9d-8ab6-e190d1366b36 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:33.091673 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a0346427-72dd-4e9d-8ab6-e190d1366b36 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:33.097578 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-bbbf95bf-e3a8-459b-9eb6-e9d5bf76bb73 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:33.101243 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a0346427-72dd-4e9d-8ab6-e190d1366b36 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:33.110536 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a0346427-72dd-4e9d-8ab6-e190d1366b36 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:33.113901 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-bbbf95bf-e3a8-459b-9eb6-e9d5bf76bb73 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:33.114080 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a0346427-72dd-4e9d-8ab6-e190d1366b36 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:33.114507 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a0346427-72dd-4e9d-8ab6-e190d1366b36 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:33.117068 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-bbbf95bf-e3a8-459b-9eb6-e9d5bf76bb73 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:33.121442 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-bbbf95bf-e3a8-459b-9eb6-e9d5bf76bb73 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1869 microversion: 2.42 time: 1.004925 Jun 05 08:32:33.128956 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1211/2364] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:32 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1869 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:33.406459 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a0346427-72dd-4e9d-8ab6-e190d1366b36 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:33.421148 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a0346427-72dd-4e9d-8ab6-e190d1366b36 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:33.423006 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a0346427-72dd-4e9d-8ab6-e190d1366b36 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:33.426891 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a0346427-72dd-4e9d-8ab6-e190d1366b36 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1564 microversion: 2.25 time: 0.339984 Jun 05 08:32:33.432107 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1154/2365] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:33 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1564 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:33.902543 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-24d70d57-c959-49bb-89b2-cb578980cb1e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:32:33.905126 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-24d70d57-c959-49bb-89b2-cb578980cb1e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:33.917592 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-24d70d57-c959-49bb-89b2-cb578980cb1e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:33.918360 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-24d70d57-c959-49bb-89b2-cb578980cb1e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:33.919359 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-24d70d57-c959-49bb-89b2-cb578980cb1e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:33.920156 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-24d70d57-c959-49bb-89b2-cb578980cb1e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:33.988954 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-24d70d57-c959-49bb-89b2-cb578980cb1e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lazy-loading 'flavor' on Instance uuid 040dd488-42f2-45c3-86de-1a675e78d7ca {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:32:34.152714 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6a46a020-8355-4bfd-95d6-6374b0ccc75a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:34.153381 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6a46a020-8355-4bfd-95d6-6374b0ccc75a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:34.173952 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6a46a020-8355-4bfd-95d6-6374b0ccc75a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:34.177514 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6a46a020-8355-4bfd-95d6-6374b0ccc75a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:34.178473 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6a46a020-8355-4bfd-95d6-6374b0ccc75a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:34.181044 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6a46a020-8355-4bfd-95d6-6374b0ccc75a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:34.701881 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6a46a020-8355-4bfd-95d6-6374b0ccc75a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:34.737525 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6a46a020-8355-4bfd-95d6-6374b0ccc75a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:34.744505 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6a46a020-8355-4bfd-95d6-6374b0ccc75a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:34.745743 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6a46a020-8355-4bfd-95d6-6374b0ccc75a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1869 microversion: 2.42 time: 0.598481 Jun 05 08:32:34.748097 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-24d70d57-c959-49bb-89b2-cb578980cb1e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "POST /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca/action" status: 202 len: 0 microversion: 2.20 time: 0.855999 Jun 05 08:32:34.749971 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1212/2366] 10.222.0.33 () {62 vars in 1318 bytes} [Sun Jun 5 08:32:33 2022] POST /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca/action => generated 0 bytes in 859 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:32:34.750667 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1155/2367] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:34 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1869 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:34.756468 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8419a5d7-6514-4cdd-8591-3784484af4a5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:34.757176 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8419a5d7-6514-4cdd-8591-3784484af4a5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:34.766564 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8419a5d7-6514-4cdd-8591-3784484af4a5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:34.773326 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6778a51a-ff73-44e5-a37a-d9fd464d94b8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:34.774260 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6778a51a-ff73-44e5-a37a-d9fd464d94b8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:34.778572 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8419a5d7-6514-4cdd-8591-3784484af4a5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:34.784368 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8419a5d7-6514-4cdd-8591-3784484af4a5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:34.784900 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8419a5d7-6514-4cdd-8591-3784484af4a5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:34.788645 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6778a51a-ff73-44e5-a37a-d9fd464d94b8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:34.789137 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6778a51a-ff73-44e5-a37a-d9fd464d94b8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:34.791427 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6778a51a-ff73-44e5-a37a-d9fd464d94b8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:34.792568 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6778a51a-ff73-44e5-a37a-d9fd464d94b8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:35.115778 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=52,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:32:35.365263 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8419a5d7-6514-4cdd-8591-3784484af4a5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:35.381768 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8419a5d7-6514-4cdd-8591-3784484af4a5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:35.389927 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8419a5d7-6514-4cdd-8591-3784484af4a5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:35.398456 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8419a5d7-6514-4cdd-8591-3784484af4a5 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1564 microversion: 2.25 time: 0.644888 Jun 05 08:32:35.401503 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1213/2368] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:34 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1564 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:35.456172 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6778a51a-ff73-44e5-a37a-d9fd464d94b8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:35.472998 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6778a51a-ff73-44e5-a37a-d9fd464d94b8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:35.475240 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6778a51a-ff73-44e5-a37a-d9fd464d94b8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:35.476522 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6778a51a-ff73-44e5-a37a-d9fd464d94b8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1721 microversion: 2.20 time: 0.713130 Jun 05 08:32:35.487217 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1156/2369] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:34 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1721 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:32:35.498768 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-3da1ce1e-57c4-4ae2-a4a0-63a6ebd6cddb req-454fd6fa-af6e-4fa2-bfe1-29b5ff096a22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d031b21-37d5-4454-bed7-db50a225bce5", "name": "network-vif-deleted", "tag": "8d0bec8a-b955-48a2-b49c-95afe47c2245"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:32:35.519525 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-3da1ce1e-57c4-4ae2-a4a0-63a6ebd6cddb req-454fd6fa-af6e-4fa2-bfe1-29b5ff096a22 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:35.523471 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-3da1ce1e-57c4-4ae2-a4a0-63a6ebd6cddb req-454fd6fa-af6e-4fa2-bfe1-29b5ff096a22 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:35.556229 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-3da1ce1e-57c4-4ae2-a4a0-63a6ebd6cddb req-454fd6fa-af6e-4fa2-bfe1-29b5ff096a22 service nova] Creating event network-vif-deleted:8d0bec8a-b955-48a2-b49c-95afe47c2245 for instance 5d031b21-37d5-4454-bed7-db50a225bce5 on n-h2-844739-1 Jun 05 08:32:35.567830 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-3da1ce1e-57c4-4ae2-a4a0-63a6ebd6cddb req-454fd6fa-af6e-4fa2-bfe1-29b5ff096a22 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078543 Jun 05 08:32:35.570296 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1214/2370] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:35.774806 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-41d30d57-19a2-4b6e-b112-0c5490621f5a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:35.775438 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-41d30d57-19a2-4b6e-b112-0c5490621f5a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:35.791892 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-41d30d57-19a2-4b6e-b112-0c5490621f5a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:35.792531 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-41d30d57-19a2-4b6e-b112-0c5490621f5a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:35.803280 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-41d30d57-19a2-4b6e-b112-0c5490621f5a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:35.805010 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-41d30d57-19a2-4b6e-b112-0c5490621f5a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:36.420917 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ec8afc31-18cd-4f1e-a89e-b5dc7e7ea6db tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:36.422498 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ec8afc31-18cd-4f1e-a89e-b5dc7e7ea6db tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 5d031b21-37d5-4454-bed7-db50a225bce5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:36.443935 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ec8afc31-18cd-4f1e-a89e-b5dc7e7ea6db tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:36.462876 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ec8afc31-18cd-4f1e-a89e-b5dc7e7ea6db tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:36.464379 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ec8afc31-18cd-4f1e-a89e-b5dc7e7ea6db tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:36.465064 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ec8afc31-18cd-4f1e-a89e-b5dc7e7ea6db tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:36.617073 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ec8afc31-18cd-4f1e-a89e-b5dc7e7ea6db tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:36.619583 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ec8afc31-18cd-4f1e-a89e-b5dc7e7ea6db tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:36.628296 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-ec8afc31-18cd-4f1e-a89e-b5dc7e7ea6db tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lazy-loading 'fault' on Instance uuid 5d031b21-37d5-4454-bed7-db50a225bce5 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:32:36.791072 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ec8afc31-18cd-4f1e-a89e-b5dc7e7ea6db tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:36.814806 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ec8afc31-18cd-4f1e-a89e-b5dc7e7ea6db tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:36.825058 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-41d30d57-19a2-4b6e-b112-0c5490621f5a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:36.842666 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ec8afc31-18cd-4f1e-a89e-b5dc7e7ea6db tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:36.847398 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ec8afc31-18cd-4f1e-a89e-b5dc7e7ea6db tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5" status: 200 len: 1406 microversion: 2.25 time: 0.429406 Jun 05 08:32:36.849776 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-41d30d57-19a2-4b6e-b112-0c5490621f5a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:36.850005 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1215/2371] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:36 2022] GET /compute/v2.1/servers/5d031b21-37d5-4454-bed7-db50a225bce5 => generated 1406 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:32:36.856371 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-41d30d57-19a2-4b6e-b112-0c5490621f5a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:36.863348 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-41d30d57-19a2-4b6e-b112-0c5490621f5a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1869 microversion: 2.42 time: 1.088749 Jun 05 08:32:36.876655 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1157/2372] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:35 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1869 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:36.877087 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-db7a82c4-9b91-4298-a714-c953e2f52795 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:36.877087 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-db7a82c4-9b91-4298-a714-c953e2f52795 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:36.883755 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f346b5b6-ba5c-442a-83a4-dcb64868b52a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:36.884342 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f346b5b6-ba5c-442a-83a4-dcb64868b52a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:36.893930 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-db7a82c4-9b91-4298-a714-c953e2f52795 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:36.894697 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-db7a82c4-9b91-4298-a714-c953e2f52795 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:36.896894 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-db7a82c4-9b91-4298-a714-c953e2f52795 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:36.898359 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-db7a82c4-9b91-4298-a714-c953e2f52795 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:36.900321 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f346b5b6-ba5c-442a-83a4-dcb64868b52a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:36.900783 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f346b5b6-ba5c-442a-83a4-dcb64868b52a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:36.901751 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f346b5b6-ba5c-442a-83a4-dcb64868b52a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:36.902194 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f346b5b6-ba5c-442a-83a4-dcb64868b52a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:37.005981 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f346b5b6-ba5c-442a-83a4-dcb64868b52a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:32:37.253051 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f346b5b6-ba5c-442a-83a4-dcb64868b52a tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "DELETE /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 204 len: 0 microversion: 2.25 time: 0.382373 Jun 05 08:32:37.257765 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1158/2373] 10.222.0.33 () {60 vars in 1279 bytes} [Sun Jun 5 08:32:36 2022] DELETE /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:32:37.266302 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a7ed62da-df91-4031-8c30-ede1f215ca5f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:37.270084 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a7ed62da-df91-4031-8c30-ede1f215ca5f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:37.286001 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a7ed62da-df91-4031-8c30-ede1f215ca5f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:37.286460 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a7ed62da-df91-4031-8c30-ede1f215ca5f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:37.287256 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a7ed62da-df91-4031-8c30-ede1f215ca5f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:37.287701 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a7ed62da-df91-4031-8c30-ede1f215ca5f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:37.639932 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-db7a82c4-9b91-4298-a714-c953e2f52795 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:37.657303 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-db7a82c4-9b91-4298-a714-c953e2f52795 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:37.660401 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-db7a82c4-9b91-4298-a714-c953e2f52795 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:37.661760 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-db7a82c4-9b91-4298-a714-c953e2f52795 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1721 microversion: 2.20 time: 0.810348 Jun 05 08:32:37.662590 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1216/2374] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:36 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1721 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:37.855379 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a7ed62da-df91-4031-8c30-ede1f215ca5f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:37.878196 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a7ed62da-df91-4031-8c30-ede1f215ca5f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:37.881044 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a7ed62da-df91-4031-8c30-ede1f215ca5f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:37.884589 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3fcd5ebb-9584-484a-a253-2a5743bded97 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:37.885571 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3fcd5ebb-9584-484a-a253-2a5743bded97 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:37.893917 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a7ed62da-df91-4031-8c30-ede1f215ca5f tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 1549 microversion: 2.25 time: 0.634461 Jun 05 08:32:37.896235 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3fcd5ebb-9584-484a-a253-2a5743bded97 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:37.896935 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3fcd5ebb-9584-484a-a253-2a5743bded97 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:37.898474 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3fcd5ebb-9584-484a-a253-2a5743bded97 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:37.900409 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1159/2375] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:37 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 1549 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:37.901486 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3fcd5ebb-9584-484a-a253-2a5743bded97 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:38.362130 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3fcd5ebb-9584-484a-a253-2a5743bded97 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:38.372825 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:32:38.376630 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3fcd5ebb-9584-484a-a253-2a5743bded97 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:38.385780 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3fcd5ebb-9584-484a-a253-2a5743bded97 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:38.387108 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3fcd5ebb-9584-484a-a253-2a5743bded97 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1869 microversion: 2.42 time: 0.506574 Jun 05 08:32:38.387882 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1217/2376] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:37 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1869 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:38.681221 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-42e87950-72e0-409c-99d7-3eddef1e6949 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:38.681889 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-42e87950-72e0-409c-99d7-3eddef1e6949 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:38.696313 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-42e87950-72e0-409c-99d7-3eddef1e6949 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:38.700801 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-42e87950-72e0-409c-99d7-3eddef1e6949 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:38.702584 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-42e87950-72e0-409c-99d7-3eddef1e6949 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:38.707812 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-42e87950-72e0-409c-99d7-3eddef1e6949 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:38.947900 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e5e82a2a-1282-433c-892d-03a616d934de tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1739058482", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "6ae041e2-2719-4b5a-8067-42384887402d"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:32:39.126057 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-42e87950-72e0-409c-99d7-3eddef1e6949 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:39.145754 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-e5e82a2a-1282-433c-892d-03a616d934de tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] validate_networks() for [('6ae041e2-2719-4b5a-8067-42384887402d', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:32:39.161762 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-42e87950-72e0-409c-99d7-3eddef1e6949 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:39.170498 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-42e87950-72e0-409c-99d7-3eddef1e6949 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:39.176790 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-42e87950-72e0-409c-99d7-3eddef1e6949 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1721 microversion: 2.20 time: 0.499384 Jun 05 08:32:39.180427 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1218/2377] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:38 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1721 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:32:39.197771 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8d05beef-4a7c-44fb-b75b-86cf01a1bf88 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:39.201407 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8d05beef-4a7c-44fb-b75b-86cf01a1bf88 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:39.224550 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:32:39.242847 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8d05beef-4a7c-44fb-b75b-86cf01a1bf88 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:39.249119 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8d05beef-4a7c-44fb-b75b-86cf01a1bf88 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:39.250833 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8d05beef-4a7c-44fb-b75b-86cf01a1bf88 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:39.254298 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8d05beef-4a7c-44fb-b75b-86cf01a1bf88 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:39.634356 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8d05beef-4a7c-44fb-b75b-86cf01a1bf88 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:39.655117 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8d05beef-4a7c-44fb-b75b-86cf01a1bf88 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:39.670553 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8d05beef-4a7c-44fb-b75b-86cf01a1bf88 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:39.675621 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8d05beef-4a7c-44fb-b75b-86cf01a1bf88 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 1507 microversion: 2.25 time: 0.490074 Jun 05 08:32:39.677451 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1219/2378] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:39 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 1507 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:39.685470 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5aa5fc75-4cd2-49d3-9b14-17237f150f03 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:39.687306 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5aa5fc75-4cd2-49d3-9b14-17237f150f03 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:39.708223 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5aa5fc75-4cd2-49d3-9b14-17237f150f03 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:39.709021 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5aa5fc75-4cd2-49d3-9b14-17237f150f03 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:39.710125 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5aa5fc75-4cd2-49d3-9b14-17237f150f03 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:39.710826 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5aa5fc75-4cd2-49d3-9b14-17237f150f03 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:40.827698 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5aa5fc75-4cd2-49d3-9b14-17237f150f03 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:40.848951 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5aa5fc75-4cd2-49d3-9b14-17237f150f03 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:40.851107 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5aa5fc75-4cd2-49d3-9b14-17237f150f03 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:40.855338 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5aa5fc75-4cd2-49d3-9b14-17237f150f03 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1869 microversion: 2.42 time: 1.176298 Jun 05 08:32:40.857823 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1220/2379] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:39 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1869 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:40.880313 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-77008b86-35fc-49fd-882b-4b8fc06f8dbb req-127e1ee1-74b7-471c-a867-b07e3391d923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "476cc23e-487d-4d15-849e-208df0e985b1", "name": "network-vif-deleted", "tag": "b7264816-9730-49ab-bb1c-4148a2e5aaef"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:32:40.900003 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-77008b86-35fc-49fd-882b-4b8fc06f8dbb req-127e1ee1-74b7-471c-a867-b07e3391d923 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:40.900494 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-77008b86-35fc-49fd-882b-4b8fc06f8dbb req-127e1ee1-74b7-471c-a867-b07e3391d923 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:40.928799 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-77008b86-35fc-49fd-882b-4b8fc06f8dbb req-127e1ee1-74b7-471c-a867-b07e3391d923 service nova] Creating event network-vif-deleted:b7264816-9730-49ab-bb1c-4148a2e5aaef for instance 476cc23e-487d-4d15-849e-208df0e985b1 on n-h2-844739-1 Jun 05 08:32:40.936146 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-77008b86-35fc-49fd-882b-4b8fc06f8dbb req-127e1ee1-74b7-471c-a867-b07e3391d923 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076805 Jun 05 08:32:40.937166 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1221/2380] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:40.944765 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a7bc02c5-e6c2-4a08-94e8-f9549cac8859 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:40.945947 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a7bc02c5-e6c2-4a08-94e8-f9549cac8859 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:40.953926 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a7bc02c5-e6c2-4a08-94e8-f9549cac8859 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:40.955107 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a7bc02c5-e6c2-4a08-94e8-f9549cac8859 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:40.956581 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a7bc02c5-e6c2-4a08-94e8-f9549cac8859 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:40.957406 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a7bc02c5-e6c2-4a08-94e8-f9549cac8859 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:41.030399 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-e5e82a2a-1282-433c-892d-03a616d934de tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:32:41.030399 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-e5e82a2a-1282-433c-892d-03a616d934de tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:32:41.033803 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-e5e82a2a-1282-433c-892d-03a616d934de tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:32:41.039291 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-e5e82a2a-1282-433c-892d-03a616d934de tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:32:41.041437 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-e5e82a2a-1282-433c-892d-03a616d934de tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:32:41.072386 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e5e82a2a-1282-433c-892d-03a616d934de tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:41.072954 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e5e82a2a-1282-433c-892d-03a616d934de tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:41.073851 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e5e82a2a-1282-433c-892d-03a616d934de tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:41.074293 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e5e82a2a-1282-433c-892d-03a616d934de tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:41.097711 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-e5e82a2a-1282-433c-892d-03a616d934de tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Getting quotas for project 68ede041c3c744daa44a56817af472d7. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:32:41.100884 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-e5e82a2a-1282-433c-892d-03a616d934de tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Getting quotas for user 87be0705721c42878ae5fb2cb21c9c0d and project 68ede041c3c744daa44a56817af472d7. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:32:41.115468 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e5e82a2a-1282-433c-892d-03a616d934de tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:32:41.117970 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e5e82a2a-1282-433c-892d-03a616d934de tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: c83e9195-8396-4b31-bef0-238994d07031] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:32:41.178513 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e5e82a2a-1282-433c-892d-03a616d934de tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.600701 Jun 05 08:32:41.179798 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1160/2381] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:32:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:32:41.185074 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ead9550e-5aef-4a79-9533-1f539e98afc8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:41.186154 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ead9550e-5aef-4a79-9533-1f539e98afc8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 476cc23e-487d-4d15-849e-208df0e985b1] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:41.193577 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ead9550e-5aef-4a79-9533-1f539e98afc8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:41.194365 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ead9550e-5aef-4a79-9533-1f539e98afc8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:41.195332 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ead9550e-5aef-4a79-9533-1f539e98afc8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:41.196373 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ead9550e-5aef-4a79-9533-1f539e98afc8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:41.254160 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ead9550e-5aef-4a79-9533-1f539e98afc8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:41.254887 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ead9550e-5aef-4a79-9533-1f539e98afc8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:41.255514 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-ead9550e-5aef-4a79-9533-1f539e98afc8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lazy-loading 'fault' on Instance uuid 476cc23e-487d-4d15-849e-208df0e985b1 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:32:41.276865 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a7bc02c5-e6c2-4a08-94e8-f9549cac8859 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:41.291845 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a7bc02c5-e6c2-4a08-94e8-f9549cac8859 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:41.294149 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a7bc02c5-e6c2-4a08-94e8-f9549cac8859 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:41.299208 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a7bc02c5-e6c2-4a08-94e8-f9549cac8859 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1721 microversion: 2.20 time: 0.359915 Jun 05 08:32:41.300794 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1222/2382] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:40 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1721 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:41.327626 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e32fcbe3-17db-4597-8b95-1ea8fc56eff4 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:41.335032 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e32fcbe3-17db-4597-8b95-1ea8fc56eff4 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: c83e9195-8396-4b31-bef0-238994d07031] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:41.340145 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ead9550e-5aef-4a79-9533-1f539e98afc8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:41.361330 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ead9550e-5aef-4a79-9533-1f539e98afc8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:41.363289 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ead9550e-5aef-4a79-9533-1f539e98afc8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:41.371113 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ead9550e-5aef-4a79-9533-1f539e98afc8 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1" status: 200 len: 1407 microversion: 2.25 time: 0.189964 Jun 05 08:32:41.373364 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1161/2383] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:41 2022] GET /compute/v2.1/servers/476cc23e-487d-4d15-849e-208df0e985b1 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:41.391300 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0f493d8a-c4ea-4fc3-8d6d-3ebbe462fb25 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:41.391949 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0f493d8a-c4ea-4fc3-8d6d-3ebbe462fb25 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:41.399664 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0f493d8a-c4ea-4fc3-8d6d-3ebbe462fb25 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:41.400267 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0f493d8a-c4ea-4fc3-8d6d-3ebbe462fb25 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:41.400971 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0f493d8a-c4ea-4fc3-8d6d-3ebbe462fb25 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:41.401424 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0f493d8a-c4ea-4fc3-8d6d-3ebbe462fb25 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:41.443164 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0f493d8a-c4ea-4fc3-8d6d-3ebbe462fb25 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:32:41.470310 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e32fcbe3-17db-4597-8b95-1ea8fc56eff4 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87be0705721c42878ae5fb2cb21c9c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ede041c3c744daa44a56817af472d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:41.478457 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e32fcbe3-17db-4597-8b95-1ea8fc56eff4 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "GET /compute/v2.1/servers/c83e9195-8396-4b31-bef0-238994d07031" status: 200 len: 1215 microversion: 2.1 time: 0.159827 Jun 05 08:32:41.481375 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1223/2384] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:41 2022] GET /compute/v2.1/servers/c83e9195-8396-4b31-bef0-238994d07031 => generated 1215 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:41.635924 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0f493d8a-c4ea-4fc3-8d6d-3ebbe462fb25 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "DELETE /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 204 len: 0 microversion: 2.25 time: 0.248984 Jun 05 08:32:41.638342 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1162/2385] 10.222.0.33 () {60 vars in 1279 bytes} [Sun Jun 5 08:32:41 2022] DELETE /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:32:41.652008 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5a0b3084-7d00-41a1-ac31-bc9a6aad850d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:41.657863 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5a0b3084-7d00-41a1-ac31-bc9a6aad850d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:41.706774 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a0b3084-7d00-41a1-ac31-bc9a6aad850d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:41.709755 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a0b3084-7d00-41a1-ac31-bc9a6aad850d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:41.722889 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a0b3084-7d00-41a1-ac31-bc9a6aad850d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:41.727196 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a0b3084-7d00-41a1-ac31-bc9a6aad850d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:41.755427 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-237a73cd-8dce-4918-b1e7-d9d9a5cce763 tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Calling method '.version_select at 0x7f2433c519d0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:41.905914 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-237a73cd-8dce-4918-b1e7-d9d9a5cce763 tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/0197e8848ecc48ddaf938795998d989e" status: 200 len: 371 microversion: 2.1 time: 0.414814 Jun 05 08:32:41.912306 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1224/2386] 10.222.0.33 () {58 vars in 1241 bytes} [Sun Jun 5 08:32:41 2022] GET /compute/v2.1/os-quota-sets/0197e8848ecc48ddaf938795998d989e => generated 371 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:41.919303 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d68deff8-ab03-46ff-b62c-0e32d82353d0 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:41.919956 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d68deff8-ab03-46ff-b62c-0e32d82353d0 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:41.943052 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d68deff8-ab03-46ff-b62c-0e32d82353d0 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:41.943529 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d68deff8-ab03-46ff-b62c-0e32d82353d0 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:41.945038 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d68deff8-ab03-46ff-b62c-0e32d82353d0 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:41.945899 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d68deff8-ab03-46ff-b62c-0e32d82353d0 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:42.301094 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5a0b3084-7d00-41a1-ac31-bc9a6aad850d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:42.316523 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5a0b3084-7d00-41a1-ac31-bc9a6aad850d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:42.318313 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5a0b3084-7d00-41a1-ac31-bc9a6aad850d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:42.326679 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5a0b3084-7d00-41a1-ac31-bc9a6aad850d tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 1564 microversion: 2.25 time: 0.684528 Jun 05 08:32:42.327536 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1163/2387] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:41 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 1564 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:42.344029 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-56152ab3-e42c-4127-9bcb-ab1d0021e9fd tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Action: 'update', calling method: .version_select at 0x7f2433d73c10>, body: {"quota_set": {"ram": "5120"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:32:42.468270 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-56152ab3-e42c-4127-9bcb-ab1d0021e9fd tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:42.468702 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-56152ab3-e42c-4127-9bcb-ab1d0021e9fd tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:42.472922 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-56152ab3-e42c-4127-9bcb-ab1d0021e9fd tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:42.475399 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-56152ab3-e42c-4127-9bcb-ab1d0021e9fd tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:42.525718 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d68deff8-ab03-46ff-b62c-0e32d82353d0 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:42.549762 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d68deff8-ab03-46ff-b62c-0e32d82353d0 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:42.554821 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d68deff8-ab03-46ff-b62c-0e32d82353d0 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:42.564729 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d68deff8-ab03-46ff-b62c-0e32d82353d0 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1869 microversion: 2.42 time: 0.642730 Jun 05 08:32:42.565434 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1225/2388] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:41 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1869 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:42.570448 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2ed7be27-4ee8-4274-b7e0-94ab4dcba106 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Calling method '.version_select at 0x7f2433aebe50>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:42.601018 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-56152ab3-e42c-4127-9bcb-ab1d0021e9fd tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/0197e8848ecc48ddaf938795998d989e" status: 200 len: 328 microversion: 2.1 time: 0.261058 Jun 05 08:32:42.606486 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1164/2389] 10.222.0.33 () {60 vars in 1261 bytes} [Sun Jun 5 08:32:42 2022] PUT /compute/v2.1/os-quota-sets/0197e8848ecc48ddaf938795998d989e => generated 328 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:42.614215 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-844d1e86-a50e-454b-8ddf-84c9b72be37b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:42.614958 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-844d1e86-a50e-454b-8ddf-84c9b72be37b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:42.633339 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-844d1e86-a50e-454b-8ddf-84c9b72be37b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:42.633983 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-844d1e86-a50e-454b-8ddf-84c9b72be37b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:42.636683 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-844d1e86-a50e-454b-8ddf-84c9b72be37b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:42.637264 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-844d1e86-a50e-454b-8ddf-84c9b72be37b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:42.670600 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2ed7be27-4ee8-4274-b7e0-94ab4dcba106 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] 10.222.0.33 "GET /compute/v2.1/images/950157ac-6916-47d4-8095-a7ade8b8279a" status: 200 len: 661 microversion: 2.1 time: 0.103750 Jun 05 08:32:42.671399 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1226/2390] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:32:42 2022] GET /compute/v2.1/images/950157ac-6916-47d4-8095-a7ade8b8279a => generated 661 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:42.678963 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-61b420be-90ae-4f3c-a448-9192acc43c5f tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:42.683038 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-61b420be-90ae-4f3c-a448-9192acc43c5f tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: c83e9195-8396-4b31-bef0-238994d07031] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:42.704749 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-61b420be-90ae-4f3c-a448-9192acc43c5f tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:42.705623 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-61b420be-90ae-4f3c-a448-9192acc43c5f tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:42.706622 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-61b420be-90ae-4f3c-a448-9192acc43c5f tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:42.707245 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-61b420be-90ae-4f3c-a448-9192acc43c5f tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:42.799511 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-61b420be-90ae-4f3c-a448-9192acc43c5f tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:42.800312 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-61b420be-90ae-4f3c-a448-9192acc43c5f tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:42.800913 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-61b420be-90ae-4f3c-a448-9192acc43c5f tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lazy-loading 'fault' on Instance uuid c83e9195-8396-4b31-bef0-238994d07031 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:32:42.927536 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-61b420be-90ae-4f3c-a448-9192acc43c5f tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87be0705721c42878ae5fb2cb21c9c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ede041c3c744daa44a56817af472d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:42.938467 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-61b420be-90ae-4f3c-a448-9192acc43c5f tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "GET /compute/v2.1/servers/c83e9195-8396-4b31-bef0-238994d07031" status: 200 len: 1288 microversion: 2.1 time: 0.265735 Jun 05 08:32:42.953851 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1227/2391] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:42 2022] GET /compute/v2.1/servers/c83e9195-8396-4b31-bef0-238994d07031 => generated 1288 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:42.960271 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-93ebb795-14ef-43b5-8f54-44d4fa4421ea tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:42.980694 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-93ebb795-14ef-43b5-8f54-44d4fa4421ea tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-quota-sets/0197e8848ecc48ddaf938795998d989e" status: 202 len: 0 microversion: 2.1 time: 0.024723 Jun 05 08:32:42.981425 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1228/2392] 10.222.0.33 () {58 vars in 1244 bytes} [Sun Jun 5 08:32:42 2022] DELETE /compute/v2.1/os-quota-sets/0197e8848ecc48ddaf938795998d989e => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:32:42.990099 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-70eba412-225f-47ed-89e1-98dcfdbb8eb4 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Calling method '.version_select at 0x7f24339a9550>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:43.089358 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-70eba412-225f-47ed-89e1-98dcfdbb8eb4 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] 10.222.0.33 "GET /compute/v2.1/images/950157ac-6916-47d4-8095-a7ade8b8279a" status: 200 len: 661 microversion: 2.1 time: 0.106564 Jun 05 08:32:43.091001 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1229/2393] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:32:42 2022] GET /compute/v2.1/images/950157ac-6916-47d4-8095-a7ade8b8279a => generated 661 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:43.099916 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-aa638427-0573-475d-9a56-85ee62328562 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:43.101750 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-aa638427-0573-475d-9a56-85ee62328562 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: c83e9195-8396-4b31-bef0-238994d07031] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:43.123240 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-aa638427-0573-475d-9a56-85ee62328562 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:43.123771 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-aa638427-0573-475d-9a56-85ee62328562 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:43.124939 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-aa638427-0573-475d-9a56-85ee62328562 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:43.134633 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-aa638427-0573-475d-9a56-85ee62328562 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:43.138799 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-844d1e86-a50e-454b-8ddf-84c9b72be37b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:43.152520 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-844d1e86-a50e-454b-8ddf-84c9b72be37b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:43.156314 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-844d1e86-a50e-454b-8ddf-84c9b72be37b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:43.157584 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-844d1e86-a50e-454b-8ddf-84c9b72be37b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1721 microversion: 2.20 time: 0.554428 Jun 05 08:32:43.173944 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1165/2394] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:42 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1721 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:43.176689 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-aa638427-0573-475d-9a56-85ee62328562 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: c83e9195-8396-4b31-bef0-238994d07031] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:32:43.191953 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fd89a49b-ce09-4101-ab36-b8cc6cdfbeeb tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Calling method '.version_select at 0x7f2433cd05e0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:43.270974 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-aa638427-0573-475d-9a56-85ee62328562 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: c83e9195-8396-4b31-bef0-238994d07031] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:32:43.272134 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-aa638427-0573-475d-9a56-85ee62328562 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:43.272946 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-aa638427-0573-475d-9a56-85ee62328562 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:43.273966 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-aa638427-0573-475d-9a56-85ee62328562 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: c83e9195-8396-4b31-bef0-238994d07031] instance's host None is down, deleting from database Jun 05 08:32:43.284903 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-aa638427-0573-475d-9a56-85ee62328562 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: c83e9195-8396-4b31-bef0-238994d07031] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:32:43.311768 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fd89a49b-ce09-4101-ab36-b8cc6cdfbeeb tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/0197e8848ecc48ddaf938795998d989e" status: 200 len: 371 microversion: 2.1 time: 0.135270 Jun 05 08:32:43.313007 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1166/2395] 10.222.0.33 () {58 vars in 1241 bytes} [Sun Jun 5 08:32:43 2022] GET /compute/v2.1/os-quota-sets/0197e8848ecc48ddaf938795998d989e => generated 371 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:43.350507 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0a122adc-2df6-4ea4-af41-3db2bbeb65ab tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:43.351492 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0a122adc-2df6-4ea4-af41-3db2bbeb65ab tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:43.373565 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=4 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:32:43.386832 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0a122adc-2df6-4ea4-af41-3db2bbeb65ab tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:43.391816 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0a122adc-2df6-4ea4-af41-3db2bbeb65ab tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:43.398621 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0a122adc-2df6-4ea4-af41-3db2bbeb65ab tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:43.404371 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0a122adc-2df6-4ea4-af41-3db2bbeb65ab tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:43.448408 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-aa638427-0573-475d-9a56-85ee62328562 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: c83e9195-8396-4b31-bef0-238994d07031] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:32:43.461564 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-aa638427-0573-475d-9a56-85ee62328562 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: c83e9195-8396-4b31-bef0-238994d07031] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:32:43.597734 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0a122adc-2df6-4ea4-af41-3db2bbeb65ab tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:43.619074 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0a122adc-2df6-4ea4-af41-3db2bbeb65ab tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:43.621132 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0a122adc-2df6-4ea4-af41-3db2bbeb65ab tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:43.628206 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0a122adc-2df6-4ea4-af41-3db2bbeb65ab tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 1346 microversion: 2.25 time: 0.287194 Jun 05 08:32:43.629974 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1167/2396] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:43 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 1346 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:32:43.640839 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-d200d76b-58d3-4100-a13f-93b8bdd10aff req-c5af0039-9441-405b-b837-dc2135dad294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "035abb75-eda1-447d-b034-2bbb171f704e", "name": "network-vif-deleted", "tag": "a81939c6-14ec-4dcc-99cd-55f57077719c"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:32:43.657757 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-d200d76b-58d3-4100-a13f-93b8bdd10aff req-c5af0039-9441-405b-b837-dc2135dad294 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:43.658729 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-d200d76b-58d3-4100-a13f-93b8bdd10aff req-c5af0039-9441-405b-b837-dc2135dad294 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:43.675325 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-d200d76b-58d3-4100-a13f-93b8bdd10aff req-c5af0039-9441-405b-b837-dc2135dad294 service nova] Creating event network-vif-deleted:a81939c6-14ec-4dcc-99cd-55f57077719c for instance 035abb75-eda1-447d-b034-2bbb171f704e on n-h2-844739-1 Jun 05 08:32:43.682030 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-d200d76b-58d3-4100-a13f-93b8bdd10aff req-c5af0039-9441-405b-b837-dc2135dad294 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050417 Jun 05 08:32:43.683746 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1168/2397] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:43.691750 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-994bb04d-5c78-4ee5-bb5b-5b94fdcb1647 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:43.693537 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-994bb04d-5c78-4ee5-bb5b-5b94fdcb1647 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:43.706026 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-994bb04d-5c78-4ee5-bb5b-5b94fdcb1647 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:43.706486 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-994bb04d-5c78-4ee5-bb5b-5b94fdcb1647 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:43.708408 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-994bb04d-5c78-4ee5-bb5b-5b94fdcb1647 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:43.709143 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-994bb04d-5c78-4ee5-bb5b-5b94fdcb1647 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:43.788585 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-aa638427-0573-475d-9a56-85ee62328562 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c83e9195-8396-4b31-bef0-238994d07031" status: 204 len: 0 microversion: 2.1 time: 0.691614 Jun 05 08:32:43.799081 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1230/2398] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:32:43 2022] DELETE /compute/v2.1/servers/c83e9195-8396-4b31-bef0-238994d07031 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:32:43.808525 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-51bd7c82-7380-4fdc-8625-141cbd105c1a tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Calling method '.version_select at 0x7f2433c519d0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:44.101890 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-51bd7c82-7380-4fdc-8625-141cbd105c1a tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/7e2ef15522c14b60b1b04ae2475e11c9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.297086 Jun 05 08:32:44.102556 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1231/2399] 10.222.0.33 () {58 vars in 1268 bytes} [Sun Jun 5 08:32:43 2022] GET /compute/v2.1/os-quota-sets/7e2ef15522c14b60b1b04ae2475e11c9/defaults => generated 371 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:44.109063 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cf08a43a-3f4d-48aa-a3c5-0a832552823d tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:44.110757 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-cf08a43a-3f4d-48aa-a3c5-0a832552823d tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: c83e9195-8396-4b31-bef0-238994d07031] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:44.120959 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cf08a43a-3f4d-48aa-a3c5-0a832552823d tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:44.121908 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cf08a43a-3f4d-48aa-a3c5-0a832552823d tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:44.124992 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cf08a43a-3f4d-48aa-a3c5-0a832552823d tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:44.125621 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cf08a43a-3f4d-48aa-a3c5-0a832552823d tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:44.135697 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-994bb04d-5c78-4ee5-bb5b-5b94fdcb1647 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:44.142874 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:32:44.144900 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-cf08a43a-3f4d-48aa-a3c5-0a832552823d tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] HTTP exception thrown: Instance c83e9195-8396-4b31-bef0-238994d07031 could not be found. Jun 05 08:32:44.147664 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-994bb04d-5c78-4ee5-bb5b-5b94fdcb1647 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cf08a43a-3f4d-48aa-a3c5-0a832552823d tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Request method failure captured: Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/c83e9195-8396-4b31-bef0-238994d07031 HTTP/1.1 Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGomxwdsv5YyqoQnJ8M3HKY493BdT1kF-ZKjGTvsa4dCdMv2tEzSjVIMsusSuNEFxy259rdnBrKrLso7oL5cHjLMPvzuV3e39WGeMwcC-IUAIwS3lJ_NQ03pDpr22BFtYBYlipbszAv78HDt0XYSE3VMC0HZNva_Yj8FUzYwZlfcuNk Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 68ede041c3c744daa44a56817af472d7 Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-DeleteServersTestJSON-753623147 Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/68ede041c3c744daa44a56817af472d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/68ede041c3c744daa44a56817af472d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_68ede041c3c744daa44a56817af472d7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/68ede041c3c744daa44a56817af472d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-DeleteServersTestJSON-753623147 Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 68ede041c3c744daa44a56817af472d7 Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-DeleteServersTestJSON-753623147 Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-DeleteServersTestJSON-753623147-project Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 87be0705721c42878ae5fb2cb21c9c0d Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-DeleteServersTestJSON-753623147-project Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance c83e9195-8396-4b31-bef0-238994d07031 could not be found. Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'c83e9195-8396-4b31-bef0-238994d07031'} Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c83e9195-8396-4b31-bef0-238994d07031 could not be found. Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c83e9195-8396-4b31-bef0-238994d07031 could not be found. Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:32:44.147925 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:44.152901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:44.152901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:32:44.152901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:32:44.152901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:32:44.152901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:32:44.152901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c83e9195-8396-4b31-bef0-238994d07031 could not be found. Jun 05 08:32:44.152901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:44.154926 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cf08a43a-3f4d-48aa-a3c5-0a832552823d tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Returning 404 to user: Instance c83e9195-8396-4b31-bef0-238994d07031 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:32:44.156168 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-cf08a43a-3f4d-48aa-a3c5-0a832552823d tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "GET /compute/v2.1/servers/c83e9195-8396-4b31-bef0-238994d07031" status: 404 len: 111 microversion: 2.1 time: 0.051110 Jun 05 08:32:44.156914 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1232/2400] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:44 2022] GET /compute/v2.1/servers/c83e9195-8396-4b31-bef0-238994d07031 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:32:44.169187 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-994bb04d-5c78-4ee5-bb5b-5b94fdcb1647 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:44.170589 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-994bb04d-5c78-4ee5-bb5b-5b94fdcb1647 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1869 microversion: 2.42 time: 0.485064 Jun 05 08:32:44.180445 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1169/2401] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:43 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1869 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:44.186844 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ad5b4f3f-6d98-4d2d-b9fa-274231854572 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:44.187759 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ad5b4f3f-6d98-4d2d-b9fa-274231854572 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:44.214498 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ad5b4f3f-6d98-4d2d-b9fa-274231854572 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:44.214912 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ad5b4f3f-6d98-4d2d-b9fa-274231854572 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:44.215738 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ad5b4f3f-6d98-4d2d-b9fa-274231854572 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:44.216220 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ad5b4f3f-6d98-4d2d-b9fa-274231854572 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:44.319761 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d5049d60-e3f0-4f38-998c-421417ce9f85 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-125820152", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "6ae041e2-2719-4b5a-8067-42384887402d"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:32:44.407172 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-d5049d60-e3f0-4f38-998c-421417ce9f85 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] validate_networks() for [('6ae041e2-2719-4b5a-8067-42384887402d', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:32:44.952687 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ad5b4f3f-6d98-4d2d-b9fa-274231854572 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:44.965816 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ad5b4f3f-6d98-4d2d-b9fa-274231854572 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:44.969264 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ad5b4f3f-6d98-4d2d-b9fa-274231854572 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:44.974815 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ad5b4f3f-6d98-4d2d-b9fa-274231854572 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1721 microversion: 2.20 time: 0.796707 Jun 05 08:32:44.976101 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1233/2402] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:44 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1721 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:44.991396 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-539735ef-5aa2-4a7f-8371-12f06fd57cd8 tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Action: 'update', calling method: .version_select at 0x7f24338613a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:32:45.252294 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-539735ef-5aa2-4a7f-8371-12f06fd57cd8 tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:45.256329 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-539735ef-5aa2-4a7f-8371-12f06fd57cd8 tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:45.259959 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-539735ef-5aa2-4a7f-8371-12f06fd57cd8 tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:45.260660 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-539735ef-5aa2-4a7f-8371-12f06fd57cd8 tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:45.349054 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-539735ef-5aa2-4a7f-8371-12f06fd57cd8 tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/2e7e349dc0c0431aa79fb8720b2a9e24" status: 200 len: 328 microversion: 2.1 time: 0.370812 Jun 05 08:32:45.350999 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1234/2403] 10.222.0.33 () {60 vars in 1261 bytes} [Sun Jun 5 08:32:44 2022] PUT /compute/v2.1/os-quota-sets/2e7e349dc0c0431aa79fb8720b2a9e24 => generated 328 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:45.359256 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-92eaf8ff-1c34-465d-809a-d72b69b8f089 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:45.360698 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-92eaf8ff-1c34-465d-809a-d72b69b8f089 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] [instance: 035abb75-eda1-447d-b034-2bbb171f704e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:45.369655 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-92eaf8ff-1c34-465d-809a-d72b69b8f089 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:45.370473 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-92eaf8ff-1c34-465d-809a-d72b69b8f089 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:45.371910 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-92eaf8ff-1c34-465d-809a-d72b69b8f089 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:45.372742 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-92eaf8ff-1c34-465d-809a-d72b69b8f089 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:45.418138 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-92eaf8ff-1c34-465d-809a-d72b69b8f089 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:45.418885 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-92eaf8ff-1c34-465d-809a-d72b69b8f089 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:45.419519 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-92eaf8ff-1c34-465d-809a-d72b69b8f089 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Lazy-loading 'fault' on Instance uuid 035abb75-eda1-447d-b034-2bbb171f704e {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:32:45.822217 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-92eaf8ff-1c34-465d-809a-d72b69b8f089 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:45.835779 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-d5049d60-e3f0-4f38-998c-421417ce9f85 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:32:45.836512 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-d5049d60-e3f0-4f38-998c-421417ce9f85 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:32:45.837456 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-d5049d60-e3f0-4f38-998c-421417ce9f85 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:32:45.838629 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-d5049d60-e3f0-4f38-998c-421417ce9f85 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:32:45.839061 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-d5049d60-e3f0-4f38-998c-421417ce9f85 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:32:45.840095 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-92eaf8ff-1c34-465d-809a-d72b69b8f089 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:45.841644 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-92eaf8ff-1c34-465d-809a-d72b69b8f089 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '03720c07cc1e4ae6a2c621b1d3feed9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5c1766af9c4e079f74b67177db0246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:45.842825 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-92eaf8ff-1c34-465d-809a-d72b69b8f089 tempest-LiveAutoBlockMigrationV225Test-440279431 tempest-LiveAutoBlockMigrationV225Test-440279431-project] 10.222.0.33 "GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e" status: 200 len: 1406 microversion: 2.25 time: 0.489754 Jun 05 08:32:45.856515 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1235/2404] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:45 2022] GET /compute/v2.1/servers/035abb75-eda1-447d-b034-2bbb171f704e => generated 1406 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:45.856515 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d556a3da-f2e8-415b-aa2d-ef66233946df tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Calling method '.version_select at 0x7f243396d430>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:45.864197 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d5049d60-e3f0-4f38-998c-421417ce9f85 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:45.864658 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d5049d60-e3f0-4f38-998c-421417ce9f85 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:45.866042 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d5049d60-e3f0-4f38-998c-421417ce9f85 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:45.866263 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d5049d60-e3f0-4f38-998c-421417ce9f85 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:45.918429 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d556a3da-f2e8-415b-aa2d-ef66233946df tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] 10.222.0.33 "GET /compute/v2.1/images/b654274e-0d99-4d09-a446-3589beac4b43" status: 200 len: 662 microversion: 2.1 time: 0.073113 Jun 05 08:32:45.922298 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1236/2405] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:32:45 2022] GET /compute/v2.1/images/b654274e-0d99-4d09-a446-3589beac4b43 => generated 662 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:45.936916 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ca6eed2c-60f8-4ad3-adc0-9f55d4900b95 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:45.937947 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ca6eed2c-60f8-4ad3-adc0-9f55d4900b95 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:45.946475 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-d5049d60-e3f0-4f38-998c-421417ce9f85 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Getting quotas for project 68ede041c3c744daa44a56817af472d7. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:32:45.950585 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ca6eed2c-60f8-4ad3-adc0-9f55d4900b95 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:45.951309 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ca6eed2c-60f8-4ad3-adc0-9f55d4900b95 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:45.953661 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ca6eed2c-60f8-4ad3-adc0-9f55d4900b95 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:45.955484 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ca6eed2c-60f8-4ad3-adc0-9f55d4900b95 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:45.984316 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-d5049d60-e3f0-4f38-998c-421417ce9f85 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Getting quotas for user 87be0705721c42878ae5fb2cb21c9c0d and project 68ede041c3c744daa44a56817af472d7. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:32:46.042719 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d5049d60-e3f0-4f38-998c-421417ce9f85 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:32:46.050720 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d5049d60-e3f0-4f38-998c-421417ce9f85 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: a9fca4aa-f2ee-42b9-a9f8-54b5abb012d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:32:46.237126 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d5049d60-e3f0-4f38-998c-421417ce9f85 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.916117 Jun 05 08:32:46.238473 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1170/2406] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:32:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:32:46.247486 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-eff42bd3-d976-4f95-bf54-36298d4a67d0 tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Calling method '.version_select at 0x7f2433d738b0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:46.408832 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-eff42bd3-d976-4f95-bf54-36298d4a67d0 tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:46.411519 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-eff42bd3-d976-4f95-bf54-36298d4a67d0 tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:46.412718 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-eff42bd3-d976-4f95-bf54-36298d4a67d0 tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:46.414742 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-eff42bd3-d976-4f95-bf54-36298d4a67d0 tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:46.458772 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-eff42bd3-d976-4f95-bf54-36298d4a67d0 tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/2e7e349dc0c0431aa79fb8720b2a9e24/detail" status: 200 len: 916 microversion: 2.1 time: 0.218526 Jun 05 08:32:46.467199 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ca6eed2c-60f8-4ad3-adc0-9f55d4900b95 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:46.479917 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1171/2407] 10.222.0.33 () {58 vars in 1262 bytes} [Sun Jun 5 08:32:46 2022] GET /compute/v2.1/os-quota-sets/2e7e349dc0c0431aa79fb8720b2a9e24/detail => generated 916 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:46.479917 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4471d509-063e-43ef-9075-15fcd7105cee tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Calling method '.version_select at 0x7f2433c8e160>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:46.495874 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ca6eed2c-60f8-4ad3-adc0-9f55d4900b95 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:46.504118 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ca6eed2c-60f8-4ad3-adc0-9f55d4900b95 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:46.509306 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ca6eed2c-60f8-4ad3-adc0-9f55d4900b95 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1869 microversion: 2.42 time: 0.585627 Jun 05 08:32:46.511824 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1237/2408] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:45 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1869 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:46.535489 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cf968075-3c8c-4b80-b9a8-11bfae9b24f3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:46.537730 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-cf968075-3c8c-4b80-b9a8-11bfae9b24f3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:46.561563 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cf968075-3c8c-4b80-b9a8-11bfae9b24f3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:46.566569 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cf968075-3c8c-4b80-b9a8-11bfae9b24f3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:46.567532 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cf968075-3c8c-4b80-b9a8-11bfae9b24f3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:46.567867 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cf968075-3c8c-4b80-b9a8-11bfae9b24f3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:46.585660 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4471d509-063e-43ef-9075-15fcd7105cee tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] 10.222.0.33 "GET /compute/v2.1/images/b654274e-0d99-4d09-a446-3589beac4b43" status: 200 len: 662 microversion: 2.1 time: 0.112473 Jun 05 08:32:46.592376 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1172/2409] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:32:46 2022] GET /compute/v2.1/images/b654274e-0d99-4d09-a446-3589beac4b43 => generated 662 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:46.611418 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1982c031-69b7-4993-8366-64d2e7343e18 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:46.620572 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1982c031-69b7-4993-8366-64d2e7343e18 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: a9fca4aa-f2ee-42b9-a9f8-54b5abb012d5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:46.646757 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1982c031-69b7-4993-8366-64d2e7343e18 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:46.647481 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1982c031-69b7-4993-8366-64d2e7343e18 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:46.648300 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1982c031-69b7-4993-8366-64d2e7343e18 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:46.648741 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1982c031-69b7-4993-8366-64d2e7343e18 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:46.754558 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1982c031-69b7-4993-8366-64d2e7343e18 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:46.755041 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1982c031-69b7-4993-8366-64d2e7343e18 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:46.756916 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-1982c031-69b7-4993-8366-64d2e7343e18 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lazy-loading 'fault' on Instance uuid a9fca4aa-f2ee-42b9-a9f8-54b5abb012d5 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:32:46.950923 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-1982c031-69b7-4993-8366-64d2e7343e18 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87be0705721c42878ae5fb2cb21c9c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ede041c3c744daa44a56817af472d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:46.976914 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1982c031-69b7-4993-8366-64d2e7343e18 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "GET /compute/v2.1/servers/a9fca4aa-f2ee-42b9-a9f8-54b5abb012d5" status: 200 len: 1287 microversion: 2.1 time: 0.375453 Jun 05 08:32:46.977895 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1173/2410] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:46 2022] GET /compute/v2.1/servers/a9fca4aa-f2ee-42b9-a9f8-54b5abb012d5 => generated 1287 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:46.982714 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-649a8c83-2c66-4a4f-bc5e-7956ca4f9cae tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Action: 'update', calling method: .version_select at 0x7f24339c95e0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:32:47.148815 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-649a8c83-2c66-4a4f-bc5e-7956ca4f9cae tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:47.149466 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-649a8c83-2c66-4a4f-bc5e-7956ca4f9cae tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:47.150292 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-649a8c83-2c66-4a4f-bc5e-7956ca4f9cae tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:47.150882 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-649a8c83-2c66-4a4f-bc5e-7956ca4f9cae tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:47.199512 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-649a8c83-2c66-4a4f-bc5e-7956ca4f9cae tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:47.200285 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-649a8c83-2c66-4a4f-bc5e-7956ca4f9cae tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:47.201411 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-649a8c83-2c66-4a4f-bc5e-7956ca4f9cae tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:47.201850 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-649a8c83-2c66-4a4f-bc5e-7956ca4f9cae tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:47.264808 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-cf968075-3c8c-4b80-b9a8-11bfae9b24f3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:47.279986 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-cf968075-3c8c-4b80-b9a8-11bfae9b24f3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:47.284397 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-cf968075-3c8c-4b80-b9a8-11bfae9b24f3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:47.288027 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-cf968075-3c8c-4b80-b9a8-11bfae9b24f3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1721 microversion: 2.20 time: 0.773520 Jun 05 08:32:47.293300 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1238/2411] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:46 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1721 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:47.298382 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-649a8c83-2c66-4a4f-bc5e-7956ca4f9cae tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/2e7e349dc0c0431aa79fb8720b2a9e24?user_id=5b267ede1b954d66bb38ec62e5a02915" status: 200 len: 328 microversion: 2.1 time: 0.318539 Jun 05 08:32:47.299280 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1174/2412] 10.222.0.33 () {60 vars in 1342 bytes} [Sun Jun 5 08:32:46 2022] PUT /compute/v2.1/os-quota-sets/2e7e349dc0c0431aa79fb8720b2a9e24?user_id=5b267ede1b954d66bb38ec62e5a02915 => generated 328 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:47.311289 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-531b044c-1a51-4aaf-a30f-1fff6be1903a tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Calling method '.version_select at 0x7f2433996160>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:47.462198 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-531b044c-1a51-4aaf-a30f-1fff6be1903a tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/2e7e349dc0c0431aa79fb8720b2a9e24?user_id=5b267ede1b954d66bb38ec62e5a02915" status: 200 len: 370 microversion: 2.1 time: 0.156168 Jun 05 08:32:47.462814 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1239/2413] 10.222.0.33 () {58 vars in 1322 bytes} [Sun Jun 5 08:32:47 2022] GET /compute/v2.1/os-quota-sets/2e7e349dc0c0431aa79fb8720b2a9e24?user_id=5b267ede1b954d66bb38ec62e5a02915 => generated 370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:47.531763 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-dd0daae7-756e-47c6-ab91-eec8207698d6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:47.533388 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-dd0daae7-756e-47c6-ab91-eec8207698d6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:47.544479 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dd0daae7-756e-47c6-ab91-eec8207698d6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:47.548160 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dd0daae7-756e-47c6-ab91-eec8207698d6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:47.554745 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dd0daae7-756e-47c6-ab91-eec8207698d6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:47.555781 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dd0daae7-756e-47c6-ab91-eec8207698d6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:47.997994 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6901a2cb-83dc-4bde-95d4-dbf9c9a8c26b tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:47.999271 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6901a2cb-83dc-4bde-95d4-dbf9c9a8c26b tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: a9fca4aa-f2ee-42b9-a9f8-54b5abb012d5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:48.017729 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6901a2cb-83dc-4bde-95d4-dbf9c9a8c26b tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:48.023379 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6901a2cb-83dc-4bde-95d4-dbf9c9a8c26b tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:48.027829 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6901a2cb-83dc-4bde-95d4-dbf9c9a8c26b tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:48.028341 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6901a2cb-83dc-4bde-95d4-dbf9c9a8c26b tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:48.096322 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-dd0daae7-756e-47c6-ab91-eec8207698d6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:48.122956 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-dd0daae7-756e-47c6-ab91-eec8207698d6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:48.131518 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-dd0daae7-756e-47c6-ab91-eec8207698d6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:48.133314 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-dd0daae7-756e-47c6-ab91-eec8207698d6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1869 microversion: 2.42 time: 0.606146 Jun 05 08:32:48.147649 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1175/2414] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:47 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1869 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:48.148182 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6901a2cb-83dc-4bde-95d4-dbf9c9a8c26b tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:48.148714 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6901a2cb-83dc-4bde-95d4-dbf9c9a8c26b tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:48.149192 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-6901a2cb-83dc-4bde-95d4-dbf9c9a8c26b tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lazy-loading 'fault' on Instance uuid a9fca4aa-f2ee-42b9-a9f8-54b5abb012d5 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:32:48.161266 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-808613b9-1bcf-4a0e-ae70-407ac410c639 tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Calling method '.version_select at 0x7f24453e31f0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:48.390350 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6901a2cb-83dc-4bde-95d4-dbf9c9a8c26b tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87be0705721c42878ae5fb2cb21c9c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ede041c3c744daa44a56817af472d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:48.418161 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6901a2cb-83dc-4bde-95d4-dbf9c9a8c26b tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "GET /compute/v2.1/servers/a9fca4aa-f2ee-42b9-a9f8-54b5abb012d5" status: 200 len: 1287 microversion: 2.1 time: 0.415957 Jun 05 08:32:48.421235 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1240/2415] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:47 2022] GET /compute/v2.1/servers/a9fca4aa-f2ee-42b9-a9f8-54b5abb012d5 => generated 1287 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:48.431357 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4222001b-932b-469b-8207-16f7af7d4a52 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:48.432983 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4222001b-932b-469b-8207-16f7af7d4a52 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:48.456650 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4222001b-932b-469b-8207-16f7af7d4a52 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:48.457683 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4222001b-932b-469b-8207-16f7af7d4a52 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:48.458808 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4222001b-932b-469b-8207-16f7af7d4a52 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:48.459512 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4222001b-932b-469b-8207-16f7af7d4a52 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:48.671063 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-808613b9-1bcf-4a0e-ae70-407ac410c639 tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/7e2ef15522c14b60b1b04ae2475e11c9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.459396 Jun 05 08:32:48.671063 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1176/2416] 10.222.0.33 () {58 vars in 1268 bytes} [Sun Jun 5 08:32:48 2022] GET /compute/v2.1/os-quota-sets/7e2ef15522c14b60b1b04ae2475e11c9/defaults => generated 371 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:48.671063 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5ec7dd7e-af9e-4df4-8097-8ae35ab48c54 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:48.671063 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5ec7dd7e-af9e-4df4-8097-8ae35ab48c54 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: a9fca4aa-f2ee-42b9-a9f8-54b5abb012d5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:48.671063 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5ec7dd7e-af9e-4df4-8097-8ae35ab48c54 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:48.671063 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5ec7dd7e-af9e-4df4-8097-8ae35ab48c54 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:48.671063 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5ec7dd7e-af9e-4df4-8097-8ae35ab48c54 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:48.671063 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5ec7dd7e-af9e-4df4-8097-8ae35ab48c54 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:48.771135 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5ec7dd7e-af9e-4df4-8097-8ae35ab48c54 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: a9fca4aa-f2ee-42b9-a9f8-54b5abb012d5] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:32:48.987570 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5ec7dd7e-af9e-4df4-8097-8ae35ab48c54 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: a9fca4aa-f2ee-42b9-a9f8-54b5abb012d5] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:32:48.989832 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5ec7dd7e-af9e-4df4-8097-8ae35ab48c54 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:48.990540 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5ec7dd7e-af9e-4df4-8097-8ae35ab48c54 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:48.991177 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-5ec7dd7e-af9e-4df4-8097-8ae35ab48c54 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: a9fca4aa-f2ee-42b9-a9f8-54b5abb012d5] instance's host None is down, deleting from database Jun 05 08:32:48.997261 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-5ec7dd7e-af9e-4df4-8097-8ae35ab48c54 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: a9fca4aa-f2ee-42b9-a9f8-54b5abb012d5] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:32:49.102270 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-5ec7dd7e-af9e-4df4-8097-8ae35ab48c54 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: a9fca4aa-f2ee-42b9-a9f8-54b5abb012d5] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:32:49.111589 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-5ec7dd7e-af9e-4df4-8097-8ae35ab48c54 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: a9fca4aa-f2ee-42b9-a9f8-54b5abb012d5] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:32:49.196908 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4222001b-932b-469b-8207-16f7af7d4a52 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:49.219908 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4222001b-932b-469b-8207-16f7af7d4a52 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:49.225958 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4222001b-932b-469b-8207-16f7af7d4a52 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:49.229211 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4222001b-932b-469b-8207-16f7af7d4a52 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1721 microversion: 2.20 time: 0.805122 Jun 05 08:32:49.230845 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1241/2417] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:48 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1721 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:49.246484 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0b726939-b30f-40f2-a8ec-e123f82649f5 tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Action: 'update', calling method: .version_select at 0x7f24337caa60>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:32:49.409162 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0b726939-b30f-40f2-a8ec-e123f82649f5 tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:49.409988 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0b726939-b30f-40f2-a8ec-e123f82649f5 tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:49.410951 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0b726939-b30f-40f2-a8ec-e123f82649f5 tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:49.411573 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0b726939-b30f-40f2-a8ec-e123f82649f5 tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:49.431851 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5ec7dd7e-af9e-4df4-8097-8ae35ab48c54 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a9fca4aa-f2ee-42b9-a9f8-54b5abb012d5" status: 204 len: 0 microversion: 2.1 time: 0.812610 Jun 05 08:32:49.433741 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1177/2418] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:32:48 2022] DELETE /compute/v2.1/servers/a9fca4aa-f2ee-42b9-a9f8-54b5abb012d5 => generated 0 bytes in 816 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:32:49.445919 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-68aed67d-d094-4079-b68f-df863ef741ae tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Calling method '.version_select at 0x7f24453fab80>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:49.529304 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-68aed67d-d094-4079-b68f-df863ef741ae tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] 10.222.0.33 "GET /compute/v2.1/images/a18fb544-7619-4179-ab09-1d5117aa8a92" status: 200 len: 661 microversion: 2.1 time: 0.094241 Jun 05 08:32:49.530276 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1178/2419] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:32:49 2022] GET /compute/v2.1/images/a18fb544-7619-4179-ab09-1d5117aa8a92 => generated 661 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:49.542680 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-67245900-956d-4093-967a-bb8ba6a98917 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:49.543664 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-67245900-956d-4093-967a-bb8ba6a98917 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:49.551767 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-67245900-956d-4093-967a-bb8ba6a98917 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:49.552391 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-67245900-956d-4093-967a-bb8ba6a98917 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:49.553313 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-67245900-956d-4093-967a-bb8ba6a98917 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:49.554051 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-67245900-956d-4093-967a-bb8ba6a98917 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:49.662925 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=10 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:32:49.818440 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0b726939-b30f-40f2-a8ec-e123f82649f5 tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/7e2ef15522c14b60b1b04ae2475e11c9" status: 200 len: 329 microversion: 2.1 time: 0.585086 Jun 05 08:32:49.830388 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1242/2420] 10.222.0.33 () {60 vars in 1262 bytes} [Sun Jun 5 08:32:49 2022] PUT /compute/v2.1/os-quota-sets/7e2ef15522c14b60b1b04ae2475e11c9 => generated 329 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:49.835828 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-af968a1d-c253-4e65-9c89-1bb99c51fab0 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:49.836787 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-af968a1d-c253-4e65-9c89-1bb99c51fab0 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: a9fca4aa-f2ee-42b9-a9f8-54b5abb012d5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:49.851828 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-af968a1d-c253-4e65-9c89-1bb99c51fab0 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:49.852512 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-af968a1d-c253-4e65-9c89-1bb99c51fab0 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:49.853749 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-af968a1d-c253-4e65-9c89-1bb99c51fab0 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:49.855407 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-af968a1d-c253-4e65-9c89-1bb99c51fab0 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:49.886356 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-af968a1d-c253-4e65-9c89-1bb99c51fab0 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] HTTP exception thrown: Instance a9fca4aa-f2ee-42b9-a9f8-54b5abb012d5 could not be found. Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-af968a1d-c253-4e65-9c89-1bb99c51fab0 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Request method failure captured: Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/a9fca4aa-f2ee-42b9-a9f8-54b5abb012d5 HTTP/1.1 Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGomxwdsv5YyqoQnJ8M3HKY493BdT1kF-ZKjGTvsa4dCdMv2tEzSjVIMsusSuNEFxy259rdnBrKrLso7oL5cHjLMPvzuV3e39WGeMwcC-IUAIwS3lJ_NQ03pDpr22BFtYBYlipbszAv78HDt0XYSE3VMC0HZNva_Yj8FUzYwZlfcuNk Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 68ede041c3c744daa44a56817af472d7 Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-DeleteServersTestJSON-753623147 Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/68ede041c3c744daa44a56817af472d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/68ede041c3c744daa44a56817af472d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_68ede041c3c744daa44a56817af472d7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/68ede041c3c744daa44a56817af472d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-DeleteServersTestJSON-753623147 Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 68ede041c3c744daa44a56817af472d7 Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-DeleteServersTestJSON-753623147 Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-DeleteServersTestJSON-753623147-project Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 87be0705721c42878ae5fb2cb21c9c0d Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-DeleteServersTestJSON-753623147-project Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance a9fca4aa-f2ee-42b9-a9f8-54b5abb012d5 could not be found. Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'a9fca4aa-f2ee-42b9-a9f8-54b5abb012d5'} Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9fca4aa-f2ee-42b9-a9f8-54b5abb012d5 could not be found. Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9fca4aa-f2ee-42b9-a9f8-54b5abb012d5 could not be found. Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:32:49.888312 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:49.891589 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:49.891589 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:32:49.891589 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:32:49.891589 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:32:49.891589 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:32:49.891589 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9fca4aa-f2ee-42b9-a9f8-54b5abb012d5 could not be found. Jun 05 08:32:49.891589 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:49.891589 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-af968a1d-c253-4e65-9c89-1bb99c51fab0 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Returning 404 to user: Instance a9fca4aa-f2ee-42b9-a9f8-54b5abb012d5 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:32:49.891589 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-af968a1d-c253-4e65-9c89-1bb99c51fab0 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "GET /compute/v2.1/servers/a9fca4aa-f2ee-42b9-a9f8-54b5abb012d5" status: 404 len: 111 microversion: 2.1 time: 0.058111 Jun 05 08:32:49.891589 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1243/2421] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:49 2022] GET /compute/v2.1/servers/a9fca4aa-f2ee-42b9-a9f8-54b5abb012d5 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:32:49.909405 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cdb357fe-9901-4760-a072-6131643d5e68 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Calling method '.version_select at 0x7f24339d64c0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:49.989195 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-67245900-956d-4093-967a-bb8ba6a98917 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:49.996065 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-cdb357fe-9901-4760-a072-6131643d5e68 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] 10.222.0.33 "GET /compute/v2.1/images/a18fb544-7619-4179-ab09-1d5117aa8a92" status: 200 len: 661 microversion: 2.1 time: 0.104293 Jun 05 08:32:49.998926 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-67245900-956d-4093-967a-bb8ba6a98917 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:50.000111 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1244/2422] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:32:49 2022] GET /compute/v2.1/images/a18fb544-7619-4179-ab09-1d5117aa8a92 => generated 661 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:50.000469 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-67245900-956d-4093-967a-bb8ba6a98917 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:50.001685 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-67245900-956d-4093-967a-bb8ba6a98917 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1869 microversion: 2.42 time: 0.462891 Jun 05 08:32:50.002227 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1179/2423] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:49 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1869 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:50.024647 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-21913228-6845-49f8-9406-c184c49e0930 tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Action: 'update', calling method: .version_select at 0x7f2433a70280>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:32:50.522836 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-aaa9ce62-25b8-41aa-be8c-669a12831650 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-654045103", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "3237d672-f2a7-48e9-afc8-0c5c877fbba7"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:32:50.603295 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-aaa9ce62-25b8-41aa-be8c-669a12831650 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] validate_networks() for [('3237d672-f2a7-48e9-afc8-0c5c877fbba7', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:32:50.652521 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-21913228-6845-49f8-9406-c184c49e0930 tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:50.653551 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-21913228-6845-49f8-9406-c184c49e0930 tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:50.654509 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-21913228-6845-49f8-9406-c184c49e0930 tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:50.655348 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-21913228-6845-49f8-9406-c184c49e0930 tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:50.934245 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=10,nova_api:UPDATE=6 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:32:51.226077 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-aaa9ce62-25b8-41aa-be8c-669a12831650 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:32:51.226502 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-aaa9ce62-25b8-41aa-be8c-669a12831650 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:32:51.227065 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-aaa9ce62-25b8-41aa-be8c-669a12831650 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:32:51.227493 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-aaa9ce62-25b8-41aa-be8c-669a12831650 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:32:51.228184 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-aaa9ce62-25b8-41aa-be8c-669a12831650 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:32:51.243222 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-aaa9ce62-25b8-41aa-be8c-669a12831650 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:51.243222 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-aaa9ce62-25b8-41aa-be8c-669a12831650 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:51.248781 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-aaa9ce62-25b8-41aa-be8c-669a12831650 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:51.249259 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-aaa9ce62-25b8-41aa-be8c-669a12831650 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:51.252867 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-21913228-6845-49f8-9406-c184c49e0930 tempest-QuotasAdminTestJSON-985482910 tempest-QuotasAdminTestJSON-985482910-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/7e2ef15522c14b60b1b04ae2475e11c9" status: 200 len: 329 microversion: 2.1 time: 1.239437 Jun 05 08:32:51.254234 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1180/2424] 10.222.0.33 () {60 vars in 1262 bytes} [Sun Jun 5 08:32:50 2022] PUT /compute/v2.1/os-quota-sets/7e2ef15522c14b60b1b04ae2475e11c9 => generated 329 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:51.260912 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7cb005d8-f8ba-4a09-8899-aa6514c2e7b8 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1766217446", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "6ae041e2-2719-4b5a-8067-42384887402d"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:32:51.298362 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-aaa9ce62-25b8-41aa-be8c-669a12831650 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Getting quotas for project dd018e48c5d847c3b27b9cb4d42bdc79. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:32:51.306074 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-aaa9ce62-25b8-41aa-be8c-669a12831650 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Getting quotas for user 00ea24535938453fa4e9cb66b29cab70 and project dd018e48c5d847c3b27b9cb4d42bdc79. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:32:51.322286 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-aaa9ce62-25b8-41aa-be8c-669a12831650 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:32:51.326182 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-aaa9ce62-25b8-41aa-be8c-669a12831650 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] [instance: 8747ad78-e4aa-4b25-91c9-60884bac393f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:32:51.372275 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-7cb005d8-f8ba-4a09-8899-aa6514c2e7b8 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] validate_networks() for [('6ae041e2-2719-4b5a-8067-42384887402d', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:32:51.407078 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-aaa9ce62-25b8-41aa-be8c-669a12831650 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.406014 Jun 05 08:32:51.411533 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1245/2425] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:32:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1411 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:32:51.422623 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fc68b458-2224-4be2-864c-b3a4177844b9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:51.427126 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-fc68b458-2224-4be2-864c-b3a4177844b9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:51.450592 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fc68b458-2224-4be2-864c-b3a4177844b9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:51.451589 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fc68b458-2224-4be2-864c-b3a4177844b9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:51.453602 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fc68b458-2224-4be2-864c-b3a4177844b9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:51.454912 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fc68b458-2224-4be2-864c-b3a4177844b9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:51.992441 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-fc68b458-2224-4be2-864c-b3a4177844b9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:52.012906 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-fc68b458-2224-4be2-864c-b3a4177844b9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:52.014799 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-fc68b458-2224-4be2-864c-b3a4177844b9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:52.016309 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fc68b458-2224-4be2-864c-b3a4177844b9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1721 microversion: 2.20 time: 0.603336 Jun 05 08:32:52.017124 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1246/2426] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:51 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1721 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:52.022255 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1ae5c7c0-7fcc-465c-aad2-7bd095981f11 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-758900177", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:32:52.101985 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-1ae5c7c0-7fcc-465c-aad2-7bd095981f11 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] validate_networks() for None {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:32:52.635729 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-7cb005d8-f8ba-4a09-8899-aa6514c2e7b8 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:32:52.636992 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-7cb005d8-f8ba-4a09-8899-aa6514c2e7b8 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:32:52.638255 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-7cb005d8-f8ba-4a09-8899-aa6514c2e7b8 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:32:52.638961 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-7cb005d8-f8ba-4a09-8899-aa6514c2e7b8 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:32:52.639601 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-7cb005d8-f8ba-4a09-8899-aa6514c2e7b8 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:32:52.663515 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7cb005d8-f8ba-4a09-8899-aa6514c2e7b8 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:52.664238 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7cb005d8-f8ba-4a09-8899-aa6514c2e7b8 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:52.665729 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7cb005d8-f8ba-4a09-8899-aa6514c2e7b8 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:52.666561 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7cb005d8-f8ba-4a09-8899-aa6514c2e7b8 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:52.696355 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-7cb005d8-f8ba-4a09-8899-aa6514c2e7b8 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Getting quotas for project 68ede041c3c744daa44a56817af472d7. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:32:52.703523 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-7cb005d8-f8ba-4a09-8899-aa6514c2e7b8 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Getting quotas for user 87be0705721c42878ae5fb2cb21c9c0d and project 68ede041c3c744daa44a56817af472d7. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:32:52.719727 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-1ae5c7c0-7fcc-465c-aad2-7bd095981f11 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:32:52.720258 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-1ae5c7c0-7fcc-465c-aad2-7bd095981f11 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:32:52.720926 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-1ae5c7c0-7fcc-465c-aad2-7bd095981f11 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:32:52.721493 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-1ae5c7c0-7fcc-465c-aad2-7bd095981f11 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:32:52.721924 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-1ae5c7c0-7fcc-465c-aad2-7bd095981f11 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:32:52.724833 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7cb005d8-f8ba-4a09-8899-aa6514c2e7b8 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:32:52.728009 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7cb005d8-f8ba-4a09-8899-aa6514c2e7b8 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: dfc870d3-6d2b-4e93-ac38-223552ca76c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:32:52.746737 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1ae5c7c0-7fcc-465c-aad2-7bd095981f11 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:52.747692 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1ae5c7c0-7fcc-465c-aad2-7bd095981f11 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:52.748797 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1ae5c7c0-7fcc-465c-aad2-7bd095981f11 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:52.749275 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1ae5c7c0-7fcc-465c-aad2-7bd095981f11 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:52.800852 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-1ae5c7c0-7fcc-465c-aad2-7bd095981f11 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Getting quotas for project df337986c7f746a683e93491b82e8219. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:32:52.817109 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-1ae5c7c0-7fcc-465c-aad2-7bd095981f11 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Getting quotas for user 66890badcc7d4a3d9cdd230a9a3a97a8 and project df337986c7f746a683e93491b82e8219. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:32:52.823135 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7cb005d8-f8ba-4a09-8899-aa6514c2e7b8 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.566240 Jun 05 08:32:52.824766 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1181/2427] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:32:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:32:52.831930 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5a48c39b-dac2-4989-861d-86724ed30c7b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:52.834191 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5a48c39b-dac2-4989-861d-86724ed30c7b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:52.844866 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a48c39b-dac2-4989-861d-86724ed30c7b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:52.845637 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a48c39b-dac2-4989-861d-86724ed30c7b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:52.847035 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a48c39b-dac2-4989-861d-86724ed30c7b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:52.847730 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a48c39b-dac2-4989-861d-86724ed30c7b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:52.894017 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1ae5c7c0-7fcc-465c-aad2-7bd095981f11 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:32:52.903703 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1ae5c7c0-7fcc-465c-aad2-7bd095981f11 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] [instance: 8a1be07c-efab-48c3-874c-1f15ee7f220d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:32:53.031196 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1ae5c7c0-7fcc-465c-aad2-7bd095981f11 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.012617 Jun 05 08:32:53.031864 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1247/2428] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:32:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:32:53.052595 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1b4362da-db0a-40c2-8c20-8174a527e246 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:53.053188 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1b4362da-db0a-40c2-8c20-8174a527e246 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] [instance: 8747ad78-e4aa-4b25-91c9-60884bac393f] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:53.116116 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1b4362da-db0a-40c2-8c20-8174a527e246 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:53.117060 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1b4362da-db0a-40c2-8c20-8174a527e246 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:53.120532 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1b4362da-db0a-40c2-8c20-8174a527e246 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:53.123763 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1b4362da-db0a-40c2-8c20-8174a527e246 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:53.244303 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1b4362da-db0a-40c2-8c20-8174a527e246 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:53.258425 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1b4362da-db0a-40c2-8c20-8174a527e246 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:53.258425 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-1b4362da-db0a-40c2-8c20-8174a527e246 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Lazy-loading 'fault' on Instance uuid 8747ad78-e4aa-4b25-91c9-60884bac393f {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:32:53.277836 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5a48c39b-dac2-4989-861d-86724ed30c7b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:53.308998 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5a48c39b-dac2-4989-861d-86724ed30c7b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:53.319175 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5a48c39b-dac2-4989-861d-86724ed30c7b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:53.319175 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5a48c39b-dac2-4989-861d-86724ed30c7b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1869 microversion: 2.42 time: 0.491700 Jun 05 08:32:53.330055 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1182/2429] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:52 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1869 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:53.335868 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-c317d7d5-203b-4118-8750-75782d1ed2c7 req-2134bdaa-0362-4091-b2a9-34edd78cc1f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40933e98-d7d3-4d63-9012-ad5607e45085", "name": "network-vif-plugged", "status": "completed", "tag": "4b72d95e-c895-455c-8626-04e2ca35dbf3"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:32:53.365346 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-c317d7d5-203b-4118-8750-75782d1ed2c7 req-2134bdaa-0362-4091-b2a9-34edd78cc1f6 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:53.366275 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-c317d7d5-203b-4118-8750-75782d1ed2c7 req-2134bdaa-0362-4091-b2a9-34edd78cc1f6 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:53.390236 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1b4362da-db0a-40c2-8c20-8174a527e246 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ea24535938453fa4e9cb66b29cab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd018e48c5d847c3b27b9cb4d42bdc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:53.402895 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1b4362da-db0a-40c2-8c20-8174a527e246 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] 10.222.0.33 "GET /compute/v2.1/servers/8747ad78-e4aa-4b25-91c9-60884bac393f" status: 200 len: 1304 microversion: 2.1 time: 0.369683 Jun 05 08:32:53.403525 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1248/2430] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:53 2022] GET /compute/v2.1/servers/8747ad78-e4aa-4b25-91c9-60884bac393f => generated 1304 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:53.412225 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-c317d7d5-203b-4118-8750-75782d1ed2c7 req-2134bdaa-0362-4091-b2a9-34edd78cc1f6 service nova] Creating event network-vif-plugged:4b72d95e-c895-455c-8626-04e2ca35dbf3 for instance 40933e98-d7d3-4d63-9012-ad5607e45085 on n-h1-844739-1 Jun 05 08:32:53.417110 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-51b58315-4b3d-4599-9aac-5df671385bd5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:53.417796 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-51b58315-4b3d-4599-9aac-5df671385bd5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: dfc870d3-6d2b-4e93-ac38-223552ca76c2] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:53.427172 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-c317d7d5-203b-4118-8750-75782d1ed2c7 req-2134bdaa-0362-4091-b2a9-34edd78cc1f6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093526 Jun 05 08:32:53.428822 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1183/2431] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:53.433188 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-51b58315-4b3d-4599-9aac-5df671385bd5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:53.433660 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-51b58315-4b3d-4599-9aac-5df671385bd5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:53.434464 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-51b58315-4b3d-4599-9aac-5df671385bd5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:53.436230 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-51b58315-4b3d-4599-9aac-5df671385bd5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:53.444863 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-babe83aa-6e9a-45a7-87c8-f18912850ca3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:53.449033 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-babe83aa-6e9a-45a7-87c8-f18912850ca3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:53.465249 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-babe83aa-6e9a-45a7-87c8-f18912850ca3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:53.469528 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-babe83aa-6e9a-45a7-87c8-f18912850ca3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:53.474849 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-babe83aa-6e9a-45a7-87c8-f18912850ca3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:53.476387 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-babe83aa-6e9a-45a7-87c8-f18912850ca3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:53.525240 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-51b58315-4b3d-4599-9aac-5df671385bd5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:53.525705 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-51b58315-4b3d-4599-9aac-5df671385bd5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:53.528237 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-51b58315-4b3d-4599-9aac-5df671385bd5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lazy-loading 'fault' on Instance uuid dfc870d3-6d2b-4e93-ac38-223552ca76c2 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:32:53.630414 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-51b58315-4b3d-4599-9aac-5df671385bd5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87be0705721c42878ae5fb2cb21c9c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ede041c3c744daa44a56817af472d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:53.643783 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-51b58315-4b3d-4599-9aac-5df671385bd5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "GET /compute/v2.1/servers/dfc870d3-6d2b-4e93-ac38-223552ca76c2" status: 200 len: 1288 microversion: 2.1 time: 0.237014 Jun 05 08:32:53.645576 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1249/2432] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:53 2022] GET /compute/v2.1/servers/dfc870d3-6d2b-4e93-ac38-223552ca76c2 => generated 1288 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:53.656517 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b4866c43-2f20-43c9-8429-c011f7af3f7d tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-29923563", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:32:53.701637 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-babe83aa-6e9a-45a7-87c8-f18912850ca3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:53.712076 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-babe83aa-6e9a-45a7-87c8-f18912850ca3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:53.714624 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-babe83aa-6e9a-45a7-87c8-f18912850ca3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:53.716311 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-babe83aa-6e9a-45a7-87c8-f18912850ca3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1721 microversion: 2.20 time: 0.281665 Jun 05 08:32:53.718280 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1184/2433] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:53 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1721 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:53.725841 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-db26a36f-cdeb-433e-abda-707e46be904f tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:53.726569 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-db26a36f-cdeb-433e-abda-707e46be904f tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: dfc870d3-6d2b-4e93-ac38-223552ca76c2] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:53.734675 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-db26a36f-cdeb-433e-abda-707e46be904f tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:53.735216 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-db26a36f-cdeb-433e-abda-707e46be904f tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:53.736281 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-db26a36f-cdeb-433e-abda-707e46be904f tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:53.738977 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-db26a36f-cdeb-433e-abda-707e46be904f tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:53.757756 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-b4866c43-2f20-43c9-8429-c011f7af3f7d tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] validate_networks() for None {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:32:53.776971 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-db26a36f-cdeb-433e-abda-707e46be904f tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: dfc870d3-6d2b-4e93-ac38-223552ca76c2] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:32:53.873411 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-db26a36f-cdeb-433e-abda-707e46be904f tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: dfc870d3-6d2b-4e93-ac38-223552ca76c2] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:32:53.875084 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-db26a36f-cdeb-433e-abda-707e46be904f tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:53.877010 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-db26a36f-cdeb-433e-abda-707e46be904f tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:53.878486 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-db26a36f-cdeb-433e-abda-707e46be904f tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: dfc870d3-6d2b-4e93-ac38-223552ca76c2] instance's host None is down, deleting from database Jun 05 08:32:53.886697 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-db26a36f-cdeb-433e-abda-707e46be904f tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: dfc870d3-6d2b-4e93-ac38-223552ca76c2] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:32:54.045243 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-db26a36f-cdeb-433e-abda-707e46be904f tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: dfc870d3-6d2b-4e93-ac38-223552ca76c2] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:32:54.055771 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-db26a36f-cdeb-433e-abda-707e46be904f tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: dfc870d3-6d2b-4e93-ac38-223552ca76c2] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:32:54.324362 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-b4866c43-2f20-43c9-8429-c011f7af3f7d tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:32:54.325402 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-b4866c43-2f20-43c9-8429-c011f7af3f7d tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:32:54.326207 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-b4866c43-2f20-43c9-8429-c011f7af3f7d tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:32:54.326862 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-b4866c43-2f20-43c9-8429-c011f7af3f7d tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:32:54.327426 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-b4866c43-2f20-43c9-8429-c011f7af3f7d tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:32:54.354361 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b4866c43-2f20-43c9-8429-c011f7af3f7d tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:54.355104 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b4866c43-2f20-43c9-8429-c011f7af3f7d tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:54.358242 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b4866c43-2f20-43c9-8429-c011f7af3f7d tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:54.361259 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b4866c43-2f20-43c9-8429-c011f7af3f7d tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:54.366018 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=73,nova_cell0:UPDATE=21,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:32:54.379495 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-db26a36f-cdeb-433e-abda-707e46be904f tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dfc870d3-6d2b-4e93-ac38-223552ca76c2" status: 204 len: 0 microversion: 2.1 time: 0.657896 Jun 05 08:32:54.380387 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1185/2434] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:32:53 2022] DELETE /compute/v2.1/servers/dfc870d3-6d2b-4e93-ac38-223552ca76c2 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:32:54.392550 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e083c1fb-e963-4ee9-b7cb-85a816e8269f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:54.393384 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e083c1fb-e963-4ee9-b7cb-85a816e8269f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:54.399199 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-b4866c43-2f20-43c9-8429-c011f7af3f7d tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Getting quotas for project df337986c7f746a683e93491b82e8219. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:32:54.406612 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-b4866c43-2f20-43c9-8429-c011f7af3f7d tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Getting quotas for user 66890badcc7d4a3d9cdd230a9a3a97a8 and project df337986c7f746a683e93491b82e8219. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:32:54.411509 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e083c1fb-e963-4ee9-b7cb-85a816e8269f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:54.411975 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e083c1fb-e963-4ee9-b7cb-85a816e8269f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:54.412860 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e083c1fb-e963-4ee9-b7cb-85a816e8269f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:54.413313 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e083c1fb-e963-4ee9-b7cb-85a816e8269f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:54.431943 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b4866c43-2f20-43c9-8429-c011f7af3f7d tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:32:54.436157 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b4866c43-2f20-43c9-8429-c011f7af3f7d tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] [instance: 2ff547e5-96a1-47e8-a99e-1928e36f9fd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:32:54.525438 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b4866c43-2f20-43c9-8429-c011f7af3f7d tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.876631 Jun 05 08:32:54.529297 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1250/2435] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:32:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:32:54.550465 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7c1bbae5-4a01-45ba-b8f2-a88f14eca083 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:54.551361 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7c1bbae5-4a01-45ba-b8f2-a88f14eca083 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: dfc870d3-6d2b-4e93-ac38-223552ca76c2] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:54.568614 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7c1bbae5-4a01-45ba-b8f2-a88f14eca083 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:54.569082 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7c1bbae5-4a01-45ba-b8f2-a88f14eca083 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:54.571762 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7c1bbae5-4a01-45ba-b8f2-a88f14eca083 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:54.576010 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7c1bbae5-4a01-45ba-b8f2-a88f14eca083 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:54.607524 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-7c1bbae5-4a01-45ba-b8f2-a88f14eca083 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] HTTP exception thrown: Instance dfc870d3-6d2b-4e93-ac38-223552ca76c2 could not be found. Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7c1bbae5-4a01-45ba-b8f2-a88f14eca083 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Request method failure captured: Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/dfc870d3-6d2b-4e93-ac38-223552ca76c2 HTTP/1.1 Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGomxwdsv5YyqoQnJ8M3HKY493BdT1kF-ZKjGTvsa4dCdMv2tEzSjVIMsusSuNEFxy259rdnBrKrLso7oL5cHjLMPvzuV3e39WGeMwcC-IUAIwS3lJ_NQ03pDpr22BFtYBYlipbszAv78HDt0XYSE3VMC0HZNva_Yj8FUzYwZlfcuNk Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 68ede041c3c744daa44a56817af472d7 Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-DeleteServersTestJSON-753623147 Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/68ede041c3c744daa44a56817af472d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/68ede041c3c744daa44a56817af472d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_68ede041c3c744daa44a56817af472d7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/68ede041c3c744daa44a56817af472d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-DeleteServersTestJSON-753623147 Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 68ede041c3c744daa44a56817af472d7 Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-DeleteServersTestJSON-753623147 Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-DeleteServersTestJSON-753623147-project Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 87be0705721c42878ae5fb2cb21c9c0d Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-DeleteServersTestJSON-753623147-project Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance dfc870d3-6d2b-4e93-ac38-223552ca76c2 could not be found. Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'dfc870d3-6d2b-4e93-ac38-223552ca76c2'} Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfc870d3-6d2b-4e93-ac38-223552ca76c2 could not be found. Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfc870d3-6d2b-4e93-ac38-223552ca76c2 could not be found. Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:32:54.609113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:54.612816 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:54.612816 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:32:54.612816 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:32:54.612816 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:32:54.612816 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:32:54.612816 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfc870d3-6d2b-4e93-ac38-223552ca76c2 could not be found. Jun 05 08:32:54.612816 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:54.612816 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7c1bbae5-4a01-45ba-b8f2-a88f14eca083 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Returning 404 to user: Instance dfc870d3-6d2b-4e93-ac38-223552ca76c2 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:32:54.617118 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7c1bbae5-4a01-45ba-b8f2-a88f14eca083 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "GET /compute/v2.1/servers/dfc870d3-6d2b-4e93-ac38-223552ca76c2" status: 404 len: 111 microversion: 2.1 time: 0.085383 Jun 05 08:32:54.617693 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1251/2436] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:54 2022] GET /compute/v2.1/servers/dfc870d3-6d2b-4e93-ac38-223552ca76c2 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:32:54.633665 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c760bb7a-8968-4ef4-9660-52daa7761c15 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:54.638456 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c760bb7a-8968-4ef4-9660-52daa7761c15 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] [instance: 8747ad78-e4aa-4b25-91c9-60884bac393f] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:54.660495 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c760bb7a-8968-4ef4-9660-52daa7761c15 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:54.660976 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c760bb7a-8968-4ef4-9660-52daa7761c15 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:54.661820 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c760bb7a-8968-4ef4-9660-52daa7761c15 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:54.662255 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c760bb7a-8968-4ef4-9660-52daa7761c15 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:54.732809 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c760bb7a-8968-4ef4-9660-52daa7761c15 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:54.737832 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c760bb7a-8968-4ef4-9660-52daa7761c15 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:54.738370 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-c760bb7a-8968-4ef4-9660-52daa7761c15 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Lazy-loading 'fault' on Instance uuid 8747ad78-e4aa-4b25-91c9-60884bac393f {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:32:54.809164 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c760bb7a-8968-4ef4-9660-52daa7761c15 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00ea24535938453fa4e9cb66b29cab70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd018e48c5d847c3b27b9cb4d42bdc79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:54.820026 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c760bb7a-8968-4ef4-9660-52daa7761c15 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] 10.222.0.33 "GET /compute/v2.1/servers/8747ad78-e4aa-4b25-91c9-60884bac393f" status: 200 len: 1304 microversion: 2.1 time: 0.190804 Jun 05 08:32:54.821780 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1252/2437] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:54 2022] GET /compute/v2.1/servers/8747ad78-e4aa-4b25-91c9-60884bac393f => generated 1304 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:54.901384 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e083c1fb-e963-4ee9-b7cb-85a816e8269f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:54.922936 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e083c1fb-e963-4ee9-b7cb-85a816e8269f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:54.929823 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e083c1fb-e963-4ee9-b7cb-85a816e8269f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:54.931094 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e083c1fb-e963-4ee9-b7cb-85a816e8269f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1869 microversion: 2.42 time: 0.549659 Jun 05 08:32:54.945859 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1186/2438] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:54 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1869 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:54.945859 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-822b0be8-c0ea-424f-a451-af9dcbeda642 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:54.945859 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-822b0be8-c0ea-424f-a451-af9dcbeda642 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] [instance: 2ff547e5-96a1-47e8-a99e-1928e36f9fd6] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:54.970938 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-822b0be8-c0ea-424f-a451-af9dcbeda642 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:54.973576 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-822b0be8-c0ea-424f-a451-af9dcbeda642 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:54.977593 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-822b0be8-c0ea-424f-a451-af9dcbeda642 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:54.978239 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-822b0be8-c0ea-424f-a451-af9dcbeda642 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:55.050151 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ef9625db-3f63-4b94-8b71-d42bd0be386a tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-717335846", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:32:55.111648 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-822b0be8-c0ea-424f-a451-af9dcbeda642 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66890badcc7d4a3d9cdd230a9a3a97a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df337986c7f746a683e93491b82e8219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:55.125849 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-ef9625db-3f63-4b94-8b71-d42bd0be386a tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] validate_networks() for None {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:32:55.132896 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-822b0be8-c0ea-424f-a451-af9dcbeda642 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] 10.222.0.33 "GET /compute/v2.1/servers/2ff547e5-96a1-47e8-a99e-1928e36f9fd6" status: 200 len: 1216 microversion: 2.1 time: 0.194703 Jun 05 08:32:55.136096 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1187/2439] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:54 2022] GET /compute/v2.1/servers/2ff547e5-96a1-47e8-a99e-1928e36f9fd6 => generated 1216 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:55.140172 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-32288123-9ef9-49bb-bf09-d92ebb5c047b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:55.140812 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-32288123-9ef9-49bb-bf09-d92ebb5c047b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:55.150043 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-32288123-9ef9-49bb-bf09-d92ebb5c047b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:55.157125 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-32288123-9ef9-49bb-bf09-d92ebb5c047b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:55.160032 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-32288123-9ef9-49bb-bf09-d92ebb5c047b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:55.160543 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-32288123-9ef9-49bb-bf09-d92ebb5c047b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:55.852616 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-32288123-9ef9-49bb-bf09-d92ebb5c047b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:55.866791 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-32288123-9ef9-49bb-bf09-d92ebb5c047b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:55.872683 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-32288123-9ef9-49bb-bf09-d92ebb5c047b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:55.878078 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-32288123-9ef9-49bb-bf09-d92ebb5c047b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1721 microversion: 2.20 time: 0.741763 Jun 05 08:32:55.879420 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1188/2440] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:55 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1721 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:55.886778 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-33ce1dbe-4b77-47c9-9fff-a4efc9d555b3 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:55.887401 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-33ce1dbe-4b77-47c9-9fff-a4efc9d555b3 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] [instance: 8747ad78-e4aa-4b25-91c9-60884bac393f] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:55.905051 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-33ce1dbe-4b77-47c9-9fff-a4efc9d555b3 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:55.905679 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-33ce1dbe-4b77-47c9-9fff-a4efc9d555b3 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:55.906299 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-33ce1dbe-4b77-47c9-9fff-a4efc9d555b3 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:55.906747 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-33ce1dbe-4b77-47c9-9fff-a4efc9d555b3 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:55.925138 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-ef9625db-3f63-4b94-8b71-d42bd0be386a tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:32:55.925703 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-ef9625db-3f63-4b94-8b71-d42bd0be386a tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:32:55.926141 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-ef9625db-3f63-4b94-8b71-d42bd0be386a tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:32:55.926775 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-ef9625db-3f63-4b94-8b71-d42bd0be386a tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:32:55.927266 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-ef9625db-3f63-4b94-8b71-d42bd0be386a tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:32:55.945498 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ef9625db-3f63-4b94-8b71-d42bd0be386a tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:55.945943 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ef9625db-3f63-4b94-8b71-d42bd0be386a tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:55.947143 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ef9625db-3f63-4b94-8b71-d42bd0be386a tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:55.947732 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ef9625db-3f63-4b94-8b71-d42bd0be386a tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:55.958244 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=81,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:32:55.959803 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-33ce1dbe-4b77-47c9-9fff-a4efc9d555b3 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] [instance: 8747ad78-e4aa-4b25-91c9-60884bac393f] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:32:55.975591 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-ef9625db-3f63-4b94-8b71-d42bd0be386a tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Getting quotas for project 2e2a416e66d24723a9c880ec94b49843. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:32:55.982165 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-ef9625db-3f63-4b94-8b71-d42bd0be386a tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Getting quotas for user 8719cfb39a1f424193a55296214c20ff and project 2e2a416e66d24723a9c880ec94b49843. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:32:56.006744 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ef9625db-3f63-4b94-8b71-d42bd0be386a tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:32:56.010661 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ef9625db-3f63-4b94-8b71-d42bd0be386a tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 89e63314-82a1-4f95-a759-4bf604dd3f06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:32:56.053820 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-33ce1dbe-4b77-47c9-9fff-a4efc9d555b3 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] [instance: 8747ad78-e4aa-4b25-91c9-60884bac393f] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:32:56.057070 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-33ce1dbe-4b77-47c9-9fff-a4efc9d555b3 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:56.057639 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-33ce1dbe-4b77-47c9-9fff-a4efc9d555b3 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:56.058947 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-33ce1dbe-4b77-47c9-9fff-a4efc9d555b3 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] [instance: 8747ad78-e4aa-4b25-91c9-60884bac393f] instance's host None is down, deleting from database Jun 05 08:32:56.066839 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-33ce1dbe-4b77-47c9-9fff-a4efc9d555b3 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] [instance: 8747ad78-e4aa-4b25-91c9-60884bac393f] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:32:56.101812 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ef9625db-3f63-4b94-8b71-d42bd0be386a tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.278076 Jun 05 08:32:56.102649 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1253/2441] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:32:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:32:56.113757 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0da0c359-86b3-40c4-8ff7-6ab7165672c2 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-215699615", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "6ae041e2-2719-4b5a-8067-42384887402d"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:32:56.149796 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-33ce1dbe-4b77-47c9-9fff-a4efc9d555b3 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] [instance: 8747ad78-e4aa-4b25-91c9-60884bac393f] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:32:56.157331 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-33ce1dbe-4b77-47c9-9fff-a4efc9d555b3 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] [instance: 8747ad78-e4aa-4b25-91c9-60884bac393f] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:32:56.185143 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-0da0c359-86b3-40c4-8ff7-6ab7165672c2 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] validate_networks() for [('6ae041e2-2719-4b5a-8067-42384887402d', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:32:56.502318 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-33ce1dbe-4b77-47c9-9fff-a4efc9d555b3 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8747ad78-e4aa-4b25-91c9-60884bac393f" status: 204 len: 0 microversion: 2.1 time: 0.620837 Jun 05 08:32:56.507001 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1189/2442] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:32:55 2022] DELETE /compute/v2.1/servers/8747ad78-e4aa-4b25-91c9-60884bac393f => generated 0 bytes in 624 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:32:56.516692 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-425154e6-1544-4af9-9cbf-9e5aeb7488e6 req-c439b74f-4eb3-4605-9c5f-c6626c6a1b6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40933e98-d7d3-4d63-9012-ad5607e45085", "name": "network-vif-plugged", "status": "completed", "tag": "cb457b77-bef8-4764-bb0e-ace5a2c35d93"}, {"server_uuid": "40933e98-d7d3-4d63-9012-ad5607e45085", "name": "network-vif-plugged", "status": "completed", "tag": "07c8ff98-a22e-410d-9341-f7e044856815"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:32:56.539635 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-425154e6-1544-4af9-9cbf-9e5aeb7488e6 req-c439b74f-4eb3-4605-9c5f-c6626c6a1b6d service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:56.540111 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-425154e6-1544-4af9-9cbf-9e5aeb7488e6 req-c439b74f-4eb3-4605-9c5f-c6626c6a1b6d service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:56.577738 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-425154e6-1544-4af9-9cbf-9e5aeb7488e6 req-c439b74f-4eb3-4605-9c5f-c6626c6a1b6d service nova] Creating event network-vif-plugged:cb457b77-bef8-4764-bb0e-ace5a2c35d93 for instance 40933e98-d7d3-4d63-9012-ad5607e45085 on n-h1-844739-1 Jun 05 08:32:56.580291 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-425154e6-1544-4af9-9cbf-9e5aeb7488e6 req-c439b74f-4eb3-4605-9c5f-c6626c6a1b6d service nova] Creating event network-vif-plugged:07c8ff98-a22e-410d-9341-f7e044856815 for instance 40933e98-d7d3-4d63-9012-ad5607e45085 on n-h1-844739-1 Jun 05 08:32:56.600328 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-425154e6-1544-4af9-9cbf-9e5aeb7488e6 req-c439b74f-4eb3-4605-9c5f-c6626c6a1b6d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.091747 Jun 05 08:32:56.601511 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1190/2443] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:56.613912 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3e2a138a-b92c-4822-8930-356614f0cee7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:56.616079 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3e2a138a-b92c-4822-8930-356614f0cee7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:56.628757 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3e2a138a-b92c-4822-8930-356614f0cee7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:56.631913 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3e2a138a-b92c-4822-8930-356614f0cee7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:56.632956 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3e2a138a-b92c-4822-8930-356614f0cee7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:56.638059 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3e2a138a-b92c-4822-8930-356614f0cee7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:56.880590 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-0da0c359-86b3-40c4-8ff7-6ab7165672c2 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:32:56.881118 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-0da0c359-86b3-40c4-8ff7-6ab7165672c2 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:32:56.881759 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-0da0c359-86b3-40c4-8ff7-6ab7165672c2 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:32:56.882251 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-0da0c359-86b3-40c4-8ff7-6ab7165672c2 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:32:56.882745 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-0da0c359-86b3-40c4-8ff7-6ab7165672c2 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:32:56.899298 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0da0c359-86b3-40c4-8ff7-6ab7165672c2 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:56.899861 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0da0c359-86b3-40c4-8ff7-6ab7165672c2 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:56.902896 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0da0c359-86b3-40c4-8ff7-6ab7165672c2 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:56.903574 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0da0c359-86b3-40c4-8ff7-6ab7165672c2 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:56.942010 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:INSERT=17,nova_api:SELECT=83 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:32:56.955582 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-0da0c359-86b3-40c4-8ff7-6ab7165672c2 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Getting quotas for project 68ede041c3c744daa44a56817af472d7. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:32:56.973926 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-0da0c359-86b3-40c4-8ff7-6ab7165672c2 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Getting quotas for user 87be0705721c42878ae5fb2cb21c9c0d and project 68ede041c3c744daa44a56817af472d7. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:32:56.980475 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3e2a138a-b92c-4822-8930-356614f0cee7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:56.993617 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3e2a138a-b92c-4822-8930-356614f0cee7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:56.995553 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3e2a138a-b92c-4822-8930-356614f0cee7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:56.997128 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3e2a138a-b92c-4822-8930-356614f0cee7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1869 microversion: 2.42 time: 0.394434 Jun 05 08:32:56.997900 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1191/2444] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:56 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1869 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:57.013667 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0da0c359-86b3-40c4-8ff7-6ab7165672c2 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:32:57.021055 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b0ade4c2-5c3a-4c62-8b7a-197a25be0d24 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:57.021812 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b0ade4c2-5c3a-4c62-8b7a-197a25be0d24 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 89e63314-82a1-4f95-a759-4bf604dd3f06] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:57.022944 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0da0c359-86b3-40c4-8ff7-6ab7165672c2 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: fdef50fc-ea3a-476f-81aa-226958ae3c4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:32:57.030976 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b0ade4c2-5c3a-4c62-8b7a-197a25be0d24 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:57.031427 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b0ade4c2-5c3a-4c62-8b7a-197a25be0d24 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:57.032242 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b0ade4c2-5c3a-4c62-8b7a-197a25be0d24 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:57.038742 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b0ade4c2-5c3a-4c62-8b7a-197a25be0d24 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:57.112262 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b0ade4c2-5c3a-4c62-8b7a-197a25be0d24 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:57.113255 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b0ade4c2-5c3a-4c62-8b7a-197a25be0d24 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:57.114374 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-b0ade4c2-5c3a-4c62-8b7a-197a25be0d24 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lazy-loading 'fault' on Instance uuid 89e63314-82a1-4f95-a759-4bf604dd3f06 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:32:57.159926 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0da0c359-86b3-40c4-8ff7-6ab7165672c2 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.051142 Jun 05 08:32:57.176324 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1254/2445] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:32:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:32:57.188230 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a9335c5f-07af-4f8b-ad56-7a45948dc34a tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:57.189625 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a9335c5f-07af-4f8b-ad56-7a45948dc34a tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] [instance: 2ff547e5-96a1-47e8-a99e-1928e36f9fd6] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:57.206709 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a9335c5f-07af-4f8b-ad56-7a45948dc34a tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:57.208509 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a9335c5f-07af-4f8b-ad56-7a45948dc34a tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:57.211489 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a9335c5f-07af-4f8b-ad56-7a45948dc34a tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:57.212240 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a9335c5f-07af-4f8b-ad56-7a45948dc34a tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:57.257216 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b0ade4c2-5c3a-4c62-8b7a-197a25be0d24 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8719cfb39a1f424193a55296214c20ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2a416e66d24723a9c880ec94b49843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:57.266099 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b0ade4c2-5c3a-4c62-8b7a-197a25be0d24 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] 10.222.0.33 "GET /compute/v2.1/servers/89e63314-82a1-4f95-a759-4bf604dd3f06" status: 200 len: 1285 microversion: 2.1 time: 0.266795 Jun 05 08:32:57.274255 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1192/2446] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:56 2022] GET /compute/v2.1/servers/89e63314-82a1-4f95-a759-4bf604dd3f06 => generated 1285 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:57.290790 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a9335c5f-07af-4f8b-ad56-7a45948dc34a tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:57.291944 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a9335c5f-07af-4f8b-ad56-7a45948dc34a tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:57.293585 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-a9335c5f-07af-4f8b-ad56-7a45948dc34a tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lazy-loading 'fault' on Instance uuid 2ff547e5-96a1-47e8-a99e-1928e36f9fd6 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:32:57.304459 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-615714c1-4596-45b4-b1c6-bb12ef855cf0 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:57.306048 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-615714c1-4596-45b4-b1c6-bb12ef855cf0 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] [instance: 8747ad78-e4aa-4b25-91c9-60884bac393f] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:57.319829 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-615714c1-4596-45b4-b1c6-bb12ef855cf0 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:57.320386 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-615714c1-4596-45b4-b1c6-bb12ef855cf0 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:57.321165 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-615714c1-4596-45b4-b1c6-bb12ef855cf0 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:57.321602 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-615714c1-4596-45b4-b1c6-bb12ef855cf0 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:57.372254 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-615714c1-4596-45b4-b1c6-bb12ef855cf0 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] HTTP exception thrown: Instance 8747ad78-e4aa-4b25-91c9-60884bac393f could not be found. Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-615714c1-4596-45b4-b1c6-bb12ef855cf0 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Request method failure captured: Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/8747ad78-e4aa-4b25-91c9-60884bac393f HTTP/1.1 Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGoxuG3d5bl3kO0QYIGxkb2hb5XG9AghEXP4x75qjZG5qg2jU-tkSUoI3Zni6HlX2UHFVkfMHQrjshSRQg5X100UXDEC4Xi5TJ8k25aAV0SJueDlNl72dSxwkNM_oxwWmceDe2svjDTSdGy1crOyrcyTe8BMHYFm4a90e-ZmRrL4Ri8 Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: dd018e48c5d847c3b27b9cb4d42bdc79 Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dd018e48c5d847c3b27b9cb4d42bdc79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd018e48c5d847c3b27b9cb4d42bdc79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dd018e48c5d847c3b27b9cb4d42bdc79", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd018e48c5d847c3b27b9cb4d42bdc79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: dd018e48c5d847c3b27b9cb4d42bdc79 Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 00ea24535938453fa4e9cb66b29cab70 Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 8747ad78-e4aa-4b25-91c9-60884bac393f could not be found. Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '8747ad78-e4aa-4b25-91c9-60884bac393f'} Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8747ad78-e4aa-4b25-91c9-60884bac393f could not be found. Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8747ad78-e4aa-4b25-91c9-60884bac393f could not be found. Jun 05 08:32:57.374121 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:32:57.379742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:32:57.379742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:32:57.379742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:57.379742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:32:57.379742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:32:57.379742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:32:57.379742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:32:57.379742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8747ad78-e4aa-4b25-91c9-60884bac393f could not be found. Jun 05 08:32:57.379742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:32:57.379742 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-615714c1-4596-45b4-b1c6-bb12ef855cf0 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] Returning 404 to user: Instance 8747ad78-e4aa-4b25-91c9-60884bac393f could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:32:57.379742 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-615714c1-4596-45b4-b1c6-bb12ef855cf0 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919 tempest-FloatingIPsAssociationNegativeTestJSON-1863826919-project] 10.222.0.33 "GET /compute/v2.1/servers/8747ad78-e4aa-4b25-91c9-60884bac393f" status: 404 len: 111 microversion: 2.1 time: 0.094237 Jun 05 08:32:57.379742 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1193/2447] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:57 2022] GET /compute/v2.1/servers/8747ad78-e4aa-4b25-91c9-60884bac393f => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:32:57.391720 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d4d90319-f06e-46bb-acf2-5ded13579414 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:57.395171 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d4d90319-f06e-46bb-acf2-5ded13579414 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:57.417073 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d4d90319-f06e-46bb-acf2-5ded13579414 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:57.417871 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d4d90319-f06e-46bb-acf2-5ded13579414 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:57.418999 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d4d90319-f06e-46bb-acf2-5ded13579414 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:57.420011 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d4d90319-f06e-46bb-acf2-5ded13579414 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:57.493279 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a9335c5f-07af-4f8b-ad56-7a45948dc34a tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66890badcc7d4a3d9cdd230a9a3a97a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df337986c7f746a683e93491b82e8219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:57.504345 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a9335c5f-07af-4f8b-ad56-7a45948dc34a tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] 10.222.0.33 "GET /compute/v2.1/servers/2ff547e5-96a1-47e8-a99e-1928e36f9fd6" status: 200 len: 1289 microversion: 2.1 time: 0.326782 Jun 05 08:32:57.505377 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1255/2448] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:57 2022] GET /compute/v2.1/servers/2ff547e5-96a1-47e8-a99e-1928e36f9fd6 => generated 1289 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:57.513154 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f2700c40-3bb7-4cba-8def-c6e40dd25ba3 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:57.523417 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f2700c40-3bb7-4cba-8def-c6e40dd25ba3 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: fdef50fc-ea3a-476f-81aa-226958ae3c4c] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:57.541977 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f2700c40-3bb7-4cba-8def-c6e40dd25ba3 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:57.546673 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f2700c40-3bb7-4cba-8def-c6e40dd25ba3 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:57.554058 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f2700c40-3bb7-4cba-8def-c6e40dd25ba3 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:57.555209 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f2700c40-3bb7-4cba-8def-c6e40dd25ba3 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:57.859294 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f2700c40-3bb7-4cba-8def-c6e40dd25ba3 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87be0705721c42878ae5fb2cb21c9c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ede041c3c744daa44a56817af472d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:57.869053 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f2700c40-3bb7-4cba-8def-c6e40dd25ba3 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "GET /compute/v2.1/servers/fdef50fc-ea3a-476f-81aa-226958ae3c4c" status: 200 len: 1214 microversion: 2.1 time: 0.359838 Jun 05 08:32:57.884199 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1256/2449] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:57 2022] GET /compute/v2.1/servers/fdef50fc-ea3a-476f-81aa-226958ae3c4c => generated 1214 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:57.906507 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2de9562d-1c64-43c2-b021-72f0f64c03e7 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:57.908116 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2de9562d-1c64-43c2-b021-72f0f64c03e7 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] [instance: 2ff547e5-96a1-47e8-a99e-1928e36f9fd6] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:57.920005 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2de9562d-1c64-43c2-b021-72f0f64c03e7 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:57.920840 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2de9562d-1c64-43c2-b021-72f0f64c03e7 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:57.921936 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2de9562d-1c64-43c2-b021-72f0f64c03e7 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:57.922527 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2de9562d-1c64-43c2-b021-72f0f64c03e7 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:57.979341 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d4d90319-f06e-46bb-acf2-5ded13579414 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:57.995922 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d4d90319-f06e-46bb-acf2-5ded13579414 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:57.996496 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2de9562d-1c64-43c2-b021-72f0f64c03e7 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] [instance: 2ff547e5-96a1-47e8-a99e-1928e36f9fd6] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:32:58.001508 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d4d90319-f06e-46bb-acf2-5ded13579414 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:58.004656 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d4d90319-f06e-46bb-acf2-5ded13579414 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1742 microversion: 2.20 time: 0.627057 Jun 05 08:32:58.006913 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1194/2450] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:57 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1742 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:58.022237 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4a48a763-81d8-416c-b97f-1438105fca2c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:58.023118 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4a48a763-81d8-416c-b97f-1438105fca2c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:58.032190 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4a48a763-81d8-416c-b97f-1438105fca2c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:58.036066 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4a48a763-81d8-416c-b97f-1438105fca2c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:58.039937 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4a48a763-81d8-416c-b97f-1438105fca2c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:58.041295 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4a48a763-81d8-416c-b97f-1438105fca2c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:58.146073 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2de9562d-1c64-43c2-b021-72f0f64c03e7 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] [instance: 2ff547e5-96a1-47e8-a99e-1928e36f9fd6] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:32:58.147328 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2de9562d-1c64-43c2-b021-72f0f64c03e7 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:58.149310 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2de9562d-1c64-43c2-b021-72f0f64c03e7 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:58.150741 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-2de9562d-1c64-43c2-b021-72f0f64c03e7 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] [instance: 2ff547e5-96a1-47e8-a99e-1928e36f9fd6] instance's host None is down, deleting from database Jun 05 08:32:58.159068 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-2de9562d-1c64-43c2-b021-72f0f64c03e7 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] [instance: 2ff547e5-96a1-47e8-a99e-1928e36f9fd6] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:32:58.372307 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-2de9562d-1c64-43c2-b021-72f0f64c03e7 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] [instance: 2ff547e5-96a1-47e8-a99e-1928e36f9fd6] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:32:58.382223 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-2de9562d-1c64-43c2-b021-72f0f64c03e7 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] [instance: 2ff547e5-96a1-47e8-a99e-1928e36f9fd6] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:32:58.608178 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4a48a763-81d8-416c-b97f-1438105fca2c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:58.620551 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4a48a763-81d8-416c-b97f-1438105fca2c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:58.624068 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4a48a763-81d8-416c-b97f-1438105fca2c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:58.633381 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4a48a763-81d8-416c-b97f-1438105fca2c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1869 microversion: 2.42 time: 0.613372 Jun 05 08:32:58.646633 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1195/2451] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:58 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1869 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:58.655947 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ae301f03-b173-4d61-9456-420a90bf5ba5 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:58.657267 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ae301f03-b173-4d61-9456-420a90bf5ba5 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 89e63314-82a1-4f95-a759-4bf604dd3f06] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:58.670808 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:UPDATE=11,nova_api:SELECT=78,nova_api:INSERT=11 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:32:58.675161 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ae301f03-b173-4d61-9456-420a90bf5ba5 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:58.678117 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ae301f03-b173-4d61-9456-420a90bf5ba5 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:58.679192 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ae301f03-b173-4d61-9456-420a90bf5ba5 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:58.700996 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ae301f03-b173-4d61-9456-420a90bf5ba5 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:58.734770 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2de9562d-1c64-43c2-b021-72f0f64c03e7 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2ff547e5-96a1-47e8-a99e-1928e36f9fd6" status: 204 len: 0 microversion: 2.1 time: 0.848513 Jun 05 08:32:58.741281 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1257/2452] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:32:57 2022] DELETE /compute/v2.1/servers/2ff547e5-96a1-47e8-a99e-1928e36f9fd6 => generated 0 bytes in 851 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:32:58.747098 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d7f5950d-9211-42c6-8df9-fa898a97871f tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:58.748020 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d7f5950d-9211-42c6-8df9-fa898a97871f tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] [instance: 2ff547e5-96a1-47e8-a99e-1928e36f9fd6] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:58.759848 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d7f5950d-9211-42c6-8df9-fa898a97871f tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:58.760826 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d7f5950d-9211-42c6-8df9-fa898a97871f tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:58.762942 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d7f5950d-9211-42c6-8df9-fa898a97871f tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:58.763666 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d7f5950d-9211-42c6-8df9-fa898a97871f tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:58.785810 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-d7f5950d-9211-42c6-8df9-fa898a97871f tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] HTTP exception thrown: Instance 2ff547e5-96a1-47e8-a99e-1928e36f9fd6 could not be found. Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d7f5950d-9211-42c6-8df9-fa898a97871f tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Request method failure captured: Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/2ff547e5-96a1-47e8-a99e-1928e36f9fd6 HTTP/1.1 Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGon99bWSE461hhMYijC-8-Th58L-N2V2OlkYLRWp64wX_o6-T4Z2CiM5elIr2VN4waaqUvnxVjO7vLE2yOzEtatHHZmy3j-Oam-NBjojscx6aoNkz1jKvKJex4dcyav8nKlz4w4sGFlgcrq0ZwMVuk7HbsJjc9MgRr-oEXPhlJDTtY Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: df337986c7f746a683e93491b82e8219 Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ListImageFiltersTestJSON-172198461 Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/df337986c7f746a683e93491b82e8219"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/df337986c7f746a683e93491b82e8219"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_df337986c7f746a683e93491b82e8219", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/df337986c7f746a683e93491b82e8219"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ListImageFiltersTestJSON-172198461 Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: df337986c7f746a683e93491b82e8219 Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-172198461 Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ListImageFiltersTestJSON-172198461-project Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 66890badcc7d4a3d9cdd230a9a3a97a8 Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ListImageFiltersTestJSON-172198461-project Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 2ff547e5-96a1-47e8-a99e-1928e36f9fd6 could not be found. Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '2ff547e5-96a1-47e8-a99e-1928e36f9fd6'} Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ff547e5-96a1-47e8-a99e-1928e36f9fd6 could not be found. Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ff547e5-96a1-47e8-a99e-1928e36f9fd6 could not be found. Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:32:58.787907 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:58.790831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:32:58.790831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:32:58.790831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:32:58.790831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:32:58.790831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:32:58.790831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ff547e5-96a1-47e8-a99e-1928e36f9fd6 could not be found. Jun 05 08:32:58.790831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:32:58.793511 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d7f5950d-9211-42c6-8df9-fa898a97871f tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Returning 404 to user: Instance 2ff547e5-96a1-47e8-a99e-1928e36f9fd6 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:32:58.794599 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d7f5950d-9211-42c6-8df9-fa898a97871f tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] 10.222.0.33 "GET /compute/v2.1/servers/2ff547e5-96a1-47e8-a99e-1928e36f9fd6" status: 404 len: 111 microversion: 2.1 time: 0.051895 Jun 05 08:32:58.799467 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1258/2453] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:58 2022] GET /compute/v2.1/servers/2ff547e5-96a1-47e8-a99e-1928e36f9fd6 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:32:58.810434 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-220005e8-f6ad-4496-84d4-3404fd5895f9 req-2e9216e2-0709-4971-8337-efe992c09813 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40933e98-d7d3-4d63-9012-ad5607e45085", "name": "network-vif-plugged", "status": "completed", "tag": "6625a448-ba61-493b-896c-b465fe36dc0c"}, {"server_uuid": "40933e98-d7d3-4d63-9012-ad5607e45085", "name": "network-vif-plugged", "status": "completed", "tag": "50f3c778-e1df-4dd9-ba33-fc1897f015e1"}, {"server_uuid": "40933e98-d7d3-4d63-9012-ad5607e45085", "name": "network-vif-plugged", "status": "completed", "tag": "0c4f6906-83f1-49f6-9951-e7976dadeb79"}, {"server_uuid": "40933e98-d7d3-4d63-9012-ad5607e45085", "name": "network-vif-plugged", "status": "completed", "tag": "2f3b34fc-705b-4063-a0c0-7ed026c1ebba"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:32:58.832435 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-220005e8-f6ad-4496-84d4-3404fd5895f9 req-2e9216e2-0709-4971-8337-efe992c09813 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:58.833477 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-220005e8-f6ad-4496-84d4-3404fd5895f9 req-2e9216e2-0709-4971-8337-efe992c09813 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:58.833599 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ae301f03-b173-4d61-9456-420a90bf5ba5 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:58.836481 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ae301f03-b173-4d61-9456-420a90bf5ba5 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:58.836964 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-ae301f03-b173-4d61-9456-420a90bf5ba5 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lazy-loading 'fault' on Instance uuid 89e63314-82a1-4f95-a759-4bf604dd3f06 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:32:58.849848 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-220005e8-f6ad-4496-84d4-3404fd5895f9 req-2e9216e2-0709-4971-8337-efe992c09813 service nova] Creating event network-vif-plugged:6625a448-ba61-493b-896c-b465fe36dc0c for instance 40933e98-d7d3-4d63-9012-ad5607e45085 on n-h1-844739-1 Jun 05 08:32:58.850599 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-220005e8-f6ad-4496-84d4-3404fd5895f9 req-2e9216e2-0709-4971-8337-efe992c09813 service nova] Creating event network-vif-plugged:50f3c778-e1df-4dd9-ba33-fc1897f015e1 for instance 40933e98-d7d3-4d63-9012-ad5607e45085 on n-h1-844739-1 Jun 05 08:32:58.851279 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-220005e8-f6ad-4496-84d4-3404fd5895f9 req-2e9216e2-0709-4971-8337-efe992c09813 service nova] Creating event network-vif-plugged:0c4f6906-83f1-49f6-9951-e7976dadeb79 for instance 40933e98-d7d3-4d63-9012-ad5607e45085 on n-h1-844739-1 Jun 05 08:32:58.851941 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-220005e8-f6ad-4496-84d4-3404fd5895f9 req-2e9216e2-0709-4971-8337-efe992c09813 service nova] Creating event network-vif-plugged:2f3b34fc-705b-4063-a0c0-7ed026c1ebba for instance 40933e98-d7d3-4d63-9012-ad5607e45085 on n-h1-844739-1 Jun 05 08:32:58.862628 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-220005e8-f6ad-4496-84d4-3404fd5895f9 req-2e9216e2-0709-4971-8337-efe992c09813 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.058484 Jun 05 08:32:58.863841 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1259/2454] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:32:58.886314 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a987fffc-8a16-4f62-b439-e30b6d10419c tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:58.886929 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a987fffc-8a16-4f62-b439-e30b6d10419c tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] [instance: 8a1be07c-efab-48c3-874c-1f15ee7f220d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:58.902654 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a987fffc-8a16-4f62-b439-e30b6d10419c tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:58.906350 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a987fffc-8a16-4f62-b439-e30b6d10419c tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:58.907143 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a987fffc-8a16-4f62-b439-e30b6d10419c tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:58.909752 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a987fffc-8a16-4f62-b439-e30b6d10419c tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:58.983342 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a987fffc-8a16-4f62-b439-e30b6d10419c tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] [instance: 8a1be07c-efab-48c3-874c-1f15ee7f220d] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:32:59.086742 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a987fffc-8a16-4f62-b439-e30b6d10419c tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] [instance: 8a1be07c-efab-48c3-874c-1f15ee7f220d] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:32:59.089102 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a987fffc-8a16-4f62-b439-e30b6d10419c tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:59.095103 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a987fffc-8a16-4f62-b439-e30b6d10419c tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:59.098410 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-a987fffc-8a16-4f62-b439-e30b6d10419c tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] [instance: 8a1be07c-efab-48c3-874c-1f15ee7f220d] instance's host None is down, deleting from database Jun 05 08:32:59.119338 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ae301f03-b173-4d61-9456-420a90bf5ba5 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8719cfb39a1f424193a55296214c20ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2a416e66d24723a9c880ec94b49843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:59.130346 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ae301f03-b173-4d61-9456-420a90bf5ba5 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] 10.222.0.33 "GET /compute/v2.1/servers/89e63314-82a1-4f95-a759-4bf604dd3f06" status: 200 len: 1285 microversion: 2.1 time: 0.482213 Jun 05 08:32:59.131584 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1196/2455] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:58 2022] GET /compute/v2.1/servers/89e63314-82a1-4f95-a759-4bf604dd3f06 => generated 1285 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:59.133539 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-a987fffc-8a16-4f62-b439-e30b6d10419c tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] [instance: 8a1be07c-efab-48c3-874c-1f15ee7f220d] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:32:59.136857 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-712237fb-e01c-40b6-aeb7-a524b65debbe tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:59.137686 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-712237fb-e01c-40b6-aeb7-a524b65debbe tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: fdef50fc-ea3a-476f-81aa-226958ae3c4c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:59.152991 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-712237fb-e01c-40b6-aeb7-a524b65debbe tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:59.155023 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-712237fb-e01c-40b6-aeb7-a524b65debbe tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:59.157323 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-712237fb-e01c-40b6-aeb7-a524b65debbe tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:59.158902 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-712237fb-e01c-40b6-aeb7-a524b65debbe tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:59.215811 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-712237fb-e01c-40b6-aeb7-a524b65debbe tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:59.216509 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-712237fb-e01c-40b6-aeb7-a524b65debbe tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:59.217178 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-712237fb-e01c-40b6-aeb7-a524b65debbe tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lazy-loading 'fault' on Instance uuid fdef50fc-ea3a-476f-81aa-226958ae3c4c {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:32:59.262599 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-a987fffc-8a16-4f62-b439-e30b6d10419c tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] [instance: 8a1be07c-efab-48c3-874c-1f15ee7f220d] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:32:59.285498 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-a987fffc-8a16-4f62-b439-e30b6d10419c tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] [instance: 8a1be07c-efab-48c3-874c-1f15ee7f220d] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:32:59.359188 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-712237fb-e01c-40b6-aeb7-a524b65debbe tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87be0705721c42878ae5fb2cb21c9c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ede041c3c744daa44a56817af472d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:59.367550 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-712237fb-e01c-40b6-aeb7-a524b65debbe tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "GET /compute/v2.1/servers/fdef50fc-ea3a-476f-81aa-226958ae3c4c" status: 200 len: 1287 microversion: 2.1 time: 0.234603 Jun 05 08:32:59.371639 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1197/2456] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:32:59 2022] GET /compute/v2.1/servers/fdef50fc-ea3a-476f-81aa-226958ae3c4c => generated 1287 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:32:59.382075 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d5e09659-1201-446d-ab72-f8fc7e88ed86 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:59.383045 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d5e09659-1201-446d-ab72-f8fc7e88ed86 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:59.397640 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d5e09659-1201-446d-ab72-f8fc7e88ed86 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:59.398290 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d5e09659-1201-446d-ab72-f8fc7e88ed86 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:59.409033 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d5e09659-1201-446d-ab72-f8fc7e88ed86 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:59.409813 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d5e09659-1201-446d-ab72-f8fc7e88ed86 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:59.570288 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=67,nova_cell0:UPDATE=27,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:32:59.587165 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a987fffc-8a16-4f62-b439-e30b6d10419c tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8a1be07c-efab-48c3-874c-1f15ee7f220d" status: 204 len: 0 microversion: 2.1 time: 0.721693 Jun 05 08:32:59.588215 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1260/2457] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:32:58 2022] DELETE /compute/v2.1/servers/8a1be07c-efab-48c3-874c-1f15ee7f220d => generated 0 bytes in 723 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:32:59.594649 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-193c0680-8924-42f9-a198-058216502d6c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:59.595836 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-193c0680-8924-42f9-a198-058216502d6c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 89e63314-82a1-4f95-a759-4bf604dd3f06] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:59.603650 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-193c0680-8924-42f9-a198-058216502d6c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:59.604603 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-193c0680-8924-42f9-a198-058216502d6c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:59.605406 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-193c0680-8924-42f9-a198-058216502d6c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:59.606548 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-193c0680-8924-42f9-a198-058216502d6c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:59.649403 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-193c0680-8924-42f9-a198-058216502d6c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 89e63314-82a1-4f95-a759-4bf604dd3f06] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:32:59.726490 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d5e09659-1201-446d-ab72-f8fc7e88ed86 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:59.746474 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d5e09659-1201-446d-ab72-f8fc7e88ed86 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:59.751862 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d5e09659-1201-446d-ab72-f8fc7e88ed86 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:32:59.753287 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d5e09659-1201-446d-ab72-f8fc7e88ed86 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1742 microversion: 2.20 time: 0.380409 Jun 05 08:32:59.753572 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-193c0680-8924-42f9-a198-058216502d6c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 89e63314-82a1-4f95-a759-4bf604dd3f06] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:32:59.754825 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-193c0680-8924-42f9-a198-058216502d6c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:59.755347 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-193c0680-8924-42f9-a198-058216502d6c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:59.755794 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-193c0680-8924-42f9-a198-058216502d6c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 89e63314-82a1-4f95-a759-4bf604dd3f06] instance's host None is down, deleting from database Jun 05 08:32:59.757267 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1198/2458] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:32:59 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1742 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:32:59.762888 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-efb0986c-047e-4cc5-9747-e0234effccad tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:32:59.768003 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-efb0986c-047e-4cc5-9747-e0234effccad tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: fdef50fc-ea3a-476f-81aa-226958ae3c4c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:32:59.775641 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-193c0680-8924-42f9-a198-058216502d6c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 89e63314-82a1-4f95-a759-4bf604dd3f06] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:32:59.783711 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-efb0986c-047e-4cc5-9747-e0234effccad tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:59.784200 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-efb0986c-047e-4cc5-9747-e0234effccad tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:59.784986 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-efb0986c-047e-4cc5-9747-e0234effccad tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:59.785563 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-efb0986c-047e-4cc5-9747-e0234effccad tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:59.835220 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-efb0986c-047e-4cc5-9747-e0234effccad tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: fdef50fc-ea3a-476f-81aa-226958ae3c4c] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:32:59.867051 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-193c0680-8924-42f9-a198-058216502d6c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 89e63314-82a1-4f95-a759-4bf604dd3f06] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:32:59.872404 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-193c0680-8924-42f9-a198-058216502d6c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 89e63314-82a1-4f95-a759-4bf604dd3f06] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:32:59.957882 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-efb0986c-047e-4cc5-9747-e0234effccad tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: fdef50fc-ea3a-476f-81aa-226958ae3c4c] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:32:59.961315 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-efb0986c-047e-4cc5-9747-e0234effccad tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:32:59.961779 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-efb0986c-047e-4cc5-9747-e0234effccad tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:32:59.962278 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-efb0986c-047e-4cc5-9747-e0234effccad tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: fdef50fc-ea3a-476f-81aa-226958ae3c4c] instance's host None is down, deleting from database Jun 05 08:32:59.976174 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-efb0986c-047e-4cc5-9747-e0234effccad tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: fdef50fc-ea3a-476f-81aa-226958ae3c4c] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:33:00.020798 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-efb0986c-047e-4cc5-9747-e0234effccad tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: fdef50fc-ea3a-476f-81aa-226958ae3c4c] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:33:00.034396 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:UPDATE=26,nova_cell0:DELETE=4,nova_cell0:SELECT=68,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:33:00.035974 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-efb0986c-047e-4cc5-9747-e0234effccad tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: fdef50fc-ea3a-476f-81aa-226958ae3c4c] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:33:00.245450 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-193c0680-8924-42f9-a198-058216502d6c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] 10.222.0.33 "DELETE /compute/v2.1/servers/89e63314-82a1-4f95-a759-4bf604dd3f06" status: 204 len: 0 microversion: 2.1 time: 0.655375 Jun 05 08:33:00.247840 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1261/2459] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:32:59 2022] DELETE /compute/v2.1/servers/89e63314-82a1-4f95-a759-4bf604dd3f06 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:33:00.256863 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-77f6a4a5-8c57-4205-8741-ff0afce8c3b1 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:00.258888 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-77f6a4a5-8c57-4205-8741-ff0afce8c3b1 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] [instance: 8a1be07c-efab-48c3-874c-1f15ee7f220d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:00.270629 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-77f6a4a5-8c57-4205-8741-ff0afce8c3b1 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:00.271344 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-77f6a4a5-8c57-4205-8741-ff0afce8c3b1 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:00.272940 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-77f6a4a5-8c57-4205-8741-ff0afce8c3b1 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:00.273894 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-77f6a4a5-8c57-4205-8741-ff0afce8c3b1 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:00.301101 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-77f6a4a5-8c57-4205-8741-ff0afce8c3b1 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] HTTP exception thrown: Instance 8a1be07c-efab-48c3-874c-1f15ee7f220d could not be found. Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-77f6a4a5-8c57-4205-8741-ff0afce8c3b1 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Request method failure captured: Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/8a1be07c-efab-48c3-874c-1f15ee7f220d HTTP/1.1 Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGon99bWSE461hhMYijC-8-Th58L-N2V2OlkYLRWp64wX_o6-T4Z2CiM5elIr2VN4waaqUvnxVjO7vLE2yOzEtatHHZmy3j-Oam-NBjojscx6aoNkz1jKvKJex4dcyav8nKlz4w4sGFlgcrq0ZwMVuk7HbsJjc9MgRr-oEXPhlJDTtY Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: df337986c7f746a683e93491b82e8219 Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ListImageFiltersTestJSON-172198461 Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/df337986c7f746a683e93491b82e8219"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/df337986c7f746a683e93491b82e8219"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_df337986c7f746a683e93491b82e8219", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/df337986c7f746a683e93491b82e8219"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ListImageFiltersTestJSON-172198461 Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: df337986c7f746a683e93491b82e8219 Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-172198461 Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ListImageFiltersTestJSON-172198461-project Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 66890badcc7d4a3d9cdd230a9a3a97a8 Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ListImageFiltersTestJSON-172198461-project Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 8a1be07c-efab-48c3-874c-1f15ee7f220d could not be found. Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '8a1be07c-efab-48c3-874c-1f15ee7f220d'} Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a1be07c-efab-48c3-874c-1f15ee7f220d could not be found. Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a1be07c-efab-48c3-874c-1f15ee7f220d could not be found. Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:00.310257 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:00.313961 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:00.313961 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:00.313961 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:00.313961 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:33:00.313961 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:33:00.313961 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a1be07c-efab-48c3-874c-1f15ee7f220d could not be found. Jun 05 08:33:00.313961 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:00.316821 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-77f6a4a5-8c57-4205-8741-ff0afce8c3b1 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Returning 404 to user: Instance 8a1be07c-efab-48c3-874c-1f15ee7f220d could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:33:00.316821 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-77f6a4a5-8c57-4205-8741-ff0afce8c3b1 tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] 10.222.0.33 "GET /compute/v2.1/servers/8a1be07c-efab-48c3-874c-1f15ee7f220d" status: 404 len: 111 microversion: 2.1 time: 0.064938 Jun 05 08:33:00.320413 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1262/2460] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:00 2022] GET /compute/v2.1/servers/8a1be07c-efab-48c3-874c-1f15ee7f220d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:33:00.325939 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0418e2f1-97e9-4b2c-ab77-a5bcad2dc139 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:00.326758 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0418e2f1-97e9-4b2c-ab77-a5bcad2dc139 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:00.335103 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0418e2f1-97e9-4b2c-ab77-a5bcad2dc139 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:00.335575 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0418e2f1-97e9-4b2c-ab77-a5bcad2dc139 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:00.337035 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0418e2f1-97e9-4b2c-ab77-a5bcad2dc139 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:00.337490 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0418e2f1-97e9-4b2c-ab77-a5bcad2dc139 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:00.389952 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-efb0986c-047e-4cc5-9747-e0234effccad tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fdef50fc-ea3a-476f-81aa-226958ae3c4c" status: 204 len: 0 microversion: 2.1 time: 0.631097 Jun 05 08:33:00.390871 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1199/2461] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:32:59 2022] DELETE /compute/v2.1/servers/fdef50fc-ea3a-476f-81aa-226958ae3c4c => generated 0 bytes in 633 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:33:00.398979 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2c8d675b-d5ff-4964-8e53-388685ea880b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:00.399881 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2c8d675b-d5ff-4964-8e53-388685ea880b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 89e63314-82a1-4f95-a759-4bf604dd3f06] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:00.409746 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2c8d675b-d5ff-4964-8e53-388685ea880b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:00.410417 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2c8d675b-d5ff-4964-8e53-388685ea880b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:00.411379 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2c8d675b-d5ff-4964-8e53-388685ea880b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:00.411893 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2c8d675b-d5ff-4964-8e53-388685ea880b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:00.434671 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-2c8d675b-d5ff-4964-8e53-388685ea880b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] HTTP exception thrown: Instance 89e63314-82a1-4f95-a759-4bf604dd3f06 could not be found. Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2c8d675b-d5ff-4964-8e53-388685ea880b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Request method failure captured: Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/89e63314-82a1-4f95-a759-4bf604dd3f06 HTTP/1.1 Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGo0zUwvGQJLggYE2mJzmrtDjhLPxpgeHRB9PRJ_F9mTHfgZYh_wD8kE2xs_J05lu4NR8rT5pA0XV6cPqniNuPkUyiVDylB3XJieQM_9ixtCwV22mtrB3n3XzxjAgAgGp7H2o6_wWMW4ID0Tnoh-OFGq10CSZMrZjaweuYAdLxfsjbs Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 2e2a416e66d24723a9c880ec94b49843 Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-MigrationsAdminTest-152185534 Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2e2a416e66d24723a9c880ec94b49843"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e2a416e66d24723a9c880ec94b49843"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2e2a416e66d24723a9c880ec94b49843", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e2a416e66d24723a9c880ec94b49843"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-MigrationsAdminTest-152185534 Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 2e2a416e66d24723a9c880ec94b49843 Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-MigrationsAdminTest-152185534 Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-MigrationsAdminTest-152185534-project Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 8719cfb39a1f424193a55296214c20ff Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-MigrationsAdminTest-152185534-project Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 89e63314-82a1-4f95-a759-4bf604dd3f06 could not be found. Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '89e63314-82a1-4f95-a759-4bf604dd3f06'} Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89e63314-82a1-4f95-a759-4bf604dd3f06 could not be found. Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89e63314-82a1-4f95-a759-4bf604dd3f06 could not be found. Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:00.436819 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:00.441184 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:00.441184 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:00.441184 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:00.441184 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:33:00.441184 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:33:00.441184 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89e63314-82a1-4f95-a759-4bf604dd3f06 could not be found. Jun 05 08:33:00.441184 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:00.443177 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2c8d675b-d5ff-4964-8e53-388685ea880b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Returning 404 to user: Instance 89e63314-82a1-4f95-a759-4bf604dd3f06 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:33:00.444373 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2c8d675b-d5ff-4964-8e53-388685ea880b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] 10.222.0.33 "GET /compute/v2.1/servers/89e63314-82a1-4f95-a759-4bf604dd3f06" status: 404 len: 111 microversion: 2.1 time: 0.050204 Jun 05 08:33:00.445653 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1200/2462] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:00 2022] GET /compute/v2.1/servers/89e63314-82a1-4f95-a759-4bf604dd3f06 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:33:00.451380 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1a736e28-eb54-45fa-b936-f1032902688a tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Calling method '.version_select at 0x7f2433903af0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:01.141291 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0418e2f1-97e9-4b2c-ab77-a5bcad2dc139 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:01.159128 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1a736e28-eb54-45fa-b936-f1032902688a tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] 10.222.0.33 "DELETE /compute/v2.1/images/a18fb544-7619-4179-ab09-1d5117aa8a92" status: 204 len: 0 microversion: 2.1 time: 0.711596 Jun 05 08:33:01.159486 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0418e2f1-97e9-4b2c-ab77-a5bcad2dc139 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:01.160436 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1201/2463] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:00 2022] DELETE /compute/v2.1/images/a18fb544-7619-4179-ab09-1d5117aa8a92 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:33:01.166804 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0418e2f1-97e9-4b2c-ab77-a5bcad2dc139 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:01.167031 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c0667db7-e827-42d6-8167-d872d48f1c32 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:01.168022 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c0667db7-e827-42d6-8167-d872d48f1c32 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: fdef50fc-ea3a-476f-81aa-226958ae3c4c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:01.168553 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0418e2f1-97e9-4b2c-ab77-a5bcad2dc139 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1869 microversion: 2.42 time: 0.847103 Jun 05 08:33:01.169110 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1263/2464] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:00 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1869 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:33:01.187702 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c0667db7-e827-42d6-8167-d872d48f1c32 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:01.188351 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c0667db7-e827-42d6-8167-d872d48f1c32 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:01.189639 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c0667db7-e827-42d6-8167-d872d48f1c32 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:01.190388 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c0667db7-e827-42d6-8167-d872d48f1c32 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:01.209360 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-c0667db7-e827-42d6-8167-d872d48f1c32 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] HTTP exception thrown: Instance fdef50fc-ea3a-476f-81aa-226958ae3c4c could not be found. Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c0667db7-e827-42d6-8167-d872d48f1c32 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Request method failure captured: Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/fdef50fc-ea3a-476f-81aa-226958ae3c4c HTTP/1.1 Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGomxwdsv5YyqoQnJ8M3HKY493BdT1kF-ZKjGTvsa4dCdMv2tEzSjVIMsusSuNEFxy259rdnBrKrLso7oL5cHjLMPvzuV3e39WGeMwcC-IUAIwS3lJ_NQ03pDpr22BFtYBYlipbszAv78HDt0XYSE3VMC0HZNva_Yj8FUzYwZlfcuNk Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 68ede041c3c744daa44a56817af472d7 Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-DeleteServersTestJSON-753623147 Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/68ede041c3c744daa44a56817af472d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/68ede041c3c744daa44a56817af472d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_68ede041c3c744daa44a56817af472d7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/68ede041c3c744daa44a56817af472d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-DeleteServersTestJSON-753623147 Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 68ede041c3c744daa44a56817af472d7 Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-DeleteServersTestJSON-753623147 Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-DeleteServersTestJSON-753623147-project Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 87be0705721c42878ae5fb2cb21c9c0d Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-DeleteServersTestJSON-753623147-project Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance fdef50fc-ea3a-476f-81aa-226958ae3c4c could not be found. Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'fdef50fc-ea3a-476f-81aa-226958ae3c4c'} Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdef50fc-ea3a-476f-81aa-226958ae3c4c could not be found. Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdef50fc-ea3a-476f-81aa-226958ae3c4c could not be found. Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:01.211742 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:01.214782 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:01.214782 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:01.214782 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:01.214782 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:33:01.214782 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:33:01.214782 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdef50fc-ea3a-476f-81aa-226958ae3c4c could not be found. Jun 05 08:33:01.214782 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:01.216894 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c0667db7-e827-42d6-8167-d872d48f1c32 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Returning 404 to user: Instance fdef50fc-ea3a-476f-81aa-226958ae3c4c could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:33:01.218059 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c0667db7-e827-42d6-8167-d872d48f1c32 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "GET /compute/v2.1/servers/fdef50fc-ea3a-476f-81aa-226958ae3c4c" status: 404 len: 111 microversion: 2.1 time: 0.056422 Jun 05 08:33:01.218880 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1202/2465] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:01 2022] GET /compute/v2.1/servers/fdef50fc-ea3a-476f-81aa-226958ae3c4c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:33:01.224837 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-08705ac6-deaa-436b-a82a-945f1323fada tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:01.225720 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-08705ac6-deaa-436b-a82a-945f1323fada tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:01.245826 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-08705ac6-deaa-436b-a82a-945f1323fada tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:01.250124 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-08705ac6-deaa-436b-a82a-945f1323fada tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:01.251296 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-08705ac6-deaa-436b-a82a-945f1323fada tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:01.254704 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-08705ac6-deaa-436b-a82a-945f1323fada tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:01.661497 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-08705ac6-deaa-436b-a82a-945f1323fada tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:01.676824 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-08705ac6-deaa-436b-a82a-945f1323fada tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:01.679616 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-08705ac6-deaa-436b-a82a-945f1323fada tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:01.681092 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-08705ac6-deaa-436b-a82a-945f1323fada tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1742 microversion: 2.20 time: 0.461038 Jun 05 08:33:01.681235 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-967b7a2e-bc98-41c0-b161-208f2185b7f2 tempest-MigrationsAdminTest-986751700 tempest-MigrationsAdminTest-986751700-project-admin] Calling method '.version_select at 0x7f24336b8ee0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:01.681968 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1203/2466] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:01 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1742 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:33:01.690489 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a4a43c2d-009d-4e4c-9385-412d741a17bb tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Calling method '.version_select at 0x7f243395cd30>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:01.694973 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-967b7a2e-bc98-41c0-b161-208f2185b7f2 tempest-MigrationsAdminTest-986751700 tempest-MigrationsAdminTest-986751700-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:01.695533 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-967b7a2e-bc98-41c0-b161-208f2185b7f2 tempest-MigrationsAdminTest-986751700 tempest-MigrationsAdminTest-986751700-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:01.726344 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-967b7a2e-bc98-41c0-b161-208f2185b7f2 tempest-MigrationsAdminTest-986751700 tempest-MigrationsAdminTest-986751700-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 3062 microversion: 2.1 time: 0.552057 Jun 05 08:33:01.727055 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1264/2467] 10.222.0.33 () {58 vars in 1142 bytes} [Sun Jun 5 08:33:01 2022] GET /compute/v2.1/os-migrations => generated 3062 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:33:01.769335 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-2939b639-708a-4a66-b1fc-731268df9199 req-49b08913-4ce1-458d-8a1a-d753cf79fe20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "040dd488-42f2-45c3-86de-1a675e78d7ca", "name": "network-vif-plugged", "status": "completed", "tag": "93d59181-26a5-451b-8871-ccba610464fd"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:01.790455 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-2939b639-708a-4a66-b1fc-731268df9199 req-49b08913-4ce1-458d-8a1a-d753cf79fe20 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:01.793459 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-2939b639-708a-4a66-b1fc-731268df9199 req-49b08913-4ce1-458d-8a1a-d753cf79fe20 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:01.806355 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-2939b639-708a-4a66-b1fc-731268df9199 req-49b08913-4ce1-458d-8a1a-d753cf79fe20 service nova] Creating event network-vif-plugged:93d59181-26a5-451b-8871-ccba610464fd for instance 040dd488-42f2-45c3-86de-1a675e78d7ca on n-h1-844739-1 Jun 05 08:33:01.815683 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-2939b639-708a-4a66-b1fc-731268df9199 req-49b08913-4ce1-458d-8a1a-d753cf79fe20 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069781 Jun 05 08:33:01.816565 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1265/2468] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:33:01.824986 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-519e105e-f431-4813-a314-ab558d09c051 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1732602782", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "6ae041e2-2719-4b5a-8067-42384887402d"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:01.925330 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-519e105e-f431-4813-a314-ab558d09c051 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] validate_networks() for [('6ae041e2-2719-4b5a-8067-42384887402d', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:33:02.374310 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a4a43c2d-009d-4e4c-9385-412d741a17bb tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] 10.222.0.33 "DELETE /compute/v2.1/images/b654274e-0d99-4d09-a446-3589beac4b43" status: 204 len: 0 microversion: 2.1 time: 0.691237 Jun 05 08:33:02.375479 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1204/2469] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:01 2022] DELETE /compute/v2.1/images/b654274e-0d99-4d09-a446-3589beac4b43 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:33:02.380334 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7c6ff399-cc95-436f-8d06-0291cdb57ab4 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-886100376", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:02.473167 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-7c6ff399-cc95-436f-8d06-0291cdb57ab4 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] validate_networks() for None {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:33:02.715059 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=76 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:33:03.095194 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-7c6ff399-cc95-436f-8d06-0291cdb57ab4 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:33:03.096255 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-7c6ff399-cc95-436f-8d06-0291cdb57ab4 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:33:03.097249 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-7c6ff399-cc95-436f-8d06-0291cdb57ab4 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:33:03.098100 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-7c6ff399-cc95-436f-8d06-0291cdb57ab4 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:33:03.098630 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-7c6ff399-cc95-436f-8d06-0291cdb57ab4 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:33:03.120977 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7c6ff399-cc95-436f-8d06-0291cdb57ab4 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:03.128519 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7c6ff399-cc95-436f-8d06-0291cdb57ab4 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:03.129695 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7c6ff399-cc95-436f-8d06-0291cdb57ab4 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:03.134706 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7c6ff399-cc95-436f-8d06-0291cdb57ab4 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:03.188451 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-7c6ff399-cc95-436f-8d06-0291cdb57ab4 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Getting quotas for project 2e2a416e66d24723a9c880ec94b49843. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:33:03.202211 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-7c6ff399-cc95-436f-8d06-0291cdb57ab4 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Getting quotas for user 8719cfb39a1f424193a55296214c20ff and project 2e2a416e66d24723a9c880ec94b49843. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:33:03.238833 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7c6ff399-cc95-436f-8d06-0291cdb57ab4 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:33:03.248634 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7c6ff399-cc95-436f-8d06-0291cdb57ab4 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 103136fa-8531-4dd8-adf4-29a2a48ba088] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:33:03.478748 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7c6ff399-cc95-436f-8d06-0291cdb57ab4 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.083492 Jun 05 08:33:03.486938 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1205/2470] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:33:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:33:03.515047 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f8676c71-326d-43cc-9ce7-95357a8d4393 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:03.515702 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f8676c71-326d-43cc-9ce7-95357a8d4393 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:03.545758 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f8676c71-326d-43cc-9ce7-95357a8d4393 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:03.546610 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f8676c71-326d-43cc-9ce7-95357a8d4393 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:03.547552 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f8676c71-326d-43cc-9ce7-95357a8d4393 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:03.548738 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f8676c71-326d-43cc-9ce7-95357a8d4393 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:03.625965 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-519e105e-f431-4813-a314-ab558d09c051 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:33:03.630335 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-519e105e-f431-4813-a314-ab558d09c051 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:33:03.631068 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-519e105e-f431-4813-a314-ab558d09c051 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:33:03.631705 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-519e105e-f431-4813-a314-ab558d09c051 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:33:03.632361 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-519e105e-f431-4813-a314-ab558d09c051 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:33:03.653686 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=81 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:33:03.659483 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-519e105e-f431-4813-a314-ab558d09c051 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:03.661307 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-519e105e-f431-4813-a314-ab558d09c051 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:03.665119 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-519e105e-f431-4813-a314-ab558d09c051 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:03.672359 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-519e105e-f431-4813-a314-ab558d09c051 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:03.718584 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-519e105e-f431-4813-a314-ab558d09c051 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Getting quotas for project 68ede041c3c744daa44a56817af472d7. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:33:03.731327 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-519e105e-f431-4813-a314-ab558d09c051 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Getting quotas for user 87be0705721c42878ae5fb2cb21c9c0d and project 68ede041c3c744daa44a56817af472d7. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:33:03.748951 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-519e105e-f431-4813-a314-ab558d09c051 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:33:03.752568 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-519e105e-f431-4813-a314-ab558d09c051 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: 65c0ff64-f818-4afb-b4eb-08a6ff9614b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:33:03.827768 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-519e105e-f431-4813-a314-ab558d09c051 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.009654 Jun 05 08:33:03.828717 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1266/2471] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:33:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:33:03.834624 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a206e76f-cfa2-48e0-a9af-dae6dbd3f5fd tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] Calling method '.version_select at 0x7f2433aeb9d0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:04.092174 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f8676c71-326d-43cc-9ce7-95357a8d4393 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:04.109515 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f8676c71-326d-43cc-9ce7-95357a8d4393 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:04.115399 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f8676c71-326d-43cc-9ce7-95357a8d4393 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:04.117804 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f8676c71-326d-43cc-9ce7-95357a8d4393 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 2829 microversion: 2.42 time: 0.629656 Jun 05 08:33:04.121918 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1206/2472] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:03 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 2829 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:33:04.152645 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0b87713d-6602-49fa-9711-bed2b3075519 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:04.155216 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0b87713d-6602-49fa-9711-bed2b3075519 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:04.172742 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0b87713d-6602-49fa-9711-bed2b3075519 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:04.173672 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0b87713d-6602-49fa-9711-bed2b3075519 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:04.175117 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0b87713d-6602-49fa-9711-bed2b3075519 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:04.175962 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0b87713d-6602-49fa-9711-bed2b3075519 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:04.751899 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a206e76f-cfa2-48e0-a9af-dae6dbd3f5fd tempest-ListImageFiltersTestJSON-172198461 tempest-ListImageFiltersTestJSON-172198461-project] 10.222.0.33 "DELETE /compute/v2.1/images/950157ac-6916-47d4-8095-a7ade8b8279a" status: 204 len: 0 microversion: 2.1 time: 0.921774 Jun 05 08:33:04.752965 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1267/2473] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:03 2022] DELETE /compute/v2.1/images/950157ac-6916-47d4-8095-a7ade8b8279a => generated 0 bytes in 923 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:33:04.767050 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-74c90784-fa19-445d-b821-99c37503a6b7 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:04.773557 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-74c90784-fa19-445d-b821-99c37503a6b7 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 103136fa-8531-4dd8-adf4-29a2a48ba088] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:04.823892 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-74c90784-fa19-445d-b821-99c37503a6b7 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:04.824393 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-74c90784-fa19-445d-b821-99c37503a6b7 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:04.832935 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-74c90784-fa19-445d-b821-99c37503a6b7 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:04.833948 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-74c90784-fa19-445d-b821-99c37503a6b7 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:04.871472 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0b87713d-6602-49fa-9711-bed2b3075519 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:04.887115 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0b87713d-6602-49fa-9711-bed2b3075519 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:04.890297 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0b87713d-6602-49fa-9711-bed2b3075519 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:04.898219 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0b87713d-6602-49fa-9711-bed2b3075519 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1737 microversion: 2.20 time: 0.774980 Jun 05 08:33:04.907986 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1207/2474] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:04 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1737 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:33:04.922858 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-85290a40-73dd-4335-95a0-1ef9f69b65c0 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:04.928463 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-85290a40-73dd-4335-95a0-1ef9f69b65c0 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: 65c0ff64-f818-4afb-b4eb-08a6ff9614b3] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:04.957622 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-85290a40-73dd-4335-95a0-1ef9f69b65c0 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:04.960084 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-85290a40-73dd-4335-95a0-1ef9f69b65c0 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:04.964647 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-74c90784-fa19-445d-b821-99c37503a6b7 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:04.965109 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-74c90784-fa19-445d-b821-99c37503a6b7 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:04.965576 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-74c90784-fa19-445d-b821-99c37503a6b7 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lazy-loading 'fault' on Instance uuid 103136fa-8531-4dd8-adf4-29a2a48ba088 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:33:04.967972 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-85290a40-73dd-4335-95a0-1ef9f69b65c0 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:04.968580 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-85290a40-73dd-4335-95a0-1ef9f69b65c0 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:05.071375 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-85290a40-73dd-4335-95a0-1ef9f69b65c0 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:05.071937 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-85290a40-73dd-4335-95a0-1ef9f69b65c0 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:05.072630 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-85290a40-73dd-4335-95a0-1ef9f69b65c0 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lazy-loading 'fault' on Instance uuid 65c0ff64-f818-4afb-b4eb-08a6ff9614b3 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:33:05.119210 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-74c90784-fa19-445d-b821-99c37503a6b7 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8719cfb39a1f424193a55296214c20ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2a416e66d24723a9c880ec94b49843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:05.128527 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-74c90784-fa19-445d-b821-99c37503a6b7 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] 10.222.0.33 "GET /compute/v2.1/servers/103136fa-8531-4dd8-adf4-29a2a48ba088" status: 200 len: 1285 microversion: 2.1 time: 0.374226 Jun 05 08:33:05.140320 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1268/2475] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:04 2022] GET /compute/v2.1/servers/103136fa-8531-4dd8-adf4-29a2a48ba088 => generated 1285 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:33:05.146596 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-736deb74-1f68-4a58-93bb-5327b13b5a15 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:05.147315 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-736deb74-1f68-4a58-93bb-5327b13b5a15 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:05.155692 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-736deb74-1f68-4a58-93bb-5327b13b5a15 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:05.160837 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-736deb74-1f68-4a58-93bb-5327b13b5a15 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:05.163967 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-736deb74-1f68-4a58-93bb-5327b13b5a15 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:05.164636 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-736deb74-1f68-4a58-93bb-5327b13b5a15 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:05.226753 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-85290a40-73dd-4335-95a0-1ef9f69b65c0 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87be0705721c42878ae5fb2cb21c9c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ede041c3c744daa44a56817af472d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:05.237250 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=100 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:33:05.248540 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-85290a40-73dd-4335-95a0-1ef9f69b65c0 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "GET /compute/v2.1/servers/65c0ff64-f818-4afb-b4eb-08a6ff9614b3" status: 200 len: 1288 microversion: 2.1 time: 0.338573 Jun 05 08:33:05.256427 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1208/2476] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:04 2022] GET /compute/v2.1/servers/65c0ff64-f818-4afb-b4eb-08a6ff9614b3 => generated 1288 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:33:05.928293 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-736deb74-1f68-4a58-93bb-5327b13b5a15 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.786358 Jun 05 08:33:05.929478 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1269/2477] 10.222.0.33 () {60 vars in 1315 bytes} [Sun Jun 5 08:33:05 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085/os-interface => generated 1832 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:33:05.936792 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e3517559-514c-4151-9a7b-7ee09140becb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:05.937726 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e3517559-514c-4151-9a7b-7ee09140becb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:05.955863 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e3517559-514c-4151-9a7b-7ee09140becb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:05.959356 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e3517559-514c-4151-9a7b-7ee09140becb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:05.960910 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e3517559-514c-4151-9a7b-7ee09140becb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:05.962790 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e3517559-514c-4151-9a7b-7ee09140becb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:06.122207 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-54171c33-41e3-474a-aefe-53e53c17d1fc tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-504476883", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": "none"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:06.279450 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-54171c33-41e3-474a-aefe-53e53c17d1fc tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:33:06.281085 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-54171c33-41e3-474a-aefe-53e53c17d1fc tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:33:06.281653 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-54171c33-41e3-474a-aefe-53e53c17d1fc tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:33:06.282131 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-54171c33-41e3-474a-aefe-53e53c17d1fc tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:33:06.282653 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-54171c33-41e3-474a-aefe-53e53c17d1fc tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:33:06.301441 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-54171c33-41e3-474a-aefe-53e53c17d1fc tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:06.302263 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-54171c33-41e3-474a-aefe-53e53c17d1fc tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:06.303285 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-54171c33-41e3-474a-aefe-53e53c17d1fc tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:06.303898 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-54171c33-41e3-474a-aefe-53e53c17d1fc tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:06.369161 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-54171c33-41e3-474a-aefe-53e53c17d1fc tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Getting quotas for project f6786f5ca5884feb8141831e5993edfb. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:33:06.379073 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-54171c33-41e3-474a-aefe-53e53c17d1fc tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Getting quotas for user 5ef42b862d154566bccdc87de859d3b2 and project f6786f5ca5884feb8141831e5993edfb. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:33:06.401529 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-54171c33-41e3-474a-aefe-53e53c17d1fc tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:33:06.404227 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-54171c33-41e3-474a-aefe-53e53c17d1fc tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] [instance: d45fa817-5c9e-476e-9f2f-b9d2d094a56f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:33:06.492734 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-54171c33-41e3-474a-aefe-53e53c17d1fc tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.900684 Jun 05 08:33:06.495448 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1209/2478] 10.222.0.33 () {62 vars in 1187 bytes} [Sun Jun 5 08:33:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 05 08:33:06.508134 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-cbe7beaf-ae98-4789-9759-108c68b180ae tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:06.509514 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-cbe7beaf-ae98-4789-9759-108c68b180ae tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 103136fa-8531-4dd8-adf4-29a2a48ba088] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:06.526524 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cbe7beaf-ae98-4789-9759-108c68b180ae tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:06.528694 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cbe7beaf-ae98-4789-9759-108c68b180ae tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:06.531731 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cbe7beaf-ae98-4789-9759-108c68b180ae tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:06.533004 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cbe7beaf-ae98-4789-9759-108c68b180ae tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:06.649489 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cbe7beaf-ae98-4789-9759-108c68b180ae tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:06.651626 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cbe7beaf-ae98-4789-9759-108c68b180ae tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:06.652364 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-cbe7beaf-ae98-4789-9759-108c68b180ae tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lazy-loading 'fault' on Instance uuid 103136fa-8531-4dd8-adf4-29a2a48ba088 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:33:06.786826 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-cbe7beaf-ae98-4789-9759-108c68b180ae tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8719cfb39a1f424193a55296214c20ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2a416e66d24723a9c880ec94b49843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:06.798984 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-cbe7beaf-ae98-4789-9759-108c68b180ae tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] 10.222.0.33 "GET /compute/v2.1/servers/103136fa-8531-4dd8-adf4-29a2a48ba088" status: 200 len: 1285 microversion: 2.1 time: 0.301273 Jun 05 08:33:06.800792 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1210/2479] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:06 2022] GET /compute/v2.1/servers/103136fa-8531-4dd8-adf4-29a2a48ba088 => generated 1285 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:33:06.819859 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ed3dd80f-f7e0-4a41-9551-e6586db90dd5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:06.821415 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ed3dd80f-f7e0-4a41-9551-e6586db90dd5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: 65c0ff64-f818-4afb-b4eb-08a6ff9614b3] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:06.838615 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ed3dd80f-f7e0-4a41-9551-e6586db90dd5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:06.840480 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ed3dd80f-f7e0-4a41-9551-e6586db90dd5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:06.841512 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ed3dd80f-f7e0-4a41-9551-e6586db90dd5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:06.843044 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ed3dd80f-f7e0-4a41-9551-e6586db90dd5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:06.942792 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ed3dd80f-f7e0-4a41-9551-e6586db90dd5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:06.943684 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ed3dd80f-f7e0-4a41-9551-e6586db90dd5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:06.945601 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-ed3dd80f-f7e0-4a41-9551-e6586db90dd5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lazy-loading 'fault' on Instance uuid 65c0ff64-f818-4afb-b4eb-08a6ff9614b3 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:33:07.230669 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ed3dd80f-f7e0-4a41-9551-e6586db90dd5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87be0705721c42878ae5fb2cb21c9c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ede041c3c744daa44a56817af472d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:07.242099 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ed3dd80f-f7e0-4a41-9551-e6586db90dd5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "GET /compute/v2.1/servers/65c0ff64-f818-4afb-b4eb-08a6ff9614b3" status: 200 len: 1288 microversion: 2.1 time: 0.439945 Jun 05 08:33:07.248681 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1211/2480] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:06 2022] GET /compute/v2.1/servers/65c0ff64-f818-4afb-b4eb-08a6ff9614b3 => generated 1288 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:33:07.274038 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d4444ec3-6a23-44c3-865a-0551bd50fb60 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:07.275920 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d4444ec3-6a23-44c3-865a-0551bd50fb60 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] [instance: d45fa817-5c9e-476e-9f2f-b9d2d094a56f] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:07.295741 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d4444ec3-6a23-44c3-865a-0551bd50fb60 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:07.296387 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d4444ec3-6a23-44c3-865a-0551bd50fb60 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:07.299404 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d4444ec3-6a23-44c3-865a-0551bd50fb60 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:07.303617 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d4444ec3-6a23-44c3-865a-0551bd50fb60 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:07.561522 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d4444ec3-6a23-44c3-865a-0551bd50fb60 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:07.566416 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d4444ec3-6a23-44c3-865a-0551bd50fb60 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:07.566855 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-d4444ec3-6a23-44c3-865a-0551bd50fb60 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lazy-loading 'fault' on Instance uuid d45fa817-5c9e-476e-9f2f-b9d2d094a56f {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:33:08.104859 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d4444ec3-6a23-44c3-865a-0551bd50fb60 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef42b862d154566bccdc87de859d3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6786f5ca5884feb8141831e5993edfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:08.114798 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d4444ec3-6a23-44c3-865a-0551bd50fb60 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef42b862d154566bccdc87de859d3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6786f5ca5884feb8141831e5993edfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:08.119779 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d4444ec3-6a23-44c3-865a-0551bd50fb60 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef42b862d154566bccdc87de859d3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6786f5ca5884feb8141831e5993edfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:08.134096 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d4444ec3-6a23-44c3-865a-0551bd50fb60 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] 10.222.0.33 "PUT /compute/v2.1/servers/d45fa817-5c9e-476e-9f2f-b9d2d094a56f" status: 200 len: 1431 microversion: 2.75 time: 0.880763 Jun 05 08:33:08.143708 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1212/2481] 10.222.0.33 () {62 vars in 1296 bytes} [Sun Jun 5 08:33:07 2022] PUT /compute/v2.1/servers/d45fa817-5c9e-476e-9f2f-b9d2d094a56f => generated 1431 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:33:08.161607 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e3517559-514c-4151-9a7b-7ee09140becb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:08.177995 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f127cb5d-e702-47af-852b-e779fcce259c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:08.178784 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f127cb5d-e702-47af-852b-e779fcce259c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 103136fa-8531-4dd8-adf4-29a2a48ba088] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:08.183072 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e3517559-514c-4151-9a7b-7ee09140becb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:08.187844 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e3517559-514c-4151-9a7b-7ee09140becb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:08.193638 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e3517559-514c-4151-9a7b-7ee09140becb tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1737 microversion: 2.20 time: 2.262852 Jun 05 08:33:08.210759 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1270/2482] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:05 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1737 bytes in 2279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:33:08.237059 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c85be69e-cce4-40c2-a16e-dd88611a7b81 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:08.237574 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c85be69e-cce4-40c2-a16e-dd88611a7b81 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: 65c0ff64-f818-4afb-b4eb-08a6ff9614b3] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:08.243366 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f127cb5d-e702-47af-852b-e779fcce259c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:08.246021 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f127cb5d-e702-47af-852b-e779fcce259c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:08.247097 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f127cb5d-e702-47af-852b-e779fcce259c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:08.248912 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f127cb5d-e702-47af-852b-e779fcce259c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:08.261334 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c85be69e-cce4-40c2-a16e-dd88611a7b81 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:08.262269 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c85be69e-cce4-40c2-a16e-dd88611a7b81 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:08.263330 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c85be69e-cce4-40c2-a16e-dd88611a7b81 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:08.263913 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c85be69e-cce4-40c2-a16e-dd88611a7b81 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:08.318429 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c85be69e-cce4-40c2-a16e-dd88611a7b81 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: 65c0ff64-f818-4afb-b4eb-08a6ff9614b3] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:33:08.349388 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f127cb5d-e702-47af-852b-e779fcce259c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 103136fa-8531-4dd8-adf4-29a2a48ba088] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:33:08.425863 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c85be69e-cce4-40c2-a16e-dd88611a7b81 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: 65c0ff64-f818-4afb-b4eb-08a6ff9614b3] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:33:08.433751 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c85be69e-cce4-40c2-a16e-dd88611a7b81 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:08.436133 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c85be69e-cce4-40c2-a16e-dd88611a7b81 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:08.436628 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-c85be69e-cce4-40c2-a16e-dd88611a7b81 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: 65c0ff64-f818-4afb-b4eb-08a6ff9614b3] instance's host None is down, deleting from database Jun 05 08:33:08.446539 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-c85be69e-cce4-40c2-a16e-dd88611a7b81 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: 65c0ff64-f818-4afb-b4eb-08a6ff9614b3] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:33:08.520773 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f127cb5d-e702-47af-852b-e779fcce259c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 103136fa-8531-4dd8-adf4-29a2a48ba088] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:33:08.521744 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f127cb5d-e702-47af-852b-e779fcce259c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:08.522126 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f127cb5d-e702-47af-852b-e779fcce259c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:08.524151 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-f127cb5d-e702-47af-852b-e779fcce259c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 103136fa-8531-4dd8-adf4-29a2a48ba088] instance's host None is down, deleting from database Jun 05 08:33:08.544700 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-f127cb5d-e702-47af-852b-e779fcce259c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 103136fa-8531-4dd8-adf4-29a2a48ba088] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:33:08.709779 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-c85be69e-cce4-40c2-a16e-dd88611a7b81 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: 65c0ff64-f818-4afb-b4eb-08a6ff9614b3] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:33:08.716907 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-c85be69e-cce4-40c2-a16e-dd88611a7b81 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: 65c0ff64-f818-4afb-b4eb-08a6ff9614b3] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:33:08.781431 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-f127cb5d-e702-47af-852b-e779fcce259c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 103136fa-8531-4dd8-adf4-29a2a48ba088] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:33:08.794531 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-f127cb5d-e702-47af-852b-e779fcce259c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 103136fa-8531-4dd8-adf4-29a2a48ba088] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:33:09.145980 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=76,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:UPDATE=18,nova_cell0:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:33:09.213035 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f127cb5d-e702-47af-852b-e779fcce259c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] 10.222.0.33 "DELETE /compute/v2.1/servers/103136fa-8531-4dd8-adf4-29a2a48ba088" status: 204 len: 0 microversion: 2.1 time: 1.045205 Jun 05 08:33:09.214492 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1213/2483] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:33:08 2022] DELETE /compute/v2.1/servers/103136fa-8531-4dd8-adf4-29a2a48ba088 => generated 0 bytes in 1048 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:33:09.219605 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:UPDATE=32,nova_cell0:DELETE=4,nova_cell0:SELECT=60,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:33:09.222696 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6bc1cb57-5601-4724-834a-651773921ad7 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:09.239334 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6bc1cb57-5601-4724-834a-651773921ad7 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] [instance: d45fa817-5c9e-476e-9f2f-b9d2d094a56f] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:09.240726 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c85be69e-cce4-40c2-a16e-dd88611a7b81 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "DELETE /compute/v2.1/servers/65c0ff64-f818-4afb-b4eb-08a6ff9614b3" status: 204 len: 0 microversion: 2.1 time: 1.028581 Jun 05 08:33:09.241820 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1271/2484] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:33:08 2022] DELETE /compute/v2.1/servers/65c0ff64-f818-4afb-b4eb-08a6ff9614b3 => generated 0 bytes in 1030 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:33:09.253211 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6bc1cb57-5601-4724-834a-651773921ad7 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:09.253937 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6bc1cb57-5601-4724-834a-651773921ad7 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:09.267130 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6bc1cb57-5601-4724-834a-651773921ad7 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:09.272009 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6bc1cb57-5601-4724-834a-651773921ad7 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:09.333652 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6bc1cb57-5601-4724-834a-651773921ad7 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:09.336116 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6bc1cb57-5601-4724-834a-651773921ad7 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:09.337660 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-6bc1cb57-5601-4724-834a-651773921ad7 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lazy-loading 'fault' on Instance uuid d45fa817-5c9e-476e-9f2f-b9d2d094a56f {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:33:09.458975 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7596cedf-7a26-4073-8be1-ab072e126a0b tempest-ListImagesTestJSON-956709179 tempest-ListImagesTestJSON-956709179-project] Calling method '.version_select at 0x7f24337ca820>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:09.537198 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7596cedf-7a26-4073-8be1-ab072e126a0b tempest-ListImagesTestJSON-956709179 tempest-ListImagesTestJSON-956709179-project] 10.222.0.33 "GET /compute/v2.1/images/1241bde3-ef1f-41a5-b0fa-6f409216229a" status: 200 len: 784 microversion: 2.1 time: 0.293824 Jun 05 08:33:09.557834 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1272/2485] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:33:09 2022] GET /compute/v2.1/images/1241bde3-ef1f-41a5-b0fa-6f409216229a => generated 784 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:33:09.563142 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-77038200-7b92-41d6-b185-bb74f03b04db tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:09.564222 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-77038200-7b92-41d6-b185-bb74f03b04db tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:09.572173 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-77038200-7b92-41d6-b185-bb74f03b04db tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:09.572944 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-77038200-7b92-41d6-b185-bb74f03b04db tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:09.574621 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-77038200-7b92-41d6-b185-bb74f03b04db tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:09.575266 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-77038200-7b92-41d6-b185-bb74f03b04db tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:09.989393 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-77038200-7b92-41d6-b185-bb74f03b04db tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:09.998454 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-77038200-7b92-41d6-b185-bb74f03b04db tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:10.005324 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6bc1cb57-5601-4724-834a-651773921ad7 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef42b862d154566bccdc87de859d3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6786f5ca5884feb8141831e5993edfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:10.029083 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-77038200-7b92-41d6-b185-bb74f03b04db tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:10.031673 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-77038200-7b92-41d6-b185-bb74f03b04db tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1737 microversion: 2.20 time: 0.472306 Jun 05 08:33:10.034776 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6bc1cb57-5601-4724-834a-651773921ad7 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef42b862d154566bccdc87de859d3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6786f5ca5884feb8141831e5993edfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:10.038520 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1273/2486] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:09 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1737 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:33:10.040794 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6bc1cb57-5601-4724-834a-651773921ad7 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef42b862d154566bccdc87de859d3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6786f5ca5884feb8141831e5993edfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:10.061882 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-484db171-b3c2-47bc-89c9-4a68abfb3380 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:10.065722 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-484db171-b3c2-47bc-89c9-4a68abfb3380 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 103136fa-8531-4dd8-adf4-29a2a48ba088] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:10.070509 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6bc1cb57-5601-4724-834a-651773921ad7 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] 10.222.0.33 "GET /compute/v2.1/servers/d45fa817-5c9e-476e-9f2f-b9d2d094a56f" status: 200 len: 1431 microversion: 2.75 time: 0.851959 Jun 05 08:33:10.072563 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1214/2487] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:09 2022] GET /compute/v2.1/servers/d45fa817-5c9e-476e-9f2f-b9d2d094a56f => generated 1431 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:33:10.088190 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-484db171-b3c2-47bc-89c9-4a68abfb3380 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:10.088775 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a3d9d9e9-5566-4f1a-aa0d-73afa1e4026c tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:10.091055 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a3d9d9e9-5566-4f1a-aa0d-73afa1e4026c tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: 65c0ff64-f818-4afb-b4eb-08a6ff9614b3] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:10.094279 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-484db171-b3c2-47bc-89c9-4a68abfb3380 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:10.095801 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-484db171-b3c2-47bc-89c9-4a68abfb3380 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:10.098318 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-484db171-b3c2-47bc-89c9-4a68abfb3380 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:10.107700 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a3d9d9e9-5566-4f1a-aa0d-73afa1e4026c tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:10.119652 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a3d9d9e9-5566-4f1a-aa0d-73afa1e4026c tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:10.120636 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a3d9d9e9-5566-4f1a-aa0d-73afa1e4026c tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:10.121632 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a3d9d9e9-5566-4f1a-aa0d-73afa1e4026c tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:10.157283 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-484db171-b3c2-47bc-89c9-4a68abfb3380 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] HTTP exception thrown: Instance 103136fa-8531-4dd8-adf4-29a2a48ba088 could not be found. Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-484db171-b3c2-47bc-89c9-4a68abfb3380 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Request method failure captured: Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/103136fa-8531-4dd8-adf4-29a2a48ba088 HTTP/1.1 Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGo0zUwvGQJLggYE2mJzmrtDjhLPxpgeHRB9PRJ_F9mTHfgZYh_wD8kE2xs_J05lu4NR8rT5pA0XV6cPqniNuPkUyiVDylB3XJieQM_9ixtCwV22mtrB3n3XzxjAgAgGp7H2o6_wWMW4ID0Tnoh-OFGq10CSZMrZjaweuYAdLxfsjbs Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 2e2a416e66d24723a9c880ec94b49843 Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-MigrationsAdminTest-152185534 Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2e2a416e66d24723a9c880ec94b49843"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e2a416e66d24723a9c880ec94b49843"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2e2a416e66d24723a9c880ec94b49843", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e2a416e66d24723a9c880ec94b49843"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-MigrationsAdminTest-152185534 Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 2e2a416e66d24723a9c880ec94b49843 Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-MigrationsAdminTest-152185534 Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-MigrationsAdminTest-152185534-project Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 8719cfb39a1f424193a55296214c20ff Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-MigrationsAdminTest-152185534-project Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 103136fa-8531-4dd8-adf4-29a2a48ba088 could not be found. Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '103136fa-8531-4dd8-adf4-29a2a48ba088'} Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 103136fa-8531-4dd8-adf4-29a2a48ba088 could not be found. Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 103136fa-8531-4dd8-adf4-29a2a48ba088 could not be found. Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:10.159402 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:10.162576 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:10.162576 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:10.162576 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:10.162576 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:33:10.162576 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:33:10.162576 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 103136fa-8531-4dd8-adf4-29a2a48ba088 could not be found. Jun 05 08:33:10.162576 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:10.162576 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-484db171-b3c2-47bc-89c9-4a68abfb3380 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Returning 404 to user: Instance 103136fa-8531-4dd8-adf4-29a2a48ba088 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:33:10.162576 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-484db171-b3c2-47bc-89c9-4a68abfb3380 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] 10.222.0.33 "GET /compute/v2.1/servers/103136fa-8531-4dd8-adf4-29a2a48ba088" status: 404 len: 111 microversion: 2.1 time: 0.121159 Jun 05 08:33:10.172517 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1274/2488] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:10 2022] GET /compute/v2.1/servers/103136fa-8531-4dd8-adf4-29a2a48ba088 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:33:10.180103 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a95b8b57-b10c-42c2-8d5b-8a417e9970cb tempest-ListImagesTestJSON-956709179 tempest-ListImagesTestJSON-956709179-project] Calling method '.version_select at 0x7f2433699790>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:10.209440 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-a3d9d9e9-5566-4f1a-aa0d-73afa1e4026c tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] HTTP exception thrown: Instance 65c0ff64-f818-4afb-b4eb-08a6ff9614b3 could not be found. Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a3d9d9e9-5566-4f1a-aa0d-73afa1e4026c tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Request method failure captured: Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/65c0ff64-f818-4afb-b4eb-08a6ff9614b3 HTTP/1.1 Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGomxwdsv5YyqoQnJ8M3HKY493BdT1kF-ZKjGTvsa4dCdMv2tEzSjVIMsusSuNEFxy259rdnBrKrLso7oL5cHjLMPvzuV3e39WGeMwcC-IUAIwS3lJ_NQ03pDpr22BFtYBYlipbszAv78HDt0XYSE3VMC0HZNva_Yj8FUzYwZlfcuNk Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 68ede041c3c744daa44a56817af472d7 Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-DeleteServersTestJSON-753623147 Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/68ede041c3c744daa44a56817af472d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/68ede041c3c744daa44a56817af472d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_68ede041c3c744daa44a56817af472d7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/68ede041c3c744daa44a56817af472d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-DeleteServersTestJSON-753623147 Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 68ede041c3c744daa44a56817af472d7 Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-DeleteServersTestJSON-753623147 Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-DeleteServersTestJSON-753623147-project Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 87be0705721c42878ae5fb2cb21c9c0d Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-DeleteServersTestJSON-753623147-project Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 65c0ff64-f818-4afb-b4eb-08a6ff9614b3 could not be found. Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '65c0ff64-f818-4afb-b4eb-08a6ff9614b3'} Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65c0ff64-f818-4afb-b4eb-08a6ff9614b3 could not be found. Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65c0ff64-f818-4afb-b4eb-08a6ff9614b3 could not be found. Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:10.211018 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:10.215601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:10.215601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:10.215601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:10.215601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:33:10.215601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:33:10.215601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65c0ff64-f818-4afb-b4eb-08a6ff9614b3 could not be found. Jun 05 08:33:10.215601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:10.215601 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a3d9d9e9-5566-4f1a-aa0d-73afa1e4026c tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Returning 404 to user: Instance 65c0ff64-f818-4afb-b4eb-08a6ff9614b3 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:33:10.215601 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a3d9d9e9-5566-4f1a-aa0d-73afa1e4026c tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "GET /compute/v2.1/servers/65c0ff64-f818-4afb-b4eb-08a6ff9614b3" status: 404 len: 111 microversion: 2.1 time: 0.139084 Jun 05 08:33:10.216998 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1215/2489] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:10 2022] GET /compute/v2.1/servers/65c0ff64-f818-4afb-b4eb-08a6ff9614b3 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:33:10.223130 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-81608594-a940-4902-8f3e-390b650f8612 tempest-MigrationsAdminTest-986751700 tempest-MigrationsAdminTest-986751700-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:10.283678 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-81608594-a940-4902-8f3e-390b650f8612 tempest-MigrationsAdminTest-986751700 tempest-MigrationsAdminTest-986751700-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.066507 Jun 05 08:33:10.284358 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1216/2490] 10.222.0.33 () {58 vars in 1136 bytes} [Sun Jun 5 08:33:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:33:10.304871 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a95b8b57-b10c-42c2-8d5b-8a417e9970cb tempest-ListImagesTestJSON-956709179 tempest-ListImagesTestJSON-956709179-project] 10.222.0.33 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.129978 Jun 05 08:33:10.305840 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1275/2491] 10.222.0.33 () {58 vars in 1121 bytes} [Sun Jun 5 08:33:10 2022] GET /compute/v2.1/images => generated 445 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:33:10.327616 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-70c74a74-2fcd-46c7-8179-0f716ab2b085 tempest-MigrationsAdminTest-986751700 tempest-MigrationsAdminTest-986751700-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-413244878", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:10.332971 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:33:10.332971 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:33:10.353172 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-975d0a4f-2d6d-46b3-8368-030353189191 tempest-ListImagesTestJSON-956709179 tempest-ListImagesTestJSON-956709179-project] Calling method '.version_select at 0x7f2433907700>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:10.392238 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-70c74a74-2fcd-46c7-8179-0f716ab2b085 tempest-MigrationsAdminTest-986751700 tempest-MigrationsAdminTest-986751700-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.083624 Jun 05 08:33:10.394951 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1276/2492] 10.222.0.33 () {60 vars in 1145 bytes} [Sun Jun 5 08:33:10 2022] POST /compute/v2.1/flavors => generated 498 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:33:10.424908 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ea167387-435c-4d20-9225-bb2bc3868e01 tempest-MigrationsAdminTest-986751700 tempest-MigrationsAdminTest-986751700-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:10.439980 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:UPDATE=4 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:33:10.463616 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ea167387-435c-4d20-9225-bb2bc3868e01 tempest-MigrationsAdminTest-986751700 tempest-MigrationsAdminTest-986751700-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.060297 Jun 05 08:33:10.472437 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1277/2493] 10.222.0.33 () {58 vars in 1181 bytes} [Sun Jun 5 08:33:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:33:10.493525 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-975d0a4f-2d6d-46b3-8368-030353189191 tempest-ListImagesTestJSON-956709179 tempest-ListImagesTestJSON-956709179-project] 10.222.0.33 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.177175 Jun 05 08:33:10.494106 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1217/2494] 10.222.0.33 () {58 vars in 1142 bytes} [Sun Jun 5 08:33:10 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:33:10.664229 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e81d3dba-60ca-4587-aaa0-d8faeae52d90 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2136725675", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "6ae041e2-2719-4b5a-8067-42384887402d"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:10.720570 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3f9a038e-0ff7-4016-ba97-3ea88cc7ea59 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2050414184", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "edc92901-d229-442e-98d9-f97e9433429f"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:10.742306 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:33:10.911824 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-e81d3dba-60ca-4587-aaa0-d8faeae52d90 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] validate_networks() for [('6ae041e2-2719-4b5a-8067-42384887402d', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:33:10.942028 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-3f9a038e-0ff7-4016-ba97-3ea88cc7ea59 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] validate_networks() for None {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:33:11.859658 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-3f9a038e-0ff7-4016-ba97-3ea88cc7ea59 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:33:11.862999 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-3f9a038e-0ff7-4016-ba97-3ea88cc7ea59 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:33:11.864287 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-3f9a038e-0ff7-4016-ba97-3ea88cc7ea59 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:33:11.864709 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-3f9a038e-0ff7-4016-ba97-3ea88cc7ea59 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:33:11.865131 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-3f9a038e-0ff7-4016-ba97-3ea88cc7ea59 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:33:11.886399 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3f9a038e-0ff7-4016-ba97-3ea88cc7ea59 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:11.890159 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3f9a038e-0ff7-4016-ba97-3ea88cc7ea59 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:11.895293 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3f9a038e-0ff7-4016-ba97-3ea88cc7ea59 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:11.898841 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3f9a038e-0ff7-4016-ba97-3ea88cc7ea59 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:11.924817 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=100 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:33:11.946913 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-3f9a038e-0ff7-4016-ba97-3ea88cc7ea59 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Getting quotas for project 2e2a416e66d24723a9c880ec94b49843. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:33:11.954683 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-3f9a038e-0ff7-4016-ba97-3ea88cc7ea59 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Getting quotas for user 8719cfb39a1f424193a55296214c20ff and project 2e2a416e66d24723a9c880ec94b49843. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:33:11.971610 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3f9a038e-0ff7-4016-ba97-3ea88cc7ea59 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:33:11.977442 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3f9a038e-0ff7-4016-ba97-3ea88cc7ea59 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 6970530a-90a4-487f-a88a-d0f474772e22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:33:12.100415 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3f9a038e-0ff7-4016-ba97-3ea88cc7ea59 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.385952 Jun 05 08:33:12.106751 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1218/2495] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:33:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 05 08:33:12.118627 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-31e33ca8-61f8-424c-a8ca-7ec3e58970a0 req-155d3b2c-fee9-4b0c-94cb-f43d9cf36b0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40933e98-d7d3-4d63-9012-ad5607e45085", "tag": "4b72d95e-c895-455c-8626-04e2ca35dbf3"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:12.162366 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-31e33ca8-61f8-424c-a8ca-7ec3e58970a0 req-155d3b2c-fee9-4b0c-94cb-f43d9cf36b0d service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:12.165709 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-31e33ca8-61f8-424c-a8ca-7ec3e58970a0 req-155d3b2c-fee9-4b0c-94cb-f43d9cf36b0d service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:12.191993 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-31e33ca8-61f8-424c-a8ca-7ec3e58970a0 req-155d3b2c-fee9-4b0c-94cb-f43d9cf36b0d service nova] Creating event network-changed:4b72d95e-c895-455c-8626-04e2ca35dbf3 for instance 40933e98-d7d3-4d63-9012-ad5607e45085 on n-h1-844739-1 Jun 05 08:33:12.206046 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-31e33ca8-61f8-424c-a8ca-7ec3e58970a0 req-155d3b2c-fee9-4b0c-94cb-f43d9cf36b0d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101371 Jun 05 08:33:12.207148 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1219/2496] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:33:12.214190 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-079f9fc9-3dbb-4bd8-8ec5-7fa1b7d3bb0b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:12.215555 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-079f9fc9-3dbb-4bd8-8ec5-7fa1b7d3bb0b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:12.224069 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-079f9fc9-3dbb-4bd8-8ec5-7fa1b7d3bb0b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:12.224919 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-079f9fc9-3dbb-4bd8-8ec5-7fa1b7d3bb0b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:12.225849 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-079f9fc9-3dbb-4bd8-8ec5-7fa1b7d3bb0b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:12.226481 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-079f9fc9-3dbb-4bd8-8ec5-7fa1b7d3bb0b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:12.452952 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-e81d3dba-60ca-4587-aaa0-d8faeae52d90 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:33:12.454111 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-e81d3dba-60ca-4587-aaa0-d8faeae52d90 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:33:12.454769 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-e81d3dba-60ca-4587-aaa0-d8faeae52d90 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:33:12.455426 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-e81d3dba-60ca-4587-aaa0-d8faeae52d90 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:33:12.456052 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-e81d3dba-60ca-4587-aaa0-d8faeae52d90 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:33:12.481603 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e81d3dba-60ca-4587-aaa0-d8faeae52d90 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:12.482447 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e81d3dba-60ca-4587-aaa0-d8faeae52d90 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:12.483599 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e81d3dba-60ca-4587-aaa0-d8faeae52d90 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:12.484349 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e81d3dba-60ca-4587-aaa0-d8faeae52d90 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:12.531092 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-e81d3dba-60ca-4587-aaa0-d8faeae52d90 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Getting quotas for project 68ede041c3c744daa44a56817af472d7. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:33:12.547249 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-e81d3dba-60ca-4587-aaa0-d8faeae52d90 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Getting quotas for user 87be0705721c42878ae5fb2cb21c9c0d and project 68ede041c3c744daa44a56817af472d7. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:33:12.580801 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e81d3dba-60ca-4587-aaa0-d8faeae52d90 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:33:12.583702 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e81d3dba-60ca-4587-aaa0-d8faeae52d90 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: a8e112c2-ecb2-426a-a8d9-f5cab1c0e40d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:33:12.756595 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e81d3dba-60ca-4587-aaa0-d8faeae52d90 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.094682 Jun 05 08:33:12.757976 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1278/2497] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:33:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:33:12.774927 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-babadf62-f17b-4367-b734-1c3351e1b3b3 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:12.786177 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-babadf62-f17b-4367-b734-1c3351e1b3b3 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] [instance: d45fa817-5c9e-476e-9f2f-b9d2d094a56f] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:12.809682 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-babadf62-f17b-4367-b734-1c3351e1b3b3 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:12.810139 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-babadf62-f17b-4367-b734-1c3351e1b3b3 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:12.811254 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-babadf62-f17b-4367-b734-1c3351e1b3b3 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:12.814147 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-babadf62-f17b-4367-b734-1c3351e1b3b3 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:12.998534 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-079f9fc9-3dbb-4bd8-8ec5-7fa1b7d3bb0b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:13.005889 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-babadf62-f17b-4367-b734-1c3351e1b3b3 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:13.008024 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-babadf62-f17b-4367-b734-1c3351e1b3b3 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:13.008757 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-babadf62-f17b-4367-b734-1c3351e1b3b3 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lazy-loading 'fault' on Instance uuid d45fa817-5c9e-476e-9f2f-b9d2d094a56f {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:33:13.026514 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-079f9fc9-3dbb-4bd8-8ec5-7fa1b7d3bb0b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:13.031099 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-079f9fc9-3dbb-4bd8-8ec5-7fa1b7d3bb0b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:13.035884 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-079f9fc9-3dbb-4bd8-8ec5-7fa1b7d3bb0b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1737 microversion: 2.20 time: 0.823379 Jun 05 08:33:13.038745 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1220/2498] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:12 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1737 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:33:13.052913 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-508206d1-a818-4da8-8a6a-fb4e2569698d tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:13.053824 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-508206d1-a818-4da8-8a6a-fb4e2569698d tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 6970530a-90a4-487f-a88a-d0f474772e22] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:13.096698 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-508206d1-a818-4da8-8a6a-fb4e2569698d tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:13.097156 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-508206d1-a818-4da8-8a6a-fb4e2569698d tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:13.102311 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-508206d1-a818-4da8-8a6a-fb4e2569698d tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:13.102835 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-508206d1-a818-4da8-8a6a-fb4e2569698d tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:13.212504 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-508206d1-a818-4da8-8a6a-fb4e2569698d tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:13.212988 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-508206d1-a818-4da8-8a6a-fb4e2569698d tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:13.213547 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-508206d1-a818-4da8-8a6a-fb4e2569698d tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lazy-loading 'fault' on Instance uuid 6970530a-90a4-487f-a88a-d0f474772e22 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:33:13.482074 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-babadf62-f17b-4367-b734-1c3351e1b3b3 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef42b862d154566bccdc87de859d3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6786f5ca5884feb8141831e5993edfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:13.490826 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-babadf62-f17b-4367-b734-1c3351e1b3b3 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef42b862d154566bccdc87de859d3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6786f5ca5884feb8141831e5993edfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:13.498088 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-babadf62-f17b-4367-b734-1c3351e1b3b3 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef42b862d154566bccdc87de859d3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6786f5ca5884feb8141831e5993edfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:13.519678 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-babadf62-f17b-4367-b734-1c3351e1b3b3 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] 10.222.0.33 "GET /compute/v2.1/servers/d45fa817-5c9e-476e-9f2f-b9d2d094a56f" status: 200 len: 1431 microversion: 2.75 time: 0.760371 Jun 05 08:33:13.538155 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1279/2499] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:12 2022] GET /compute/v2.1/servers/d45fa817-5c9e-476e-9f2f-b9d2d094a56f => generated 1431 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:33:13.551905 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-643f7967-5b10-4b81-b267-4da99e098cd2 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:13.553016 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-643f7967-5b10-4b81-b267-4da99e098cd2 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: a8e112c2-ecb2-426a-a8d9-f5cab1c0e40d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:13.569459 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-643f7967-5b10-4b81-b267-4da99e098cd2 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:13.570156 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-643f7967-5b10-4b81-b267-4da99e098cd2 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:13.571143 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-643f7967-5b10-4b81-b267-4da99e098cd2 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:13.571818 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-643f7967-5b10-4b81-b267-4da99e098cd2 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:13.633621 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-508206d1-a818-4da8-8a6a-fb4e2569698d tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8719cfb39a1f424193a55296214c20ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2a416e66d24723a9c880ec94b49843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:13.645276 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-508206d1-a818-4da8-8a6a-fb4e2569698d tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] 10.222.0.33 "GET /compute/v2.1/servers/6970530a-90a4-487f-a88a-d0f474772e22" status: 200 len: 1352 microversion: 2.1 time: 0.601177 Jun 05 08:33:13.649416 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1221/2500] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:13 2022] GET /compute/v2.1/servers/6970530a-90a4-487f-a88a-d0f474772e22 => generated 1352 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:33:13.662785 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-33ed5970-5f08-409d-96a8-ce0fc694fbd8 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Calling method '.version_select at 0x7f24337c63a0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:13.665661 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-643f7967-5b10-4b81-b267-4da99e098cd2 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:13.666149 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-643f7967-5b10-4b81-b267-4da99e098cd2 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:13.666633 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-643f7967-5b10-4b81-b267-4da99e098cd2 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lazy-loading 'fault' on Instance uuid a8e112c2-ecb2-426a-a8d9-f5cab1c0e40d {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:33:13.755757 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-33ed5970-5f08-409d-96a8-ce0fc694fbd8 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] 10.222.0.33 "GET /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6" status: 200 len: 637 microversion: 2.1 time: 0.104799 Jun 05 08:33:13.763460 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1222/2501] 10.222.0.33 () {58 vars in 1232 bytes} [Sun Jun 5 08:33:13 2022] GET /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6 => generated 637 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:33:13.776956 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a2224f9b-05c7-43ad-b4c4-c0cff59db136 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:13.777873 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a2224f9b-05c7-43ad-b4c4-c0cff59db136 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] [instance: d45fa817-5c9e-476e-9f2f-b9d2d094a56f] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:13.801847 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a2224f9b-05c7-43ad-b4c4-c0cff59db136 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:13.802621 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a2224f9b-05c7-43ad-b4c4-c0cff59db136 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:13.803759 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a2224f9b-05c7-43ad-b4c4-c0cff59db136 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:13.804381 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a2224f9b-05c7-43ad-b4c4-c0cff59db136 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:13.830607 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-643f7967-5b10-4b81-b267-4da99e098cd2 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87be0705721c42878ae5fb2cb21c9c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ede041c3c744daa44a56817af472d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:13.850386 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-643f7967-5b10-4b81-b267-4da99e098cd2 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "GET /compute/v2.1/servers/a8e112c2-ecb2-426a-a8d9-f5cab1c0e40d" status: 200 len: 1288 microversion: 2.1 time: 0.310717 Jun 05 08:33:13.851212 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1280/2502] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:13 2022] GET /compute/v2.1/servers/a8e112c2-ecb2-426a-a8d9-f5cab1c0e40d => generated 1288 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:33:13.868360 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8e0ab9e2-bc60-416e-9101-16f7de718b30 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Action: 'update_all', calling method: .version_select at 0x7f24339a9670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:13.893734 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a2224f9b-05c7-43ad-b4c4-c0cff59db136 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] [instance: d45fa817-5c9e-476e-9f2f-b9d2d094a56f] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:33:13.975013 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-8e0ab9e2-bc60-416e-9101-16f7de718b30 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Getting quotas for project ee9c97cba7b94883a57faabad636c17b. Resources: dict_keys(['metadata_items']) {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:33:14.003721 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-8e0ab9e2-bc60-416e-9101-16f7de718b30 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Getting quotas for user 6dc042fd4a6b48e4a51a597659beb150 and project ee9c97cba7b94883a57faabad636c17b. Resources: dict_keys(['metadata_items']) {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:33:14.020487 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a2224f9b-05c7-43ad-b4c4-c0cff59db136 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] [instance: d45fa817-5c9e-476e-9f2f-b9d2d094a56f] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:33:14.022685 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a2224f9b-05c7-43ad-b4c4-c0cff59db136 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:14.024806 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a2224f9b-05c7-43ad-b4c4-c0cff59db136 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:14.026653 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-a2224f9b-05c7-43ad-b4c4-c0cff59db136 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] [instance: d45fa817-5c9e-476e-9f2f-b9d2d094a56f] instance's host None is down, deleting from database Jun 05 08:33:14.042325 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-a2224f9b-05c7-43ad-b4c4-c0cff59db136 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] [instance: d45fa817-5c9e-476e-9f2f-b9d2d094a56f] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:33:14.153716 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-a2224f9b-05c7-43ad-b4c4-c0cff59db136 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] [instance: d45fa817-5c9e-476e-9f2f-b9d2d094a56f] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:33:14.162856 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-a2224f9b-05c7-43ad-b4c4-c0cff59db136 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] [instance: d45fa817-5c9e-476e-9f2f-b9d2d094a56f] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:33:14.574919 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a2224f9b-05c7-43ad-b4c4-c0cff59db136 tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d45fa817-5c9e-476e-9f2f-b9d2d094a56f" status: 204 len: 0 microversion: 2.75 time: 0.809813 Jun 05 08:33:14.581395 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1223/2503] 10.222.0.33 () {60 vars in 1279 bytes} [Sun Jun 5 08:33:13 2022] DELETE /compute/v2.1/servers/d45fa817-5c9e-476e-9f2f-b9d2d094a56f => generated 0 bytes in 813 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:33:14.586392 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0b44eb7e-c1bc-45e5-8813-fd5add6e8588 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:14.587017 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0b44eb7e-c1bc-45e5-8813-fd5add6e8588 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:14.594863 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0b44eb7e-c1bc-45e5-8813-fd5add6e8588 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:14.594863 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0b44eb7e-c1bc-45e5-8813-fd5add6e8588 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:14.594863 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0b44eb7e-c1bc-45e5-8813-fd5add6e8588 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:14.595296 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0b44eb7e-c1bc-45e5-8813-fd5add6e8588 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:14.929947 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0b44eb7e-c1bc-45e5-8813-fd5add6e8588 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:14.935047 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8e0ab9e2-bc60-416e-9101-16f7de718b30 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] 10.222.0.33 "PUT /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata" status: 200 len: 61 microversion: 2.1 time: 1.082468 Jun 05 08:33:14.939941 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1281/2504] 10.222.0.33 () {60 vars in 1279 bytes} [Sun Jun 5 08:33:13 2022] PUT /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata => generated 61 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:33:14.941613 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-724bc436-8e22-474f-9386-c381093ab19c tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:14.942233 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-724bc436-8e22-474f-9386-c381093ab19c tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] [instance: d45fa817-5c9e-476e-9f2f-b9d2d094a56f] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:14.948374 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0b44eb7e-c1bc-45e5-8813-fd5add6e8588 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:14.950317 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0b44eb7e-c1bc-45e5-8813-fd5add6e8588 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:14.952128 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0b44eb7e-c1bc-45e5-8813-fd5add6e8588 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1737 microversion: 2.20 time: 0.369680 Jun 05 08:33:14.963666 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1224/2505] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:14 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1737 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:33:14.968242 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-724bc436-8e22-474f-9386-c381093ab19c tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:14.968711 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-724bc436-8e22-474f-9386-c381093ab19c tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:14.969495 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-724bc436-8e22-474f-9386-c381093ab19c tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:14.975555 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-724bc436-8e22-474f-9386-c381093ab19c tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:14.976028 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4b361bdf-936e-44e5-9473-4abd95abd11d tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:14.978544 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4b361bdf-936e-44e5-9473-4abd95abd11d tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 6970530a-90a4-487f-a88a-d0f474772e22] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:14.990246 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4b361bdf-936e-44e5-9473-4abd95abd11d tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:14.993506 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4b361bdf-936e-44e5-9473-4abd95abd11d tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:14.995669 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4b361bdf-936e-44e5-9473-4abd95abd11d tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:14.997419 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4b361bdf-936e-44e5-9473-4abd95abd11d tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:15.041924 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-724bc436-8e22-474f-9386-c381093ab19c tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] HTTP exception thrown: Instance d45fa817-5c9e-476e-9f2f-b9d2d094a56f could not be found. Jun 05 08:33:15.042749 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4b361bdf-936e-44e5-9473-4abd95abd11d tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:15.043719 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4b361bdf-936e-44e5-9473-4abd95abd11d tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:15.044387 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-4b361bdf-936e-44e5-9473-4abd95abd11d tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lazy-loading 'fault' on Instance uuid 6970530a-90a4-487f-a88a-d0f474772e22 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-724bc436-8e22-474f-9386-c381093ab19c tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Request method failure captured: Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/d45fa817-5c9e-476e-9f2f-b9d2d094a56f HTTP/1.1 Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGo_Ui7Q_GZS0aTDTw3NeKXaEJzzUsZ0oRivnVcnKSGJPPiPdw1ztPnNxrCKLE21_uzyC5bmCA5JPpZt5I5_-u58zWL3vG8F2enQ8_Xu38OF8_anJ7E47vhPbWWJj-Kd1KIZfund433n3xzg-qKlsMYDkpcQlYX7jVSQPWWLjFwefMY Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: X-Openstack-Nova-Api-Version: 2.75 Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: f6786f5ca5884feb8141831e5993edfb Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ServersAdmin275Test-4045894 Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f6786f5ca5884feb8141831e5993edfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f6786f5ca5884feb8141831e5993edfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f6786f5ca5884feb8141831e5993edfb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f6786f5ca5884feb8141831e5993edfb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ServersAdmin275Test-4045894 Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: f6786f5ca5884feb8141831e5993edfb Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ServersAdmin275Test-4045894 Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ServersAdmin275Test-4045894-project Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 5ef42b862d154566bccdc87de859d3b2 Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ServersAdmin275Test-4045894-project Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance d45fa817-5c9e-476e-9f2f-b9d2d094a56f could not be found. Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'd45fa817-5c9e-476e-9f2f-b9d2d094a56f'} Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d45fa817-5c9e-476e-9f2f-b9d2d094a56f could not be found. Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d45fa817-5c9e-476e-9f2f-b9d2d094a56f could not be found. Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:15.055380 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:15.058699 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:15.058699 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:15.058699 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:15.058699 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:33:15.058699 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:33:15.058699 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d45fa817-5c9e-476e-9f2f-b9d2d094a56f could not be found. Jun 05 08:33:15.058699 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:15.058699 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-724bc436-8e22-474f-9386-c381093ab19c tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] Returning 404 to user: Instance d45fa817-5c9e-476e-9f2f-b9d2d094a56f could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:33:15.058699 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-724bc436-8e22-474f-9386-c381093ab19c tempest-ServersAdmin275Test-4045894 tempest-ServersAdmin275Test-4045894-project] 10.222.0.33 "GET /compute/v2.1/servers/d45fa817-5c9e-476e-9f2f-b9d2d094a56f" status: 404 len: 111 microversion: 2.75 time: 0.119987 Jun 05 08:33:15.071436 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1282/2506] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:14 2022] GET /compute/v2.1/servers/d45fa817-5c9e-476e-9f2f-b9d2d094a56f => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 05 08:33:15.103547 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6affd90c-73b8-473c-8c7c-3ebed9a671da tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:15.106145 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6affd90c-73b8-473c-8c7c-3ebed9a671da tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: a8e112c2-ecb2-426a-a8d9-f5cab1c0e40d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:15.136656 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6affd90c-73b8-473c-8c7c-3ebed9a671da tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:15.137415 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6affd90c-73b8-473c-8c7c-3ebed9a671da tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:15.138684 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6affd90c-73b8-473c-8c7c-3ebed9a671da tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:15.139340 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6affd90c-73b8-473c-8c7c-3ebed9a671da tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:15.175330 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4b361bdf-936e-44e5-9473-4abd95abd11d tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8719cfb39a1f424193a55296214c20ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2a416e66d24723a9c880ec94b49843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:15.186646 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4b361bdf-936e-44e5-9473-4abd95abd11d tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] 10.222.0.33 "GET /compute/v2.1/servers/6970530a-90a4-487f-a88a-d0f474772e22" status: 200 len: 1352 microversion: 2.1 time: 0.228192 Jun 05 08:33:15.193496 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1225/2507] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:14 2022] GET /compute/v2.1/servers/6970530a-90a4-487f-a88a-d0f474772e22 => generated 1352 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:33:15.221161 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5ec3c376-1ef6-4def-a4f8-f6fd3a77a95a tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Calling method '.version_select at 0x7f243392a040>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:15.234828 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6affd90c-73b8-473c-8c7c-3ebed9a671da tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:15.235712 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6affd90c-73b8-473c-8c7c-3ebed9a671da tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:15.236584 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-6affd90c-73b8-473c-8c7c-3ebed9a671da tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lazy-loading 'fault' on Instance uuid a8e112c2-ecb2-426a-a8d9-f5cab1c0e40d {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:33:15.301204 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6affd90c-73b8-473c-8c7c-3ebed9a671da tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87be0705721c42878ae5fb2cb21c9c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ede041c3c744daa44a56817af472d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:15.312116 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6affd90c-73b8-473c-8c7c-3ebed9a671da tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "GET /compute/v2.1/servers/a8e112c2-ecb2-426a-a8d9-f5cab1c0e40d" status: 200 len: 1288 microversion: 2.1 time: 0.239174 Jun 05 08:33:15.325280 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1283/2508] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:15 2022] GET /compute/v2.1/servers/a8e112c2-ecb2-426a-a8d9-f5cab1c0e40d => generated 1288 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:33:15.332549 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0e668347-8328-4dbd-8872-2d72c1ff337c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:15.333486 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0e668347-8328-4dbd-8872-2d72c1ff337c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 6970530a-90a4-487f-a88a-d0f474772e22] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:15.342398 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0e668347-8328-4dbd-8872-2d72c1ff337c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:15.343102 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0e668347-8328-4dbd-8872-2d72c1ff337c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:15.344195 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0e668347-8328-4dbd-8872-2d72c1ff337c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:15.346041 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0e668347-8328-4dbd-8872-2d72c1ff337c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:15.419710 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0e668347-8328-4dbd-8872-2d72c1ff337c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 6970530a-90a4-487f-a88a-d0f474772e22] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:33:15.566981 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0e668347-8328-4dbd-8872-2d72c1ff337c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 6970530a-90a4-487f-a88a-d0f474772e22] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:33:15.569220 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0e668347-8328-4dbd-8872-2d72c1ff337c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:15.569661 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0e668347-8328-4dbd-8872-2d72c1ff337c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:15.570129 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-0e668347-8328-4dbd-8872-2d72c1ff337c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 6970530a-90a4-487f-a88a-d0f474772e22] instance's host None is down, deleting from database Jun 05 08:33:15.581589 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-0e668347-8328-4dbd-8872-2d72c1ff337c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 6970530a-90a4-487f-a88a-d0f474772e22] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:33:15.675944 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-0e668347-8328-4dbd-8872-2d72c1ff337c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 6970530a-90a4-487f-a88a-d0f474772e22] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:33:15.689993 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-0e668347-8328-4dbd-8872-2d72c1ff337c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 6970530a-90a4-487f-a88a-d0f474772e22] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:33:15.953430 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5ec3c376-1ef6-4def-a4f8-f6fd3a77a95a tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] 10.222.0.33 "DELETE /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.758538 Jun 05 08:33:15.956991 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1226/2509] 10.222.0.33 () {58 vars in 1295 bytes} [Sun Jun 5 08:33:15 2022] DELETE /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata/os_version => generated 0 bytes in 760 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:33:15.959075 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-37705b93-fe34-44a8-9de2-154698aa2767 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:15.959585 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-37705b93-fe34-44a8-9de2-154698aa2767 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: a8e112c2-ecb2-426a-a8d9-f5cab1c0e40d] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:15.983954 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-37705b93-fe34-44a8-9de2-154698aa2767 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:15.984816 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-37705b93-fe34-44a8-9de2-154698aa2767 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:15.986455 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-37705b93-fe34-44a8-9de2-154698aa2767 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:15.988001 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-37705b93-fe34-44a8-9de2-154698aa2767 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:16.047040 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-37705b93-fe34-44a8-9de2-154698aa2767 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: a8e112c2-ecb2-426a-a8d9-f5cab1c0e40d] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:33:16.089333 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0e668347-8328-4dbd-8872-2d72c1ff337c tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6970530a-90a4-487f-a88a-d0f474772e22" status: 204 len: 0 microversion: 2.1 time: 0.762292 Jun 05 08:33:16.090344 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1284/2510] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:33:15 2022] DELETE /compute/v2.1/servers/6970530a-90a4-487f-a88a-d0f474772e22 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:33:16.097218 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-021c5030-5b03-4319-aa93-d56519fe0e9f tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Calling method '.version_select at 0x7f2433aebc10>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:16.108717 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-37705b93-fe34-44a8-9de2-154698aa2767 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: a8e112c2-ecb2-426a-a8d9-f5cab1c0e40d] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:33:16.109618 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-37705b93-fe34-44a8-9de2-154698aa2767 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:16.110073 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-37705b93-fe34-44a8-9de2-154698aa2767 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:16.111921 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-37705b93-fe34-44a8-9de2-154698aa2767 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: a8e112c2-ecb2-426a-a8d9-f5cab1c0e40d] instance's host None is down, deleting from database Jun 05 08:33:16.115696 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-37705b93-fe34-44a8-9de2-154698aa2767 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: a8e112c2-ecb2-426a-a8d9-f5cab1c0e40d] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:33:16.144737 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-021c5030-5b03-4319-aa93-d56519fe0e9f tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] 10.222.0.33 "GET /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata" status: 200 len: 37 microversion: 2.1 time: 0.053147 Jun 05 08:33:16.145312 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1285/2511] 10.222.0.33 () {58 vars in 1259 bytes} [Sun Jun 5 08:33:16 2022] GET /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata => generated 37 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:33:16.156186 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-539966d0-1efe-4f21-91e8-f55831ad2ac2 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:16.156824 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-539966d0-1efe-4f21-91e8-f55831ad2ac2 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:16.163628 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-539966d0-1efe-4f21-91e8-f55831ad2ac2 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:16.164304 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-539966d0-1efe-4f21-91e8-f55831ad2ac2 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:16.165231 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-539966d0-1efe-4f21-91e8-f55831ad2ac2 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:16.165820 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-539966d0-1efe-4f21-91e8-f55831ad2ac2 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:16.262886 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-37705b93-fe34-44a8-9de2-154698aa2767 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: a8e112c2-ecb2-426a-a8d9-f5cab1c0e40d] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:33:16.270200 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-37705b93-fe34-44a8-9de2-154698aa2767 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: a8e112c2-ecb2-426a-a8d9-f5cab1c0e40d] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:33:16.275411 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:UPDATE=27,nova_cell0:DELETE=4,nova_cell0:SELECT=66,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:33:16.460517 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-37705b93-fe34-44a8-9de2-154698aa2767 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a8e112c2-ecb2-426a-a8d9-f5cab1c0e40d" status: 204 len: 0 microversion: 2.1 time: 0.503839 Jun 05 08:33:16.460517 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1227/2512] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:33:15 2022] DELETE /compute/v2.1/servers/a8e112c2-ecb2-426a-a8d9-f5cab1c0e40d => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:33:16.466657 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e3ea2713-9e2e-43df-90f9-735cd5a04c9b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:16.467499 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e3ea2713-9e2e-43df-90f9-735cd5a04c9b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 6970530a-90a4-487f-a88a-d0f474772e22] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:16.475290 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e3ea2713-9e2e-43df-90f9-735cd5a04c9b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:16.475892 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e3ea2713-9e2e-43df-90f9-735cd5a04c9b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:16.477168 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e3ea2713-9e2e-43df-90f9-735cd5a04c9b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:16.477281 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e3ea2713-9e2e-43df-90f9-735cd5a04c9b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:16.493509 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-e3ea2713-9e2e-43df-90f9-735cd5a04c9b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] HTTP exception thrown: Instance 6970530a-90a4-487f-a88a-d0f474772e22 could not be found. Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e3ea2713-9e2e-43df-90f9-735cd5a04c9b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Request method failure captured: Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/6970530a-90a4-487f-a88a-d0f474772e22 HTTP/1.1 Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGo0zUwvGQJLggYE2mJzmrtDjhLPxpgeHRB9PRJ_F9mTHfgZYh_wD8kE2xs_J05lu4NR8rT5pA0XV6cPqniNuPkUyiVDylB3XJieQM_9ixtCwV22mtrB3n3XzxjAgAgGp7H2o6_wWMW4ID0Tnoh-OFGq10CSZMrZjaweuYAdLxfsjbs Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 2e2a416e66d24723a9c880ec94b49843 Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-MigrationsAdminTest-152185534 Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2e2a416e66d24723a9c880ec94b49843"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e2a416e66d24723a9c880ec94b49843"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2e2a416e66d24723a9c880ec94b49843", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e2a416e66d24723a9c880ec94b49843"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-MigrationsAdminTest-152185534 Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 2e2a416e66d24723a9c880ec94b49843 Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-MigrationsAdminTest-152185534 Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-MigrationsAdminTest-152185534-project Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 8719cfb39a1f424193a55296214c20ff Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-MigrationsAdminTest-152185534-project Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 6970530a-90a4-487f-a88a-d0f474772e22 could not be found. Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '6970530a-90a4-487f-a88a-d0f474772e22'} Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6970530a-90a4-487f-a88a-d0f474772e22 could not be found. Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6970530a-90a4-487f-a88a-d0f474772e22 could not be found. Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:16.495331 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:16.499188 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:16.499188 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:16.499188 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:16.499188 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:33:16.499188 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:33:16.499188 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6970530a-90a4-487f-a88a-d0f474772e22 could not be found. Jun 05 08:33:16.499188 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:16.499188 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e3ea2713-9e2e-43df-90f9-735cd5a04c9b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Returning 404 to user: Instance 6970530a-90a4-487f-a88a-d0f474772e22 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:33:16.499188 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e3ea2713-9e2e-43df-90f9-735cd5a04c9b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] 10.222.0.33 "GET /compute/v2.1/servers/6970530a-90a4-487f-a88a-d0f474772e22" status: 404 len: 111 microversion: 2.1 time: 0.034319 Jun 05 08:33:16.499188 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1228/2513] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:16 2022] GET /compute/v2.1/servers/6970530a-90a4-487f-a88a-d0f474772e22 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:33:16.507876 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bd4e9970-af31-439f-8af7-bf70a14b6142 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Action: 'update_all', calling method: .version_select at 0x7f2433bf7c10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:16.564980 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-bd4e9970-af31-439f-8af7-bf70a14b6142 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Getting quotas for project ee9c97cba7b94883a57faabad636c17b. Resources: dict_keys(['metadata_items']) {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:33:16.570192 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-bd4e9970-af31-439f-8af7-bf70a14b6142 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Getting quotas for user 6dc042fd4a6b48e4a51a597659beb150 and project ee9c97cba7b94883a57faabad636c17b. Resources: dict_keys(['metadata_items']) {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:33:16.572984 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-539966d0-1efe-4f21-91e8-f55831ad2ac2 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:16.593983 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-539966d0-1efe-4f21-91e8-f55831ad2ac2 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:16.598970 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-539966d0-1efe-4f21-91e8-f55831ad2ac2 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:16.601493 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-539966d0-1efe-4f21-91e8-f55831ad2ac2 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1737 microversion: 2.20 time: 0.449967 Jun 05 08:33:16.606244 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1286/2514] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:16 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1737 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:33:16.637078 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3b2ba56b-1441-4017-afa8-7c3d237c3282 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:16.640326 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3b2ba56b-1441-4017-afa8-7c3d237c3282 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: a8e112c2-ecb2-426a-a8d9-f5cab1c0e40d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:16.674668 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3b2ba56b-1441-4017-afa8-7c3d237c3282 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:16.675474 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3b2ba56b-1441-4017-afa8-7c3d237c3282 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:16.676629 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3b2ba56b-1441-4017-afa8-7c3d237c3282 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:16.677319 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3b2ba56b-1441-4017-afa8-7c3d237c3282 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:16.726263 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-3b2ba56b-1441-4017-afa8-7c3d237c3282 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] HTTP exception thrown: Instance a8e112c2-ecb2-426a-a8d9-f5cab1c0e40d could not be found. Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3b2ba56b-1441-4017-afa8-7c3d237c3282 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Request method failure captured: Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/a8e112c2-ecb2-426a-a8d9-f5cab1c0e40d HTTP/1.1 Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGomxwdsv5YyqoQnJ8M3HKY493BdT1kF-ZKjGTvsa4dCdMv2tEzSjVIMsusSuNEFxy259rdnBrKrLso7oL5cHjLMPvzuV3e39WGeMwcC-IUAIwS3lJ_NQ03pDpr22BFtYBYlipbszAv78HDt0XYSE3VMC0HZNva_Yj8FUzYwZlfcuNk Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 68ede041c3c744daa44a56817af472d7 Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-DeleteServersTestJSON-753623147 Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/68ede041c3c744daa44a56817af472d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/68ede041c3c744daa44a56817af472d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_68ede041c3c744daa44a56817af472d7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/68ede041c3c744daa44a56817af472d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-DeleteServersTestJSON-753623147 Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 68ede041c3c744daa44a56817af472d7 Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-DeleteServersTestJSON-753623147 Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-DeleteServersTestJSON-753623147-project Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 87be0705721c42878ae5fb2cb21c9c0d Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-DeleteServersTestJSON-753623147-project Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance a8e112c2-ecb2-426a-a8d9-f5cab1c0e40d could not be found. Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'a8e112c2-ecb2-426a-a8d9-f5cab1c0e40d'} Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8e112c2-ecb2-426a-a8d9-f5cab1c0e40d could not be found. Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8e112c2-ecb2-426a-a8d9-f5cab1c0e40d could not be found. Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:16.728689 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:16.732895 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:16.732895 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:16.732895 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:16.732895 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:33:16.732895 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:33:16.732895 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8e112c2-ecb2-426a-a8d9-f5cab1c0e40d could not be found. Jun 05 08:33:16.732895 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:16.735319 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3b2ba56b-1441-4017-afa8-7c3d237c3282 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Returning 404 to user: Instance a8e112c2-ecb2-426a-a8d9-f5cab1c0e40d could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:33:16.736469 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3b2ba56b-1441-4017-afa8-7c3d237c3282 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "GET /compute/v2.1/servers/a8e112c2-ecb2-426a-a8d9-f5cab1c0e40d" status: 404 len: 111 microversion: 2.1 time: 0.128813 Jun 05 08:33:16.748866 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1287/2515] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:16 2022] GET /compute/v2.1/servers/a8e112c2-ecb2-426a-a8d9-f5cab1c0e40d => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:33:16.755752 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-05d7bad7-9dd2-472c-9ffb-7cf12549c74c tempest-MigrationsAdminTest-986751700 tempest-MigrationsAdminTest-986751700-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:16.756809 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:33:16.756809 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:33:16.799031 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-05d7bad7-9dd2-472c-9ffb-7cf12549c74c tempest-MigrationsAdminTest-986751700 tempest-MigrationsAdminTest-986751700-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/edc92901-d229-442e-98d9-f97e9433429f" status: 202 len: 0 microversion: 2.1 time: 0.035176 Jun 05 08:33:16.801634 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1288/2516] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:33:16 2022] DELETE /compute/v2.1/flavors/edc92901-d229-442e-98d9-f97e9433429f => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:33:16.816957 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6ad1ac3e-7913-49d7-b439-6f046d0724df tempest-MigrationsAdminTest-986751700 tempest-MigrationsAdminTest-986751700-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:16.898824 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6ad1ac3e-7913-49d7-b439-6f046d0724df tempest-MigrationsAdminTest-986751700 tempest-MigrationsAdminTest-986751700-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.090418 Jun 05 08:33:16.903444 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1289/2517] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:33:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:33:16.969518 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-18864aad-1d57-425e-97d1-130b404e144d tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1593550941", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "6ae041e2-2719-4b5a-8067-42384887402d"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:17.111385 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bd4e9970-af31-439f-8af7-bf70a14b6142 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] 10.222.0.33 "PUT /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.610345 Jun 05 08:33:17.112636 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1229/2518] 10.222.0.33 () {60 vars in 1279 bytes} [Sun Jun 5 08:33:16 2022] PUT /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata => generated 61 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:33:17.117882 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-112fe2d3-ff89-4f75-ba37-0ce083c1e59b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1222507424", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:17.136211 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-18864aad-1d57-425e-97d1-130b404e144d tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] validate_networks() for [('6ae041e2-2719-4b5a-8067-42384887402d', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:33:17.196665 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-112fe2d3-ff89-4f75-ba37-0ce083c1e59b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] validate_networks() for None {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:33:17.930918 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-112fe2d3-ff89-4f75-ba37-0ce083c1e59b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:33:17.932084 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-112fe2d3-ff89-4f75-ba37-0ce083c1e59b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:33:17.933424 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-112fe2d3-ff89-4f75-ba37-0ce083c1e59b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:33:17.934183 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-112fe2d3-ff89-4f75-ba37-0ce083c1e59b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:33:17.934821 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-112fe2d3-ff89-4f75-ba37-0ce083c1e59b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:33:17.961603 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-112fe2d3-ff89-4f75-ba37-0ce083c1e59b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:17.964108 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-112fe2d3-ff89-4f75-ba37-0ce083c1e59b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:17.968184 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-112fe2d3-ff89-4f75-ba37-0ce083c1e59b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:17.969478 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-112fe2d3-ff89-4f75-ba37-0ce083c1e59b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:18.008297 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-112fe2d3-ff89-4f75-ba37-0ce083c1e59b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Getting quotas for project 2e2a416e66d24723a9c880ec94b49843. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:33:18.020940 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-112fe2d3-ff89-4f75-ba37-0ce083c1e59b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Getting quotas for user 8719cfb39a1f424193a55296214c20ff and project 2e2a416e66d24723a9c880ec94b49843. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:33:18.040524 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-112fe2d3-ff89-4f75-ba37-0ce083c1e59b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:33:18.044397 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-112fe2d3-ff89-4f75-ba37-0ce083c1e59b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 01a33792-863c-4a6d-90ea-7d090ea08bde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:33:18.158180 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-112fe2d3-ff89-4f75-ba37-0ce083c1e59b tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.043572 Jun 05 08:33:18.160860 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1230/2519] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:33:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:33:18.166286 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-00078431-8bed-4d77-80cd-d307824fcc6f tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Calling method '.version_select at 0x7f243395c1f0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:18.281892 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-18864aad-1d57-425e-97d1-130b404e144d tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:33:18.282478 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-18864aad-1d57-425e-97d1-130b404e144d tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:33:18.282830 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-18864aad-1d57-425e-97d1-130b404e144d tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:33:18.283260 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-18864aad-1d57-425e-97d1-130b404e144d tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:33:18.283673 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-18864aad-1d57-425e-97d1-130b404e144d tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:33:18.299172 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-18864aad-1d57-425e-97d1-130b404e144d tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:18.299637 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-18864aad-1d57-425e-97d1-130b404e144d tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:18.300493 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-18864aad-1d57-425e-97d1-130b404e144d tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:18.300946 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-18864aad-1d57-425e-97d1-130b404e144d tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:18.370158 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-18864aad-1d57-425e-97d1-130b404e144d tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Getting quotas for project 68ede041c3c744daa44a56817af472d7. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:33:18.381278 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-18864aad-1d57-425e-97d1-130b404e144d tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Getting quotas for user 87be0705721c42878ae5fb2cb21c9c0d and project 68ede041c3c744daa44a56817af472d7. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:33:18.427170 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-18864aad-1d57-425e-97d1-130b404e144d tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:33:18.439091 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-18864aad-1d57-425e-97d1-130b404e144d tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: 80e9c75c-91b3-4183-903e-ea0a292648ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:33:18.580326 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-18864aad-1d57-425e-97d1-130b404e144d tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.616684 Jun 05 08:33:18.581233 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1290/2520] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:33:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:33:18.590000 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6a16eede-29ca-43fc-9abd-78e8d22d2745 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:18.590634 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6a16eede-29ca-43fc-9abd-78e8d22d2745 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:18.609847 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6a16eede-29ca-43fc-9abd-78e8d22d2745 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:18.610841 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6a16eede-29ca-43fc-9abd-78e8d22d2745 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:18.611639 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6a16eede-29ca-43fc-9abd-78e8d22d2745 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:18.621708 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6a16eede-29ca-43fc-9abd-78e8d22d2745 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:18.814728 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-00078431-8bed-4d77-80cd-d307824fcc6f tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] 10.222.0.33 "GET /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.650076 Jun 05 08:33:18.815362 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1231/2521] 10.222.0.33 () {58 vars in 1289 bytes} [Sun Jun 5 08:33:18 2022] GET /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata/os_distro => generated 33 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:33:18.828888 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d57698df-75ad-442d-80be-c3a71eaa9e25 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:18.829831 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d57698df-75ad-442d-80be-c3a71eaa9e25 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 01a33792-863c-4a6d-90ea-7d090ea08bde] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:18.842533 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d57698df-75ad-442d-80be-c3a71eaa9e25 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:18.842996 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d57698df-75ad-442d-80be-c3a71eaa9e25 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:18.843768 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d57698df-75ad-442d-80be-c3a71eaa9e25 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:18.847168 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d57698df-75ad-442d-80be-c3a71eaa9e25 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:18.917322 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d57698df-75ad-442d-80be-c3a71eaa9e25 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:18.918586 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d57698df-75ad-442d-80be-c3a71eaa9e25 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:18.919158 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-d57698df-75ad-442d-80be-c3a71eaa9e25 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lazy-loading 'fault' on Instance uuid 01a33792-863c-4a6d-90ea-7d090ea08bde {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:33:19.108702 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d57698df-75ad-442d-80be-c3a71eaa9e25 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8719cfb39a1f424193a55296214c20ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2a416e66d24723a9c880ec94b49843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:19.126420 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d57698df-75ad-442d-80be-c3a71eaa9e25 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] 10.222.0.33 "GET /compute/v2.1/servers/01a33792-863c-4a6d-90ea-7d090ea08bde" status: 200 len: 1286 microversion: 2.1 time: 0.309839 Jun 05 08:33:19.143361 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1232/2522] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:18 2022] GET /compute/v2.1/servers/01a33792-863c-4a6d-90ea-7d090ea08bde => generated 1286 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:33:19.148800 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3d142fe5-04ca-4d6e-8e80-109cb57a7789 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:19.149489 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3d142fe5-04ca-4d6e-8e80-109cb57a7789 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: 80e9c75c-91b3-4183-903e-ea0a292648ea] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:19.168146 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3d142fe5-04ca-4d6e-8e80-109cb57a7789 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:19.170183 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3d142fe5-04ca-4d6e-8e80-109cb57a7789 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:19.171018 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3d142fe5-04ca-4d6e-8e80-109cb57a7789 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:19.172928 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6a16eede-29ca-43fc-9abd-78e8d22d2745 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:19.174434 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3d142fe5-04ca-4d6e-8e80-109cb57a7789 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:19.182553 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6a16eede-29ca-43fc-9abd-78e8d22d2745 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:19.185456 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6a16eede-29ca-43fc-9abd-78e8d22d2745 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:19.186745 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6a16eede-29ca-43fc-9abd-78e8d22d2745 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1737 microversion: 2.20 time: 0.602704 Jun 05 08:33:19.187388 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1291/2523] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:18 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1737 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:33:19.192538 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3255df33-2dfc-47c7-85f1-14236e8734ab tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Action: 'update_all', calling method: .version_select at 0x7f243371de50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:19.261197 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-3255df33-2dfc-47c7-85f1-14236e8734ab tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Getting quotas for project ee9c97cba7b94883a57faabad636c17b. Resources: dict_keys(['metadata_items']) {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:33:19.270051 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-3255df33-2dfc-47c7-85f1-14236e8734ab tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Getting quotas for user 6dc042fd4a6b48e4a51a597659beb150 and project ee9c97cba7b94883a57faabad636c17b. Resources: dict_keys(['metadata_items']) {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:33:19.291491 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3d142fe5-04ca-4d6e-8e80-109cb57a7789 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:19.291847 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3d142fe5-04ca-4d6e-8e80-109cb57a7789 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:19.292344 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-3d142fe5-04ca-4d6e-8e80-109cb57a7789 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lazy-loading 'fault' on Instance uuid 80e9c75c-91b3-4183-903e-ea0a292648ea {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:33:19.394068 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3d142fe5-04ca-4d6e-8e80-109cb57a7789 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87be0705721c42878ae5fb2cb21c9c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ede041c3c744daa44a56817af472d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:19.403442 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3d142fe5-04ca-4d6e-8e80-109cb57a7789 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "GET /compute/v2.1/servers/80e9c75c-91b3-4183-903e-ea0a292648ea" status: 200 len: 1288 microversion: 2.1 time: 0.267503 Jun 05 08:33:19.404027 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1233/2524] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:19 2022] GET /compute/v2.1/servers/80e9c75c-91b3-4183-903e-ea0a292648ea => generated 1288 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:33:19.763795 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3255df33-2dfc-47c7-85f1-14236e8734ab tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] 10.222.0.33 "PUT /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.575060 Jun 05 08:33:19.764450 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1292/2525] 10.222.0.33 () {60 vars in 1279 bytes} [Sun Jun 5 08:33:19 2022] PUT /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata => generated 61 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:33:19.774341 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d9cb3ae1-5923-428d-93cd-c95f3ae9152b tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Calling method '.version_select at 0x7f2433cd05e0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:19.875703 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d9cb3ae1-5923-428d-93cd-c95f3ae9152b tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] 10.222.0.33 "GET /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.105283 Jun 05 08:33:19.876893 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1234/2526] 10.222.0.33 () {58 vars in 1259 bytes} [Sun Jun 5 08:33:19 2022] GET /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata => generated 61 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:33:19.888350 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b1f65044-0d7e-46ca-87f3-17dd116e2c33 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Action: 'update_all', calling method: .version_select at 0x7f2433861700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:19.981798 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-b1f65044-0d7e-46ca-87f3-17dd116e2c33 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Getting quotas for project ee9c97cba7b94883a57faabad636c17b. Resources: dict_keys(['metadata_items']) {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:33:19.987417 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-b1f65044-0d7e-46ca-87f3-17dd116e2c33 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Getting quotas for user 6dc042fd4a6b48e4a51a597659beb150 and project ee9c97cba7b94883a57faabad636c17b. Resources: dict_keys(['metadata_items']) {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:33:20.152714 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-984ec38e-1537-4a3d-ac99-8224e4350e35 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:20.153752 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-984ec38e-1537-4a3d-ac99-8224e4350e35 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 01a33792-863c-4a6d-90ea-7d090ea08bde] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:20.168651 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-984ec38e-1537-4a3d-ac99-8224e4350e35 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:20.175050 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-984ec38e-1537-4a3d-ac99-8224e4350e35 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:20.176749 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-984ec38e-1537-4a3d-ac99-8224e4350e35 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:20.177965 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-984ec38e-1537-4a3d-ac99-8224e4350e35 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:20.303229 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-984ec38e-1537-4a3d-ac99-8224e4350e35 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:20.303703 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-984ec38e-1537-4a3d-ac99-8224e4350e35 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:20.304232 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-984ec38e-1537-4a3d-ac99-8224e4350e35 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lazy-loading 'fault' on Instance uuid 01a33792-863c-4a6d-90ea-7d090ea08bde {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:33:20.380152 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-984ec38e-1537-4a3d-ac99-8224e4350e35 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8719cfb39a1f424193a55296214c20ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e2a416e66d24723a9c880ec94b49843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:20.396965 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-984ec38e-1537-4a3d-ac99-8224e4350e35 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] 10.222.0.33 "GET /compute/v2.1/servers/01a33792-863c-4a6d-90ea-7d090ea08bde" status: 200 len: 1286 microversion: 2.1 time: 0.249511 Jun 05 08:33:20.397771 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1235/2527] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:20 2022] GET /compute/v2.1/servers/01a33792-863c-4a6d-90ea-7d090ea08bde => generated 1286 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:33:20.402303 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b097c49a-a3e0-4a41-9025-3e4f2d169a87 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:20.402923 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b097c49a-a3e0-4a41-9025-3e4f2d169a87 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:20.425757 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b097c49a-a3e0-4a41-9025-3e4f2d169a87 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:20.426221 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b097c49a-a3e0-4a41-9025-3e4f2d169a87 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:20.428813 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b097c49a-a3e0-4a41-9025-3e4f2d169a87 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:20.429671 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b097c49a-a3e0-4a41-9025-3e4f2d169a87 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:20.610382 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b1f65044-0d7e-46ca-87f3-17dd116e2c33 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] 10.222.0.33 "PUT /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.725853 Jun 05 08:33:20.611350 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1293/2528] 10.222.0.33 () {60 vars in 1279 bytes} [Sun Jun 5 08:33:19 2022] PUT /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata => generated 61 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:33:20.619584 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-893311bf-1b7d-44c1-ad74-4653fb6ae4ef tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:20.620370 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-893311bf-1b7d-44c1-ad74-4653fb6ae4ef tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 01a33792-863c-4a6d-90ea-7d090ea08bde] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:20.630439 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:33:20.654731 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-893311bf-1b7d-44c1-ad74-4653fb6ae4ef tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:20.656522 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-893311bf-1b7d-44c1-ad74-4653fb6ae4ef tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:20.659449 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-893311bf-1b7d-44c1-ad74-4653fb6ae4ef tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:20.660200 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-893311bf-1b7d-44c1-ad74-4653fb6ae4ef tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:20.731589 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-893311bf-1b7d-44c1-ad74-4653fb6ae4ef tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 01a33792-863c-4a6d-90ea-7d090ea08bde] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:33:20.803218 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b097c49a-a3e0-4a41-9025-3e4f2d169a87 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:20.818670 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b097c49a-a3e0-4a41-9025-3e4f2d169a87 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:20.821680 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b097c49a-a3e0-4a41-9025-3e4f2d169a87 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:20.824613 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b097c49a-a3e0-4a41-9025-3e4f2d169a87 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1737 microversion: 2.20 time: 0.425859 Jun 05 08:33:20.832216 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1236/2529] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:20 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1737 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:33:20.834896 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9e61538f-6940-4c02-8ed9-9cd7fe280588 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:20.835271 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9e61538f-6940-4c02-8ed9-9cd7fe280588 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: 80e9c75c-91b3-4183-903e-ea0a292648ea] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:20.852944 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9e61538f-6940-4c02-8ed9-9cd7fe280588 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:20.853800 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9e61538f-6940-4c02-8ed9-9cd7fe280588 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:20.854866 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-893311bf-1b7d-44c1-ad74-4653fb6ae4ef tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 01a33792-863c-4a6d-90ea-7d090ea08bde] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:33:20.855486 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9e61538f-6940-4c02-8ed9-9cd7fe280588 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:20.856096 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-893311bf-1b7d-44c1-ad74-4653fb6ae4ef tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:20.856419 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9e61538f-6940-4c02-8ed9-9cd7fe280588 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:20.861001 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-893311bf-1b7d-44c1-ad74-4653fb6ae4ef tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:20.861609 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-893311bf-1b7d-44c1-ad74-4653fb6ae4ef tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 01a33792-863c-4a6d-90ea-7d090ea08bde] instance's host None is down, deleting from database Jun 05 08:33:20.866639 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-893311bf-1b7d-44c1-ad74-4653fb6ae4ef tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 01a33792-863c-4a6d-90ea-7d090ea08bde] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:33:20.950258 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9e61538f-6940-4c02-8ed9-9cd7fe280588 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:20.951292 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9e61538f-6940-4c02-8ed9-9cd7fe280588 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:20.952123 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-893311bf-1b7d-44c1-ad74-4653fb6ae4ef tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 01a33792-863c-4a6d-90ea-7d090ea08bde] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:33:20.952693 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-9e61538f-6940-4c02-8ed9-9cd7fe280588 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lazy-loading 'fault' on Instance uuid 80e9c75c-91b3-4183-903e-ea0a292648ea {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:33:20.962313 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-893311bf-1b7d-44c1-ad74-4653fb6ae4ef tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 01a33792-863c-4a6d-90ea-7d090ea08bde] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:33:21.020694 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:UPDATE=19,nova_cell0:DELETE=4,nova_cell0:SELECT=73,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:33:21.100375 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9e61538f-6940-4c02-8ed9-9cd7fe280588 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87be0705721c42878ae5fb2cb21c9c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ede041c3c744daa44a56817af472d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:21.109947 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9e61538f-6940-4c02-8ed9-9cd7fe280588 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "GET /compute/v2.1/servers/80e9c75c-91b3-4183-903e-ea0a292648ea" status: 200 len: 1288 microversion: 2.1 time: 0.282257 Jun 05 08:33:21.114485 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1237/2530] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:20 2022] GET /compute/v2.1/servers/80e9c75c-91b3-4183-903e-ea0a292648ea => generated 1288 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:33:21.153965 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2b25a18f-4fea-4d68-86ff-20afccb6036f tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Action: 'update_all', calling method: .version_select at 0x7f24337d2dc0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:21.297195 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-2b25a18f-4fea-4d68-86ff-20afccb6036f tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Getting quotas for project ee9c97cba7b94883a57faabad636c17b. Resources: dict_keys(['metadata_items']) {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:33:21.316474 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-2b25a18f-4fea-4d68-86ff-20afccb6036f tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Getting quotas for user 6dc042fd4a6b48e4a51a597659beb150 and project ee9c97cba7b94883a57faabad636c17b. Resources: dict_keys(['metadata_items']) {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:33:21.343727 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:33:21.529667 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-893311bf-1b7d-44c1-ad74-4653fb6ae4ef tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] 10.222.0.33 "DELETE /compute/v2.1/servers/01a33792-863c-4a6d-90ea-7d090ea08bde" status: 204 len: 0 microversion: 2.1 time: 0.916398 Jun 05 08:33:21.530904 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1294/2531] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:33:20 2022] DELETE /compute/v2.1/servers/01a33792-863c-4a6d-90ea-7d090ea08bde => generated 0 bytes in 919 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:33:21.544447 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5649988d-c9e3-4039-8a3b-f94584037310 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:21.545521 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5649988d-c9e3-4039-8a3b-f94584037310 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: 80e9c75c-91b3-4183-903e-ea0a292648ea] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:21.557202 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5649988d-c9e3-4039-8a3b-f94584037310 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:21.557796 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5649988d-c9e3-4039-8a3b-f94584037310 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:21.559125 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5649988d-c9e3-4039-8a3b-f94584037310 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:21.559575 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5649988d-c9e3-4039-8a3b-f94584037310 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:21.661285 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5649988d-c9e3-4039-8a3b-f94584037310 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: 80e9c75c-91b3-4183-903e-ea0a292648ea] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:33:21.852354 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5649988d-c9e3-4039-8a3b-f94584037310 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: 80e9c75c-91b3-4183-903e-ea0a292648ea] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:33:21.876383 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5649988d-c9e3-4039-8a3b-f94584037310 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:21.877624 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5649988d-c9e3-4039-8a3b-f94584037310 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:21.882398 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-5649988d-c9e3-4039-8a3b-f94584037310 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: 80e9c75c-91b3-4183-903e-ea0a292648ea] instance's host None is down, deleting from database Jun 05 08:33:21.889231 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-5649988d-c9e3-4039-8a3b-f94584037310 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: 80e9c75c-91b3-4183-903e-ea0a292648ea] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:33:22.354545 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2b25a18f-4fea-4d68-86ff-20afccb6036f tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] 10.222.0.33 "PUT /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata" status: 200 len: 64 microversion: 2.1 time: 1.225680 Jun 05 08:33:22.355946 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1238/2532] 10.222.0.33 () {60 vars in 1279 bytes} [Sun Jun 5 08:33:21 2022] PUT /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata => generated 64 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:33:22.361002 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-42ae2aa6-2eae-4e60-bb60-b8020d57c287 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:22.361827 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-42ae2aa6-2eae-4e60-bb60-b8020d57c287 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] [instance: 01a33792-863c-4a6d-90ea-7d090ea08bde] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:22.385233 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42ae2aa6-2eae-4e60-bb60-b8020d57c287 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:22.397522 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42ae2aa6-2eae-4e60-bb60-b8020d57c287 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:22.398460 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42ae2aa6-2eae-4e60-bb60-b8020d57c287 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:22.401569 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42ae2aa6-2eae-4e60-bb60-b8020d57c287 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:22.439084 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-42ae2aa6-2eae-4e60-bb60-b8020d57c287 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] HTTP exception thrown: Instance 01a33792-863c-4a6d-90ea-7d090ea08bde could not be found. Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-42ae2aa6-2eae-4e60-bb60-b8020d57c287 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Request method failure captured: Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/01a33792-863c-4a6d-90ea-7d090ea08bde HTTP/1.1 Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGo0zUwvGQJLggYE2mJzmrtDjhLPxpgeHRB9PRJ_F9mTHfgZYh_wD8kE2xs_J05lu4NR8rT5pA0XV6cPqniNuPkUyiVDylB3XJieQM_9ixtCwV22mtrB3n3XzxjAgAgGp7H2o6_wWMW4ID0Tnoh-OFGq10CSZMrZjaweuYAdLxfsjbs Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 2e2a416e66d24723a9c880ec94b49843 Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-MigrationsAdminTest-152185534 Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2e2a416e66d24723a9c880ec94b49843"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e2a416e66d24723a9c880ec94b49843"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2e2a416e66d24723a9c880ec94b49843", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e2a416e66d24723a9c880ec94b49843"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-MigrationsAdminTest-152185534 Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 2e2a416e66d24723a9c880ec94b49843 Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-MigrationsAdminTest-152185534 Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-MigrationsAdminTest-152185534-project Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 8719cfb39a1f424193a55296214c20ff Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-MigrationsAdminTest-152185534-project Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 01a33792-863c-4a6d-90ea-7d090ea08bde could not be found. Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '01a33792-863c-4a6d-90ea-7d090ea08bde'} Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a33792-863c-4a6d-90ea-7d090ea08bde could not be found. Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a33792-863c-4a6d-90ea-7d090ea08bde could not be found. Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:22.455190 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:22.459135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:22.459135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:22.459135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:22.459135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:33:22.459135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:33:22.459135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a33792-863c-4a6d-90ea-7d090ea08bde could not be found. Jun 05 08:33:22.459135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:22.459135 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-42ae2aa6-2eae-4e60-bb60-b8020d57c287 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] Returning 404 to user: Instance 01a33792-863c-4a6d-90ea-7d090ea08bde could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:33:22.471581 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-42ae2aa6-2eae-4e60-bb60-b8020d57c287 tempest-MigrationsAdminTest-152185534 tempest-MigrationsAdminTest-152185534-project] 10.222.0.33 "GET /compute/v2.1/servers/01a33792-863c-4a6d-90ea-7d090ea08bde" status: 404 len: 111 microversion: 2.1 time: 0.114265 Jun 05 08:33:22.472220 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1239/2533] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:22 2022] GET /compute/v2.1/servers/01a33792-863c-4a6d-90ea-7d090ea08bde => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:33:22.484481 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-52679133-ab4e-46b5-b9a5-ae436c3322b5 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:22.485176 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-52679133-ab4e-46b5-b9a5-ae436c3322b5 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:22.497324 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-5649988d-c9e3-4039-8a3b-f94584037310 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: 80e9c75c-91b3-4183-903e-ea0a292648ea] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:33:22.505092 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-5649988d-c9e3-4039-8a3b-f94584037310 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: 80e9c75c-91b3-4183-903e-ea0a292648ea] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:33:22.514425 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-52679133-ab4e-46b5-b9a5-ae436c3322b5 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:22.515023 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-52679133-ab4e-46b5-b9a5-ae436c3322b5 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:22.518231 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-52679133-ab4e-46b5-b9a5-ae436c3322b5 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:22.518933 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-52679133-ab4e-46b5-b9a5-ae436c3322b5 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:22.877440 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5649988d-c9e3-4039-8a3b-f94584037310 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "DELETE /compute/v2.1/servers/80e9c75c-91b3-4183-903e-ea0a292648ea" status: 204 len: 0 microversion: 2.1 time: 1.345225 Jun 05 08:33:22.881326 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1295/2534] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:33:21 2022] DELETE /compute/v2.1/servers/80e9c75c-91b3-4183-903e-ea0a292648ea => generated 0 bytes in 1348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:33:22.887759 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-707adb4a-e585-4622-b65a-cdb187ab26b7 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Calling method '.version_select at 0x7f24337aeee0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:22.991324 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-707adb4a-e585-4622-b65a-cdb187ab26b7 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] 10.222.0.33 "GET /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata" status: 200 len: 64 microversion: 2.1 time: 0.108644 Jun 05 08:33:22.991898 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1296/2535] 10.222.0.33 () {58 vars in 1259 bytes} [Sun Jun 5 08:33:22 2022] GET /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata => generated 64 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:33:23.166738 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-52679133-ab4e-46b5-b9a5-ae436c3322b5 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:23.180500 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-52679133-ab4e-46b5-b9a5-ae436c3322b5 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:23.182116 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-52679133-ab4e-46b5-b9a5-ae436c3322b5 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:23.183364 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-52679133-ab4e-46b5-b9a5-ae436c3322b5 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1737 microversion: 2.20 time: 0.704940 Jun 05 08:33:23.184092 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1240/2536] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:22 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1737 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:33:23.204903 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8c696f53-bea6-4d79-8faa-3caf225eaea5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:23.205509 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8c696f53-bea6-4d79-8faa-3caf225eaea5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: 80e9c75c-91b3-4183-903e-ea0a292648ea] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:23.237117 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8c696f53-bea6-4d79-8faa-3caf225eaea5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:23.237580 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8c696f53-bea6-4d79-8faa-3caf225eaea5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:23.245618 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8c696f53-bea6-4d79-8faa-3caf225eaea5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:23.246329 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8c696f53-bea6-4d79-8faa-3caf225eaea5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:23.293332 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-8c696f53-bea6-4d79-8faa-3caf225eaea5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] HTTP exception thrown: Instance 80e9c75c-91b3-4183-903e-ea0a292648ea could not be found. Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8c696f53-bea6-4d79-8faa-3caf225eaea5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Request method failure captured: Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/80e9c75c-91b3-4183-903e-ea0a292648ea HTTP/1.1 Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGomxwdsv5YyqoQnJ8M3HKY493BdT1kF-ZKjGTvsa4dCdMv2tEzSjVIMsusSuNEFxy259rdnBrKrLso7oL5cHjLMPvzuV3e39WGeMwcC-IUAIwS3lJ_NQ03pDpr22BFtYBYlipbszAv78HDt0XYSE3VMC0HZNva_Yj8FUzYwZlfcuNk Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 68ede041c3c744daa44a56817af472d7 Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-DeleteServersTestJSON-753623147 Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/68ede041c3c744daa44a56817af472d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/68ede041c3c744daa44a56817af472d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_68ede041c3c744daa44a56817af472d7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/68ede041c3c744daa44a56817af472d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-DeleteServersTestJSON-753623147 Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 68ede041c3c744daa44a56817af472d7 Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-DeleteServersTestJSON-753623147 Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-DeleteServersTestJSON-753623147-project Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 87be0705721c42878ae5fb2cb21c9c0d Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-DeleteServersTestJSON-753623147-project Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 80e9c75c-91b3-4183-903e-ea0a292648ea could not be found. Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '80e9c75c-91b3-4183-903e-ea0a292648ea'} Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80e9c75c-91b3-4183-903e-ea0a292648ea could not be found. Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80e9c75c-91b3-4183-903e-ea0a292648ea could not be found. Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:23.310159 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:23.314014 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:23.314014 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:23.314014 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:23.314014 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:33:23.314014 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:33:23.314014 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80e9c75c-91b3-4183-903e-ea0a292648ea could not be found. Jun 05 08:33:23.314014 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:23.314014 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8c696f53-bea6-4d79-8faa-3caf225eaea5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Returning 404 to user: Instance 80e9c75c-91b3-4183-903e-ea0a292648ea could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:33:23.314014 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8c696f53-bea6-4d79-8faa-3caf225eaea5 tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "GET /compute/v2.1/servers/80e9c75c-91b3-4183-903e-ea0a292648ea" status: 404 len: 111 microversion: 2.1 time: 0.126690 Jun 05 08:33:23.315196 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1241/2537] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:23 2022] GET /compute/v2.1/servers/80e9c75c-91b3-4183-903e-ea0a292648ea => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:33:23.327874 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-31613228-05f7-40fd-8635-db43a7cf7e32 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Action: 'update_all', calling method: .version_select at 0x7f243380a5e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:23.439820 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-31613228-05f7-40fd-8635-db43a7cf7e32 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Getting quotas for project ee9c97cba7b94883a57faabad636c17b. Resources: dict_keys(['metadata_items']) {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:33:23.461131 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-31613228-05f7-40fd-8635-db43a7cf7e32 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Getting quotas for user 6dc042fd4a6b48e4a51a597659beb150 and project ee9c97cba7b94883a57faabad636c17b. Resources: dict_keys(['metadata_items']) {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:33:23.487070 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-37e4b1ad-25f9-4dc3-b241-1bd54911e672 tempest-TenantUsagesNegativeTestJSON-1198556161 tempest-TenantUsagesNegativeTestJSON-1198556161-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-06-04T08%3A33%3A22.531337&end=2022-06-06T08%3A33%3A22.531337" status: 404 len: 112 microversion: - time: 0.487009 Jun 05 08:33:23.487855 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1297/2538] 10.222.0.33 () {58 vars in 1315 bytes} [Sun Jun 5 08:33:22 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-06-04T08%3A33%3A22.531337&end=2022-06-06T08%3A33%3A22.531337 => generated 112 bytes in 488 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 05 08:33:23.504562 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ba47a8a0-4251-4a8e-a5f3-0428c2507a2b tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:23.507374 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ba47a8a0-4251-4a8e-a5f3-0428c2507a2b tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: dfc870d3-6d2b-4e93-ac38-223552ca76c2] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:23.526065 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ba47a8a0-4251-4a8e-a5f3-0428c2507a2b tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:23.526850 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ba47a8a0-4251-4a8e-a5f3-0428c2507a2b tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:23.529671 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ba47a8a0-4251-4a8e-a5f3-0428c2507a2b tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:23.533066 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ba47a8a0-4251-4a8e-a5f3-0428c2507a2b tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:23.577397 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-ba47a8a0-4251-4a8e-a5f3-0428c2507a2b tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] HTTP exception thrown: Instance dfc870d3-6d2b-4e93-ac38-223552ca76c2 could not be found. Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ba47a8a0-4251-4a8e-a5f3-0428c2507a2b tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Request method failure captured: Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: request: DELETE /compute/v2.1/servers/dfc870d3-6d2b-4e93-ac38-223552ca76c2 HTTP/1.1 Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGomxwdsv5YyqoQnJ8M3HKY493BdT1kF-ZKjGTvsa4dCdMv2tEzSjVIMsusSuNEFxy259rdnBrKrLso7oL5cHjLMPvzuV3e39WGeMwcC-IUAIwS3lJ_NQ03pDpr22BFtYBYlipbszAv78HDt0XYSE3VMC0HZNva_Yj8FUzYwZlfcuNk Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 68ede041c3c744daa44a56817af472d7 Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-DeleteServersTestJSON-753623147 Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/68ede041c3c744daa44a56817af472d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/68ede041c3c744daa44a56817af472d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_68ede041c3c744daa44a56817af472d7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/68ede041c3c744daa44a56817af472d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-DeleteServersTestJSON-753623147 Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 68ede041c3c744daa44a56817af472d7 Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-DeleteServersTestJSON-753623147 Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-DeleteServersTestJSON-753623147-project Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 87be0705721c42878ae5fb2cb21c9c0d Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-DeleteServersTestJSON-753623147-project Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance dfc870d3-6d2b-4e93-ac38-223552ca76c2 could not be found. Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'dfc870d3-6d2b-4e93-ac38-223552ca76c2'} Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfc870d3-6d2b-4e93-ac38-223552ca76c2 could not be found. Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:33:23.582501 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:33:23.586813 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfc870d3-6d2b-4e93-ac38-223552ca76c2 could not be found. Jun 05 08:33:23.586813 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:23.586813 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:23.586813 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:23.586813 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:23.586813 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:23.586813 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:23.586813 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:33:23.586813 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:33:23.586813 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfc870d3-6d2b-4e93-ac38-223552ca76c2 could not be found. Jun 05 08:33:23.586813 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:23.586813 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ba47a8a0-4251-4a8e-a5f3-0428c2507a2b tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Returning 404 to user: Instance dfc870d3-6d2b-4e93-ac38-223552ca76c2 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:33:23.589698 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ba47a8a0-4251-4a8e-a5f3-0428c2507a2b tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dfc870d3-6d2b-4e93-ac38-223552ca76c2" status: 404 len: 111 microversion: 2.1 time: 0.092588 Jun 05 08:33:23.592010 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1298/2539] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:33:23 2022] DELETE /compute/v2.1/servers/dfc870d3-6d2b-4e93-ac38-223552ca76c2 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:33:23.603158 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3acadf26-dae6-474b-b305-4e3059d78cd9 tempest-TenantUsagesNegativeTestJSON-1198556161 tempest-TenantUsagesNegativeTestJSON-1198556161-project-admin] Calling method '.version_select at 0x7f243375c670>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:23.605955 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-3acadf26-dae6-474b-b305-4e3059d78cd9 tempest-TenantUsagesNegativeTestJSON-1198556161 tempest-TenantUsagesNegativeTestJSON-1198556161-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3acadf26-dae6-474b-b305-4e3059d78cd9 tempest-TenantUsagesNegativeTestJSON-1198556161 tempest-TenantUsagesNegativeTestJSON-1198556161-project-admin] Request method failure captured: Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-simple-tenant-usage/4d3a4364fe514422a3f1f7cbfe72f4cb?start=2022-06-06T08%3A33%3A22.531337&end=2022-06-04T08%3A33%3A22.531337 HTTP/1.1 Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGpSENeutGfSzsRS61a4d05acbylBKJYv5N0-hRHebCbuweH0l_pkBneTbJFB3SzJLzyrxQ1IF9_MAXIGe3o8xUrkRVy50DQ41FiFoRHgXoSp0EbF3z1ednn7ZZqUmyN9N5l-OAcZSq4jm1uxJP36Zo9NV_GzQB4cRgfMoYNy7wMZqQ Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: ead87a3c15f0477db5987d6314550bc2 Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1198556161 Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: X-Role: admin,reader,member Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: admin,reader,member Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ead87a3c15f0477db5987d6314550bc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ead87a3c15f0477db5987d6314550bc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ead87a3c15f0477db5987d6314550bc2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ead87a3c15f0477db5987d6314550bc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1198556161 Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: ead87a3c15f0477db5987d6314550bc2 Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1198556161 Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-TenantUsagesNegativeTestJSON-1198556161-project-admin Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 6aada969a5244d54885d05eb81b565cb Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1198556161-project-admin Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: exception: Invalid start time. The start time cannot occur after the end time. Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '4d3a4364fe514422a3f1f7cbfe72f4cb'} Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jun 05 08:33:23.615475 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:23.618692 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3acadf26-dae6-474b-b305-4e3059d78cd9 tempest-TenantUsagesNegativeTestJSON-1198556161 tempest-TenantUsagesNegativeTestJSON-1198556161-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:33:23.623702 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3acadf26-dae6-474b-b305-4e3059d78cd9 tempest-TenantUsagesNegativeTestJSON-1198556161 tempest-TenantUsagesNegativeTestJSON-1198556161-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/4d3a4364fe514422a3f1f7cbfe72f4cb?start=2022-06-06T08%3A33%3A22.531337&end=2022-06-04T08%3A33%3A22.531337" status: 400 len: 111 microversion: 2.1 time: 0.026512 Jun 05 08:33:23.628413 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1299/2540] 10.222.0.33 () {58 vars in 1411 bytes} [Sun Jun 5 08:33:23 2022] GET /compute/v2.1/os-simple-tenant-usage/4d3a4364fe514422a3f1f7cbfe72f4cb?start=2022-06-06T08%3A33%3A22.531337&end=2022-06-04T08%3A33%3A22.531337 => generated 111 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 05 08:33:23.641937 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1e637ed1-ee44-40e1-b30a-062f5d1054bf tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:23.643344 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1e637ed1-ee44-40e1-b30a-062f5d1054bf tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] [instance: dfc870d3-6d2b-4e93-ac38-223552ca76c2] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:23.652031 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1e637ed1-ee44-40e1-b30a-062f5d1054bf tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:23.666887 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1e637ed1-ee44-40e1-b30a-062f5d1054bf tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:23.670512 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1e637ed1-ee44-40e1-b30a-062f5d1054bf tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:23.671017 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1e637ed1-ee44-40e1-b30a-062f5d1054bf tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:23.711291 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-1e637ed1-ee44-40e1-b30a-062f5d1054bf tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] HTTP exception thrown: Instance dfc870d3-6d2b-4e93-ac38-223552ca76c2 could not be found. Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1e637ed1-ee44-40e1-b30a-062f5d1054bf tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Request method failure captured: Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/dfc870d3-6d2b-4e93-ac38-223552ca76c2 HTTP/1.1 Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGomxwdsv5YyqoQnJ8M3HKY493BdT1kF-ZKjGTvsa4dCdMv2tEzSjVIMsusSuNEFxy259rdnBrKrLso7oL5cHjLMPvzuV3e39WGeMwcC-IUAIwS3lJ_NQ03pDpr22BFtYBYlipbszAv78HDt0XYSE3VMC0HZNva_Yj8FUzYwZlfcuNk Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 68ede041c3c744daa44a56817af472d7 Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-DeleteServersTestJSON-753623147 Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/68ede041c3c744daa44a56817af472d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/68ede041c3c744daa44a56817af472d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_68ede041c3c744daa44a56817af472d7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/68ede041c3c744daa44a56817af472d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-DeleteServersTestJSON-753623147 Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 68ede041c3c744daa44a56817af472d7 Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-DeleteServersTestJSON-753623147 Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-DeleteServersTestJSON-753623147-project Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 87be0705721c42878ae5fb2cb21c9c0d Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-DeleteServersTestJSON-753623147-project Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance dfc870d3-6d2b-4e93-ac38-223552ca76c2 could not be found. Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'dfc870d3-6d2b-4e93-ac38-223552ca76c2'} Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfc870d3-6d2b-4e93-ac38-223552ca76c2 could not be found. Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfc870d3-6d2b-4e93-ac38-223552ca76c2 could not be found. Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:23.715558 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:23.733967 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:23.733967 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:23.733967 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:23.733967 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:33:23.733967 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:33:23.733967 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfc870d3-6d2b-4e93-ac38-223552ca76c2 could not be found. Jun 05 08:33:23.733967 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:23.733967 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1e637ed1-ee44-40e1-b30a-062f5d1054bf tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] Returning 404 to user: Instance dfc870d3-6d2b-4e93-ac38-223552ca76c2 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:33:23.733967 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1e637ed1-ee44-40e1-b30a-062f5d1054bf tempest-DeleteServersTestJSON-753623147 tempest-DeleteServersTestJSON-753623147-project] 10.222.0.33 "GET /compute/v2.1/servers/dfc870d3-6d2b-4e93-ac38-223552ca76c2" status: 404 len: 111 microversion: 2.1 time: 0.089028 Jun 05 08:33:23.733967 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1300/2541] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:23 2022] GET /compute/v2.1/servers/dfc870d3-6d2b-4e93-ac38-223552ca76c2 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:33:23.956253 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c6c8fecf-b242-4e47-876e-765abc7bc699 tempest-TenantUsagesNegativeTestJSON-549168925 tempest-TenantUsagesNegativeTestJSON-549168925-project] Calling method '.version_select at 0x7f24337ae0d0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:23.959985 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c6c8fecf-b242-4e47-876e-765abc7bc699 tempest-TenantUsagesNegativeTestJSON-549168925 tempest-TenantUsagesNegativeTestJSON-549168925-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '77c20ea7f92b4a4b928a9578997c2d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d3a4364fe514422a3f1f7cbfe72f4cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c6c8fecf-b242-4e47-876e-765abc7bc699 tempest-TenantUsagesNegativeTestJSON-549168925 tempest-TenantUsagesNegativeTestJSON-549168925-project] Request method failure captured: Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-04T08%3A33%3A22.531337&end=2022-06-06T08%3A33%3A22.531337&detailed=1 HTTP/1.1 Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGpQ3_Tto-c2dn9RU5HS-BH9vYO6SwcDruy_IyT5BXhjv6Wur3ZnlMUuj0KkC-1aAMDVftb_K30leY3jGhnS2LIAyjk8Aj5cdVzhLEeFfMF_k0-HfbwZKdZZWdLDiycvmaesmg5axQbK4zjkG-XiJYQIv6xv-DaaT3Hsd1pK3jC9HEs Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 4d3a4364fe514422a3f1f7cbfe72f4cb Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-549168925 Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4d3a4364fe514422a3f1f7cbfe72f4cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4d3a4364fe514422a3f1f7cbfe72f4cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4d3a4364fe514422a3f1f7cbfe72f4cb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4d3a4364fe514422a3f1f7cbfe72f4cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-549168925 Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 4d3a4364fe514422a3f1f7cbfe72f4cb Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-549168925 Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-TenantUsagesNegativeTestJSON-549168925-project Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 77c20ea7f92b4a4b928a9578997c2d5d Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-549168925-project Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: action_args: {} Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._index(req) Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:33:23.961887 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:33:23.965927 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jun 05 08:33:23.965927 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:23.965927 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:23.965927 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:23.965927 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:23.965927 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:23.965927 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:23.965927 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:33:23.965927 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:33:23.965927 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jun 05 08:33:23.965927 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:23.970749 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c6c8fecf-b242-4e47-876e-765abc7bc699 tempest-TenantUsagesNegativeTestJSON-549168925 tempest-TenantUsagesNegativeTestJSON-549168925-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:33:23.971950 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c6c8fecf-b242-4e47-876e-765abc7bc699 tempest-TenantUsagesNegativeTestJSON-549168925 tempest-TenantUsagesNegativeTestJSON-549168925-project] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-04T08%3A33%3A22.531337&end=2022-06-06T08%3A33%3A22.531337&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.249799 Jun 05 08:33:23.975810 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1301/2542] 10.222.0.33 () {58 vars in 1334 bytes} [Sun Jun 5 08:33:23 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-04T08%3A33%3A22.531337&end=2022-06-06T08%3A33%3A22.531337&detailed=1 => generated 123 bytes in 254 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:33:24.203158 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7f6fd32c-3902-4630-96fa-88e991d38253 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:24.207338 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7f6fd32c-3902-4630-96fa-88e991d38253 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:24.210611 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-31613228-05f7-40fd-8635-db43a7cf7e32 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] 10.222.0.33 "PUT /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.893989 Jun 05 08:33:24.212080 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1242/2543] 10.222.0.33 () {60 vars in 1279 bytes} [Sun Jun 5 08:33:23 2022] PUT /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata => generated 61 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:33:24.223090 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7f5c2871-e01a-456a-b96e-abca4d08cb01 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Action: 'update', calling method: .version_select at 0x7f24337d2670>, body: {"meta": {"os_version": "alt"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:24.233119 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7f6fd32c-3902-4630-96fa-88e991d38253 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:24.233582 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7f6fd32c-3902-4630-96fa-88e991d38253 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:24.237919 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7f6fd32c-3902-4630-96fa-88e991d38253 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:24.238270 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7f6fd32c-3902-4630-96fa-88e991d38253 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:24.330606 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-7f5c2871-e01a-456a-b96e-abca4d08cb01 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Getting quotas for project ee9c97cba7b94883a57faabad636c17b. Resources: dict_keys(['metadata_items']) {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:33:24.347853 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-7f5c2871-e01a-456a-b96e-abca4d08cb01 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Getting quotas for user 6dc042fd4a6b48e4a51a597659beb150 and project ee9c97cba7b94883a57faabad636c17b. Resources: dict_keys(['metadata_items']) {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:33:24.615926 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7f6fd32c-3902-4630-96fa-88e991d38253 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:24.632838 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7f6fd32c-3902-4630-96fa-88e991d38253 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:24.637817 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7f6fd32c-3902-4630-96fa-88e991d38253 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:24.641007 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7f6fd32c-3902-4630-96fa-88e991d38253 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1737 microversion: 2.20 time: 0.440727 Jun 05 08:33:24.645067 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1302/2544] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:24 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1737 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:33:25.087322 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7f5c2871-e01a-456a-b96e-abca4d08cb01 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] 10.222.0.33 "PUT /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.869742 Jun 05 08:33:25.088425 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1243/2545] 10.222.0.33 () {60 vars in 1312 bytes} [Sun Jun 5 08:33:24 2022] PUT /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata/os_version => generated 31 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:33:25.101910 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-da615c3a-0076-4dfe-8f48-f429de592c9c tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Calling method '.version_select at 0x7f2433861ca0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:25.175949 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-da615c3a-0076-4dfe-8f48-f429de592c9c tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] 10.222.0.33 "GET /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata" status: 200 len: 58 microversion: 2.1 time: 0.079972 Jun 05 08:33:25.177929 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1303/2546] 10.222.0.33 () {58 vars in 1259 bytes} [Sun Jun 5 08:33:25 2022] GET /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata => generated 58 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:33:25.190214 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3062719b-bc7c-4efc-a23f-e90e28c11ca9 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Action: 'update_all', calling method: .version_select at 0x7f2433835280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:25.293964 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-3062719b-bc7c-4efc-a23f-e90e28c11ca9 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Getting quotas for project ee9c97cba7b94883a57faabad636c17b. Resources: dict_keys(['metadata_items']) {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:33:25.316210 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-3062719b-bc7c-4efc-a23f-e90e28c11ca9 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Getting quotas for user 6dc042fd4a6b48e4a51a597659beb150 and project ee9c97cba7b94883a57faabad636c17b. Resources: dict_keys(['metadata_items']) {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:33:25.662675 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1e5c4805-2344-452e-8b28-47a3596ed6de tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:25.663423 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1e5c4805-2344-452e-8b28-47a3596ed6de tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:25.683732 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1e5c4805-2344-452e-8b28-47a3596ed6de tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:25.685077 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1e5c4805-2344-452e-8b28-47a3596ed6de tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:25.687915 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1e5c4805-2344-452e-8b28-47a3596ed6de tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:25.690363 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1e5c4805-2344-452e-8b28-47a3596ed6de tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:26.151028 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3062719b-bc7c-4efc-a23f-e90e28c11ca9 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] 10.222.0.33 "PUT /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata" status: 200 len: 61 microversion: 2.1 time: 0.965449 Jun 05 08:33:26.152688 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1244/2547] 10.222.0.33 () {60 vars in 1279 bytes} [Sun Jun 5 08:33:25 2022] PUT /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata => generated 61 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:33:26.165813 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-aec62a15-06cc-4926-bad2-8b9ec9bb1608 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Action: 'create', calling method: .version_select at 0x7f24337ed280>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:26.285387 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-aec62a15-06cc-4926-bad2-8b9ec9bb1608 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Getting quotas for project ee9c97cba7b94883a57faabad636c17b. Resources: dict_keys(['metadata_items']) {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:33:26.309834 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-aec62a15-06cc-4926-bad2-8b9ec9bb1608 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Getting quotas for user 6dc042fd4a6b48e4a51a597659beb150 and project ee9c97cba7b94883a57faabad636c17b. Resources: dict_keys(['metadata_items']) {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:33:27.092530 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-aec62a15-06cc-4926-bad2-8b9ec9bb1608 tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] 10.222.0.33 "POST /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata" status: 200 len: 85 microversion: 2.1 time: 0.934113 Jun 05 08:33:27.097548 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1245/2548] 10.222.0.33 () {60 vars in 1280 bytes} [Sun Jun 5 08:33:26 2022] POST /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata => generated 85 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 05 08:33:27.106276 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1e5c4805-2344-452e-8b28-47a3596ed6de tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:27.108898 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2766eaee-341b-4582-a662-bb7cc58f71ba tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] Calling method '.version_select at 0x7f24337c6b80>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:27.129224 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1e5c4805-2344-452e-8b28-47a3596ed6de tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:27.135696 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1e5c4805-2344-452e-8b28-47a3596ed6de tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:27.140953 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1e5c4805-2344-452e-8b28-47a3596ed6de tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1737 microversion: 2.20 time: 1.481017 Jun 05 08:33:27.143544 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1304/2549] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:25 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1737 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:33:27.214150 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2766eaee-341b-4582-a662-bb7cc58f71ba tempest-ImagesMetadataTestJSON-52319998 tempest-ImagesMetadataTestJSON-52319998-project] 10.222.0.33 "GET /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata" status: 200 len: 85 microversion: 2.1 time: 0.109056 Jun 05 08:33:27.214760 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1246/2550] 10.222.0.33 () {58 vars in 1259 bytes} [Sun Jun 5 08:33:27 2022] GET /compute/v2.1/images/644a4bb0-e6d4-4a39-ac31-11f606d515f6/metadata => generated 85 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:33:28.162884 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a20479d9-8fbe-46f1-9da2-dfa61972aca0 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:28.164457 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a20479d9-8fbe-46f1-9da2-dfa61972aca0 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:28.176071 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a20479d9-8fbe-46f1-9da2-dfa61972aca0 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:28.180150 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a20479d9-8fbe-46f1-9da2-dfa61972aca0 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:28.181400 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a20479d9-8fbe-46f1-9da2-dfa61972aca0 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:28.183546 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a20479d9-8fbe-46f1-9da2-dfa61972aca0 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:28.914662 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a20479d9-8fbe-46f1-9da2-dfa61972aca0 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:28.930990 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a20479d9-8fbe-46f1-9da2-dfa61972aca0 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:28.933021 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a20479d9-8fbe-46f1-9da2-dfa61972aca0 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:28.934288 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a20479d9-8fbe-46f1-9da2-dfa61972aca0 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1737 microversion: 2.20 time: 0.777353 Jun 05 08:33:28.942744 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1305/2551] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:28 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1737 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:33:29.965570 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c9b99a92-5d6e-434e-9eb8-90abb5798b25 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:29.967701 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c9b99a92-5d6e-434e-9eb8-90abb5798b25 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:29.990119 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c9b99a92-5d6e-434e-9eb8-90abb5798b25 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:29.997453 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c9b99a92-5d6e-434e-9eb8-90abb5798b25 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:29.999821 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c9b99a92-5d6e-434e-9eb8-90abb5798b25 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:30.002986 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c9b99a92-5d6e-434e-9eb8-90abb5798b25 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:30.713003 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c9b99a92-5d6e-434e-9eb8-90abb5798b25 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:30.731767 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c9b99a92-5d6e-434e-9eb8-90abb5798b25 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:30.747714 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c9b99a92-5d6e-434e-9eb8-90abb5798b25 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:30.749948 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c9b99a92-5d6e-434e-9eb8-90abb5798b25 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1737 microversion: 2.20 time: 0.790232 Jun 05 08:33:30.751987 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1247/2552] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:29 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1737 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:33:31.773103 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c7fa413f-69f7-4ef8-93f8-8f3de1e5b1a7 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:31.773720 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c7fa413f-69f7-4ef8-93f8-8f3de1e5b1a7 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:31.781562 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=29 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:33:31.795893 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c7fa413f-69f7-4ef8-93f8-8f3de1e5b1a7 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:31.796378 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c7fa413f-69f7-4ef8-93f8-8f3de1e5b1a7 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:31.797260 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c7fa413f-69f7-4ef8-93f8-8f3de1e5b1a7 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:31.797890 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c7fa413f-69f7-4ef8-93f8-8f3de1e5b1a7 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:32.103224 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c7fa413f-69f7-4ef8-93f8-8f3de1e5b1a7 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:32.125074 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c7fa413f-69f7-4ef8-93f8-8f3de1e5b1a7 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:32.132637 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c7fa413f-69f7-4ef8-93f8-8f3de1e5b1a7 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:32.136654 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c7fa413f-69f7-4ef8-93f8-8f3de1e5b1a7 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1737 microversion: 2.20 time: 0.368044 Jun 05 08:33:32.140757 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1306/2553] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:31 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1737 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:33:33.006531 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0ed99002-1550-4e58-97dd-7d689bdd6c58 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Action: 'create', calling method: .version_select at 0x7f24455385e0>, body: {"keypair": {"name": "tempest-keypair-280605666", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfxYgAI/8T7Of8xLVh77+eHt8lGXGZSRbzW+wJzzjzJZInrydFu5RynGS0S+RJeVN9u0oWr8OD1d2CE87hrieuL/ZBhoFpWoGYGLAHxy3JaaJsEJuMqbIZ+gCUfUYEKgw=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:33.040383 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=49 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:33:33.042015 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-0ed99002-1550-4e58-97dd-7d689bdd6c58 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Getting quotas for project dd38999f83494e22a3e5e090e03ec3e3. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:33:33.055639 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-0ed99002-1550-4e58-97dd-7d689bdd6c58 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Getting quotas for user 9ce2809b953240219120a4cb9628b3b2 and project dd38999f83494e22a3e5e090e03ec3e3. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:33:33.121951 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0ed99002-1550-4e58-97dd-7d689bdd6c58 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.677530 Jun 05 08:33:33.123230 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1248/2554] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:33:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:33:33.162027 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e2350d14-cf15-4b61-87ec-58f2cbd34494 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:33.163003 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e2350d14-cf15-4b61-87ec-58f2cbd34494 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:33.171242 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e2350d14-cf15-4b61-87ec-58f2cbd34494 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:33.171590 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e2350d14-cf15-4b61-87ec-58f2cbd34494 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:33.182411 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e2350d14-cf15-4b61-87ec-58f2cbd34494 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:33.184071 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e2350d14-cf15-4b61-87ec-58f2cbd34494 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:33.362440 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:RELEASE=1,nova_cell0:SELECT=50,nova_cell0:UPDATE=13,nova_cell0:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:33:33.644692 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8ea13912-70c9-49aa-ab0c-11260bc2adbf tempest-QuotaClassesAdminTestJSON-1891123506 tempest-QuotaClassesAdminTestJSON-1891123506-project-admin] Calling method '.version_select at 0x7f2445566310>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:33.645643 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:33:33.645643 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:33:33.688758 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8ea13912-70c9-49aa-ab0c-11260bc2adbf tempest-QuotaClassesAdminTestJSON-1891123506 tempest-QuotaClassesAdminTestJSON-1891123506-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.329359 Jun 05 08:33:33.695198 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1249/2555] 10.222.0.33 () {58 vars in 1184 bytes} [Sun Jun 5 08:33:33 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:33:33.710470 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ea76c5ae-c416-472b-9abe-f0ac1f0de027 tempest-QuotaClassesAdminTestJSON-1891123506 tempest-QuotaClassesAdminTestJSON-1891123506-project-admin] Action: 'update', calling method: .version_select at 0x7f2445566790>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:33.711249 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=37,nova_cell0:UPDATE=27,nova_cell0:DELETE=4,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:33:33.720210 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:33:33.720210 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:33:34.210015 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=8,nova_api:UPDATE=12 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:33:34.262595 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ea76c5ae-c416-472b-9abe-f0ac1f0de027 tempest-QuotaClassesAdminTestJSON-1891123506 tempest-QuotaClassesAdminTestJSON-1891123506-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.563902 Jun 05 08:33:34.270009 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1250/2556] 10.222.0.33 () {60 vars in 1205 bytes} [Sun Jun 5 08:33:33 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:33:34.275418 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3e82067f-e92a-4094-b477-c02a9806ffea tempest-QuotaClassesAdminTestJSON-1891123506 tempest-QuotaClassesAdminTestJSON-1891123506-project-admin] Calling method '.version_select at 0x7f24455665e0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:34.311970 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3e82067f-e92a-4094-b477-c02a9806ffea tempest-QuotaClassesAdminTestJSON-1891123506 tempest-QuotaClassesAdminTestJSON-1891123506-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.040340 Jun 05 08:33:34.316512 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1251/2557] 10.222.0.33 () {58 vars in 1184 bytes} [Sun Jun 5 08:33:34 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:33:34.325008 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0a966512-9907-400a-a705-91f948c24f81 tempest-QuotaClassesAdminTestJSON-1891123506 tempest-QuotaClassesAdminTestJSON-1891123506-project-admin] Action: 'update', calling method: .version_select at 0x7f24337164c0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:34.528762 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e2350d14-cf15-4b61-87ec-58f2cbd34494 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:34.557130 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e2350d14-cf15-4b61-87ec-58f2cbd34494 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:34.565504 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e2350d14-cf15-4b61-87ec-58f2cbd34494 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:34.568322 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0a966512-9907-400a-a705-91f948c24f81 tempest-QuotaClassesAdminTestJSON-1891123506 tempest-QuotaClassesAdminTestJSON-1891123506-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.247330 Jun 05 08:33:34.572313 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e2350d14-cf15-4b61-87ec-58f2cbd34494 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1719 microversion: 2.20 time: 1.414069 Jun 05 08:33:34.573314 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1307/2558] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:33 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1719 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:33:34.574369 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1252/2559] 10.222.0.33 () {60 vars in 1205 bytes} [Sun Jun 5 08:33:34 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:33:35.593658 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8e66191e-153d-4c24-9765-4562c0ed4129 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:35.596243 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8e66191e-153d-4c24-9765-4562c0ed4129 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:35.607923 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8e66191e-153d-4c24-9765-4562c0ed4129 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:35.608726 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8e66191e-153d-4c24-9765-4562c0ed4129 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:35.609688 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8e66191e-153d-4c24-9765-4562c0ed4129 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:35.610481 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8e66191e-153d-4c24-9765-4562c0ed4129 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:35.639533 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=61 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:33:35.711104 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-2e30edff-037f-4099-82d8-2aede6d70fca req-5d00379d-85db-45bf-a3f9-56259675852d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "040dd488-42f2-45c3-86de-1a675e78d7ca", "name": "network-vif-unplugged", "status": "completed", "tag": "93d59181-26a5-451b-8871-ccba610464fd"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:35.727553 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-2e30edff-037f-4099-82d8-2aede6d70fca req-5d00379d-85db-45bf-a3f9-56259675852d service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:35.732175 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-2e30edff-037f-4099-82d8-2aede6d70fca req-5d00379d-85db-45bf-a3f9-56259675852d service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:35.768323 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-2e30edff-037f-4099-82d8-2aede6d70fca req-5d00379d-85db-45bf-a3f9-56259675852d service nova] Creating event network-vif-unplugged:93d59181-26a5-451b-8871-ccba610464fd for instance 040dd488-42f2-45c3-86de-1a675e78d7ca on n-h1-844739-1 Jun 05 08:33:35.777885 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-2e30edff-037f-4099-82d8-2aede6d70fca req-5d00379d-85db-45bf-a3f9-56259675852d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070418 Jun 05 08:33:35.779090 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1253/2560] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:33:36.671067 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8e66191e-153d-4c24-9765-4562c0ed4129 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:36.690424 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8e66191e-153d-4c24-9765-4562c0ed4129 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:36.699446 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8e66191e-153d-4c24-9765-4562c0ed4129 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:36.700964 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8e66191e-153d-4c24-9765-4562c0ed4129 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1719 microversion: 2.20 time: 1.111500 Jun 05 08:33:36.707542 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1308/2561] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:35 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1719 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:33:37.730147 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-07ad6125-ce1f-4c88-aca7-068fb06d2a3b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:37.731485 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-07ad6125-ce1f-4c88-aca7-068fb06d2a3b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:37.770540 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-07ad6125-ce1f-4c88-aca7-068fb06d2a3b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:37.771564 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-07ad6125-ce1f-4c88-aca7-068fb06d2a3b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:37.773905 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-07ad6125-ce1f-4c88-aca7-068fb06d2a3b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:37.774975 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-07ad6125-ce1f-4c88-aca7-068fb06d2a3b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:38.221431 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-07ad6125-ce1f-4c88-aca7-068fb06d2a3b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:38.239646 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-07ad6125-ce1f-4c88-aca7-068fb06d2a3b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:38.247188 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-07ad6125-ce1f-4c88-aca7-068fb06d2a3b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:38.251663 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-07ad6125-ce1f-4c88-aca7-068fb06d2a3b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1662 microversion: 2.20 time: 0.529670 Jun 05 08:33:38.257975 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1254/2562] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:37 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1662 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:33:38.278871 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-610e30f7-573c-42c5-87e9-c468b459d86b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc2f2c59-a79a-4293-ac98-46babfa49a13"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:38.280190 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-610e30f7-573c-42c5-87e9-c468b459d86b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:38.295292 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-610e30f7-573c-42c5-87e9-c468b459d86b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:38.296130 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-610e30f7-573c-42c5-87e9-c468b459d86b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:38.298393 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-610e30f7-573c-42c5-87e9-c468b459d86b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:38.299698 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-610e30f7-573c-42c5-87e9-c468b459d86b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:38.423933 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0acecedf-15f5-443a-8a46-0b3307d49fba tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Action: 'create', calling method: .version_select at 0x7f2445357af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-18395562", "description": "tempest-description-2109071861"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:38.925775 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-610e30f7-573c-42c5-87e9-c468b459d86b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "POST /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.651027 Jun 05 08:33:38.927451 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1255/2563] 10.222.0.33 () {62 vars in 1363 bytes} [Sun Jun 5 08:33:38 2022] POST /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca/os-volume_attachments => generated 188 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:33:38.963284 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0acecedf-15f5-443a-8a46-0b3307d49fba tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.824541 Jun 05 08:33:38.964995 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1309/2564] 10.222.0.33 () {60 vars in 1179 bytes} [Sun Jun 5 08:33:38 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:33:38.980413 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5d72d5d8-b573-4b3d-97fb-7942eb3bf8eb tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Action: 'create', calling method: .version_select at 0x7f2433cd0c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-657888382", "description": "tempest-description-1777053987"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:39.200402 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-930101a6-9042-47f2-8b15-c572dd570e20 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:39.201092 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-930101a6-9042-47f2-8b15-c572dd570e20 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:39.213726 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-930101a6-9042-47f2-8b15-c572dd570e20 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:39.214419 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-930101a6-9042-47f2-8b15-c572dd570e20 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:39.216524 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-930101a6-9042-47f2-8b15-c572dd570e20 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:39.217857 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-930101a6-9042-47f2-8b15-c572dd570e20 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:39.720483 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-930101a6-9042-47f2-8b15-c572dd570e20 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "DELETE /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca/os-volume_attachments/dc2f2c59-a79a-4293-ac98-46babfa49a13" status: 202 len: 0 microversion: 2.20 time: 0.525249 Jun 05 08:33:39.728543 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1310/2565] 10.222.0.33 () {60 vars in 1456 bytes} [Sun Jun 5 08:33:39 2022] DELETE /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca/os-volume_attachments/dc2f2c59-a79a-4293-ac98-46babfa49a13 => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 05 08:33:39.762869 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e305c898-3df2-4d9f-afcc-ab2e0339fd0a tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1107411509", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "3d233ae1-4f64-4733-80e6-2c0bd8a9fed1"}], "security_groups": [{"name": "tempest-securitygroup--1267345612"}], "key_name": "tempest-keypair-280605666", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:39.946549 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5d72d5d8-b573-4b3d-97fb-7942eb3bf8eb tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.971999 Jun 05 08:33:39.959013 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1256/2566] 10.222.0.33 () {60 vars in 1179 bytes} [Sun Jun 5 08:33:38 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:33:39.973408 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f758e9d0-827d-4d3b-b627-73c2cec71d69 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:39.974694 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f758e9d0-827d-4d3b-b627-73c2cec71d69 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:39.998456 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f758e9d0-827d-4d3b-b627-73c2cec71d69 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:39.999307 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f758e9d0-827d-4d3b-b627-73c2cec71d69 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:40.002793 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f758e9d0-827d-4d3b-b627-73c2cec71d69 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:40.003830 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f758e9d0-827d-4d3b-b627-73c2cec71d69 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:40.231461 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f758e9d0-827d-4d3b-b627-73c2cec71d69 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "POST /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca/action" status: 202 len: 0 microversion: 2.20 time: 0.269802 Jun 05 08:33:40.232816 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1257/2567] 10.222.0.33 () {62 vars in 1318 bytes} [Sun Jun 5 08:33:39 2022] POST /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:33:40.243573 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-801c474c-bb93-4f6c-ade8-ec9c3e1abce4 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-432028700", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "d0e67171-28e8-402b-b6fe-2c9f0c0fff86"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:40.261447 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-e305c898-3df2-4d9f-afcc-ab2e0339fd0a tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] validate_networks() for [('3d233ae1-4f64-4733-80e6-2c0bd8a9fed1', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:33:40.350622 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-801c474c-bb93-4f6c-ade8-ec9c3e1abce4 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] validate_networks() for [('d0e67171-28e8-402b-b6fe-2c9f0c0fff86', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:33:42.983638 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-e305c898-3df2-4d9f-afcc-ab2e0339fd0a tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Getting quotas for project dd38999f83494e22a3e5e090e03ec3e3. Resources: dict_keys(['metadata_items']) {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:33:43.004874 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-e305c898-3df2-4d9f-afcc-ab2e0339fd0a tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Getting quotas for user 9ce2809b953240219120a4cb9628b3b2 and project dd38999f83494e22a3e5e090e03ec3e3. Resources: dict_keys(['metadata_items']) {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:33:43.036990 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-e305c898-3df2-4d9f-afcc-ab2e0339fd0a tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:33:43.037587 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-e305c898-3df2-4d9f-afcc-ab2e0339fd0a tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:33:43.038329 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-e305c898-3df2-4d9f-afcc-ab2e0339fd0a tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:33:43.039726 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-e305c898-3df2-4d9f-afcc-ab2e0339fd0a tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:33:43.040363 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-e305c898-3df2-4d9f-afcc-ab2e0339fd0a tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:33:43.069951 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e305c898-3df2-4d9f-afcc-ab2e0339fd0a tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:43.070410 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e305c898-3df2-4d9f-afcc-ab2e0339fd0a tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:43.071264 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e305c898-3df2-4d9f-afcc-ab2e0339fd0a tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:43.075050 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e305c898-3df2-4d9f-afcc-ab2e0339fd0a tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:43.108232 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-e305c898-3df2-4d9f-afcc-ab2e0339fd0a tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Getting quotas for project dd38999f83494e22a3e5e090e03ec3e3. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:33:43.127123 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-e305c898-3df2-4d9f-afcc-ab2e0339fd0a tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Getting quotas for user 9ce2809b953240219120a4cb9628b3b2 and project dd38999f83494e22a3e5e090e03ec3e3. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:33:43.160969 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e305c898-3df2-4d9f-afcc-ab2e0339fd0a tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:33:43.175159 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e305c898-3df2-4d9f-afcc-ab2e0339fd0a tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] [instance: 308733f8-e53b-41e8-88a0-e5cdf0db8207] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:33:43.274039 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-801c474c-bb93-4f6c-ade8-ec9c3e1abce4 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:33:43.274514 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-801c474c-bb93-4f6c-ade8-ec9c3e1abce4 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:33:43.274904 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-801c474c-bb93-4f6c-ade8-ec9c3e1abce4 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:33:43.275328 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-801c474c-bb93-4f6c-ade8-ec9c3e1abce4 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:33:43.275735 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-801c474c-bb93-4f6c-ade8-ec9c3e1abce4 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:33:43.282622 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e305c898-3df2-4d9f-afcc-ab2e0339fd0a tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.552584 Jun 05 08:33:43.283790 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1311/2568] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:33:39 2022] POST /compute/v2.1/servers => generated 407 bytes in 3554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:33:43.300819 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-219ad1b0-138f-4d1f-9a12-9d14e16c7cdf tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:43.301519 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-219ad1b0-138f-4d1f-9a12-9d14e16c7cdf tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:43.307010 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-801c474c-bb93-4f6c-ade8-ec9c3e1abce4 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:43.307463 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-801c474c-bb93-4f6c-ade8-ec9c3e1abce4 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:43.308291 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-801c474c-bb93-4f6c-ade8-ec9c3e1abce4 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:43.308729 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-801c474c-bb93-4f6c-ade8-ec9c3e1abce4 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:43.347516 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-219ad1b0-138f-4d1f-9a12-9d14e16c7cdf tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:43.347966 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-219ad1b0-138f-4d1f-9a12-9d14e16c7cdf tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:43.348786 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-219ad1b0-138f-4d1f-9a12-9d14e16c7cdf tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:43.349226 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-219ad1b0-138f-4d1f-9a12-9d14e16c7cdf tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:43.352793 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:33:43.369857 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-801c474c-bb93-4f6c-ade8-ec9c3e1abce4 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Getting quotas for project bca25b0072144b22a04124f80362a310. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:33:43.384266 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-801c474c-bb93-4f6c-ade8-ec9c3e1abce4 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Getting quotas for user 3f3f6d563ecb4a6c88931c63b04a0974 and project bca25b0072144b22a04124f80362a310. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:33:43.408612 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-801c474c-bb93-4f6c-ade8-ec9c3e1abce4 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:33:43.418982 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-801c474c-bb93-4f6c-ade8-ec9c3e1abce4 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] [instance: 0c1c5b97-b093-4e28-93c9-b39687513dd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:33:43.541824 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-801c474c-bb93-4f6c-ade8-ec9c3e1abce4 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.307702 Jun 05 08:33:43.547991 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1258/2569] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:33:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 3312 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:33:43.903303 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6d6d27a6-ab64-4d02-b5f4-fb2b77258936 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-352288656", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:44.022964 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-6d6d27a6-ab64-4d02-b5f4-fb2b77258936 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] validate_networks() for None {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:33:44.165505 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-219ad1b0-138f-4d1f-9a12-9d14e16c7cdf tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:44.194374 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-219ad1b0-138f-4d1f-9a12-9d14e16c7cdf tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:44.201707 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-219ad1b0-138f-4d1f-9a12-9d14e16c7cdf tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:44.208866 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-219ad1b0-138f-4d1f-9a12-9d14e16c7cdf tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1670 microversion: 2.20 time: 0.922059 Jun 05 08:33:44.212163 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1312/2570] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:43 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1670 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:33:44.236981 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-baf6cde3-165e-4770-9d74-d726c601bd31 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:44.239022 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-baf6cde3-165e-4770-9d74-d726c601bd31 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] [instance: 308733f8-e53b-41e8-88a0-e5cdf0db8207] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:44.251156 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-baf6cde3-165e-4770-9d74-d726c601bd31 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:44.252379 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-baf6cde3-165e-4770-9d74-d726c601bd31 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:44.253601 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-baf6cde3-165e-4770-9d74-d726c601bd31 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:44.254455 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-baf6cde3-165e-4770-9d74-d726c601bd31 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:44.327138 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-baf6cde3-165e-4770-9d74-d726c601bd31 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:44.328018 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-baf6cde3-165e-4770-9d74-d726c601bd31 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:44.328683 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-baf6cde3-165e-4770-9d74-d726c601bd31 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Lazy-loading 'fault' on Instance uuid 308733f8-e53b-41e8-88a0-e5cdf0db8207 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:33:44.523457 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-baf6cde3-165e-4770-9d74-d726c601bd31 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce2809b953240219120a4cb9628b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd38999f83494e22a3e5e090e03ec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:44.540372 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-baf6cde3-165e-4770-9d74-d726c601bd31 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] 10.222.0.33 "GET /compute/v2.1/servers/308733f8-e53b-41e8-88a0-e5cdf0db8207" status: 200 len: 1342 microversion: 2.1 time: 0.305948 Jun 05 08:33:44.543757 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1313/2571] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:44 2022] GET /compute/v2.1/servers/308733f8-e53b-41e8-88a0-e5cdf0db8207 => generated 1342 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:33:44.556883 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6ee6eb61-5c0a-4c2a-bd56-77e2ae273e0c tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:44.560697 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6ee6eb61-5c0a-4c2a-bd56-77e2ae273e0c tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] [instance: 0c1c5b97-b093-4e28-93c9-b39687513dd6] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:44.576643 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6ee6eb61-5c0a-4c2a-bd56-77e2ae273e0c tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:44.578855 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6ee6eb61-5c0a-4c2a-bd56-77e2ae273e0c tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:44.582334 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6ee6eb61-5c0a-4c2a-bd56-77e2ae273e0c tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:44.584955 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6ee6eb61-5c0a-4c2a-bd56-77e2ae273e0c tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:44.675359 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6ee6eb61-5c0a-4c2a-bd56-77e2ae273e0c tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:44.682054 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6ee6eb61-5c0a-4c2a-bd56-77e2ae273e0c tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:44.682386 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-6ee6eb61-5c0a-4c2a-bd56-77e2ae273e0c tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lazy-loading 'fault' on Instance uuid 0c1c5b97-b093-4e28-93c9-b39687513dd6 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:33:44.912386 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6ee6eb61-5c0a-4c2a-bd56-77e2ae273e0c tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3f6d563ecb4a6c88931c63b04a0974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca25b0072144b22a04124f80362a310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:44.926443 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6ee6eb61-5c0a-4c2a-bd56-77e2ae273e0c tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "GET /compute/v2.1/servers/0c1c5b97-b093-4e28-93c9-b39687513dd6" status: 200 len: 1288 microversion: 2.1 time: 0.379064 Jun 05 08:33:44.927251 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1314/2572] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:44 2022] GET /compute/v2.1/servers/0c1c5b97-b093-4e28-93c9-b39687513dd6 => generated 1288 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:33:45.199252 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-6d6d27a6-ab64-4d02-b5f4-fb2b77258936 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:33:45.200749 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-6d6d27a6-ab64-4d02-b5f4-fb2b77258936 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:33:45.208710 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-6d6d27a6-ab64-4d02-b5f4-fb2b77258936 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:33:45.210026 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-6d6d27a6-ab64-4d02-b5f4-fb2b77258936 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:33:45.210606 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-6d6d27a6-ab64-4d02-b5f4-fb2b77258936 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:33:45.235883 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c48b681f-cea8-436b-bb84-eaf5a3b0541e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:45.237737 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c48b681f-cea8-436b-bb84-eaf5a3b0541e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:45.246246 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6d6d27a6-ab64-4d02-b5f4-fb2b77258936 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:45.246996 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6d6d27a6-ab64-4d02-b5f4-fb2b77258936 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:45.248067 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6d6d27a6-ab64-4d02-b5f4-fb2b77258936 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:45.250995 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6d6d27a6-ab64-4d02-b5f4-fb2b77258936 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:45.264245 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c48b681f-cea8-436b-bb84-eaf5a3b0541e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:45.264731 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c48b681f-cea8-436b-bb84-eaf5a3b0541e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:45.270450 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c48b681f-cea8-436b-bb84-eaf5a3b0541e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:45.270925 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c48b681f-cea8-436b-bb84-eaf5a3b0541e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:45.302289 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-6d6d27a6-ab64-4d02-b5f4-fb2b77258936 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Getting quotas for project 5cfe4b69d6214663b125d3a503ce91e5. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:33:45.325387 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-6d6d27a6-ab64-4d02-b5f4-fb2b77258936 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Getting quotas for user 2e722d3ff6264f53a19f83386b0ac62e and project 5cfe4b69d6214663b125d3a503ce91e5. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:33:45.378795 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6d6d27a6-ab64-4d02-b5f4-fb2b77258936 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:33:45.386314 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6d6d27a6-ab64-4d02-b5f4-fb2b77258936 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] [instance: 532c0c14-0a05-434f-b294-a21872033cb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:33:45.527238 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6d6d27a6-ab64-4d02-b5f4-fb2b77258936 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.977968 Jun 05 08:33:45.529535 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1259/2573] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:33:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:33:45.561417 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-651bcf5f-b9e8-4735-936c-aa56b7defa8b tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:45.562308 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-651bcf5f-b9e8-4735-936c-aa56b7defa8b tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] [instance: 308733f8-e53b-41e8-88a0-e5cdf0db8207] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:45.576517 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-651bcf5f-b9e8-4735-936c-aa56b7defa8b tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:45.578315 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-651bcf5f-b9e8-4735-936c-aa56b7defa8b tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:45.580401 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-651bcf5f-b9e8-4735-936c-aa56b7defa8b tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:45.581145 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-651bcf5f-b9e8-4735-936c-aa56b7defa8b tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:45.633826 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-651bcf5f-b9e8-4735-936c-aa56b7defa8b tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:45.634480 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-651bcf5f-b9e8-4735-936c-aa56b7defa8b tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:45.634953 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-651bcf5f-b9e8-4735-936c-aa56b7defa8b tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Lazy-loading 'fault' on Instance uuid 308733f8-e53b-41e8-88a0-e5cdf0db8207 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:33:45.733512 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-651bcf5f-b9e8-4735-936c-aa56b7defa8b tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ce2809b953240219120a4cb9628b3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd38999f83494e22a3e5e090e03ec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:45.748998 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c48b681f-cea8-436b-bb84-eaf5a3b0541e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:45.769546 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c48b681f-cea8-436b-bb84-eaf5a3b0541e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:45.770992 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-651bcf5f-b9e8-4735-936c-aa56b7defa8b tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] 10.222.0.33 "GET /compute/v2.1/servers/308733f8-e53b-41e8-88a0-e5cdf0db8207" status: 200 len: 1342 microversion: 2.1 time: 0.215846 Jun 05 08:33:45.771701 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1260/2574] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:45 2022] GET /compute/v2.1/servers/308733f8-e53b-41e8-88a0-e5cdf0db8207 => generated 1342 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:33:45.773114 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c48b681f-cea8-436b-bb84-eaf5a3b0541e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:45.775977 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c48b681f-cea8-436b-bb84-eaf5a3b0541e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1728 microversion: 2.20 time: 0.545360 Jun 05 08:33:45.787910 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1315/2575] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:45 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1728 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:33:45.793293 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d29ce69a-c662-4d6e-94cd-27b17d241b80 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-993970979", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:45.808403 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e397a1cc-9e37-4c24-93db-fdb246ffea83 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:45.809432 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e397a1cc-9e37-4c24-93db-fdb246ffea83 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] [instance: 308733f8-e53b-41e8-88a0-e5cdf0db8207] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:45.827661 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e397a1cc-9e37-4c24-93db-fdb246ffea83 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:45.845148 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e397a1cc-9e37-4c24-93db-fdb246ffea83 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:45.846541 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e397a1cc-9e37-4c24-93db-fdb246ffea83 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:45.850069 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e397a1cc-9e37-4c24-93db-fdb246ffea83 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:45.904342 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-d29ce69a-c662-4d6e-94cd-27b17d241b80 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] validate_networks() for None {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:33:45.951369 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e397a1cc-9e37-4c24-93db-fdb246ffea83 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] [instance: 308733f8-e53b-41e8-88a0-e5cdf0db8207] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:33:46.079706 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e397a1cc-9e37-4c24-93db-fdb246ffea83 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] [instance: 308733f8-e53b-41e8-88a0-e5cdf0db8207] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:33:46.082478 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e397a1cc-9e37-4c24-93db-fdb246ffea83 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:46.095938 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e397a1cc-9e37-4c24-93db-fdb246ffea83 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:46.097084 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-e397a1cc-9e37-4c24-93db-fdb246ffea83 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] [instance: 308733f8-e53b-41e8-88a0-e5cdf0db8207] instance's host None is down, deleting from database Jun 05 08:33:46.102243 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-e397a1cc-9e37-4c24-93db-fdb246ffea83 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] [instance: 308733f8-e53b-41e8-88a0-e5cdf0db8207] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:33:46.214629 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-e397a1cc-9e37-4c24-93db-fdb246ffea83 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] [instance: 308733f8-e53b-41e8-88a0-e5cdf0db8207] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:33:46.223717 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-e397a1cc-9e37-4c24-93db-fdb246ffea83 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] [instance: 308733f8-e53b-41e8-88a0-e5cdf0db8207] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:33:46.571575 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e397a1cc-9e37-4c24-93db-fdb246ffea83 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] 10.222.0.33 "DELETE /compute/v2.1/servers/308733f8-e53b-41e8-88a0-e5cdf0db8207" status: 204 len: 0 microversion: 2.1 time: 0.778254 Jun 05 08:33:46.573507 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1316/2576] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:33:45 2022] DELETE /compute/v2.1/servers/308733f8-e53b-41e8-88a0-e5cdf0db8207 => generated 0 bytes in 783 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:33:46.580515 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-37f891c9-ae5a-49ec-bc19-ab894a7d45f5 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:46.581716 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-37f891c9-ae5a-49ec-bc19-ab894a7d45f5 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] [instance: 0c1c5b97-b093-4e28-93c9-b39687513dd6] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:46.582237 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-d29ce69a-c662-4d6e-94cd-27b17d241b80 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:33:46.582678 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-d29ce69a-c662-4d6e-94cd-27b17d241b80 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:33:46.583115 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-d29ce69a-c662-4d6e-94cd-27b17d241b80 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:33:46.583700 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-d29ce69a-c662-4d6e-94cd-27b17d241b80 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:33:46.584293 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-d29ce69a-c662-4d6e-94cd-27b17d241b80 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:33:46.605103 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-37f891c9-ae5a-49ec-bc19-ab894a7d45f5 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:46.606340 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-37f891c9-ae5a-49ec-bc19-ab894a7d45f5 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:46.608767 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-37f891c9-ae5a-49ec-bc19-ab894a7d45f5 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:46.609896 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-37f891c9-ae5a-49ec-bc19-ab894a7d45f5 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:46.610992 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d29ce69a-c662-4d6e-94cd-27b17d241b80 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:46.611647 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d29ce69a-c662-4d6e-94cd-27b17d241b80 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:46.613243 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d29ce69a-c662-4d6e-94cd-27b17d241b80 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:46.616154 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d29ce69a-c662-4d6e-94cd-27b17d241b80 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:46.661794 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-d29ce69a-c662-4d6e-94cd-27b17d241b80 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Getting quotas for project 5cfe4b69d6214663b125d3a503ce91e5. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:33:46.674001 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-d29ce69a-c662-4d6e-94cd-27b17d241b80 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Getting quotas for user 2e722d3ff6264f53a19f83386b0ac62e and project 5cfe4b69d6214663b125d3a503ce91e5. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:33:46.680513 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-37f891c9-ae5a-49ec-bc19-ab894a7d45f5 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:46.681169 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-37f891c9-ae5a-49ec-bc19-ab894a7d45f5 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:46.681701 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-37f891c9-ae5a-49ec-bc19-ab894a7d45f5 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lazy-loading 'fault' on Instance uuid 0c1c5b97-b093-4e28-93c9-b39687513dd6 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:33:46.711368 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d29ce69a-c662-4d6e-94cd-27b17d241b80 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:33:46.716815 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d29ce69a-c662-4d6e-94cd-27b17d241b80 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] [instance: 9c64a374-2fe7-4eb3-b5af-dee9c990d4bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:33:46.808132 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-37f891c9-ae5a-49ec-bc19-ab894a7d45f5 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3f6d563ecb4a6c88931c63b04a0974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca25b0072144b22a04124f80362a310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:46.808977 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d29ce69a-c662-4d6e-94cd-27b17d241b80 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.019634 Jun 05 08:33:46.811738 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1261/2577] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:33:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:33:46.824905 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b7cd988c-de6c-4997-b205-94bf3e01ed19 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:46.825546 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b7cd988c-de6c-4997-b205-94bf3e01ed19 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] [instance: 308733f8-e53b-41e8-88a0-e5cdf0db8207] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:46.826843 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-37f891c9-ae5a-49ec-bc19-ab894a7d45f5 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "GET /compute/v2.1/servers/0c1c5b97-b093-4e28-93c9-b39687513dd6" status: 200 len: 1288 microversion: 2.1 time: 0.251413 Jun 05 08:33:46.827477 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1317/2578] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:46 2022] GET /compute/v2.1/servers/0c1c5b97-b093-4e28-93c9-b39687513dd6 => generated 1288 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:33:46.844609 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7caae3e2-d1d0-48ef-9314-9e03b28472b0 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:46.845516 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7caae3e2-d1d0-48ef-9314-9e03b28472b0 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:46.852839 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7caae3e2-d1d0-48ef-9314-9e03b28472b0 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:46.853304 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7caae3e2-d1d0-48ef-9314-9e03b28472b0 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:46.854093 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7caae3e2-d1d0-48ef-9314-9e03b28472b0 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:46.854659 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7caae3e2-d1d0-48ef-9314-9e03b28472b0 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:46.864506 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b7cd988c-de6c-4997-b205-94bf3e01ed19 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:46.867129 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b7cd988c-de6c-4997-b205-94bf3e01ed19 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:46.868697 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b7cd988c-de6c-4997-b205-94bf3e01ed19 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:46.872095 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b7cd988c-de6c-4997-b205-94bf3e01ed19 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:46.915525 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-b7cd988c-de6c-4997-b205-94bf3e01ed19 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] HTTP exception thrown: Instance 308733f8-e53b-41e8-88a0-e5cdf0db8207 could not be found. Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b7cd988c-de6c-4997-b205-94bf3e01ed19 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Request method failure captured: Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/308733f8-e53b-41e8-88a0-e5cdf0db8207 HTTP/1.1 Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGpcFqvE6VEMtCfmp-nU40NaseujDPkWYh54Ufp15_f3Q_kWYU68eyJFeG9jYUx5bT6DfZ9yJLzFcNo-069tYeRecSETQ_gNk6d_bOlPDc9IoSMekUUo8y7KGoKNL7h7zdcwLebK3IZgeCb8YjnOzL1jCBTZIolJkdcGOzwdXS_07Xo Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: dd38999f83494e22a3e5e090e03ec3e3 Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ServersTestJSON-661622954 Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dd38999f83494e22a3e5e090e03ec3e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd38999f83494e22a3e5e090e03ec3e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dd38999f83494e22a3e5e090e03ec3e3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd38999f83494e22a3e5e090e03ec3e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ServersTestJSON-661622954 Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: dd38999f83494e22a3e5e090e03ec3e3 Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ServersTestJSON-661622954 Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ServersTestJSON-661622954-project Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 9ce2809b953240219120a4cb9628b3b2 Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ServersTestJSON-661622954-project Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 308733f8-e53b-41e8-88a0-e5cdf0db8207 could not be found. Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '308733f8-e53b-41e8-88a0-e5cdf0db8207'} Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 308733f8-e53b-41e8-88a0-e5cdf0db8207 could not be found. Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 308733f8-e53b-41e8-88a0-e5cdf0db8207 could not be found. Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:46.919876 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:46.925321 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:46.925321 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:46.925321 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:33:46.925321 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:33:46.925321 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 308733f8-e53b-41e8-88a0-e5cdf0db8207 could not be found. Jun 05 08:33:46.925321 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:46.929175 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b7cd988c-de6c-4997-b205-94bf3e01ed19 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Returning 404 to user: Instance 308733f8-e53b-41e8-88a0-e5cdf0db8207 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:33:46.931563 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b7cd988c-de6c-4997-b205-94bf3e01ed19 tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] 10.222.0.33 "GET /compute/v2.1/servers/308733f8-e53b-41e8-88a0-e5cdf0db8207" status: 404 len: 111 microversion: 2.1 time: 0.118921 Jun 05 08:33:46.933524 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1262/2579] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:46 2022] GET /compute/v2.1/servers/308733f8-e53b-41e8-88a0-e5cdf0db8207 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:33:46.946205 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4ff0fc30-fc34-4f93-9b66-a17aa0f0cd98 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:46.948437 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4ff0fc30-fc34-4f93-9b66-a17aa0f0cd98 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] [instance: 9c64a374-2fe7-4eb3-b5af-dee9c990d4bf] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:47.191570 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4ff0fc30-fc34-4f93-9b66-a17aa0f0cd98 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e722d3ff6264f53a19f83386b0ac62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfe4b69d6214663b125d3a503ce91e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:47.206678 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4ff0fc30-fc34-4f93-9b66-a17aa0f0cd98 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] 10.222.0.33 "GET /compute/v2.1/servers/9c64a374-2fe7-4eb3-b5af-dee9c990d4bf" status: 200 len: 1213 microversion: 2.1 time: 0.271843 Jun 05 08:33:47.207996 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1263/2580] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:46 2022] GET /compute/v2.1/servers/9c64a374-2fe7-4eb3-b5af-dee9c990d4bf => generated 1213 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:33:47.215960 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-cb091d4f-7962-4c64-b427-3e6677f9b794 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:47.221674 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-cb091d4f-7962-4c64-b427-3e6677f9b794 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] [instance: 0c1c5b97-b093-4e28-93c9-b39687513dd6] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:47.225335 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=12,nova_api:INSERT=9 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:33:47.233290 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cb091d4f-7962-4c64-b427-3e6677f9b794 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:47.248984 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cb091d4f-7962-4c64-b427-3e6677f9b794 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:47.249941 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cb091d4f-7962-4c64-b427-3e6677f9b794 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:47.251335 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cb091d4f-7962-4c64-b427-3e6677f9b794 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:47.316932 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-cb091d4f-7962-4c64-b427-3e6677f9b794 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] [instance: 0c1c5b97-b093-4e28-93c9-b39687513dd6] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:33:47.413273 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-cb091d4f-7962-4c64-b427-3e6677f9b794 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] [instance: 0c1c5b97-b093-4e28-93c9-b39687513dd6] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:33:47.417023 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cb091d4f-7962-4c64-b427-3e6677f9b794 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:47.417688 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cb091d4f-7962-4c64-b427-3e6677f9b794 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:47.418126 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-cb091d4f-7962-4c64-b427-3e6677f9b794 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] [instance: 0c1c5b97-b093-4e28-93c9-b39687513dd6] instance's host None is down, deleting from database Jun 05 08:33:47.429895 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-cb091d4f-7962-4c64-b427-3e6677f9b794 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] [instance: 0c1c5b97-b093-4e28-93c9-b39687513dd6] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:33:47.554718 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-cb091d4f-7962-4c64-b427-3e6677f9b794 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] [instance: 0c1c5b97-b093-4e28-93c9-b39687513dd6] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:33:47.567272 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7caae3e2-d1d0-48ef-9314-9e03b28472b0 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:47.575902 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-cb091d4f-7962-4c64-b427-3e6677f9b794 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] [instance: 0c1c5b97-b093-4e28-93c9-b39687513dd6] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:33:47.584789 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7caae3e2-d1d0-48ef-9314-9e03b28472b0 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:47.594229 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7caae3e2-d1d0-48ef-9314-9e03b28472b0 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:47.596392 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7caae3e2-d1d0-48ef-9314-9e03b28472b0 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1728 microversion: 2.20 time: 0.755418 Jun 05 08:33:47.600870 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1318/2581] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:46 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1728 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:33:47.621492 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4389837f-35ef-4ea5-a947-564739bc91de tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] Calling method '.version_select at 0x7f243386cee0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:47.662481 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4389837f-35ef-4ea5-a947-564739bc91de tempest-ServersTestJSON-661622954 tempest-ServersTestJSON-661622954-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-280605666" status: 202 len: 0 microversion: 2.1 time: 0.060445 Jun 05 08:33:47.668997 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1319/2582] 10.222.0.33 () {58 vars in 1217 bytes} [Sun Jun 5 08:33:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-280605666 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:33:48.097587 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-cb091d4f-7962-4c64-b427-3e6677f9b794 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0c1c5b97-b093-4e28-93c9-b39687513dd6" status: 204 len: 0 microversion: 2.1 time: 0.888204 Jun 05 08:33:48.098205 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1264/2583] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:33:47 2022] DELETE /compute/v2.1/servers/0c1c5b97-b093-4e28-93c9-b39687513dd6 => generated 0 bytes in 889 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:33:48.127323 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-eb297714-05dc-460c-b243-6c42fbe0b27c tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:48.136726 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-eb297714-05dc-460c-b243-6c42fbe0b27c tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] [instance: 0c1c5b97-b093-4e28-93c9-b39687513dd6] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:48.155502 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-eb297714-05dc-460c-b243-6c42fbe0b27c tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:48.160674 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-eb297714-05dc-460c-b243-6c42fbe0b27c tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:48.164246 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-eb297714-05dc-460c-b243-6c42fbe0b27c tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:48.169363 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-eb297714-05dc-460c-b243-6c42fbe0b27c tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:48.213904 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-eb297714-05dc-460c-b243-6c42fbe0b27c tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] HTTP exception thrown: Instance 0c1c5b97-b093-4e28-93c9-b39687513dd6 could not be found. Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-eb297714-05dc-460c-b243-6c42fbe0b27c tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Request method failure captured: Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/0c1c5b97-b093-4e28-93c9-b39687513dd6 HTTP/1.1 Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGpib-ZK8SidNyrg6H5XRSXfosoROe5wT7voX_vBIw_2zj-mw9ztjy47EZwaCKl3eV9Wc5vOrfjToQ1AshN3RdkE-S0t1WvJzz7OTiL57Vaycuz75vyRFJgJqBGladF2f_APmIbmHHNdZW8Ocv-jxw5qoSLWJ4LysWm8Uu6DCCjMx5k Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: bca25b0072144b22a04124f80362a310 Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-SecurityGroupsTestJSON-1613578867 Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bca25b0072144b22a04124f80362a310"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bca25b0072144b22a04124f80362a310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bca25b0072144b22a04124f80362a310", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bca25b0072144b22a04124f80362a310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-SecurityGroupsTestJSON-1613578867 Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: bca25b0072144b22a04124f80362a310 Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1613578867 Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-SecurityGroupsTestJSON-1613578867-project Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 3f3f6d563ecb4a6c88931c63b04a0974 Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-SecurityGroupsTestJSON-1613578867-project Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 0c1c5b97-b093-4e28-93c9-b39687513dd6 could not be found. Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '0c1c5b97-b093-4e28-93c9-b39687513dd6'} Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c1c5b97-b093-4e28-93c9-b39687513dd6 could not be found. Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c1c5b97-b093-4e28-93c9-b39687513dd6 could not be found. Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:48.215874 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:48.219335 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:48.219335 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:48.219335 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:48.219335 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:33:48.219335 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:33:48.219335 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c1c5b97-b093-4e28-93c9-b39687513dd6 could not be found. Jun 05 08:33:48.219335 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:48.224937 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-eb297714-05dc-460c-b243-6c42fbe0b27c tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Returning 404 to user: Instance 0c1c5b97-b093-4e28-93c9-b39687513dd6 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:33:48.225261 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-913ec7fb-b560-4800-9db3-e063a38ee137 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:48.226039 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-913ec7fb-b560-4800-9db3-e063a38ee137 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] [instance: 9c64a374-2fe7-4eb3-b5af-dee9c990d4bf] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:48.226561 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-eb297714-05dc-460c-b243-6c42fbe0b27c tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "GET /compute/v2.1/servers/0c1c5b97-b093-4e28-93c9-b39687513dd6" status: 404 len: 111 microversion: 2.1 time: 0.122798 Jun 05 08:33:48.232410 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1320/2584] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:48 2022] GET /compute/v2.1/servers/0c1c5b97-b093-4e28-93c9-b39687513dd6 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 05 08:33:48.244319 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-913ec7fb-b560-4800-9db3-e063a38ee137 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:48.244786 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-913ec7fb-b560-4800-9db3-e063a38ee137 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:48.245588 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-913ec7fb-b560-4800-9db3-e063a38ee137 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:48.246032 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-913ec7fb-b560-4800-9db3-e063a38ee137 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:48.258461 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-df9499c7-1147-4203-bd06-9432ae56e73e tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Action: 'create', calling method: .version_select at 0x7f243386c550>, body: {"security_group": {"name": " tempest-securitygroup -20713740 ", "description": "tempest-description-46041873"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:48.318208 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-913ec7fb-b560-4800-9db3-e063a38ee137 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:48.318892 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-913ec7fb-b560-4800-9db3-e063a38ee137 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:48.319540 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-913ec7fb-b560-4800-9db3-e063a38ee137 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lazy-loading 'fault' on Instance uuid 9c64a374-2fe7-4eb3-b5af-dee9c990d4bf {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:33:48.445547 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-913ec7fb-b560-4800-9db3-e063a38ee137 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e722d3ff6264f53a19f83386b0ac62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfe4b69d6214663b125d3a503ce91e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:48.463006 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-913ec7fb-b560-4800-9db3-e063a38ee137 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] 10.222.0.33 "GET /compute/v2.1/servers/9c64a374-2fe7-4eb3-b5af-dee9c990d4bf" status: 200 len: 1286 microversion: 2.1 time: 0.241587 Jun 05 08:33:48.486996 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1265/2585] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:48 2022] GET /compute/v2.1/servers/9c64a374-2fe7-4eb3-b5af-dee9c990d4bf => generated 1286 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:33:48.504238 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4c730534-8b8d-476b-a690-a23638df2a18 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:48.511175 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4c730534-8b8d-476b-a690-a23638df2a18 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] [instance: 9c64a374-2fe7-4eb3-b5af-dee9c990d4bf] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:48.538434 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4c730534-8b8d-476b-a690-a23638df2a18 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:48.539205 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4c730534-8b8d-476b-a690-a23638df2a18 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:48.542863 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4c730534-8b8d-476b-a690-a23638df2a18 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:48.543655 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4c730534-8b8d-476b-a690-a23638df2a18 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:48.636849 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4c730534-8b8d-476b-a690-a23638df2a18 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] [instance: 9c64a374-2fe7-4eb3-b5af-dee9c990d4bf] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:33:48.772420 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4c730534-8b8d-476b-a690-a23638df2a18 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] [instance: 9c64a374-2fe7-4eb3-b5af-dee9c990d4bf] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:33:48.780795 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4c730534-8b8d-476b-a690-a23638df2a18 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:48.781966 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4c730534-8b8d-476b-a690-a23638df2a18 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:48.782541 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-4c730534-8b8d-476b-a690-a23638df2a18 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] [instance: 9c64a374-2fe7-4eb3-b5af-dee9c990d4bf] instance's host None is down, deleting from database Jun 05 08:33:48.787574 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-4c730534-8b8d-476b-a690-a23638df2a18 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] [instance: 9c64a374-2fe7-4eb3-b5af-dee9c990d4bf] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:33:49.965130 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-4c730534-8b8d-476b-a690-a23638df2a18 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] [instance: 9c64a374-2fe7-4eb3-b5af-dee9c990d4bf] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:33:49.976965 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-4c730534-8b8d-476b-a690-a23638df2a18 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] [instance: 9c64a374-2fe7-4eb3-b5af-dee9c990d4bf] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:33:50.292175 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-df9499c7-1147-4203-bd06-9432ae56e73e tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.051322 Jun 05 08:33:50.303462 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1321/2586] 10.222.0.33 () {60 vars in 1179 bytes} [Sun Jun 5 08:33:48 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:33:50.308349 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5fb52017-cac3-465b-aae1-56696d6dfc5b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:50.309227 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5fb52017-cac3-465b-aae1-56696d6dfc5b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:50.327322 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5fb52017-cac3-465b-aae1-56696d6dfc5b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:50.327813 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5fb52017-cac3-465b-aae1-56696d6dfc5b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:50.329353 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5fb52017-cac3-465b-aae1-56696d6dfc5b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:50.329805 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5fb52017-cac3-465b-aae1-56696d6dfc5b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:50.402470 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=72,nova_cell0:UPDATE=22,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:33:50.512381 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4c730534-8b8d-476b-a690-a23638df2a18 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9c64a374-2fe7-4eb3-b5af-dee9c990d4bf" status: 204 len: 0 microversion: 2.1 time: 2.024007 Jun 05 08:33:50.519165 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1266/2587] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:33:48 2022] DELETE /compute/v2.1/servers/9c64a374-2fe7-4eb3-b5af-dee9c990d4bf => generated 0 bytes in 2027 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:33:50.529617 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-52fbb397-1c4d-48d2-9e1b-6fc2d2c51884 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Calling method '.version_select at 0x7f24338de790>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:51.380626 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5fb52017-cac3-465b-aae1-56696d6dfc5b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:51.395831 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5fb52017-cac3-465b-aae1-56696d6dfc5b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:51.409073 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-52fbb397-1c4d-48d2-9e1b-6fc2d2c51884 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/a979965b-792d-4dd9-bc8c-d48c7e07ad5c" status: 200 len: 220 microversion: 2.1 time: 0.892036 Jun 05 08:33:51.410695 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1267/2588] 10.222.0.33 () {58 vars in 1268 bytes} [Sun Jun 5 08:33:50 2022] GET /compute/v2.1/os-security-groups/a979965b-792d-4dd9-bc8c-d48c7e07ad5c => generated 220 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:33:51.414678 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5fb52017-cac3-465b-aae1-56696d6dfc5b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:51.417285 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7e92b526-c814-4367-852c-9489fb5abfe9 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:51.421677 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7e92b526-c814-4367-852c-9489fb5abfe9 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] [instance: 9c64a374-2fe7-4eb3-b5af-dee9c990d4bf] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:51.426501 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5fb52017-cac3-465b-aae1-56696d6dfc5b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1728 microversion: 2.20 time: 1.121856 Jun 05 08:33:51.430251 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1322/2589] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:50 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1728 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:33:51.448396 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3af61174-5402-4d76-a5f9-5685adbb835d tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Calling method '.version_select at 0x7f2432ecc430>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:51.452293 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7e92b526-c814-4367-852c-9489fb5abfe9 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:51.455126 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7e92b526-c814-4367-852c-9489fb5abfe9 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:51.457733 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7e92b526-c814-4367-852c-9489fb5abfe9 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:51.459218 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7e92b526-c814-4367-852c-9489fb5abfe9 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:51.504920 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-7e92b526-c814-4367-852c-9489fb5abfe9 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] HTTP exception thrown: Instance 9c64a374-2fe7-4eb3-b5af-dee9c990d4bf could not be found. Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7e92b526-c814-4367-852c-9489fb5abfe9 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Request method failure captured: Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/9c64a374-2fe7-4eb3-b5af-dee9c990d4bf HTTP/1.1 Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGplfMQ7TNg7jAPQDOQKZLDZ0zcvGk3v2MHl8rVh8YjPvVPn5eXmDVJkkUUaNTnImkGkf1fU9zuorjzVNn8uN5ZGQwEJDIWVq7Zz6LfEHqisAiRzNgUeGr2EpnVTlSoiYcq1QW0COpEXDJp4CMkiblHpzAtscLwGy45fPSnVnTJC55M Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 5cfe4b69d6214663b125d3a503ce91e5 Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ServersAdminTestJSON-228232109 Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5cfe4b69d6214663b125d3a503ce91e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cfe4b69d6214663b125d3a503ce91e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5cfe4b69d6214663b125d3a503ce91e5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cfe4b69d6214663b125d3a503ce91e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ServersAdminTestJSON-228232109 Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 5cfe4b69d6214663b125d3a503ce91e5 Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ServersAdminTestJSON-228232109 Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ServersAdminTestJSON-228232109-project Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 2e722d3ff6264f53a19f83386b0ac62e Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ServersAdminTestJSON-228232109-project Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 9c64a374-2fe7-4eb3-b5af-dee9c990d4bf could not be found. Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '9c64a374-2fe7-4eb3-b5af-dee9c990d4bf'} Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c64a374-2fe7-4eb3-b5af-dee9c990d4bf could not be found. Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c64a374-2fe7-4eb3-b5af-dee9c990d4bf could not be found. Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:51.511814 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:51.516168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:51.516168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:51.516168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:51.516168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:33:51.516168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:33:51.516168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c64a374-2fe7-4eb3-b5af-dee9c990d4bf could not be found. Jun 05 08:33:51.516168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:51.518968 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7e92b526-c814-4367-852c-9489fb5abfe9 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Returning 404 to user: Instance 9c64a374-2fe7-4eb3-b5af-dee9c990d4bf could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:33:51.522251 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7e92b526-c814-4367-852c-9489fb5abfe9 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] 10.222.0.33 "GET /compute/v2.1/servers/9c64a374-2fe7-4eb3-b5af-dee9c990d4bf" status: 404 len: 111 microversion: 2.1 time: 0.108894 Jun 05 08:33:51.525141 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1268/2590] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:51 2022] GET /compute/v2.1/servers/9c64a374-2fe7-4eb3-b5af-dee9c990d4bf => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:33:51.540864 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2f7426d9-6f16-4835-9275-3f085aa1cc6b tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:51.542840 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2f7426d9-6f16-4835-9275-3f085aa1cc6b tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] [instance: 532c0c14-0a05-434f-b294-a21872033cb4] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:51.555005 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2f7426d9-6f16-4835-9275-3f085aa1cc6b tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:51.555822 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2f7426d9-6f16-4835-9275-3f085aa1cc6b tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:51.557691 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2f7426d9-6f16-4835-9275-3f085aa1cc6b tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:51.558318 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2f7426d9-6f16-4835-9275-3f085aa1cc6b tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:51.605805 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2f7426d9-6f16-4835-9275-3f085aa1cc6b tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] [instance: 532c0c14-0a05-434f-b294-a21872033cb4] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:33:51.725655 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2f7426d9-6f16-4835-9275-3f085aa1cc6b tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] [instance: 532c0c14-0a05-434f-b294-a21872033cb4] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:33:51.732740 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2f7426d9-6f16-4835-9275-3f085aa1cc6b tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:51.737034 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2f7426d9-6f16-4835-9275-3f085aa1cc6b tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:51.739521 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-2f7426d9-6f16-4835-9275-3f085aa1cc6b tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] [instance: 532c0c14-0a05-434f-b294-a21872033cb4] instance's host None is down, deleting from database Jun 05 08:33:51.752307 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-2f7426d9-6f16-4835-9275-3f085aa1cc6b tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] [instance: 532c0c14-0a05-434f-b294-a21872033cb4] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:33:51.906752 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-2f7426d9-6f16-4835-9275-3f085aa1cc6b tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] [instance: 532c0c14-0a05-434f-b294-a21872033cb4] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:33:51.917115 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-2f7426d9-6f16-4835-9275-3f085aa1cc6b tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] [instance: 532c0c14-0a05-434f-b294-a21872033cb4] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:33:52.452746 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2f7426d9-6f16-4835-9275-3f085aa1cc6b tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] 10.222.0.33 "DELETE /compute/v2.1/servers/532c0c14-0a05-434f-b294-a21872033cb4" status: 204 len: 0 microversion: 2.1 time: 0.923037 Jun 05 08:33:52.458371 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1269/2591] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:33:51 2022] DELETE /compute/v2.1/servers/532c0c14-0a05-434f-b294-a21872033cb4 => generated 0 bytes in 929 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 05 08:33:52.481162 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-962c0709-0507-426f-a2a6-3a989173ed9c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:52.486553 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-962c0709-0507-426f-a2a6-3a989173ed9c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:52.512070 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-962c0709-0507-426f-a2a6-3a989173ed9c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:52.519288 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-962c0709-0507-426f-a2a6-3a989173ed9c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:52.522942 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-962c0709-0507-426f-a2a6-3a989173ed9c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:52.523735 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-962c0709-0507-426f-a2a6-3a989173ed9c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:53.150951 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=10 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:33:53.682021 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-962c0709-0507-426f-a2a6-3a989173ed9c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:53.710413 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-962c0709-0507-426f-a2a6-3a989173ed9c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:53.715129 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-962c0709-0507-426f-a2a6-3a989173ed9c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:53.719325 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-962c0709-0507-426f-a2a6-3a989173ed9c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1728 microversion: 2.20 time: 1.253603 Jun 05 08:33:53.735217 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1270/2592] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:52 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1728 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:33:53.744300 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-62dece2a-06a1-4017-870d-fdc21e0f85a8 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:53.748783 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-62dece2a-06a1-4017-870d-fdc21e0f85a8 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] [instance: 532c0c14-0a05-434f-b294-a21872033cb4] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:53.764547 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-62dece2a-06a1-4017-870d-fdc21e0f85a8 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:53.773744 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-62dece2a-06a1-4017-870d-fdc21e0f85a8 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:53.779272 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-62dece2a-06a1-4017-870d-fdc21e0f85a8 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:53.779919 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-62dece2a-06a1-4017-870d-fdc21e0f85a8 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:53.820012 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-62dece2a-06a1-4017-870d-fdc21e0f85a8 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] HTTP exception thrown: Instance 532c0c14-0a05-434f-b294-a21872033cb4 could not be found. Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-62dece2a-06a1-4017-870d-fdc21e0f85a8 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Request method failure captured: Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/532c0c14-0a05-434f-b294-a21872033cb4 HTTP/1.1 Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGplfMQ7TNg7jAPQDOQKZLDZ0zcvGk3v2MHl8rVh8YjPvVPn5eXmDVJkkUUaNTnImkGkf1fU9zuorjzVNn8uN5ZGQwEJDIWVq7Zz6LfEHqisAiRzNgUeGr2EpnVTlSoiYcq1QW0COpEXDJp4CMkiblHpzAtscLwGy45fPSnVnTJC55M Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 5cfe4b69d6214663b125d3a503ce91e5 Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ServersAdminTestJSON-228232109 Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5cfe4b69d6214663b125d3a503ce91e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cfe4b69d6214663b125d3a503ce91e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5cfe4b69d6214663b125d3a503ce91e5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cfe4b69d6214663b125d3a503ce91e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ServersAdminTestJSON-228232109 Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 5cfe4b69d6214663b125d3a503ce91e5 Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ServersAdminTestJSON-228232109 Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ServersAdminTestJSON-228232109-project Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 2e722d3ff6264f53a19f83386b0ac62e Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ServersAdminTestJSON-228232109-project Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 532c0c14-0a05-434f-b294-a21872033cb4 could not be found. Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '532c0c14-0a05-434f-b294-a21872033cb4'} Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 532c0c14-0a05-434f-b294-a21872033cb4 could not be found. Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 532c0c14-0a05-434f-b294-a21872033cb4 could not be found. Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:53.822743 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:53.829886 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:53.829886 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:53.829886 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:53.829886 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:33:53.829886 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:33:53.829886 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 532c0c14-0a05-434f-b294-a21872033cb4 could not be found. Jun 05 08:33:53.829886 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:33:53.829886 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-62dece2a-06a1-4017-870d-fdc21e0f85a8 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] Returning 404 to user: Instance 532c0c14-0a05-434f-b294-a21872033cb4 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:33:53.829886 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-62dece2a-06a1-4017-870d-fdc21e0f85a8 tempest-ServersAdminTestJSON-228232109 tempest-ServersAdminTestJSON-228232109-project] 10.222.0.33 "GET /compute/v2.1/servers/532c0c14-0a05-434f-b294-a21872033cb4" status: 404 len: 111 microversion: 2.1 time: 0.092588 Jun 05 08:33:53.830850 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1271/2593] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:33:53 2022] GET /compute/v2.1/servers/532c0c14-0a05-434f-b294-a21872033cb4 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:33:54.746628 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-65aa80c6-9133-4d18-91a1-fee241844513 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:54.747968 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-65aa80c6-9133-4d18-91a1-fee241844513 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:54.781252 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-65aa80c6-9133-4d18-91a1-fee241844513 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:54.790205 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-65aa80c6-9133-4d18-91a1-fee241844513 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:54.792587 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-65aa80c6-9133-4d18-91a1-fee241844513 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:54.801833 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-65aa80c6-9133-4d18-91a1-fee241844513 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:54.920554 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3af61174-5402-4d76-a5f9-5685adbb835d tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/a979965b-792d-4dd9-bc8c-d48c7e07ad5c" status: 202 len: 0 microversion: 2.1 time: 3.488999 Jun 05 08:33:54.921728 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1323/2594] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:33:51 2022] DELETE /compute/v2.1/os-security-groups/a979965b-792d-4dd9-bc8c-d48c7e07ad5c => generated 0 bytes in 3491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:33:54.931947 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-42caa671-581b-40cf-80c9-4808b25957ef tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Calling method '.version_select at 0x7f2432eeb160>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:55.212269 n-d-844739-1 devstack@n-api.service[119050]: DEBUG neutronclient.v2_0.client [None req-42caa671-581b-40cf-80c9-4808b25957ef tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a979965b-792d-4dd9-bc8c-d48c7e07ad5c does not exist", "detail": ""}} {{(pid=119050) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 05 08:33:55.213536 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.security_group_api [None req-42caa671-581b-40cf-80c9-4808b25957ef tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Neutron security group a979965b-792d-4dd9-bc8c-d48c7e07ad5c not found {{(pid=119050) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 05 08:33:55.214224 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-42caa671-581b-40cf-80c9-4808b25957ef tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] HTTP exception thrown: Security group a979965b-792d-4dd9-bc8c-d48c7e07ad5c does not exist Jun 05 08:33:55.214224 n-d-844739-1 devstack@n-api.service[119050]: Neutron server returns request_ids: ['req-e569cc4b-907a-4336-b52a-7a28dd92327f'] Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-42caa671-581b-40cf-80c9-4808b25957ef tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Request method failure captured: Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-security-groups/a979965b-792d-4dd9-bc8c-d48c7e07ad5c HTTP/1.1 Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGpib-ZK8SidNyrg6H5XRSXfosoROe5wT7voX_vBIw_2zj-mw9ztjy47EZwaCKl3eV9Wc5vOrfjToQ1AshN3RdkE-S0t1WvJzz7OTiL57Vaycuz75vyRFJgJqBGladF2f_APmIbmHHNdZW8Ocv-jxw5qoSLWJ4LysWm8Uu6DCCjMx5k Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: bca25b0072144b22a04124f80362a310 Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-SecurityGroupsTestJSON-1613578867 Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bca25b0072144b22a04124f80362a310"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bca25b0072144b22a04124f80362a310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bca25b0072144b22a04124f80362a310", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bca25b0072144b22a04124f80362a310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-SecurityGroupsTestJSON-1613578867 Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: bca25b0072144b22a04124f80362a310 Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1613578867 Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-SecurityGroupsTestJSON-1613578867-project Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 3f3f6d563ecb4a6c88931c63b04a0974 Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-SecurityGroupsTestJSON-1613578867-project Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: exception: Security group a979965b-792d-4dd9-bc8c-d48c7e07ad5c does not exist Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: Neutron server returns request_ids: ['req-e569cc4b-907a-4336-b52a-7a28dd92327f'] Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'a979965b-792d-4dd9-bc8c-d48c7e07ad5c'} Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 05 08:33:55.218891 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a979965b-792d-4dd9-bc8c-d48c7e07ad5c does not exist Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e569cc4b-907a-4336-b52a-7a28dd92327f'] Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a979965b-792d-4dd9-bc8c-d48c7e07ad5c does not exist Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e569cc4b-907a-4336-b52a-7a28dd92327f'] Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a979965b-792d-4dd9-bc8c-d48c7e07ad5c does not exist Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e569cc4b-907a-4336-b52a-7a28dd92327f'] Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a979965b-792d-4dd9-bc8c-d48c7e07ad5c does not exist Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e569cc4b-907a-4336-b52a-7a28dd92327f'] Jun 05 08:33:55.223787 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:33:55.227256 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-42caa671-581b-40cf-80c9-4808b25957ef tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Returning 404 to user: Security group a979965b-792d-4dd9-bc8c-d48c7e07ad5c does not exist Jun 05 08:33:55.227256 n-d-844739-1 devstack@n-api.service[119050]: Neutron server returns request_ids: ['req-e569cc4b-907a-4336-b52a-7a28dd92327f'] {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:33:55.237383 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-42caa671-581b-40cf-80c9-4808b25957ef tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/a979965b-792d-4dd9-bc8c-d48c7e07ad5c" status: 404 len: 194 microversion: 2.1 time: 0.310523 Jun 05 08:33:55.238555 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1324/2595] 10.222.0.33 () {58 vars in 1268 bytes} [Sun Jun 5 08:33:54 2022] GET /compute/v2.1/os-security-groups/a979965b-792d-4dd9-bc8c-d48c7e07ad5c => generated 194 bytes in 312 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 05 08:33:55.251800 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e4e4629e-c108-41dc-b186-07b26e9bd651 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Action: 'create', calling method: .version_select at 0x7f2432ecc9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1673002932", "description": "tempest-description-693470466"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:56.239069 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-65aa80c6-9133-4d18-91a1-fee241844513 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:56.256971 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-65aa80c6-9133-4d18-91a1-fee241844513 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:56.262862 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-65aa80c6-9133-4d18-91a1-fee241844513 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:56.265442 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-65aa80c6-9133-4d18-91a1-fee241844513 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1728 microversion: 2.20 time: 1.530590 Jun 05 08:33:56.281789 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1272/2596] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:54 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1728 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:33:56.970766 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e4e4629e-c108-41dc-b186-07b26e9bd651 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.726303 Jun 05 08:33:56.972529 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1325/2597] 10.222.0.33 () {60 vars in 1179 bytes} [Sun Jun 5 08:33:55 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:33:56.985293 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-cb2d1ce5-c99b-4208-8a04-a17d05964f21 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Action: 'create', calling method: .version_select at 0x7f243392f3a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-253293218", "description": "tempest-description-578373238"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:57.196153 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=52,nova_cell0:UPDATE=7 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:33:57.289406 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9ea8772e-c8da-4265-9518-636d4f27854b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:57.290040 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9ea8772e-c8da-4265-9518-636d4f27854b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:57.303002 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:33:57.310615 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9ea8772e-c8da-4265-9518-636d4f27854b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:57.311092 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9ea8772e-c8da-4265-9518-636d4f27854b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:57.315246 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9ea8772e-c8da-4265-9518-636d4f27854b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:57.316914 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9ea8772e-c8da-4265-9518-636d4f27854b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:58.213865 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=52,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:33:58.758527 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-9ea8772e-c8da-4265-9518-636d4f27854b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:58.790802 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-9ea8772e-c8da-4265-9518-636d4f27854b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:58.801561 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-9ea8772e-c8da-4265-9518-636d4f27854b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:33:58.834217 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9ea8772e-c8da-4265-9518-636d4f27854b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1728 microversion: 2.20 time: 1.539624 Jun 05 08:33:58.846608 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1326/2598] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:57 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1728 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:33:59.159306 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-cb2d1ce5-c99b-4208-8a04-a17d05964f21 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 2.178843 Jun 05 08:33:59.162326 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1273/2599] 10.222.0.33 () {60 vars in 1179 bytes} [Sun Jun 5 08:33:56 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 2183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:33:59.176912 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-56d9ba09-3453-4fb6-8d35-59a4074278b0 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Action: 'create', calling method: .version_select at 0x7f2432ef5280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1239989628", "description": "tempest-description-1021930575"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:33:59.870460 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2eed3977-a763-4a40-85fb-2c363020651c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:33:59.877030 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2eed3977-a763-4a40-85fb-2c363020651c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:33:59.920946 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2eed3977-a763-4a40-85fb-2c363020651c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:59.931256 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2eed3977-a763-4a40-85fb-2c363020651c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:33:59.934104 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2eed3977-a763-4a40-85fb-2c363020651c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:33:59.935218 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2eed3977-a763-4a40-85fb-2c363020651c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:01.325241 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2eed3977-a763-4a40-85fb-2c363020651c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:01.371282 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2eed3977-a763-4a40-85fb-2c363020651c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:01.377885 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2eed3977-a763-4a40-85fb-2c363020651c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:01.384095 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2eed3977-a763-4a40-85fb-2c363020651c tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1728 microversion: 2.20 time: 1.529661 Jun 05 08:34:01.385888 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1274/2600] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:33:59 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1728 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:34:02.246972 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5d38cc99-8360-4aee-a93a-e099660fcdc0 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:02.248258 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5d38cc99-8360-4aee-a93a-e099660fcdc0 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:34:02.258823 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5d38cc99-8360-4aee-a93a-e099660fcdc0 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:02.259696 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5d38cc99-8360-4aee-a93a-e099660fcdc0 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:02.260996 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5d38cc99-8360-4aee-a93a-e099660fcdc0 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:02.261690 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5d38cc99-8360-4aee-a93a-e099660fcdc0 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:02.329995 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-56d9ba09-3453-4fb6-8d35-59a4074278b0 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 3.160705 Jun 05 08:34:02.332087 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1327/2601] 10.222.0.33 () {60 vars in 1179 bytes} [Sun Jun 5 08:33:59 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 3162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:34:02.341222 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7000ddaf-b1e0-49f0-83f2-6f0a756d7fb7 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Calling method '.version_select at 0x7f2433d73d30>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:03.563513 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5d38cc99-8360-4aee-a93a-e099660fcdc0 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:03.591901 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5d38cc99-8360-4aee-a93a-e099660fcdc0 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:03.598435 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5d38cc99-8360-4aee-a93a-e099660fcdc0 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:03.602957 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5d38cc99-8360-4aee-a93a-e099660fcdc0 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 2948 microversion: 2.42 time: 2.212567 Jun 05 08:34:03.604114 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1275/2602] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:34:01 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 2948 bytes in 2217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:34:03.647600 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-aee9825d-6a44-40cf-ad1c-5745513294f3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:03.648505 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-aee9825d-6a44-40cf-ad1c-5745513294f3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:34:03.670973 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aee9825d-6a44-40cf-ad1c-5745513294f3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:03.671565 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aee9825d-6a44-40cf-ad1c-5745513294f3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:03.677340 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aee9825d-6a44-40cf-ad1c-5745513294f3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:03.678153 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aee9825d-6a44-40cf-ad1c-5745513294f3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:03.799079 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:UPDATE=23,nova_cell0:DELETE=4,nova_cell0:SELECT=28,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:34:04.518096 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-aee9825d-6a44-40cf-ad1c-5745513294f3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:04.526674 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7000ddaf-b1e0-49f0-83f2-6f0a756d7fb7 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 2.189209 Jun 05 08:34:04.534665 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1328/2603] 10.222.0.33 () {58 vars in 1157 bytes} [Sun Jun 5 08:34:02 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 2191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:34:04.534665 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6278a920-dc38-414f-a4ca-a13dcf353b61 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:04.534665 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6278a920-dc38-414f-a4ca-a13dcf353b61 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:34:04.535019 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-aee9825d-6a44-40cf-ad1c-5745513294f3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:04.535906 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-aee9825d-6a44-40cf-ad1c-5745513294f3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:04.537126 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-aee9825d-6a44-40cf-ad1c-5745513294f3 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1728 microversion: 2.20 time: 0.915224 Jun 05 08:34:04.541653 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1276/2604] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:34:03 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1728 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:34:04.552518 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6278a920-dc38-414f-a4ca-a13dcf353b61 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:04.555072 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6278a920-dc38-414f-a4ca-a13dcf353b61 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:04.558344 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2ab2f465-5668-4eae-9487-e8387e3aa413 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Calling method '.version_select at 0x7f2433716940>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:04.558791 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6278a920-dc38-414f-a4ca-a13dcf353b61 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:04.559459 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6278a920-dc38-414f-a4ca-a13dcf353b61 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:05.909829 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6278a920-dc38-414f-a4ca-a13dcf353b61 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085/os-interface" status: 200 len: 1832 microversion: 2.42 time: 1.381376 Jun 05 08:34:05.910478 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1329/2605] 10.222.0.33 () {60 vars in 1315 bytes} [Sun Jun 5 08:34:04 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085/os-interface => generated 1832 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:34:06.256639 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a1b8a45a-d62f-4745-b735-3e710bfdda1f tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:06.258042 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:34:06.258042 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:34:06.259343 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a1b8a45a-d62f-4745-b735-3e710bfdda1f tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:06.259804 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a1b8a45a-d62f-4745-b735-3e710bfdda1f tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:06.262508 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a1b8a45a-d62f-4745-b735-3e710bfdda1f tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:06.264446 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a1b8a45a-d62f-4745-b735-3e710bfdda1f tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:06.281922 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:34:06.352208 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a1b8a45a-d62f-4745-b735-3e710bfdda1f tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.440434 Jun 05 08:34:06.352777 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1330/2606] 10.222.0.33 () {58 vars in 1136 bytes} [Sun Jun 5 08:34:05 2022] GET /compute/v2.1/os-services => generated 944 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:34:06.373335 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0fa41538-0fc8-4e4a-89d2-3730cf774b7e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:06.374018 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0fa41538-0fc8-4e4a-89d2-3730cf774b7e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:34:06.390147 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0fa41538-0fc8-4e4a-89d2-3730cf774b7e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:06.391344 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0fa41538-0fc8-4e4a-89d2-3730cf774b7e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:06.392317 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0fa41538-0fc8-4e4a-89d2-3730cf774b7e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:06.392780 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0fa41538-0fc8-4e4a-89d2-3730cf774b7e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:06.764081 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2ab2f465-5668-4eae-9487-e8387e3aa413 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/5cdd5ef7-da0a-4b42-a40a-27d58b926789" status: 202 len: 0 microversion: 2.1 time: 2.221208 Jun 05 08:34:06.764683 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1277/2607] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:34:04 2022] DELETE /compute/v2.1/os-security-groups/5cdd5ef7-da0a-4b42-a40a-27d58b926789 => generated 0 bytes in 2222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:34:06.770966 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-72894b9f-b439-4a92-9756-7c32ce1d366f tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:06.772235 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:34:06.772235 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:34:06.792123 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-72894b9f-b439-4a92-9756-7c32ce1d366f tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:06.803147 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-72894b9f-b439-4a92-9756-7c32ce1d366f tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:06.806198 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-72894b9f-b439-4a92-9756-7c32ce1d366f tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:06.807490 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-72894b9f-b439-4a92-9756-7c32ce1d366f tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:06.845333 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0fa41538-0fc8-4e4a-89d2-3730cf774b7e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:06.859095 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0fa41538-0fc8-4e4a-89d2-3730cf774b7e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:06.865318 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0fa41538-0fc8-4e4a-89d2-3730cf774b7e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:06.867111 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0fa41538-0fc8-4e4a-89d2-3730cf774b7e tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1728 microversion: 2.20 time: 0.513381 Jun 05 08:34:06.870512 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1331/2608] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:34:06 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1728 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:34:06.871299 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-72894b9f-b439-4a92-9756-7c32ce1d366f tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.105541 Jun 05 08:34:06.872485 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1278/2609] 10.222.0.33 () {58 vars in 1169 bytes} [Sun Jun 5 08:34:06 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:34:06.885303 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-33157aec-f3d1-48d1-ad32-c7d00d17798c tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Calling method '.version_select at 0x7f2432ecba60>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:06.900516 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b39f557a-8f74-4fcf-9f98-3838093732b7 tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:06.901346 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:34:06.901346 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:34:06.903767 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b39f557a-8f74-4fcf-9f98-3838093732b7 tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:06.904254 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b39f557a-8f74-4fcf-9f98-3838093732b7 tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:06.905060 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b39f557a-8f74-4fcf-9f98-3838093732b7 tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:06.905494 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b39f557a-8f74-4fcf-9f98-3838093732b7 tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:06.990835 n-d-844739-1 devstack@n-api.service[119050]: DEBUG neutronclient.v2_0.client [None req-33157aec-f3d1-48d1-ad32-c7d00d17798c tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5cdd5ef7-da0a-4b42-a40a-27d58b926789 does not exist", "detail": ""}} {{(pid=119050) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 05 08:34:06.992026 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.security_group_api [None req-33157aec-f3d1-48d1-ad32-c7d00d17798c tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Neutron security group 5cdd5ef7-da0a-4b42-a40a-27d58b926789 not found {{(pid=119050) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 05 08:34:06.993818 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-33157aec-f3d1-48d1-ad32-c7d00d17798c tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] HTTP exception thrown: Security group 5cdd5ef7-da0a-4b42-a40a-27d58b926789 does not exist Jun 05 08:34:06.993818 n-d-844739-1 devstack@n-api.service[119050]: Neutron server returns request_ids: ['req-32d1c500-4e99-486c-8080-bb0a535662a4'] Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-33157aec-f3d1-48d1-ad32-c7d00d17798c tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Request method failure captured: Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-security-groups/5cdd5ef7-da0a-4b42-a40a-27d58b926789 HTTP/1.1 Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGpib-ZK8SidNyrg6H5XRSXfosoROe5wT7voX_vBIw_2zj-mw9ztjy47EZwaCKl3eV9Wc5vOrfjToQ1AshN3RdkE-S0t1WvJzz7OTiL57Vaycuz75vyRFJgJqBGladF2f_APmIbmHHNdZW8Ocv-jxw5qoSLWJ4LysWm8Uu6DCCjMx5k Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: bca25b0072144b22a04124f80362a310 Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-SecurityGroupsTestJSON-1613578867 Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bca25b0072144b22a04124f80362a310"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bca25b0072144b22a04124f80362a310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bca25b0072144b22a04124f80362a310", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bca25b0072144b22a04124f80362a310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-SecurityGroupsTestJSON-1613578867 Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: bca25b0072144b22a04124f80362a310 Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1613578867 Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-SecurityGroupsTestJSON-1613578867-project Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 3f3f6d563ecb4a6c88931c63b04a0974 Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-SecurityGroupsTestJSON-1613578867-project Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: exception: Security group 5cdd5ef7-da0a-4b42-a40a-27d58b926789 does not exist Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: Neutron server returns request_ids: ['req-32d1c500-4e99-486c-8080-bb0a535662a4'] Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '5cdd5ef7-da0a-4b42-a40a-27d58b926789'} Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 05 08:34:06.997370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5cdd5ef7-da0a-4b42-a40a-27d58b926789 does not exist Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32d1c500-4e99-486c-8080-bb0a535662a4'] Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5cdd5ef7-da0a-4b42-a40a-27d58b926789 does not exist Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32d1c500-4e99-486c-8080-bb0a535662a4'] Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5cdd5ef7-da0a-4b42-a40a-27d58b926789 does not exist Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32d1c500-4e99-486c-8080-bb0a535662a4'] Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5cdd5ef7-da0a-4b42-a40a-27d58b926789 does not exist Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32d1c500-4e99-486c-8080-bb0a535662a4'] Jun 05 08:34:07.005581 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:07.010996 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b39f557a-8f74-4fcf-9f98-3838093732b7 tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.104646 Jun 05 08:34:07.010996 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1279/2610] 10.222.0.33 () {58 vars in 1136 bytes} [Sun Jun 5 08:34:06 2022] GET /compute/v2.1/os-services => generated 944 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:34:07.012938 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-33157aec-f3d1-48d1-ad32-c7d00d17798c tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Returning 404 to user: Security group 5cdd5ef7-da0a-4b42-a40a-27d58b926789 does not exist Jun 05 08:34:07.012938 n-d-844739-1 devstack@n-api.service[119050]: Neutron server returns request_ids: ['req-32d1c500-4e99-486c-8080-bb0a535662a4'] {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:34:07.012938 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-33157aec-f3d1-48d1-ad32-c7d00d17798c tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/5cdd5ef7-da0a-4b42-a40a-27d58b926789" status: 404 len: 194 microversion: 2.1 time: 0.132932 Jun 05 08:34:07.012938 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1332/2611] 10.222.0.33 () {58 vars in 1268 bytes} [Sun Jun 5 08:34:06 2022] GET /compute/v2.1/os-security-groups/5cdd5ef7-da0a-4b42-a40a-27d58b926789 => generated 194 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:34:07.033580 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e678dedb-1113-45b5-b294-ae23ea25101f tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Calling method '.version_select at 0x7f2432ef5e50>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:07.037583 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-07240d53-d73e-4c4b-ac82-fdc85914abfd tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:07.039060 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:34:07.039060 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:34:07.046827 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-07240d53-d73e-4c4b-ac82-fdc85914abfd tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:07.047468 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-07240d53-d73e-4c4b-ac82-fdc85914abfd tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:07.051042 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-07240d53-d73e-4c4b-ac82-fdc85914abfd tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:07.051548 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-07240d53-d73e-4c4b-ac82-fdc85914abfd tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:07.120584 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-07240d53-d73e-4c4b-ac82-fdc85914abfd tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=n-d-844739-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.107296 Jun 05 08:34:07.121648 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1280/2612] 10.222.0.33 () {58 vars in 1193 bytes} [Sun Jun 5 08:34:07 2022] GET /compute/v2.1/os-services?host=n-d-844739-1&binary=xxx => generated 16 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 05 08:34:07.132674 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0e279731-d1c5-4e08-9aa2-0cf7f39f9e38 tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:07.134119 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:34:07.134119 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:34:07.135525 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0e279731-d1c5-4e08-9aa2-0cf7f39f9e38 tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:07.136175 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0e279731-d1c5-4e08-9aa2-0cf7f39f9e38 tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:07.137120 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0e279731-d1c5-4e08-9aa2-0cf7f39f9e38 tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:07.137738 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0e279731-d1c5-4e08-9aa2-0cf7f39f9e38 tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:07.189433 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0e279731-d1c5-4e08-9aa2-0cf7f39f9e38 tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.060292 Jun 05 08:34:07.190671 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1281/2613] 10.222.0.33 () {58 vars in 1136 bytes} [Sun Jun 5 08:34:07 2022] GET /compute/v2.1/os-services => generated 944 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:34:07.201441 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-76a6e1a7-9c33-4790-abe7-303452749daf tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:07.206230 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:34:07.206230 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:34:07.208095 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-76a6e1a7-9c33-4790-abe7-303452749daf tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:07.210335 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-76a6e1a7-9c33-4790-abe7-303452749daf tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:07.213922 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-76a6e1a7-9c33-4790-abe7-303452749daf tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:07.214578 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-76a6e1a7-9c33-4790-abe7-303452749daf tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:07.277182 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-76a6e1a7-9c33-4790-abe7-303452749daf tempest-ServicesAdminNegativeTestJSON-1513298364 tempest-ServicesAdminNegativeTestJSON-1513298364-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.077073 Jun 05 08:34:07.279542 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1282/2614] 10.222.0.33 () {58 vars in 1197 bytes} [Sun Jun 5 08:34:07 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 05 08:34:07.513797 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1dc3518f-51c0-427b-b287-24dee1ca122c tempest-ServicesAdminNegativeTestJSON-849101063 tempest-ServicesAdminNegativeTestJSON-849101063-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:07.515249 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:34:07.515249 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:34:07.517745 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-1dc3518f-51c0-427b-b287-24dee1ca122c tempest-ServicesAdminNegativeTestJSON-849101063 tempest-ServicesAdminNegativeTestJSON-849101063-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '5128c246c1d5421a8a6fbc5140c07eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a2d042c02f4d5e93ce3fb635f83c4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1dc3518f-51c0-427b-b287-24dee1ca122c tempest-ServicesAdminNegativeTestJSON-849101063 tempest-ServicesAdminNegativeTestJSON-849101063-project] Request method failure captured: Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/os-services HTTP/1.1 Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGp7AoYBbA1ngce1hfW-RXaZpYOORSzbrEJ7pvWK1nAG-rwBAJOYJb-8-XyLw-_2TO8yutHq7KVA6hMGatSi3Oo6E0ef0yTIoHFc7F9zJil6cXpqaJQcYyvHsKvHSftqx-9LEL02kQQbZWFlqJXSZwMhJYwtOjl6Pyqtuy2rDwW_u7I Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: a5a2d042c02f4d5e93ce3fb635f83c4e Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-849101063 Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a5a2d042c02f4d5e93ce3fb635f83c4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a5a2d042c02f4d5e93ce3fb635f83c4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a5a2d042c02f4d5e93ce3fb635f83c4e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a5a2d042c02f4d5e93ce3fb635f83c4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-849101063 Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: a5a2d042c02f4d5e93ce3fb635f83c4e Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-849101063 Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ServicesAdminNegativeTestJSON-849101063-project Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 5128c246c1d5421a8a6fbc5140c07eb2 Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-849101063-project Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: action_args: {} Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise self.value Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 05 08:34:07.519376 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:07.522832 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:34:07.522832 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:07.522832 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:07.522832 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:34:07.522832 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:34:07.522832 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 05 08:34:07.522832 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 05 08:34:07.522832 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 05 08:34:07.522832 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:07.522832 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1dc3518f-51c0-427b-b287-24dee1ca122c tempest-ServicesAdminNegativeTestJSON-849101063 tempest-ServicesAdminNegativeTestJSON-849101063-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:34:07.525616 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1dc3518f-51c0-427b-b287-24dee1ca122c tempest-ServicesAdminNegativeTestJSON-849101063 tempest-ServicesAdminNegativeTestJSON-849101063-project] 10.222.0.33 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.233637 Jun 05 08:34:07.527054 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1283/2615] 10.222.0.33 () {58 vars in 1136 bytes} [Sun Jun 5 08:34:07 2022] GET /compute/v2.1/os-services => generated 112 bytes in 240 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jun 05 08:34:07.901432 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-83b5f3c5-9e9f-4a1e-a5a6-0e6125fbcfb8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:07.902899 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-83b5f3c5-9e9f-4a1e-a5a6-0e6125fbcfb8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:34:07.920262 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-83b5f3c5-9e9f-4a1e-a5a6-0e6125fbcfb8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:07.920725 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-83b5f3c5-9e9f-4a1e-a5a6-0e6125fbcfb8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:07.927381 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-83b5f3c5-9e9f-4a1e-a5a6-0e6125fbcfb8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:07.927963 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-83b5f3c5-9e9f-4a1e-a5a6-0e6125fbcfb8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:09.092316 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e678dedb-1113-45b5-b294-ae23ea25101f tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/b7ad9820-d952-424f-829a-fbab429f1d80" status: 202 len: 0 microversion: 2.1 time: 2.077816 Jun 05 08:34:09.092876 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1333/2616] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:34:07 2022] DELETE /compute/v2.1/os-security-groups/b7ad9820-d952-424f-829a-fbab429f1d80 => generated 0 bytes in 2079 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:34:09.101294 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8654fd17-e4e7-42fc-86f1-797db30c2584 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Calling method '.version_select at 0x7f2432ef5820>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:09.227139 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-83b5f3c5-9e9f-4a1e-a5a6-0e6125fbcfb8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:09.242159 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-83b5f3c5-9e9f-4a1e-a5a6-0e6125fbcfb8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:09.250837 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-83b5f3c5-9e9f-4a1e-a5a6-0e6125fbcfb8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:09.253063 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-83b5f3c5-9e9f-4a1e-a5a6-0e6125fbcfb8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1728 microversion: 2.20 time: 1.356040 Jun 05 08:34:09.255184 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1284/2617] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:34:07 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1728 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:34:09.278342 n-d-844739-1 devstack@n-api.service[119050]: DEBUG neutronclient.v2_0.client [None req-8654fd17-e4e7-42fc-86f1-797db30c2584 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b7ad9820-d952-424f-829a-fbab429f1d80 does not exist", "detail": ""}} {{(pid=119050) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 05 08:34:09.278935 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.security_group_api [None req-8654fd17-e4e7-42fc-86f1-797db30c2584 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Neutron security group b7ad9820-d952-424f-829a-fbab429f1d80 not found {{(pid=119050) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 05 08:34:09.279876 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-8654fd17-e4e7-42fc-86f1-797db30c2584 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] HTTP exception thrown: Security group b7ad9820-d952-424f-829a-fbab429f1d80 does not exist Jun 05 08:34:09.279876 n-d-844739-1 devstack@n-api.service[119050]: Neutron server returns request_ids: ['req-f559ffbd-abcc-49de-bfe7-ce1521bb4402'] Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8654fd17-e4e7-42fc-86f1-797db30c2584 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Request method failure captured: Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-security-groups/b7ad9820-d952-424f-829a-fbab429f1d80 HTTP/1.1 Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGpib-ZK8SidNyrg6H5XRSXfosoROe5wT7voX_vBIw_2zj-mw9ztjy47EZwaCKl3eV9Wc5vOrfjToQ1AshN3RdkE-S0t1WvJzz7OTiL57Vaycuz75vyRFJgJqBGladF2f_APmIbmHHNdZW8Ocv-jxw5qoSLWJ4LysWm8Uu6DCCjMx5k Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: bca25b0072144b22a04124f80362a310 Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-SecurityGroupsTestJSON-1613578867 Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bca25b0072144b22a04124f80362a310"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bca25b0072144b22a04124f80362a310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bca25b0072144b22a04124f80362a310", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bca25b0072144b22a04124f80362a310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-SecurityGroupsTestJSON-1613578867 Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: bca25b0072144b22a04124f80362a310 Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1613578867 Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-SecurityGroupsTestJSON-1613578867-project Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 3f3f6d563ecb4a6c88931c63b04a0974 Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-SecurityGroupsTestJSON-1613578867-project Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: exception: Security group b7ad9820-d952-424f-829a-fbab429f1d80 does not exist Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: Neutron server returns request_ids: ['req-f559ffbd-abcc-49de-bfe7-ce1521bb4402'] Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'b7ad9820-d952-424f-829a-fbab429f1d80'} Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 05 08:34:09.283248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b7ad9820-d952-424f-829a-fbab429f1d80 does not exist Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f559ffbd-abcc-49de-bfe7-ce1521bb4402'] Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b7ad9820-d952-424f-829a-fbab429f1d80 does not exist Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f559ffbd-abcc-49de-bfe7-ce1521bb4402'] Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b7ad9820-d952-424f-829a-fbab429f1d80 does not exist Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f559ffbd-abcc-49de-bfe7-ce1521bb4402'] Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b7ad9820-d952-424f-829a-fbab429f1d80 does not exist Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f559ffbd-abcc-49de-bfe7-ce1521bb4402'] Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8654fd17-e4e7-42fc-86f1-797db30c2584 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Returning 404 to user: Security group b7ad9820-d952-424f-829a-fbab429f1d80 does not exist Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: Neutron server returns request_ids: ['req-f559ffbd-abcc-49de-bfe7-ce1521bb4402'] {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:34:09.287084 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8654fd17-e4e7-42fc-86f1-797db30c2584 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/b7ad9820-d952-424f-829a-fbab429f1d80" status: 404 len: 194 microversion: 2.1 time: 0.187612 Jun 05 08:34:09.292505 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1334/2618] 10.222.0.33 () {58 vars in 1268 bytes} [Sun Jun 5 08:34:09 2022] GET /compute/v2.1/os-security-groups/b7ad9820-d952-424f-829a-fbab429f1d80 => generated 194 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:34:09.322142 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-cd0757b4-cad7-4c29-b6fd-efb8dcc13d67 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Calling method '.version_select at 0x7f244557ddc0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:10.272448 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f3d23026-a160-41d1-a7c5-dd0f9d9cb4c9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:10.274300 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f3d23026-a160-41d1-a7c5-dd0f9d9cb4c9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:34:10.301033 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f3d23026-a160-41d1-a7c5-dd0f9d9cb4c9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:10.301713 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f3d23026-a160-41d1-a7c5-dd0f9d9cb4c9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:10.305012 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f3d23026-a160-41d1-a7c5-dd0f9d9cb4c9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:10.306363 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f3d23026-a160-41d1-a7c5-dd0f9d9cb4c9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:11.110529 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f3d23026-a160-41d1-a7c5-dd0f9d9cb4c9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:11.119505 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f3d23026-a160-41d1-a7c5-dd0f9d9cb4c9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:11.123712 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f3d23026-a160-41d1-a7c5-dd0f9d9cb4c9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:11.125033 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f3d23026-a160-41d1-a7c5-dd0f9d9cb4c9 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1728 microversion: 2.20 time: 0.856353 Jun 05 08:34:11.130106 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1335/2619] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:34:10 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1728 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:34:11.152551 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-cd0757b4-cad7-4c29-b6fd-efb8dcc13d67 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/8003269b-f7eb-4ae3-afc9-f7c3b4781e5c" status: 202 len: 0 microversion: 2.1 time: 1.842114 Jun 05 08:34:11.154633 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1285/2620] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:34:09 2022] DELETE /compute/v2.1/os-security-groups/8003269b-f7eb-4ae3-afc9-f7c3b4781e5c => generated 0 bytes in 1845 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:34:11.164251 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4f999b45-57a6-4c83-bdc5-3141b634f744 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Calling method '.version_select at 0x7f2432e99a60>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:11.308785 n-d-844739-1 devstack@n-api.service[119050]: DEBUG neutronclient.v2_0.client [None req-4f999b45-57a6-4c83-bdc5-3141b634f744 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8003269b-f7eb-4ae3-afc9-f7c3b4781e5c does not exist", "detail": ""}} {{(pid=119050) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 05 08:34:11.309425 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.security_group_api [None req-4f999b45-57a6-4c83-bdc5-3141b634f744 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Neutron security group 8003269b-f7eb-4ae3-afc9-f7c3b4781e5c not found {{(pid=119050) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 05 08:34:11.309906 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-4f999b45-57a6-4c83-bdc5-3141b634f744 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] HTTP exception thrown: Security group 8003269b-f7eb-4ae3-afc9-f7c3b4781e5c does not exist Jun 05 08:34:11.309906 n-d-844739-1 devstack@n-api.service[119050]: Neutron server returns request_ids: ['req-5c1a7b87-b307-45d2-bff2-12d156fc49c5'] Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4f999b45-57a6-4c83-bdc5-3141b634f744 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Request method failure captured: Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-security-groups/8003269b-f7eb-4ae3-afc9-f7c3b4781e5c HTTP/1.1 Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGpib-ZK8SidNyrg6H5XRSXfosoROe5wT7voX_vBIw_2zj-mw9ztjy47EZwaCKl3eV9Wc5vOrfjToQ1AshN3RdkE-S0t1WvJzz7OTiL57Vaycuz75vyRFJgJqBGladF2f_APmIbmHHNdZW8Ocv-jxw5qoSLWJ4LysWm8Uu6DCCjMx5k Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: bca25b0072144b22a04124f80362a310 Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-SecurityGroupsTestJSON-1613578867 Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bca25b0072144b22a04124f80362a310"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bca25b0072144b22a04124f80362a310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bca25b0072144b22a04124f80362a310", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bca25b0072144b22a04124f80362a310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-SecurityGroupsTestJSON-1613578867 Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: bca25b0072144b22a04124f80362a310 Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1613578867 Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-SecurityGroupsTestJSON-1613578867-project Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 3f3f6d563ecb4a6c88931c63b04a0974 Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-SecurityGroupsTestJSON-1613578867-project Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: exception: Security group 8003269b-f7eb-4ae3-afc9-f7c3b4781e5c does not exist Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: Neutron server returns request_ids: ['req-5c1a7b87-b307-45d2-bff2-12d156fc49c5'] Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '8003269b-f7eb-4ae3-afc9-f7c3b4781e5c'} Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 05 08:34:11.311993 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8003269b-f7eb-4ae3-afc9-f7c3b4781e5c does not exist Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5c1a7b87-b307-45d2-bff2-12d156fc49c5'] Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8003269b-f7eb-4ae3-afc9-f7c3b4781e5c does not exist Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5c1a7b87-b307-45d2-bff2-12d156fc49c5'] Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8003269b-f7eb-4ae3-afc9-f7c3b4781e5c does not exist Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5c1a7b87-b307-45d2-bff2-12d156fc49c5'] Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8003269b-f7eb-4ae3-afc9-f7c3b4781e5c does not exist Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5c1a7b87-b307-45d2-bff2-12d156fc49c5'] Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4f999b45-57a6-4c83-bdc5-3141b634f744 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Returning 404 to user: Security group 8003269b-f7eb-4ae3-afc9-f7c3b4781e5c does not exist Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: Neutron server returns request_ids: ['req-5c1a7b87-b307-45d2-bff2-12d156fc49c5'] {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4f999b45-57a6-4c83-bdc5-3141b634f744 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/8003269b-f7eb-4ae3-afc9-f7c3b4781e5c" status: 404 len: 194 microversion: 2.1 time: 0.154111 Jun 05 08:34:11.316964 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1336/2621] 10.222.0.33 () {58 vars in 1268 bytes} [Sun Jun 5 08:34:11 2022] GET /compute/v2.1/os-security-groups/8003269b-f7eb-4ae3-afc9-f7c3b4781e5c => generated 194 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:34:11.324113 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-67276a38-1183-42fc-ae67-dced9bb349f0 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Calling method '.version_select at 0x7f243382c310>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:12.148233 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-25f15e6c-3430-4412-9689-b45c24cc2f33 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:12.152834 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-25f15e6c-3430-4412-9689-b45c24cc2f33 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:34:12.181869 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-25f15e6c-3430-4412-9689-b45c24cc2f33 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:12.182758 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-25f15e6c-3430-4412-9689-b45c24cc2f33 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:12.186481 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-25f15e6c-3430-4412-9689-b45c24cc2f33 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:12.186945 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-25f15e6c-3430-4412-9689-b45c24cc2f33 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:12.418270 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-67276a38-1183-42fc-ae67-dced9bb349f0 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 1.097772 Jun 05 08:34:12.428403 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1286/2622] 10.222.0.33 () {58 vars in 1157 bytes} [Sun Jun 5 08:34:11 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:34:12.434021 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-20121e9c-c0b9-4103-b12e-4f1e79429903 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Action: 'create', calling method: .version_select at 0x7f243378d790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1008830092", "description": "tempest-description-1757663018"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:34:12.886567 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-25f15e6c-3430-4412-9689-b45c24cc2f33 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:12.902674 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-25f15e6c-3430-4412-9689-b45c24cc2f33 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:12.908686 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-25f15e6c-3430-4412-9689-b45c24cc2f33 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:12.914362 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-25f15e6c-3430-4412-9689-b45c24cc2f33 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1728 microversion: 2.20 time: 0.772173 Jun 05 08:34:12.917589 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1337/2623] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:34:12 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1728 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:34:13.707354 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-20121e9c-c0b9-4103-b12e-4f1e79429903 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.277701 Jun 05 08:34:13.725180 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1287/2624] 10.222.0.33 () {60 vars in 1179 bytes} [Sun Jun 5 08:34:12 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:34:13.726566 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2cec854f-4432-44f0-9a95-de99b6f06e4c tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Action: 'create', calling method: .version_select at 0x7f243371d4c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-289653783", "description": "tempest-description-966506196"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:34:13.939870 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3a290c7e-d1e2-46d0-8579-e695c8799f66 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:13.941004 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3a290c7e-d1e2-46d0-8579-e695c8799f66 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:34:13.967488 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3a290c7e-d1e2-46d0-8579-e695c8799f66 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:13.975570 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3a290c7e-d1e2-46d0-8579-e695c8799f66 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:13.982238 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3a290c7e-d1e2-46d0-8579-e695c8799f66 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:13.982238 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3a290c7e-d1e2-46d0-8579-e695c8799f66 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:14.004081 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=52 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:34:14.819319 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2cec854f-4432-44f0-9a95-de99b6f06e4c tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.101322 Jun 05 08:34:14.841597 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1338/2625] 10.222.0.33 () {60 vars in 1179 bytes} [Sun Jun 5 08:34:13 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:34:15.287669 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3c7f5c5c-5120-44a9-8418-6e41755d4196 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-252017349", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "d0e67171-28e8-402b-b6fe-2c9f0c0fff86"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:34:15.468139 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-3c7f5c5c-5120-44a9-8418-6e41755d4196 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] validate_networks() for [('d0e67171-28e8-402b-b6fe-2c9f0c0fff86', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:34:15.582309 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3a290c7e-d1e2-46d0-8579-e695c8799f66 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:15.605763 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3a290c7e-d1e2-46d0-8579-e695c8799f66 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:15.619562 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3a290c7e-d1e2-46d0-8579-e695c8799f66 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:15.627209 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3a290c7e-d1e2-46d0-8579-e695c8799f66 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1728 microversion: 2.20 time: 1.694153 Jun 05 08:34:15.642494 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1288/2626] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:34:13 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1728 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:34:16.281760 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:34:16.839004 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-2f02ea4a-9508-41df-8ebb-7a16887e2117 req-5ac7912e-73e4-40c8-ba4b-895c9dc898c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "040dd488-42f2-45c3-86de-1a675e78d7ca", "name": "network-vif-plugged", "status": "completed", "tag": "93d59181-26a5-451b-8871-ccba610464fd"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:34:16.860732 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-2f02ea4a-9508-41df-8ebb-7a16887e2117 req-5ac7912e-73e4-40c8-ba4b-895c9dc898c1 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:16.861485 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-2f02ea4a-9508-41df-8ebb-7a16887e2117 req-5ac7912e-73e4-40c8-ba4b-895c9dc898c1 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:16.877463 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-2f02ea4a-9508-41df-8ebb-7a16887e2117 req-5ac7912e-73e4-40c8-ba4b-895c9dc898c1 service nova] Creating event network-vif-plugged:93d59181-26a5-451b-8871-ccba610464fd for instance 040dd488-42f2-45c3-86de-1a675e78d7ca on n-h1-844739-1 Jun 05 08:34:16.893217 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-2f02ea4a-9508-41df-8ebb-7a16887e2117 req-5ac7912e-73e4-40c8-ba4b-895c9dc898c1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.405603 Jun 05 08:34:16.894227 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1289/2627] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:34:16.899605 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-888b1ceb-df4a-468f-a8dd-82df194021e4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:16.908681 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-888b1ceb-df4a-468f-a8dd-82df194021e4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:34:16.928956 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-888b1ceb-df4a-468f-a8dd-82df194021e4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:16.931795 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-888b1ceb-df4a-468f-a8dd-82df194021e4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:16.933698 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-888b1ceb-df4a-468f-a8dd-82df194021e4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:16.945157 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-888b1ceb-df4a-468f-a8dd-82df194021e4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:17.224212 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-3c7f5c5c-5120-44a9-8418-6e41755d4196 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:34:17.224760 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-3c7f5c5c-5120-44a9-8418-6e41755d4196 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:34:17.225961 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-3c7f5c5c-5120-44a9-8418-6e41755d4196 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:34:17.226598 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-3c7f5c5c-5120-44a9-8418-6e41755d4196 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:34:17.227233 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-3c7f5c5c-5120-44a9-8418-6e41755d4196 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:34:17.237839 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=10 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:34:17.242769 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3c7f5c5c-5120-44a9-8418-6e41755d4196 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:17.245583 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3c7f5c5c-5120-44a9-8418-6e41755d4196 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:17.247718 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3c7f5c5c-5120-44a9-8418-6e41755d4196 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:17.249225 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3c7f5c5c-5120-44a9-8418-6e41755d4196 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:17.311238 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-3c7f5c5c-5120-44a9-8418-6e41755d4196 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Getting quotas for project bca25b0072144b22a04124f80362a310. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:34:17.324846 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-3c7f5c5c-5120-44a9-8418-6e41755d4196 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Getting quotas for user 3f3f6d563ecb4a6c88931c63b04a0974 and project bca25b0072144b22a04124f80362a310. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:34:17.369932 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3c7f5c5c-5120-44a9-8418-6e41755d4196 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:34:17.373943 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3c7f5c5c-5120-44a9-8418-6e41755d4196 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] [instance: ca9adda9-a74d-49f0-889f-2b9f68b2724e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:34:17.517771 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-888b1ceb-df4a-468f-a8dd-82df194021e4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:17.538138 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3c7f5c5c-5120-44a9-8418-6e41755d4196 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.254824 Jun 05 08:34:17.538804 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1339/2628] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:34:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:34:17.561486 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-387d8a20-a7cf-444d-b10c-387ad099ff11 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:17.565985 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-387d8a20-a7cf-444d-b10c-387ad099ff11 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] [instance: ca9adda9-a74d-49f0-889f-2b9f68b2724e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:34:17.568137 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-888b1ceb-df4a-468f-a8dd-82df194021e4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:17.569648 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-888b1ceb-df4a-468f-a8dd-82df194021e4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:17.590295 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-888b1ceb-df4a-468f-a8dd-82df194021e4 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1728 microversion: 2.20 time: 0.694702 Jun 05 08:34:17.610643 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1290/2629] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:34:16 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1728 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:34:17.737450 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-387d8a20-a7cf-444d-b10c-387ad099ff11 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3f6d563ecb4a6c88931c63b04a0974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca25b0072144b22a04124f80362a310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:17.746336 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-387d8a20-a7cf-444d-b10c-387ad099ff11 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "GET /compute/v2.1/servers/ca9adda9-a74d-49f0-889f-2b9f68b2724e" status: 200 len: 1215 microversion: 2.1 time: 0.201040 Jun 05 08:34:17.746919 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1340/2630] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:34:17 2022] GET /compute/v2.1/servers/ca9adda9-a74d-49f0-889f-2b9f68b2724e => generated 1215 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:34:18.622463 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4d7dbc38-2101-4f25-894f-03e9c1a930ea tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:18.624110 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4d7dbc38-2101-4f25-894f-03e9c1a930ea tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:34:18.662252 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=3 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:34:18.670986 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4d7dbc38-2101-4f25-894f-03e9c1a930ea tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:18.675619 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4d7dbc38-2101-4f25-894f-03e9c1a930ea tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:18.678875 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4d7dbc38-2101-4f25-894f-03e9c1a930ea tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:18.679598 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4d7dbc38-2101-4f25-894f-03e9c1a930ea tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:18.764200 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-af3c1620-e866-400b-bfbb-cebd9f3afa0e tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:18.764945 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-af3c1620-e866-400b-bfbb-cebd9f3afa0e tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] [instance: ca9adda9-a74d-49f0-889f-2b9f68b2724e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:34:18.813261 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-af3c1620-e866-400b-bfbb-cebd9f3afa0e tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:18.833158 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-af3c1620-e866-400b-bfbb-cebd9f3afa0e tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:18.837077 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-af3c1620-e866-400b-bfbb-cebd9f3afa0e tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:18.846699 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-af3c1620-e866-400b-bfbb-cebd9f3afa0e tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:18.991587 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-af3c1620-e866-400b-bfbb-cebd9f3afa0e tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:18.993588 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-af3c1620-e866-400b-bfbb-cebd9f3afa0e tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:18.994303 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-af3c1620-e866-400b-bfbb-cebd9f3afa0e tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lazy-loading 'fault' on Instance uuid ca9adda9-a74d-49f0-889f-2b9f68b2724e {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:34:19.506290 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-af3c1620-e866-400b-bfbb-cebd9f3afa0e tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f3f6d563ecb4a6c88931c63b04a0974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca25b0072144b22a04124f80362a310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:19.530596 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-af3c1620-e866-400b-bfbb-cebd9f3afa0e tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "GET /compute/v2.1/servers/ca9adda9-a74d-49f0-889f-2b9f68b2724e" status: 200 len: 1288 microversion: 2.1 time: 0.760202 Jun 05 08:34:19.536775 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1341/2631] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:34:18 2022] GET /compute/v2.1/servers/ca9adda9-a74d-49f0-889f-2b9f68b2724e => generated 1288 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:34:19.586661 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a1f00712-60eb-4920-9f3a-ee60e1bfa8cf tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:19.587441 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a1f00712-60eb-4920-9f3a-ee60e1bfa8cf tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] [instance: ca9adda9-a74d-49f0-889f-2b9f68b2724e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:34:19.628190 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a1f00712-60eb-4920-9f3a-ee60e1bfa8cf tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:19.628680 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a1f00712-60eb-4920-9f3a-ee60e1bfa8cf tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:19.629532 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a1f00712-60eb-4920-9f3a-ee60e1bfa8cf tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:19.633282 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a1f00712-60eb-4920-9f3a-ee60e1bfa8cf tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:19.762321 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a1f00712-60eb-4920-9f3a-ee60e1bfa8cf tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] [instance: ca9adda9-a74d-49f0-889f-2b9f68b2724e] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:34:19.977856 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a1f00712-60eb-4920-9f3a-ee60e1bfa8cf tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] [instance: ca9adda9-a74d-49f0-889f-2b9f68b2724e] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:34:19.993483 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a1f00712-60eb-4920-9f3a-ee60e1bfa8cf tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:19.994442 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a1f00712-60eb-4920-9f3a-ee60e1bfa8cf tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:19.997602 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-a1f00712-60eb-4920-9f3a-ee60e1bfa8cf tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] [instance: ca9adda9-a74d-49f0-889f-2b9f68b2724e] instance's host None is down, deleting from database Jun 05 08:34:20.009270 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-a1f00712-60eb-4920-9f3a-ee60e1bfa8cf tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] [instance: ca9adda9-a74d-49f0-889f-2b9f68b2724e] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:34:20.249326 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4d7dbc38-2101-4f25-894f-03e9c1a930ea tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:20.315256 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4d7dbc38-2101-4f25-894f-03e9c1a930ea tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:20.322927 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4d7dbc38-2101-4f25-894f-03e9c1a930ea tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:20.333693 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4d7dbc38-2101-4f25-894f-03e9c1a930ea tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1728 microversion: 2.20 time: 1.710491 Jun 05 08:34:20.350643 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1291/2632] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:34:18 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1728 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:34:20.500657 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-a1f00712-60eb-4920-9f3a-ee60e1bfa8cf tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] [instance: ca9adda9-a74d-49f0-889f-2b9f68b2724e] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:34:20.510278 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-a1f00712-60eb-4920-9f3a-ee60e1bfa8cf tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] [instance: ca9adda9-a74d-49f0-889f-2b9f68b2724e] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:34:21.139260 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a1f00712-60eb-4920-9f3a-ee60e1bfa8cf tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ca9adda9-a74d-49f0-889f-2b9f68b2724e" status: 204 len: 0 microversion: 2.1 time: 1.579725 Jun 05 08:34:21.143122 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1342/2633] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:34:19 2022] DELETE /compute/v2.1/servers/ca9adda9-a74d-49f0-889f-2b9f68b2724e => generated 0 bytes in 1591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:34:21.172925 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-bdeba2e7-8873-4d80-b274-b1bcc11f3cd4 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:21.173571 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-bdeba2e7-8873-4d80-b274-b1bcc11f3cd4 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] [instance: ca9adda9-a74d-49f0-889f-2b9f68b2724e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:34:21.199071 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bdeba2e7-8873-4d80-b274-b1bcc11f3cd4 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:21.199735 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bdeba2e7-8873-4d80-b274-b1bcc11f3cd4 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:21.203365 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bdeba2e7-8873-4d80-b274-b1bcc11f3cd4 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:21.203802 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bdeba2e7-8873-4d80-b274-b1bcc11f3cd4 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:21.280146 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-bdeba2e7-8873-4d80-b274-b1bcc11f3cd4 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] HTTP exception thrown: Instance ca9adda9-a74d-49f0-889f-2b9f68b2724e could not be found. Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-bdeba2e7-8873-4d80-b274-b1bcc11f3cd4 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Request method failure captured: Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/ca9adda9-a74d-49f0-889f-2b9f68b2724e HTTP/1.1 Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGpib-ZK8SidNyrg6H5XRSXfosoROe5wT7voX_vBIw_2zj-mw9ztjy47EZwaCKl3eV9Wc5vOrfjToQ1AshN3RdkE-S0t1WvJzz7OTiL57Vaycuz75vyRFJgJqBGladF2f_APmIbmHHNdZW8Ocv-jxw5qoSLWJ4LysWm8Uu6DCCjMx5k Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: bca25b0072144b22a04124f80362a310 Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-SecurityGroupsTestJSON-1613578867 Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bca25b0072144b22a04124f80362a310"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bca25b0072144b22a04124f80362a310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bca25b0072144b22a04124f80362a310", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bca25b0072144b22a04124f80362a310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-SecurityGroupsTestJSON-1613578867 Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: bca25b0072144b22a04124f80362a310 Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1613578867 Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-SecurityGroupsTestJSON-1613578867-project Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 3f3f6d563ecb4a6c88931c63b04a0974 Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-SecurityGroupsTestJSON-1613578867-project Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance ca9adda9-a74d-49f0-889f-2b9f68b2724e could not be found. Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'ca9adda9-a74d-49f0-889f-2b9f68b2724e'} Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca9adda9-a74d-49f0-889f-2b9f68b2724e could not be found. Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca9adda9-a74d-49f0-889f-2b9f68b2724e could not be found. Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:34:21.297902 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:21.302336 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:21.302336 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:34:21.302336 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:34:21.302336 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:34:21.302336 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:34:21.302336 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca9adda9-a74d-49f0-889f-2b9f68b2724e could not be found. Jun 05 08:34:21.302336 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:21.302336 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-bdeba2e7-8873-4d80-b274-b1bcc11f3cd4 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Returning 404 to user: Instance ca9adda9-a74d-49f0-889f-2b9f68b2724e could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:34:21.302336 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-bdeba2e7-8873-4d80-b274-b1bcc11f3cd4 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "GET /compute/v2.1/servers/ca9adda9-a74d-49f0-889f-2b9f68b2724e" status: 404 len: 111 microversion: 2.1 time: 0.151266 Jun 05 08:34:21.306885 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-50100d7c-144b-4f83-9ea0-c67787dc4ef5 tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1560028988", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "483f9fb8-5352-4f7e-b875-8ce11398cb2b"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:34:21.317574 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1343/2634] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:34:21 2022] GET /compute/v2.1/servers/ca9adda9-a74d-49f0-889f-2b9f68b2724e => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:34:21.357114 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d39bd7bc-0a9f-42c1-8866-3d56e618e1e8 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Action: 'create', calling method: .version_select at 0x7f24453570d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1263766621", "description": "tempest-description-1233578883"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:34:22.611858 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d39bd7bc-0a9f-42c1-8866-3d56e618e1e8 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.293023 Jun 05 08:34:22.618805 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1344/2635] 10.222.0.33 () {60 vars in 1179 bytes} [Sun Jun 5 08:34:21 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:34:22.625666 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e2488827-9f69-4868-8d72-f9eb1ba92039 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:22.628747 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e2488827-9f69-4868-8d72-f9eb1ba92039 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:34:22.647284 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e2488827-9f69-4868-8d72-f9eb1ba92039 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:22.650800 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e2488827-9f69-4868-8d72-f9eb1ba92039 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:22.651847 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e2488827-9f69-4868-8d72-f9eb1ba92039 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:22.653738 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e2488827-9f69-4868-8d72-f9eb1ba92039 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:23.164516 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-50100d7c-144b-4f83-9ea0-c67787dc4ef5 tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] validate_networks() for [('483f9fb8-5352-4f7e-b875-8ce11398cb2b', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:34:23.594760 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e2488827-9f69-4868-8d72-f9eb1ba92039 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:23.614862 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e2488827-9f69-4868-8d72-f9eb1ba92039 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:23.621665 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e2488827-9f69-4868-8d72-f9eb1ba92039 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:23.625093 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e2488827-9f69-4868-8d72-f9eb1ba92039 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1728 microversion: 2.20 time: 1.004992 Jun 05 08:34:23.627807 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1345/2636] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:34:22 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1728 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:34:23.632942 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-65db59e3-23d8-4134-8e88-1f21a2a92599 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Action: 'update', calling method: .version_select at 0x7f2432ea4790>, body: {"security_group": {"name": "tempest-sg-hth-422743795", "description": "tempest-description-hth-1364912984"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:34:24.446206 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-65db59e3-23d8-4134-8e88-1f21a2a92599 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "PUT /compute/v2.1/os-security-groups/4bf292f9-5c72-4e4f-a31f-4245fbf3ef3b" status: 200 len: 217 microversion: 2.1 time: 0.816886 Jun 05 08:34:24.448501 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1346/2637] 10.222.0.33 () {60 vars in 1289 bytes} [Sun Jun 5 08:34:23 2022] PUT /compute/v2.1/os-security-groups/4bf292f9-5c72-4e4f-a31f-4245fbf3ef3b => generated 217 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:34:24.460900 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-84a347f9-bcc3-41f3-a2f1-e84a657c42dd tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Calling method '.version_select at 0x7f2432ea5ee0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:24.637960 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-84a347f9-bcc3-41f3-a2f1-e84a657c42dd tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/4bf292f9-5c72-4e4f-a31f-4245fbf3ef3b" status: 200 len: 217 microversion: 2.1 time: 0.181877 Jun 05 08:34:24.639070 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1347/2638] 10.222.0.33 () {58 vars in 1268 bytes} [Sun Jun 5 08:34:24 2022] GET /compute/v2.1/os-security-groups/4bf292f9-5c72-4e4f-a31f-4245fbf3ef3b => generated 217 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:34:24.654750 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4f61ef5d-326d-4514-9d72-c071b41f53a0 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Calling method '.version_select at 0x7f2432eaa5e0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:25.106421 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-50100d7c-144b-4f83-9ea0-c67787dc4ef5 tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:34:25.111188 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-50100d7c-144b-4f83-9ea0-c67787dc4ef5 tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:34:25.112376 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-50100d7c-144b-4f83-9ea0-c67787dc4ef5 tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:34:25.112820 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-50100d7c-144b-4f83-9ea0-c67787dc4ef5 tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:34:25.113250 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-50100d7c-144b-4f83-9ea0-c67787dc4ef5 tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:34:25.138325 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-50100d7c-144b-4f83-9ea0-c67787dc4ef5 tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:25.138778 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-50100d7c-144b-4f83-9ea0-c67787dc4ef5 tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:25.143270 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-50100d7c-144b-4f83-9ea0-c67787dc4ef5 tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:25.146692 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-50100d7c-144b-4f83-9ea0-c67787dc4ef5 tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:25.244123 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-50100d7c-144b-4f83-9ea0-c67787dc4ef5 tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Getting quotas for project ab9950d578064758976b2b58940db26f. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:34:25.258026 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-50100d7c-144b-4f83-9ea0-c67787dc4ef5 tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Getting quotas for user 86d9ce3b4b4f416aa23acf6f243d52db and project ab9950d578064758976b2b58940db26f. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:34:25.319188 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-50100d7c-144b-4f83-9ea0-c67787dc4ef5 tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:34:25.326673 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-50100d7c-144b-4f83-9ea0-c67787dc4ef5 tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] [instance: 174ce019-0742-41ca-a1bd-ab97d3087c5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:34:25.525022 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-50100d7c-144b-4f83-9ea0-c67787dc4ef5 tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.682557 Jun 05 08:34:25.535011 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1292/2639] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:34:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 4694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:34:25.550311 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ce46892f-72b3-4b2b-bb77-442cf0a404af tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:25.552112 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ce46892f-72b3-4b2b-bb77-442cf0a404af tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:34:25.579685 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ce46892f-72b3-4b2b-bb77-442cf0a404af tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:25.586014 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ce46892f-72b3-4b2b-bb77-442cf0a404af tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:25.591067 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ce46892f-72b3-4b2b-bb77-442cf0a404af tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:25.593911 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ce46892f-72b3-4b2b-bb77-442cf0a404af tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:25.810515 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4f61ef5d-326d-4514-9d72-c071b41f53a0 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/4bf292f9-5c72-4e4f-a31f-4245fbf3ef3b" status: 202 len: 0 microversion: 2.1 time: 1.161875 Jun 05 08:34:25.811285 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1348/2640] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:34:24 2022] DELETE /compute/v2.1/os-security-groups/4bf292f9-5c72-4e4f-a31f-4245fbf3ef3b => generated 0 bytes in 1163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:34:25.821084 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-00add9ab-ff36-43a9-8afe-51b639c3e41c tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:25.822082 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-00add9ab-ff36-43a9-8afe-51b639c3e41c tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] [instance: 174ce019-0742-41ca-a1bd-ab97d3087c5e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:34:26.439429 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-00add9ab-ff36-43a9-8afe-51b639c3e41c tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9ce3b4b4f416aa23acf6f243d52db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9950d578064758976b2b58940db26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:26.450122 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-00add9ab-ff36-43a9-8afe-51b639c3e41c tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] 10.222.0.33 "GET /compute/v2.1/servers/174ce019-0742-41ca-a1bd-ab97d3087c5e" status: 200 len: 1225 microversion: 2.1 time: 0.636589 Jun 05 08:34:26.453622 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1349/2641] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:34:25 2022] GET /compute/v2.1/servers/174ce019-0742-41ca-a1bd-ab97d3087c5e => generated 1225 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:34:26.464388 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d30e1086-0bc5-4984-ab8a-1246ed747cba tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Calling method '.version_select at 0x7f243396d040>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:26.593848 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ce46892f-72b3-4b2b-bb77-442cf0a404af tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:26.604946 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ce46892f-72b3-4b2b-bb77-442cf0a404af tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:26.614554 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ce46892f-72b3-4b2b-bb77-442cf0a404af tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:26.631242 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ce46892f-72b3-4b2b-bb77-442cf0a404af tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1715 microversion: 2.20 time: 1.091996 Jun 05 08:34:26.632493 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1293/2642] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:34:25 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1715 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:34:27.078091 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d30e1086-0bc5-4984-ab8a-1246ed747cba tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/9866985c-4048-43b8-98a8-2221f23f160c" status: 202 len: 0 microversion: 2.1 time: 0.622099 Jun 05 08:34:27.079641 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1350/2643] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:34:26 2022] DELETE /compute/v2.1/os-security-groups/9866985c-4048-43b8-98a8-2221f23f160c => generated 0 bytes in 625 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:34:27.089849 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a5aca72d-3c0c-4fcc-aa95-555916836ee4 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Calling method '.version_select at 0x7f243373a820>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:27.471736 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e3ad1bc9-3011-4e43-8177-42c5849044e7 tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:27.474270 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e3ad1bc9-3011-4e43-8177-42c5849044e7 tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] [instance: 174ce019-0742-41ca-a1bd-ab97d3087c5e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:34:27.490153 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:34:27.495628 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e3ad1bc9-3011-4e43-8177-42c5849044e7 tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:27.496751 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e3ad1bc9-3011-4e43-8177-42c5849044e7 tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:27.505365 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e3ad1bc9-3011-4e43-8177-42c5849044e7 tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:27.506044 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e3ad1bc9-3011-4e43-8177-42c5849044e7 tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:27.550124 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e3ad1bc9-3011-4e43-8177-42c5849044e7 tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:27.554482 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e3ad1bc9-3011-4e43-8177-42c5849044e7 tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:27.555206 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-e3ad1bc9-3011-4e43-8177-42c5849044e7 tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Lazy-loading 'fault' on Instance uuid 174ce019-0742-41ca-a1bd-ab97d3087c5e {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:34:27.607920 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e3ad1bc9-3011-4e43-8177-42c5849044e7 tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d9ce3b4b4f416aa23acf6f243d52db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9950d578064758976b2b58940db26f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:27.619336 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e3ad1bc9-3011-4e43-8177-42c5849044e7 tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] 10.222.0.33 "GET /compute/v2.1/servers/174ce019-0742-41ca-a1bd-ab97d3087c5e" status: 200 len: 1298 microversion: 2.1 time: 0.153806 Jun 05 08:34:27.647388 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1351/2644] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:34:27 2022] GET /compute/v2.1/servers/174ce019-0742-41ca-a1bd-ab97d3087c5e => generated 1298 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:34:27.660442 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e0bc81c2-6b99-4b5c-afb6-faf7c8abb82c tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:27.674100 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e0bc81c2-6b99-4b5c-afb6-faf7c8abb82c tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] [instance: 174ce019-0742-41ca-a1bd-ab97d3087c5e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:34:27.701398 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e0bc81c2-6b99-4b5c-afb6-faf7c8abb82c tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:27.702571 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a5aca72d-3c0c-4fcc-aa95-555916836ee4 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/709a0d71-28c0-4e65-b487-98c0d462cb1c" status: 202 len: 0 microversion: 2.1 time: 0.618599 Jun 05 08:34:27.703271 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1294/2645] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:34:27 2022] DELETE /compute/v2.1/os-security-groups/709a0d71-28c0-4e65-b487-98c0d462cb1c => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 05 08:34:27.705683 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e0bc81c2-6b99-4b5c-afb6-faf7c8abb82c tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:27.711101 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e0bc81c2-6b99-4b5c-afb6-faf7c8abb82c tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:27.714418 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a63b22c9-33f8-40f3-b018-a02772e52fd9 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Calling method '.version_select at 0x7f24331a31f0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:27.714856 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e0bc81c2-6b99-4b5c-afb6-faf7c8abb82c tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:27.831833 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e0bc81c2-6b99-4b5c-afb6-faf7c8abb82c tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] [instance: 174ce019-0742-41ca-a1bd-ab97d3087c5e] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:34:27.846295 n-d-844739-1 devstack@n-api.service[119049]: DEBUG neutronclient.v2_0.client [None req-a63b22c9-33f8-40f3-b018-a02772e52fd9 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8003269b-f7eb-4ae3-afc9-f7c3b4781e5c does not exist", "detail": ""}} {{(pid=119049) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 05 08:34:27.847255 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.security_group_api [None req-a63b22c9-33f8-40f3-b018-a02772e52fd9 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Neutron security group 8003269b-f7eb-4ae3-afc9-f7c3b4781e5c not found {{(pid=119049) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 05 08:34:27.848025 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-a63b22c9-33f8-40f3-b018-a02772e52fd9 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] HTTP exception thrown: Security group 8003269b-f7eb-4ae3-afc9-f7c3b4781e5c does not exist Jun 05 08:34:27.848025 n-d-844739-1 devstack@n-api.service[119049]: Neutron server returns request_ids: ['req-c713b666-1a14-4b75-a188-2ef79ddde06d'] Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a63b22c9-33f8-40f3-b018-a02772e52fd9 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Request method failure captured: Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: request: DELETE /compute/v2.1/os-security-groups/8003269b-f7eb-4ae3-afc9-f7c3b4781e5c HTTP/1.1 Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGpib-ZK8SidNyrg6H5XRSXfosoROe5wT7voX_vBIw_2zj-mw9ztjy47EZwaCKl3eV9Wc5vOrfjToQ1AshN3RdkE-S0t1WvJzz7OTiL57Vaycuz75vyRFJgJqBGladF2f_APmIbmHHNdZW8Ocv-jxw5qoSLWJ4LysWm8Uu6DCCjMx5k Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: bca25b0072144b22a04124f80362a310 Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-SecurityGroupsTestJSON-1613578867 Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bca25b0072144b22a04124f80362a310"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bca25b0072144b22a04124f80362a310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bca25b0072144b22a04124f80362a310", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bca25b0072144b22a04124f80362a310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-SecurityGroupsTestJSON-1613578867 Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: bca25b0072144b22a04124f80362a310 Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1613578867 Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-SecurityGroupsTestJSON-1613578867-project Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 3f3f6d563ecb4a6c88931c63b04a0974 Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-SecurityGroupsTestJSON-1613578867-project Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: exception: Security group 8003269b-f7eb-4ae3-afc9-f7c3b4781e5c does not exist Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: Neutron server returns request_ids: ['req-c713b666-1a14-4b75-a188-2ef79ddde06d'] Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '8003269b-f7eb-4ae3-afc9-f7c3b4781e5c'} Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 05 08:34:27.850514 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8003269b-f7eb-4ae3-afc9-f7c3b4781e5c does not exist Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c713b666-1a14-4b75-a188-2ef79ddde06d'] Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8003269b-f7eb-4ae3-afc9-f7c3b4781e5c does not exist Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c713b666-1a14-4b75-a188-2ef79ddde06d'] Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8003269b-f7eb-4ae3-afc9-f7c3b4781e5c does not exist Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c713b666-1a14-4b75-a188-2ef79ddde06d'] Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8003269b-f7eb-4ae3-afc9-f7c3b4781e5c does not exist Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c713b666-1a14-4b75-a188-2ef79ddde06d'] Jun 05 08:34:27.854943 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:27.861446 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a63b22c9-33f8-40f3-b018-a02772e52fd9 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Returning 404 to user: Security group 8003269b-f7eb-4ae3-afc9-f7c3b4781e5c does not exist Jun 05 08:34:27.861446 n-d-844739-1 devstack@n-api.service[119049]: Neutron server returns request_ids: ['req-c713b666-1a14-4b75-a188-2ef79ddde06d'] {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:34:27.864342 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a63b22c9-33f8-40f3-b018-a02772e52fd9 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/8003269b-f7eb-4ae3-afc9-f7c3b4781e5c" status: 404 len: 194 microversion: 2.1 time: 0.154532 Jun 05 08:34:27.865154 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1295/2646] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:34:27 2022] DELETE /compute/v2.1/os-security-groups/8003269b-f7eb-4ae3-afc9-f7c3b4781e5c => generated 194 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:34:27.885829 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-316a886f-cea8-4ef8-87c6-341022761e7e tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Calling method '.version_select at 0x7f24331a3ee0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:27.944311 n-d-844739-1 devstack@n-api.service[119049]: DEBUG neutronclient.v2_0.client [None req-316a886f-cea8-4ef8-87c6-341022761e7e tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b7ad9820-d952-424f-829a-fbab429f1d80 does not exist", "detail": ""}} {{(pid=119049) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 05 08:34:27.945254 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.security_group_api [None req-316a886f-cea8-4ef8-87c6-341022761e7e tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Neutron security group b7ad9820-d952-424f-829a-fbab429f1d80 not found {{(pid=119049) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 05 08:34:27.946058 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-316a886f-cea8-4ef8-87c6-341022761e7e tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] HTTP exception thrown: Security group b7ad9820-d952-424f-829a-fbab429f1d80 does not exist Jun 05 08:34:27.946058 n-d-844739-1 devstack@n-api.service[119049]: Neutron server returns request_ids: ['req-e7421060-cdd3-43f7-ab6b-0c374d8b67b4'] Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-316a886f-cea8-4ef8-87c6-341022761e7e tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Request method failure captured: Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: request: DELETE /compute/v2.1/os-security-groups/b7ad9820-d952-424f-829a-fbab429f1d80 HTTP/1.1 Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGpib-ZK8SidNyrg6H5XRSXfosoROe5wT7voX_vBIw_2zj-mw9ztjy47EZwaCKl3eV9Wc5vOrfjToQ1AshN3RdkE-S0t1WvJzz7OTiL57Vaycuz75vyRFJgJqBGladF2f_APmIbmHHNdZW8Ocv-jxw5qoSLWJ4LysWm8Uu6DCCjMx5k Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: bca25b0072144b22a04124f80362a310 Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-SecurityGroupsTestJSON-1613578867 Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bca25b0072144b22a04124f80362a310"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bca25b0072144b22a04124f80362a310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bca25b0072144b22a04124f80362a310", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bca25b0072144b22a04124f80362a310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-SecurityGroupsTestJSON-1613578867 Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: bca25b0072144b22a04124f80362a310 Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1613578867 Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-SecurityGroupsTestJSON-1613578867-project Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 3f3f6d563ecb4a6c88931c63b04a0974 Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-SecurityGroupsTestJSON-1613578867-project Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: exception: Security group b7ad9820-d952-424f-829a-fbab429f1d80 does not exist Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: Neutron server returns request_ids: ['req-e7421060-cdd3-43f7-ab6b-0c374d8b67b4'] Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'b7ad9820-d952-424f-829a-fbab429f1d80'} Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 05 08:34:27.948466 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b7ad9820-d952-424f-829a-fbab429f1d80 does not exist Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7421060-cdd3-43f7-ab6b-0c374d8b67b4'] Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b7ad9820-d952-424f-829a-fbab429f1d80 does not exist Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7421060-cdd3-43f7-ab6b-0c374d8b67b4'] Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b7ad9820-d952-424f-829a-fbab429f1d80 does not exist Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7421060-cdd3-43f7-ab6b-0c374d8b67b4'] Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b7ad9820-d952-424f-829a-fbab429f1d80 does not exist Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e7421060-cdd3-43f7-ab6b-0c374d8b67b4'] Jun 05 08:34:27.951726 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:27.959676 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-316a886f-cea8-4ef8-87c6-341022761e7e tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Returning 404 to user: Security group b7ad9820-d952-424f-829a-fbab429f1d80 does not exist Jun 05 08:34:27.959676 n-d-844739-1 devstack@n-api.service[119049]: Neutron server returns request_ids: ['req-e7421060-cdd3-43f7-ab6b-0c374d8b67b4'] {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:34:27.961641 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-316a886f-cea8-4ef8-87c6-341022761e7e tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/b7ad9820-d952-424f-829a-fbab429f1d80" status: 404 len: 194 microversion: 2.1 time: 0.092428 Jun 05 08:34:27.966822 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1296/2647] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:34:27 2022] DELETE /compute/v2.1/os-security-groups/b7ad9820-d952-424f-829a-fbab429f1d80 => generated 194 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:34:27.998560 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-eb3c85c4-4d88-47d8-b649-836d10dad727 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Calling method '.version_select at 0x7f24337c6550>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:28.008793 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e0bc81c2-6b99-4b5c-afb6-faf7c8abb82c tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] [instance: 174ce019-0742-41ca-a1bd-ab97d3087c5e] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:34:28.009583 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e0bc81c2-6b99-4b5c-afb6-faf7c8abb82c tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:28.010057 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e0bc81c2-6b99-4b5c-afb6-faf7c8abb82c tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:28.010497 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-e0bc81c2-6b99-4b5c-afb6-faf7c8abb82c tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] [instance: 174ce019-0742-41ca-a1bd-ab97d3087c5e] instance's host None is down, deleting from database Jun 05 08:34:28.040974 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-e0bc81c2-6b99-4b5c-afb6-faf7c8abb82c tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] [instance: 174ce019-0742-41ca-a1bd-ab97d3087c5e] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:34:28.099732 n-d-844739-1 devstack@n-api.service[119049]: DEBUG neutronclient.v2_0.client [None req-eb3c85c4-4d88-47d8-b649-836d10dad727 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5cdd5ef7-da0a-4b42-a40a-27d58b926789 does not exist", "detail": ""}} {{(pid=119049) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 05 08:34:28.104789 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.security_group_api [None req-eb3c85c4-4d88-47d8-b649-836d10dad727 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Neutron security group 5cdd5ef7-da0a-4b42-a40a-27d58b926789 not found {{(pid=119049) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 05 08:34:28.106146 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-eb3c85c4-4d88-47d8-b649-836d10dad727 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] HTTP exception thrown: Security group 5cdd5ef7-da0a-4b42-a40a-27d58b926789 does not exist Jun 05 08:34:28.106146 n-d-844739-1 devstack@n-api.service[119049]: Neutron server returns request_ids: ['req-982460f1-8560-40ae-b75a-afd426fa2011'] Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-eb3c85c4-4d88-47d8-b649-836d10dad727 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Request method failure captured: Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: request: DELETE /compute/v2.1/os-security-groups/5cdd5ef7-da0a-4b42-a40a-27d58b926789 HTTP/1.1 Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGpib-ZK8SidNyrg6H5XRSXfosoROe5wT7voX_vBIw_2zj-mw9ztjy47EZwaCKl3eV9Wc5vOrfjToQ1AshN3RdkE-S0t1WvJzz7OTiL57Vaycuz75vyRFJgJqBGladF2f_APmIbmHHNdZW8Ocv-jxw5qoSLWJ4LysWm8Uu6DCCjMx5k Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: bca25b0072144b22a04124f80362a310 Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-SecurityGroupsTestJSON-1613578867 Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bca25b0072144b22a04124f80362a310"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bca25b0072144b22a04124f80362a310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bca25b0072144b22a04124f80362a310", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bca25b0072144b22a04124f80362a310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-SecurityGroupsTestJSON-1613578867 Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: bca25b0072144b22a04124f80362a310 Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1613578867 Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-SecurityGroupsTestJSON-1613578867-project Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 3f3f6d563ecb4a6c88931c63b04a0974 Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-SecurityGroupsTestJSON-1613578867-project Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: exception: Security group 5cdd5ef7-da0a-4b42-a40a-27d58b926789 does not exist Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: Neutron server returns request_ids: ['req-982460f1-8560-40ae-b75a-afd426fa2011'] Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '5cdd5ef7-da0a-4b42-a40a-27d58b926789'} Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 05 08:34:28.109274 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5cdd5ef7-da0a-4b42-a40a-27d58b926789 does not exist Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-982460f1-8560-40ae-b75a-afd426fa2011'] Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5cdd5ef7-da0a-4b42-a40a-27d58b926789 does not exist Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-982460f1-8560-40ae-b75a-afd426fa2011'] Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5cdd5ef7-da0a-4b42-a40a-27d58b926789 does not exist Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-982460f1-8560-40ae-b75a-afd426fa2011'] Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5cdd5ef7-da0a-4b42-a40a-27d58b926789 does not exist Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-982460f1-8560-40ae-b75a-afd426fa2011'] Jun 05 08:34:28.114069 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:28.120598 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-eb3c85c4-4d88-47d8-b649-836d10dad727 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Returning 404 to user: Security group 5cdd5ef7-da0a-4b42-a40a-27d58b926789 does not exist Jun 05 08:34:28.120598 n-d-844739-1 devstack@n-api.service[119049]: Neutron server returns request_ids: ['req-982460f1-8560-40ae-b75a-afd426fa2011'] {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:34:28.122473 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-eb3c85c4-4d88-47d8-b649-836d10dad727 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/5cdd5ef7-da0a-4b42-a40a-27d58b926789" status: 404 len: 194 microversion: 2.1 time: 0.154370 Jun 05 08:34:28.127869 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-e0bc81c2-6b99-4b5c-afb6-faf7c8abb82c tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] [instance: 174ce019-0742-41ca-a1bd-ab97d3087c5e] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:34:28.134567 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-e0bc81c2-6b99-4b5c-afb6-faf7c8abb82c tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] [instance: 174ce019-0742-41ca-a1bd-ab97d3087c5e] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:34:28.138032 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1297/2648] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:34:27 2022] DELETE /compute/v2.1/os-security-groups/5cdd5ef7-da0a-4b42-a40a-27d58b926789 => generated 194 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:34:28.155214 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-49816285-a043-4fe4-acbe-2033c33c0749 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Calling method '.version_select at 0x7f24338de820>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:28.295569 n-d-844739-1 devstack@n-api.service[119049]: DEBUG neutronclient.v2_0.client [None req-49816285-a043-4fe4-acbe-2033c33c0749 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a979965b-792d-4dd9-bc8c-d48c7e07ad5c does not exist", "detail": ""}} {{(pid=119049) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 05 08:34:28.297395 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.security_group_api [None req-49816285-a043-4fe4-acbe-2033c33c0749 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Neutron security group a979965b-792d-4dd9-bc8c-d48c7e07ad5c not found {{(pid=119049) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 05 08:34:28.298040 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-49816285-a043-4fe4-acbe-2033c33c0749 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] HTTP exception thrown: Security group a979965b-792d-4dd9-bc8c-d48c7e07ad5c does not exist Jun 05 08:34:28.298040 n-d-844739-1 devstack@n-api.service[119049]: Neutron server returns request_ids: ['req-203c2708-880d-4fbe-92c1-e4f797f36d26'] Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-49816285-a043-4fe4-acbe-2033c33c0749 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Request method failure captured: Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: request: DELETE /compute/v2.1/os-security-groups/a979965b-792d-4dd9-bc8c-d48c7e07ad5c HTTP/1.1 Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGpib-ZK8SidNyrg6H5XRSXfosoROe5wT7voX_vBIw_2zj-mw9ztjy47EZwaCKl3eV9Wc5vOrfjToQ1AshN3RdkE-S0t1WvJzz7OTiL57Vaycuz75vyRFJgJqBGladF2f_APmIbmHHNdZW8Ocv-jxw5qoSLWJ4LysWm8Uu6DCCjMx5k Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: bca25b0072144b22a04124f80362a310 Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-SecurityGroupsTestJSON-1613578867 Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bca25b0072144b22a04124f80362a310"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bca25b0072144b22a04124f80362a310"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bca25b0072144b22a04124f80362a310", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bca25b0072144b22a04124f80362a310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-SecurityGroupsTestJSON-1613578867 Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: bca25b0072144b22a04124f80362a310 Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1613578867 Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-SecurityGroupsTestJSON-1613578867-project Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 3f3f6d563ecb4a6c88931c63b04a0974 Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-SecurityGroupsTestJSON-1613578867-project Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: exception: Security group a979965b-792d-4dd9-bc8c-d48c7e07ad5c does not exist Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: Neutron server returns request_ids: ['req-203c2708-880d-4fbe-92c1-e4f797f36d26'] Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'a979965b-792d-4dd9-bc8c-d48c7e07ad5c'} Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 05 08:34:28.306007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a979965b-792d-4dd9-bc8c-d48c7e07ad5c does not exist Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-203c2708-880d-4fbe-92c1-e4f797f36d26'] Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a979965b-792d-4dd9-bc8c-d48c7e07ad5c does not exist Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-203c2708-880d-4fbe-92c1-e4f797f36d26'] Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a979965b-792d-4dd9-bc8c-d48c7e07ad5c does not exist Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-203c2708-880d-4fbe-92c1-e4f797f36d26'] Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a979965b-792d-4dd9-bc8c-d48c7e07ad5c does not exist Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-203c2708-880d-4fbe-92c1-e4f797f36d26'] Jun 05 08:34:28.309691 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:28.322883 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-49816285-a043-4fe4-acbe-2033c33c0749 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Returning 404 to user: Security group a979965b-792d-4dd9-bc8c-d48c7e07ad5c does not exist Jun 05 08:34:28.322883 n-d-844739-1 devstack@n-api.service[119049]: Neutron server returns request_ids: ['req-203c2708-880d-4fbe-92c1-e4f797f36d26'] {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:34:28.323710 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-49816285-a043-4fe4-acbe-2033c33c0749 tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/a979965b-792d-4dd9-bc8c-d48c7e07ad5c" status: 404 len: 194 microversion: 2.1 time: 0.182220 Jun 05 08:34:28.327253 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1298/2649] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:34:28 2022] DELETE /compute/v2.1/os-security-groups/a979965b-792d-4dd9-bc8c-d48c7e07ad5c => generated 194 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:34:28.336460 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-873d9cd2-3fcf-4672-93d1-53801e4cef0b tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Calling method '.version_select at 0x7f243378d0d0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:28.597141 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=68,nova_cell0:UPDATE=26,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:34:28.624692 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e0bc81c2-6b99-4b5c-afb6-faf7c8abb82c tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] 10.222.0.33 "DELETE /compute/v2.1/servers/174ce019-0742-41ca-a1bd-ab97d3087c5e" status: 204 len: 0 microversion: 2.1 time: 0.968843 Jun 05 08:34:28.626921 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1352/2650] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:34:27 2022] DELETE /compute/v2.1/servers/174ce019-0742-41ca-a1bd-ab97d3087c5e => generated 0 bytes in 975 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:34:28.638458 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-18e7d787-5855-476e-a4ab-a98411ba1c0b tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:28.648595 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-18e7d787-5855-476e-a4ab-a98411ba1c0b tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] [instance: 174ce019-0742-41ca-a1bd-ab97d3087c5e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:34:28.665222 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-18e7d787-5855-476e-a4ab-a98411ba1c0b tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:28.665939 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-18e7d787-5855-476e-a4ab-a98411ba1c0b tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:28.666878 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-18e7d787-5855-476e-a4ab-a98411ba1c0b tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:28.672444 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-18e7d787-5855-476e-a4ab-a98411ba1c0b tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:28.697693 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-18e7d787-5855-476e-a4ab-a98411ba1c0b tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] HTTP exception thrown: Instance 174ce019-0742-41ca-a1bd-ab97d3087c5e could not be found. Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-18e7d787-5855-476e-a4ab-a98411ba1c0b tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Request method failure captured: Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/174ce019-0742-41ca-a1bd-ab97d3087c5e HTTP/1.1 Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGqMPz_UIoyxfUlkFNb2qXIS93ZM_NiUFDnNo8UFLZuDjJrDvWDzV1zuW9LIttXcydmdC0a4pOALtQrRLG6jK2-2BPGY_MLa4c7Q7tHTFuorj2aqOARcRkZYP1gtsWuP77pu5EJvm8iAiLuYPtoIaUIioSShN-tRmB4u7oomTUT6UZg Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: ab9950d578064758976b2b58940db26f Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-539584483 Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab9950d578064758976b2b58940db26f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab9950d578064758976b2b58940db26f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab9950d578064758976b2b58940db26f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab9950d578064758976b2b58940db26f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-539584483 Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: ab9950d578064758976b2b58940db26f Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-539584483 Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ImagesOneServerNegativeTestJSON-539584483-project Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 86d9ce3b4b4f416aa23acf6f243d52db Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-539584483-project Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 174ce019-0742-41ca-a1bd-ab97d3087c5e could not be found. Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '174ce019-0742-41ca-a1bd-ab97d3087c5e'} Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 174ce019-0742-41ca-a1bd-ab97d3087c5e could not be found. Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 174ce019-0742-41ca-a1bd-ab97d3087c5e could not be found. Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:28.701815 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:34:28.705939 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:28.705939 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:28.705939 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:34:28.705939 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:34:28.705939 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:34:28.705939 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:34:28.705939 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 174ce019-0742-41ca-a1bd-ab97d3087c5e could not be found. Jun 05 08:34:28.705939 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:34:28.710120 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-18e7d787-5855-476e-a4ab-a98411ba1c0b tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] Returning 404 to user: Instance 174ce019-0742-41ca-a1bd-ab97d3087c5e could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:34:28.711240 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-18e7d787-5855-476e-a4ab-a98411ba1c0b tempest-ImagesOneServerNegativeTestJSON-539584483 tempest-ImagesOneServerNegativeTestJSON-539584483-project] 10.222.0.33 "GET /compute/v2.1/servers/174ce019-0742-41ca-a1bd-ab97d3087c5e" status: 404 len: 111 microversion: 2.1 time: 0.079702 Jun 05 08:34:28.713694 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1353/2651] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:34:28 2022] GET /compute/v2.1/servers/174ce019-0742-41ca-a1bd-ab97d3087c5e => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:34:28.979810 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-873d9cd2-3fcf-4672-93d1-53801e4cef0b tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/a66053c2-4b2b-4b21-ada1-23fdd2879dce" status: 202 len: 0 microversion: 2.1 time: 0.649394 Jun 05 08:34:28.981933 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1299/2652] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:34:28 2022] DELETE /compute/v2.1/os-security-groups/a66053c2-4b2b-4b21-ada1-23fdd2879dce => generated 0 bytes in 654 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:34:28.995773 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-db0ecbc8-3592-4d2e-9a89-632a00e57a7a tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] Calling method '.version_select at 0x7f2432ecb820>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:29.680627 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-db0ecbc8-3592-4d2e-9a89-632a00e57a7a tempest-SecurityGroupsTestJSON-1613578867 tempest-SecurityGroupsTestJSON-1613578867-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/e6fd05df-4cf5-44db-8b92-c1cd10ee1d6e" status: 202 len: 0 microversion: 2.1 time: 0.689968 Jun 05 08:34:29.692776 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1354/2653] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:34:28 2022] DELETE /compute/v2.1/os-security-groups/e6fd05df-4cf5-44db-8b92-c1cd10ee1d6e => generated 0 bytes in 708 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 05 08:34:39.453641 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:34:39.454703 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=6 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:34:39.455362 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=16,nova_api:INSERT=3 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:34:39.456951 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=27 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:34:39.462009 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8cbbb6b1-dbc7-4b38-8437-337be82e8bc5 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-286368363", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "321c0366-f264-43d7-b907-6c0dafaf83ea"}, {"uuid": "9f6d33d2-9830-4f2a-b648-cd5d912eb31d"}, {"uuid": "321c0366-f264-43d7-b907-6c0dafaf83ea"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:34:39.533221 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-8cbbb6b1-dbc7-4b38-8437-337be82e8bc5 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] validate_networks() for [('321c0366-f264-43d7-b907-6c0dafaf83ea', None, None, None, None, None), ('9f6d33d2-9830-4f2a-b648-cd5d912eb31d', None, None, None, None, None), ('321c0366-f264-43d7-b907-6c0dafaf83ea', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:34:45.033337 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-8cbbb6b1-dbc7-4b38-8437-337be82e8bc5 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:34:45.035967 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-8cbbb6b1-dbc7-4b38-8437-337be82e8bc5 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:34:45.037433 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-8cbbb6b1-dbc7-4b38-8437-337be82e8bc5 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:34:45.039241 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-8cbbb6b1-dbc7-4b38-8437-337be82e8bc5 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:34:45.040588 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-8cbbb6b1-dbc7-4b38-8437-337be82e8bc5 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:34:45.080244 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8cbbb6b1-dbc7-4b38-8437-337be82e8bc5 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:45.080755 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8cbbb6b1-dbc7-4b38-8437-337be82e8bc5 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:45.081969 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8cbbb6b1-dbc7-4b38-8437-337be82e8bc5 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:45.082420 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8cbbb6b1-dbc7-4b38-8437-337be82e8bc5 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:45.129849 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-8cbbb6b1-dbc7-4b38-8437-337be82e8bc5 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Getting quotas for project 82fde866a28a4b49badbe81e5b5ced08. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:34:45.148944 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-8cbbb6b1-dbc7-4b38-8437-337be82e8bc5 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Getting quotas for user edc2ac8650ca4864ac407b2e24afdb6e and project 82fde866a28a4b49badbe81e5b5ced08. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:34:45.171750 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8cbbb6b1-dbc7-4b38-8437-337be82e8bc5 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:34:45.182431 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8cbbb6b1-dbc7-4b38-8437-337be82e8bc5 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] [instance: 746ddcc1-c1f9-46b6-beba-45db6bc439ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:34:45.309534 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8cbbb6b1-dbc7-4b38-8437-337be82e8bc5 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.858193 Jun 05 08:34:45.318016 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1300/2654] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:34:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 5867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:34:45.322904 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ac6005f9-607c-41a2-90c9-425fab43f628 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:45.323523 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ac6005f9-607c-41a2-90c9-425fab43f628 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] [instance: 746ddcc1-c1f9-46b6-beba-45db6bc439ee] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:34:45.327895 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=27 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:34:45.328391 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=10 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:34:45.346818 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:34:45.354667 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:UPDATE=4,nova_cell0:DELETE=2,nova_cell0:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:34:46.026929 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ac6005f9-607c-41a2-90c9-425fab43f628 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc2ac8650ca4864ac407b2e24afdb6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fde866a28a4b49badbe81e5b5ced08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:46.063488 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ac6005f9-607c-41a2-90c9-425fab43f628 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] 10.222.0.33 "GET /compute/v2.1/servers/746ddcc1-c1f9-46b6-beba-45db6bc439ee" status: 200 len: 1212 microversion: 2.1 time: 0.744660 Jun 05 08:34:46.082640 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1355/2655] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:34:45 2022] GET /compute/v2.1/servers/746ddcc1-c1f9-46b6-beba-45db6bc439ee => generated 1212 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:34:47.097456 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-53639925-684a-4fed-b7f3-a62b706e8f26 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:47.098246 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-53639925-684a-4fed-b7f3-a62b706e8f26 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] [instance: 746ddcc1-c1f9-46b6-beba-45db6bc439ee] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:34:47.128263 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-53639925-684a-4fed-b7f3-a62b706e8f26 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:47.128687 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-53639925-684a-4fed-b7f3-a62b706e8f26 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:47.130579 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-53639925-684a-4fed-b7f3-a62b706e8f26 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:47.130983 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-53639925-684a-4fed-b7f3-a62b706e8f26 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:47.282746 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-53639925-684a-4fed-b7f3-a62b706e8f26 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:47.283599 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-53639925-684a-4fed-b7f3-a62b706e8f26 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:47.284243 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-53639925-684a-4fed-b7f3-a62b706e8f26 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lazy-loading 'fault' on Instance uuid 746ddcc1-c1f9-46b6-beba-45db6bc439ee {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:34:47.517823 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5881d2d6-d368-4915-b57e-9555ca7fb670 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Action: 'create', calling method: .version_select at 0x7f243378ddc0>, body: {"keypair": {"name": "tempest-keypair-1738540645", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKeWZkHB/63z0WZj5s1T3NA5wIr5QC2gxo6nwhL4y3IMOF3QO+9tfSbQne26kRqDXpWD9xC3lVcG1NlmnSOfzuIEls1mJjQe1vQkfWeyEP5y9r7FXlOlmagpV5GusthjAQ=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:34:47.538483 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-53639925-684a-4fed-b7f3-a62b706e8f26 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc2ac8650ca4864ac407b2e24afdb6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fde866a28a4b49badbe81e5b5ced08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:47.550039 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-5881d2d6-d368-4915-b57e-9555ca7fb670 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Getting quotas for project d5e7ade35b9a4274946f01b36068d54c. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:34:47.553009 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-53639925-684a-4fed-b7f3-a62b706e8f26 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] 10.222.0.33 "GET /compute/v2.1/servers/746ddcc1-c1f9-46b6-beba-45db6bc439ee" status: 200 len: 1285 microversion: 2.1 time: 0.460644 Jun 05 08:34:47.555863 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1356/2656] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:34:47 2022] GET /compute/v2.1/servers/746ddcc1-c1f9-46b6-beba-45db6bc439ee => generated 1285 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:34:47.574717 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cca1b1b1-cd94-477e-b8e6-ac7896792f4d tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:47.580829 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-cca1b1b1-cd94-477e-b8e6-ac7896792f4d tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] [instance: 746ddcc1-c1f9-46b6-beba-45db6bc439ee] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:34:47.583279 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-5881d2d6-d368-4915-b57e-9555ca7fb670 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Getting quotas for user d5d1579b6f744bee9f553cae89bed66b and project d5e7ade35b9a4274946f01b36068d54c. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:34:47.609639 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cca1b1b1-cd94-477e-b8e6-ac7896792f4d tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:47.616184 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cca1b1b1-cd94-477e-b8e6-ac7896792f4d tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:47.622693 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cca1b1b1-cd94-477e-b8e6-ac7896792f4d tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:47.627946 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cca1b1b1-cd94-477e-b8e6-ac7896792f4d tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:47.657214 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5881d2d6-d368-4915-b57e-9555ca7fb670 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.669216 Jun 05 08:34:47.658466 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1301/2657] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:34:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:34:47.781962 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-cca1b1b1-cd94-477e-b8e6-ac7896792f4d tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] [instance: 746ddcc1-c1f9-46b6-beba-45db6bc439ee] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:34:47.919502 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-cca1b1b1-cd94-477e-b8e6-ac7896792f4d tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] [instance: 746ddcc1-c1f9-46b6-beba-45db6bc439ee] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:34:47.923808 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cca1b1b1-cd94-477e-b8e6-ac7896792f4d tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:47.939887 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cca1b1b1-cd94-477e-b8e6-ac7896792f4d tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:47.940705 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-cca1b1b1-cd94-477e-b8e6-ac7896792f4d tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] [instance: 746ddcc1-c1f9-46b6-beba-45db6bc439ee] instance's host None is down, deleting from database Jun 05 08:34:47.947766 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-cca1b1b1-cd94-477e-b8e6-ac7896792f4d tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] [instance: 746ddcc1-c1f9-46b6-beba-45db6bc439ee] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:34:48.074960 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-cca1b1b1-cd94-477e-b8e6-ac7896792f4d tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] [instance: 746ddcc1-c1f9-46b6-beba-45db6bc439ee] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:34:48.082757 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-cca1b1b1-cd94-477e-b8e6-ac7896792f4d tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] [instance: 746ddcc1-c1f9-46b6-beba-45db6bc439ee] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:34:48.451962 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-cca1b1b1-cd94-477e-b8e6-ac7896792f4d tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] 10.222.0.33 "DELETE /compute/v2.1/servers/746ddcc1-c1f9-46b6-beba-45db6bc439ee" status: 204 len: 0 microversion: 2.1 time: 0.884576 Jun 05 08:34:48.456319 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1357/2658] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:34:47 2022] DELETE /compute/v2.1/servers/746ddcc1-c1f9-46b6-beba-45db6bc439ee => generated 0 bytes in 891 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:34:48.470475 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4c51e7ad-4ae6-42c0-9d6b-1b7cf490fcc0 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:48.471173 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4c51e7ad-4ae6-42c0-9d6b-1b7cf490fcc0 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] [instance: 746ddcc1-c1f9-46b6-beba-45db6bc439ee] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:34:48.488398 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4c51e7ad-4ae6-42c0-9d6b-1b7cf490fcc0 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:48.488941 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4c51e7ad-4ae6-42c0-9d6b-1b7cf490fcc0 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:48.489864 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4c51e7ad-4ae6-42c0-9d6b-1b7cf490fcc0 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:48.490315 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4c51e7ad-4ae6-42c0-9d6b-1b7cf490fcc0 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:48.534359 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-4c51e7ad-4ae6-42c0-9d6b-1b7cf490fcc0 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] HTTP exception thrown: Instance 746ddcc1-c1f9-46b6-beba-45db6bc439ee could not be found. Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4c51e7ad-4ae6-42c0-9d6b-1b7cf490fcc0 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Request method failure captured: Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/746ddcc1-c1f9-46b6-beba-45db6bc439ee HTTP/1.1 Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGqbS389pFkMqOwtoYbgHVwm8aNqR_iUe5IuDQqG3qcFARESeqH709g5ctWQ23t6SU_lV7sPH9ND3QrqDaFu1E8jQpdeauOSLOjvuPx1R7lI45JdPb64nVxIBWVQ27VdzPteDWkTHEMx4c6S4fUfSCP8T-gJo7HpMUZfU5GV9zH7etA Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 82fde866a28a4b49badbe81e5b5ced08 Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ServersTestMultiNic-1509830942 Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/82fde866a28a4b49badbe81e5b5ced08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82fde866a28a4b49badbe81e5b5ced08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_82fde866a28a4b49badbe81e5b5ced08", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82fde866a28a4b49badbe81e5b5ced08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ServersTestMultiNic-1509830942 Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 82fde866a28a4b49badbe81e5b5ced08 Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ServersTestMultiNic-1509830942 Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ServersTestMultiNic-1509830942-project Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: edc2ac8650ca4864ac407b2e24afdb6e Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ServersTestMultiNic-1509830942-project Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 746ddcc1-c1f9-46b6-beba-45db6bc439ee could not be found. Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '746ddcc1-c1f9-46b6-beba-45db6bc439ee'} Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 746ddcc1-c1f9-46b6-beba-45db6bc439ee could not be found. Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 746ddcc1-c1f9-46b6-beba-45db6bc439ee could not be found. Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:34:48.550211 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:48.557167 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:34:48.557167 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:34:48.557167 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:34:48.557167 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:34:48.557167 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:34:48.557167 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 746ddcc1-c1f9-46b6-beba-45db6bc439ee could not be found. Jun 05 08:34:48.557167 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:34:48.559108 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4c51e7ad-4ae6-42c0-9d6b-1b7cf490fcc0 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Returning 404 to user: Instance 746ddcc1-c1f9-46b6-beba-45db6bc439ee could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:34:48.560276 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4c51e7ad-4ae6-42c0-9d6b-1b7cf490fcc0 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] 10.222.0.33 "GET /compute/v2.1/servers/746ddcc1-c1f9-46b6-beba-45db6bc439ee" status: 404 len: 111 microversion: 2.1 time: 0.099460 Jun 05 08:34:48.561982 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1302/2659] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:34:48 2022] GET /compute/v2.1/servers/746ddcc1-c1f9-46b6-beba-45db6bc439ee => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 05 08:34:56.280787 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:34:56.288747 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-53b01e28-ef5b-4366-a130-2f8551e19c36 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-2054619768", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "26582359-13c8-45e3-9731-6abdacd5e890"}], "security_groups": [{"name": "tempest-securitygroup--1578591101"}], "key_name": "tempest-keypair-1738540645", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:34:56.801844 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:34:56.856184 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-53b01e28-ef5b-4366-a130-2f8551e19c36 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] validate_networks() for [('26582359-13c8-45e3-9731-6abdacd5e890', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:34:56.934369 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0ad74763-2ee7-41a5-8cd4-0ffe6d44deb3 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Action: 'create', calling method: .version_select at 0x7f2445567550>, body: {"keypair": {"name": "tempest-keypair-1357202557", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbgS1tZe7UJ/sNx9giNLAJRW3SvOVmdoVfoa3saShTBbKAfOYQWxj3NU/RbTqpcE4WS9V2p+FaBuYgRqXgGFdag45kHwkahT+4gBicXmgHhCIHVppouPZp3junGOyDW6g=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:34:56.971239 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-0ad74763-2ee7-41a5-8cd4-0ffe6d44deb3 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Getting quotas for project 64561b8391a34b5ab01f51cb31378fea. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:34:56.987310 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-0ad74763-2ee7-41a5-8cd4-0ffe6d44deb3 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Getting quotas for user 73d35c50862d43558407afdedeb8e232 and project 64561b8391a34b5ab01f51cb31378fea. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:34:57.051041 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0ad74763-2ee7-41a5-8cd4-0ffe6d44deb3 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.261370 Jun 05 08:34:57.051593 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1303/2660] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:34:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:34:58.442269 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=32,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:34:58.719861 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-53b01e28-ef5b-4366-a130-2f8551e19c36 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Getting quotas for project d5e7ade35b9a4274946f01b36068d54c. Resources: dict_keys(['metadata_items']) {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:34:58.732847 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-53b01e28-ef5b-4366-a130-2f8551e19c36 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Getting quotas for user d5d1579b6f744bee9f553cae89bed66b and project d5e7ade35b9a4274946f01b36068d54c. Resources: dict_keys(['metadata_items']) {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:34:58.773719 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-53b01e28-ef5b-4366-a130-2f8551e19c36 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:34:58.774366 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-53b01e28-ef5b-4366-a130-2f8551e19c36 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:34:58.776088 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-53b01e28-ef5b-4366-a130-2f8551e19c36 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:34:58.776839 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-53b01e28-ef5b-4366-a130-2f8551e19c36 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:34:58.778463 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-53b01e28-ef5b-4366-a130-2f8551e19c36 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:34:58.804948 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-53b01e28-ef5b-4366-a130-2f8551e19c36 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:58.806365 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-53b01e28-ef5b-4366-a130-2f8551e19c36 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:58.807811 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-53b01e28-ef5b-4366-a130-2f8551e19c36 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:34:58.809458 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-53b01e28-ef5b-4366-a130-2f8551e19c36 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:34:58.859772 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-53b01e28-ef5b-4366-a130-2f8551e19c36 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Getting quotas for project d5e7ade35b9a4274946f01b36068d54c. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:34:58.876011 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-53b01e28-ef5b-4366-a130-2f8551e19c36 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Getting quotas for user d5d1579b6f744bee9f553cae89bed66b and project d5e7ade35b9a4274946f01b36068d54c. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:34:58.908237 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-53b01e28-ef5b-4366-a130-2f8551e19c36 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:34:58.913239 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-53b01e28-ef5b-4366-a130-2f8551e19c36 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] [instance: 538c3a6e-bd90-47cc-b5bb-b564a8881969] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:34:59.045941 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-53b01e28-ef5b-4366-a130-2f8551e19c36 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.764316 Jun 05 08:34:59.046807 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1358/2661] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:34:56 2022] POST /compute/v2.1/servers => generated 409 bytes in 2769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:34:59.062459 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-327db53e-0ca3-45e4-adc5-00de509718cd tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:34:59.064162 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-327db53e-0ca3-45e4-adc5-00de509718cd tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] [instance: 538c3a6e-bd90-47cc-b5bb-b564a8881969] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:34:59.075041 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=4 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:34:59.419883 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-327db53e-0ca3-45e4-adc5-00de509718cd tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d1579b6f744bee9f553cae89bed66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e7ade35b9a4274946f01b36068d54c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:34:59.464474 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-327db53e-0ca3-45e4-adc5-00de509718cd tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] 10.222.0.33 "GET /compute/v2.1/servers/538c3a6e-bd90-47cc-b5bb-b564a8881969" status: 200 len: 1278 microversion: 2.1 time: 0.410630 Jun 05 08:34:59.481386 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1304/2662] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:34:59 2022] GET /compute/v2.1/servers/538c3a6e-bd90-47cc-b5bb-b564a8881969 => generated 1278 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:35:00.501054 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4cad025a-ddbb-4df5-873f-37939c0591db tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:00.503916 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4cad025a-ddbb-4df5-873f-37939c0591db tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] [instance: 538c3a6e-bd90-47cc-b5bb-b564a8881969] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:00.520864 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4cad025a-ddbb-4df5-873f-37939c0591db tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:00.521323 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4cad025a-ddbb-4df5-873f-37939c0591db tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:00.522145 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4cad025a-ddbb-4df5-873f-37939c0591db tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:00.522579 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4cad025a-ddbb-4df5-873f-37939c0591db tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:00.659490 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4cad025a-ddbb-4df5-873f-37939c0591db tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:00.660113 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4cad025a-ddbb-4df5-873f-37939c0591db tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:00.660608 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-4cad025a-ddbb-4df5-873f-37939c0591db tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Lazy-loading 'fault' on Instance uuid 538c3a6e-bd90-47cc-b5bb-b564a8881969 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:35:00.802194 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4cad025a-ddbb-4df5-873f-37939c0591db tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d1579b6f744bee9f553cae89bed66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e7ade35b9a4274946f01b36068d54c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:00.812423 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4cad025a-ddbb-4df5-873f-37939c0591db tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] 10.222.0.33 "GET /compute/v2.1/servers/538c3a6e-bd90-47cc-b5bb-b564a8881969" status: 200 len: 1351 microversion: 2.1 time: 0.317346 Jun 05 08:35:00.813187 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1359/2663] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:35:00 2022] GET /compute/v2.1/servers/538c3a6e-bd90-47cc-b5bb-b564a8881969 => generated 1351 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:35:00.830751 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4807cd35-6b93-4bb3-af54-052977909fe9 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:00.831246 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4807cd35-6b93-4bb3-af54-052977909fe9 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] [instance: 538c3a6e-bd90-47cc-b5bb-b564a8881969] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:00.848003 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4807cd35-6b93-4bb3-af54-052977909fe9 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:00.865899 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4807cd35-6b93-4bb3-af54-052977909fe9 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:00.869198 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4807cd35-6b93-4bb3-af54-052977909fe9 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:00.871370 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4807cd35-6b93-4bb3-af54-052977909fe9 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:00.978959 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4807cd35-6b93-4bb3-af54-052977909fe9 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] [instance: 538c3a6e-bd90-47cc-b5bb-b564a8881969] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:35:01.150741 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4807cd35-6b93-4bb3-af54-052977909fe9 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] [instance: 538c3a6e-bd90-47cc-b5bb-b564a8881969] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:35:01.151774 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4807cd35-6b93-4bb3-af54-052977909fe9 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:01.152285 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4807cd35-6b93-4bb3-af54-052977909fe9 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:01.152746 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-4807cd35-6b93-4bb3-af54-052977909fe9 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] [instance: 538c3a6e-bd90-47cc-b5bb-b564a8881969] instance's host None is down, deleting from database Jun 05 08:35:01.161926 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-4807cd35-6b93-4bb3-af54-052977909fe9 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] [instance: 538c3a6e-bd90-47cc-b5bb-b564a8881969] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:35:01.381747 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d8c0fa84-707a-42bc-a430-e22152d1eee1 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Action: 'create', calling method: .version_select at 0x7f2432ef5430>, body: {"keypair": {"name": "tempest-keypair-1226972439", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKwohFqI2dGfQObyaG61BNR736PNFUu87J1wHogAiK5pvc5bxOy8mgPWYKYwhN3REoN0n/Ce+qvAZxGpLWox1/96cr4FBgidUd2jwRgcdyAT3TIxDj4RLoF+cu9BJuc1Q=="}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:35:01.428176 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-d8c0fa84-707a-42bc-a430-e22152d1eee1 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Getting quotas for project aa3d7a07d4a141d4b75de9cc5bef0fb8. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:35:01.448460 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-d8c0fa84-707a-42bc-a430-e22152d1eee1 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Getting quotas for user cba3076f4db44ec1936514015e3d0ed5 and project aa3d7a07d4a141d4b75de9cc5bef0fb8. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:35:01.481748 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-4807cd35-6b93-4bb3-af54-052977909fe9 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] [instance: 538c3a6e-bd90-47cc-b5bb-b564a8881969] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:35:01.493886 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-4807cd35-6b93-4bb3-af54-052977909fe9 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] [instance: 538c3a6e-bd90-47cc-b5bb-b564a8881969] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:35:01.507534 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d8c0fa84-707a-42bc-a430-e22152d1eee1 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.343484 Jun 05 08:35:01.516955 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1360/2664] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:35:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:35:02.106746 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4807cd35-6b93-4bb3-af54-052977909fe9 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] 10.222.0.33 "DELETE /compute/v2.1/servers/538c3a6e-bd90-47cc-b5bb-b564a8881969" status: 204 len: 0 microversion: 2.1 time: 1.279766 Jun 05 08:35:02.116177 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1305/2665] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:35:00 2022] DELETE /compute/v2.1/servers/538c3a6e-bd90-47cc-b5bb-b564a8881969 => generated 0 bytes in 1287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:35:02.119181 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e2eef998-9ee1-4e9c-8b2c-103bf5207392 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:02.119846 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e2eef998-9ee1-4e9c-8b2c-103bf5207392 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] [instance: 538c3a6e-bd90-47cc-b5bb-b564a8881969] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:02.127340 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e2eef998-9ee1-4e9c-8b2c-103bf5207392 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:02.127849 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e2eef998-9ee1-4e9c-8b2c-103bf5207392 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:02.146913 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e2eef998-9ee1-4e9c-8b2c-103bf5207392 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:02.147377 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e2eef998-9ee1-4e9c-8b2c-103bf5207392 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:02.157225 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c4acc74c-caf2-4f3a-a7b9-3931427f9fc1 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "d9f35206-9205-4017-b3bf-54b393e6aacb"}], "security_groups": [{"name": "tempest-securitygroup--469205306"}], "key_name": "tempest-keypair-1357202557", "user_data": "}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:35:02.178594 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-e2eef998-9ee1-4e9c-8b2c-103bf5207392 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] HTTP exception thrown: Instance 538c3a6e-bd90-47cc-b5bb-b564a8881969 could not be found. Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e2eef998-9ee1-4e9c-8b2c-103bf5207392 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Request method failure captured: Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/538c3a6e-bd90-47cc-b5bb-b564a8881969 HTTP/1.1 Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGqm_scP33Ed6OFHQu99PNQ7wMpMnpoCEV-yLHdRKjJzh8T2CxgD7t0-1HhCceOpTPBWvjtoHzhzu2e8nVAlLjPu9BBMDM53T4qeUDO6PImuBwncZO_ktqNTe--xKljhSsKgDGiIVUAaYKnEiNLq9TIgv2xbVgW5dMuqHeFdT5x2ASo Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: d5e7ade35b9a4274946f01b36068d54c Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ServersTestManualDisk-969786706 Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d5e7ade35b9a4274946f01b36068d54c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d5e7ade35b9a4274946f01b36068d54c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d5e7ade35b9a4274946f01b36068d54c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d5e7ade35b9a4274946f01b36068d54c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ServersTestManualDisk-969786706 Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: d5e7ade35b9a4274946f01b36068d54c Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ServersTestManualDisk-969786706 Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ServersTestManualDisk-969786706-project Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: d5d1579b6f744bee9f553cae89bed66b Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ServersTestManualDisk-969786706-project Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 538c3a6e-bd90-47cc-b5bb-b564a8881969 could not be found. Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '538c3a6e-bd90-47cc-b5bb-b564a8881969'} Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 538c3a6e-bd90-47cc-b5bb-b564a8881969 could not be found. Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 538c3a6e-bd90-47cc-b5bb-b564a8881969 could not be found. Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:02.188128 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:02.191954 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:02.191954 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:02.191954 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:02.191954 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:35:02.191954 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:35:02.191954 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 538c3a6e-bd90-47cc-b5bb-b564a8881969 could not be found. Jun 05 08:35:02.191954 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:02.191954 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e2eef998-9ee1-4e9c-8b2c-103bf5207392 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Returning 404 to user: Instance 538c3a6e-bd90-47cc-b5bb-b564a8881969 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:35:02.194715 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e2eef998-9ee1-4e9c-8b2c-103bf5207392 tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] 10.222.0.33 "GET /compute/v2.1/servers/538c3a6e-bd90-47cc-b5bb-b564a8881969" status: 404 len: 111 microversion: 2.1 time: 0.079587 Jun 05 08:35:02.195838 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1361/2666] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:35:02 2022] GET /compute/v2.1/servers/538c3a6e-bd90-47cc-b5bb-b564a8881969 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:35:02.204507 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-146d59b9-82f3-4bd9-94a8-3cf59d12e77e tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] Calling method '.version_select at 0x7f244535ee50>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:02.245428 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-146d59b9-82f3-4bd9-94a8-3cf59d12e77e tempest-ServersTestManualDisk-969786706 tempest-ServersTestManualDisk-969786706-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1738540645" status: 202 len: 0 microversion: 2.1 time: 0.045099 Jun 05 08:35:02.246546 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1362/2667] 10.222.0.33 () {58 vars in 1220 bytes} [Sun Jun 5 08:35:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1738540645 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 05 08:35:02.501722 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-c4acc74c-caf2-4f3a-a7b9-3931427f9fc1 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] validate_networks() for [('d9f35206-9205-4017-b3bf-54b393e6aacb', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:35:03.650346 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f7b069ad-d920-4c40-bb36-fbc2250ce0d0 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-884454860", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "c2dce0a2-f262-43b3-a16d-8bae793b1f01"}, {"uuid": "91de1c46-b141-4a40-9402-6e341335a426"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:35:03.743237 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-f7b069ad-d920-4c40-bb36-fbc2250ce0d0 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] validate_networks() for [('c2dce0a2-f262-43b3-a16d-8bae793b1f01', None, None, None, None, None), ('91de1c46-b141-4a40-9402-6e341335a426', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:35:04.877647 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-c4acc74c-caf2-4f3a-a7b9-3931427f9fc1 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:35:04.881360 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-c4acc74c-caf2-4f3a-a7b9-3931427f9fc1 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:35:04.885040 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-c4acc74c-caf2-4f3a-a7b9-3931427f9fc1 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:35:04.885488 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-c4acc74c-caf2-4f3a-a7b9-3931427f9fc1 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:35:04.885917 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-c4acc74c-caf2-4f3a-a7b9-3931427f9fc1 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:35:04.916685 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c4acc74c-caf2-4f3a-a7b9-3931427f9fc1 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:04.917158 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c4acc74c-caf2-4f3a-a7b9-3931427f9fc1 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:04.917985 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c4acc74c-caf2-4f3a-a7b9-3931427f9fc1 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:04.918435 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c4acc74c-caf2-4f3a-a7b9-3931427f9fc1 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:04.974827 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-c4acc74c-caf2-4f3a-a7b9-3931427f9fc1 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Getting quotas for project 64561b8391a34b5ab01f51cb31378fea. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:35:04.989935 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-c4acc74c-caf2-4f3a-a7b9-3931427f9fc1 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Getting quotas for user 73d35c50862d43558407afdedeb8e232 and project 64561b8391a34b5ab01f51cb31378fea. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:35:05.026913 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c4acc74c-caf2-4f3a-a7b9-3931427f9fc1 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:35:05.031894 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c4acc74c-caf2-4f3a-a7b9-3931427f9fc1 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] [instance: 0139d707-356f-433f-a04a-4e4315dbc4b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:35:05.145951 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c4acc74c-caf2-4f3a-a7b9-3931427f9fc1 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.996036 Jun 05 08:35:05.147192 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1306/2668] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:35:02 2022] POST /compute/v2.1/servers => generated 408 bytes in 3000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:35:05.165163 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3f27c10f-8f5f-451a-a4b5-a26ac2aff46a tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:05.167732 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3f27c10f-8f5f-451a-a4b5-a26ac2aff46a tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] [instance: 0139d707-356f-433f-a04a-4e4315dbc4b2] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:05.312835 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3f27c10f-8f5f-451a-a4b5-a26ac2aff46a tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d35c50862d43558407afdedeb8e232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64561b8391a34b5ab01f51cb31378fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:05.329646 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3f27c10f-8f5f-451a-a4b5-a26ac2aff46a tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] 10.222.0.33 "GET /compute/v2.1/servers/0139d707-356f-433f-a04a-4e4315dbc4b2" status: 200 len: 1226 microversion: 2.1 time: 0.169106 Jun 05 08:35:05.331072 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1307/2669] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:35:05 2022] GET /compute/v2.1/servers/0139d707-356f-433f-a04a-4e4315dbc4b2 => generated 1226 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:35:05.898074 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-f7b069ad-d920-4c40-bb36-fbc2250ce0d0 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:35:05.899141 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-f7b069ad-d920-4c40-bb36-fbc2250ce0d0 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:35:05.899920 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-f7b069ad-d920-4c40-bb36-fbc2250ce0d0 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:35:05.900522 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-f7b069ad-d920-4c40-bb36-fbc2250ce0d0 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:35:05.901505 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-f7b069ad-d920-4c40-bb36-fbc2250ce0d0 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:35:05.915181 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f7b069ad-d920-4c40-bb36-fbc2250ce0d0 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:05.916231 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f7b069ad-d920-4c40-bb36-fbc2250ce0d0 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:05.917244 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f7b069ad-d920-4c40-bb36-fbc2250ce0d0 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:05.918110 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f7b069ad-d920-4c40-bb36-fbc2250ce0d0 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:05.978938 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-f7b069ad-d920-4c40-bb36-fbc2250ce0d0 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Getting quotas for project 82fde866a28a4b49badbe81e5b5ced08. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:35:05.988023 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-f7b069ad-d920-4c40-bb36-fbc2250ce0d0 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Getting quotas for user edc2ac8650ca4864ac407b2e24afdb6e and project 82fde866a28a4b49badbe81e5b5ced08. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:35:06.011710 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f7b069ad-d920-4c40-bb36-fbc2250ce0d0 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:35:06.016078 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f7b069ad-d920-4c40-bb36-fbc2250ce0d0 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] [instance: 650827ac-1ddc-401c-896b-ce315894fe36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:35:06.100283 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f7b069ad-d920-4c40-bb36-fbc2250ce0d0 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.453916 Jun 05 08:35:06.103774 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1363/2670] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:35:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:35:06.114164 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-17de62e4-2186-4bb4-88a5-7459ba50bb8e tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:06.114778 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-17de62e4-2186-4bb4-88a5-7459ba50bb8e tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] [instance: 650827ac-1ddc-401c-896b-ce315894fe36] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:06.236993 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-17de62e4-2186-4bb4-88a5-7459ba50bb8e tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc2ac8650ca4864ac407b2e24afdb6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fde866a28a4b49badbe81e5b5ced08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:06.245040 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-17de62e4-2186-4bb4-88a5-7459ba50bb8e tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] 10.222.0.33 "GET /compute/v2.1/servers/650827ac-1ddc-401c-896b-ce315894fe36" status: 200 len: 1212 microversion: 2.1 time: 0.134523 Jun 05 08:35:06.277170 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1308/2671] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:35:06 2022] GET /compute/v2.1/servers/650827ac-1ddc-401c-896b-ce315894fe36 => generated 1212 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:35:06.347993 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ebdcd0bb-3d35-435b-a2e3-f7072a8819ae tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:06.349175 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ebdcd0bb-3d35-435b-a2e3-f7072a8819ae tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] [instance: 0139d707-356f-433f-a04a-4e4315dbc4b2] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:06.373379 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ebdcd0bb-3d35-435b-a2e3-f7072a8819ae tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:06.375854 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ebdcd0bb-3d35-435b-a2e3-f7072a8819ae tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:06.378117 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ebdcd0bb-3d35-435b-a2e3-f7072a8819ae tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:06.381537 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ebdcd0bb-3d35-435b-a2e3-f7072a8819ae tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:06.527940 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ebdcd0bb-3d35-435b-a2e3-f7072a8819ae tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:06.528424 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ebdcd0bb-3d35-435b-a2e3-f7072a8819ae tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:06.529069 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-ebdcd0bb-3d35-435b-a2e3-f7072a8819ae tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Lazy-loading 'fault' on Instance uuid 0139d707-356f-433f-a04a-4e4315dbc4b2 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:35:06.642744 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ebdcd0bb-3d35-435b-a2e3-f7072a8819ae tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d35c50862d43558407afdedeb8e232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64561b8391a34b5ab01f51cb31378fea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:06.652573 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ebdcd0bb-3d35-435b-a2e3-f7072a8819ae tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] 10.222.0.33 "GET /compute/v2.1/servers/0139d707-356f-433f-a04a-4e4315dbc4b2" status: 200 len: 1299 microversion: 2.1 time: 0.308678 Jun 05 08:35:06.657178 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1364/2672] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:35:06 2022] GET /compute/v2.1/servers/0139d707-356f-433f-a04a-4e4315dbc4b2 => generated 1299 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:35:06.673948 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-64b91d73-0d54-475c-af8b-b247cc9208b4 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:06.674641 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-64b91d73-0d54-475c-af8b-b247cc9208b4 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] [instance: 0139d707-356f-433f-a04a-4e4315dbc4b2] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:06.693850 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-64b91d73-0d54-475c-af8b-b247cc9208b4 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:06.695432 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-64b91d73-0d54-475c-af8b-b247cc9208b4 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:06.700284 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-64b91d73-0d54-475c-af8b-b247cc9208b4 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:06.702513 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-64b91d73-0d54-475c-af8b-b247cc9208b4 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:06.763803 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-64b91d73-0d54-475c-af8b-b247cc9208b4 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] [instance: 0139d707-356f-433f-a04a-4e4315dbc4b2] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:35:06.932955 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-64b91d73-0d54-475c-af8b-b247cc9208b4 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] [instance: 0139d707-356f-433f-a04a-4e4315dbc4b2] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:35:06.934451 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-64b91d73-0d54-475c-af8b-b247cc9208b4 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:06.935106 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-64b91d73-0d54-475c-af8b-b247cc9208b4 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:06.936312 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-64b91d73-0d54-475c-af8b-b247cc9208b4 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] [instance: 0139d707-356f-433f-a04a-4e4315dbc4b2] instance's host None is down, deleting from database Jun 05 08:35:06.944277 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-64b91d73-0d54-475c-af8b-b247cc9208b4 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] [instance: 0139d707-356f-433f-a04a-4e4315dbc4b2] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:35:07.016606 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-64b91d73-0d54-475c-af8b-b247cc9208b4 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] [instance: 0139d707-356f-433f-a04a-4e4315dbc4b2] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:35:07.028543 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-64b91d73-0d54-475c-af8b-b247cc9208b4 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] [instance: 0139d707-356f-433f-a04a-4e4315dbc4b2] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:35:07.262580 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4e56c103-56cd-4ac2-9e57-115dffc43ba5 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:07.264108 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4e56c103-56cd-4ac2-9e57-115dffc43ba5 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] [instance: 650827ac-1ddc-401c-896b-ce315894fe36] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:07.271463 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4e56c103-56cd-4ac2-9e57-115dffc43ba5 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:07.282210 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4e56c103-56cd-4ac2-9e57-115dffc43ba5 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:07.283639 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4e56c103-56cd-4ac2-9e57-115dffc43ba5 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:07.285722 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4e56c103-56cd-4ac2-9e57-115dffc43ba5 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:07.338450 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4e56c103-56cd-4ac2-9e57-115dffc43ba5 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:07.338901 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4e56c103-56cd-4ac2-9e57-115dffc43ba5 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:07.339368 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-4e56c103-56cd-4ac2-9e57-115dffc43ba5 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lazy-loading 'fault' on Instance uuid 650827ac-1ddc-401c-896b-ce315894fe36 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:35:07.464119 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4e56c103-56cd-4ac2-9e57-115dffc43ba5 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edc2ac8650ca4864ac407b2e24afdb6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82fde866a28a4b49badbe81e5b5ced08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:07.471922 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-64b91d73-0d54-475c-af8b-b247cc9208b4 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0139d707-356f-433f-a04a-4e4315dbc4b2" status: 204 len: 0 microversion: 2.1 time: 0.803097 Jun 05 08:35:07.473183 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1309/2673] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:35:06 2022] DELETE /compute/v2.1/servers/0139d707-356f-433f-a04a-4e4315dbc4b2 => generated 0 bytes in 805 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:35:07.476560 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4e56c103-56cd-4ac2-9e57-115dffc43ba5 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] 10.222.0.33 "GET /compute/v2.1/servers/650827ac-1ddc-401c-896b-ce315894fe36" status: 200 len: 1285 microversion: 2.1 time: 0.217014 Jun 05 08:35:07.477828 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1365/2674] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:35:07 2022] GET /compute/v2.1/servers/650827ac-1ddc-401c-896b-ce315894fe36 => generated 1285 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:35:07.481120 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e0497d8c-c298-4303-86c2-776a7b0ab810 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-191858655", "imageRef": "faebc4a8-ca5a-478f-92c9-c9ae4032fe29", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e4658f82-91f1-4875-95c8-cef06510c2e5"}], "security_groups": [{"name": "tempest-securitygroup--486189279"}], "key_name": "tempest-keypair-1226972439", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:35:07.487764 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9b1786f9-76ad-434c-ac2d-742dc671ac79 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:07.488479 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9b1786f9-76ad-434c-ac2d-742dc671ac79 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] [instance: 0139d707-356f-433f-a04a-4e4315dbc4b2] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:07.506617 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9b1786f9-76ad-434c-ac2d-742dc671ac79 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:07.507077 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9b1786f9-76ad-434c-ac2d-742dc671ac79 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:07.507869 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9b1786f9-76ad-434c-ac2d-742dc671ac79 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:07.517707 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9b1786f9-76ad-434c-ac2d-742dc671ac79 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:07.535452 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-9b1786f9-76ad-434c-ac2d-742dc671ac79 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] HTTP exception thrown: Instance 0139d707-356f-433f-a04a-4e4315dbc4b2 could not be found. Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9b1786f9-76ad-434c-ac2d-742dc671ac79 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Request method failure captured: Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/0139d707-356f-433f-a04a-4e4315dbc4b2 HTTP/1.1 Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGqwlrVTTvMpboQ5qGPG8PGx_ePIwRKRHalNcYKXDRu89eU-LpVLZq2X1Q2kgEDAZhH9yWff0ZaKW3d32wpH2vteCw0UcvnXYSgaj30ElYjcF7k9k1gMIvXoasSzkZdODE0L4E3F7kk2rgr0MzF9ARU5USMfefSPhL31o0y2cO7IWic Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 64561b8391a34b5ab01f51cb31378fea Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ServersTestFqdnHostnames-327294939 Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/64561b8391a34b5ab01f51cb31378fea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64561b8391a34b5ab01f51cb31378fea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_64561b8391a34b5ab01f51cb31378fea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64561b8391a34b5ab01f51cb31378fea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ServersTestFqdnHostnames-327294939 Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 64561b8391a34b5ab01f51cb31378fea Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-327294939 Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ServersTestFqdnHostnames-327294939-project Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 73d35c50862d43558407afdedeb8e232 Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ServersTestFqdnHostnames-327294939-project Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 0139d707-356f-433f-a04a-4e4315dbc4b2 could not be found. Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '0139d707-356f-433f-a04a-4e4315dbc4b2'} Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0139d707-356f-433f-a04a-4e4315dbc4b2 could not be found. Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0139d707-356f-433f-a04a-4e4315dbc4b2 could not be found. Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:07.537337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:07.541592 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:07.541592 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:07.541592 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:07.541592 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:35:07.541592 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:35:07.541592 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0139d707-356f-433f-a04a-4e4315dbc4b2 could not be found. Jun 05 08:35:07.541592 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:07.543172 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9b1786f9-76ad-434c-ac2d-742dc671ac79 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Returning 404 to user: Instance 0139d707-356f-433f-a04a-4e4315dbc4b2 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:35:07.555773 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9b1786f9-76ad-434c-ac2d-742dc671ac79 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] 10.222.0.33 "GET /compute/v2.1/servers/0139d707-356f-433f-a04a-4e4315dbc4b2" status: 404 len: 111 microversion: 2.1 time: 0.075231 Jun 05 08:35:07.559698 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1366/2675] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:35:07 2022] GET /compute/v2.1/servers/0139d707-356f-433f-a04a-4e4315dbc4b2 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:35:07.581536 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-42f3563a-5662-486f-a3b8-302447aa7b76 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:07.583412 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-42f3563a-5662-486f-a3b8-302447aa7b76 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] [instance: 650827ac-1ddc-401c-896b-ce315894fe36] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:07.589941 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-42f3563a-5662-486f-a3b8-302447aa7b76 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:07.590706 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-42f3563a-5662-486f-a3b8-302447aa7b76 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:07.592510 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-42f3563a-5662-486f-a3b8-302447aa7b76 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:07.593336 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-42f3563a-5662-486f-a3b8-302447aa7b76 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:07.634620 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-42f3563a-5662-486f-a3b8-302447aa7b76 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] [instance: 650827ac-1ddc-401c-896b-ce315894fe36] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:35:07.716852 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-e0497d8c-c298-4303-86c2-776a7b0ab810 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] validate_networks() for [('e4658f82-91f1-4875-95c8-cef06510c2e5', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:35:07.725323 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-42f3563a-5662-486f-a3b8-302447aa7b76 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] [instance: 650827ac-1ddc-401c-896b-ce315894fe36] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:35:07.726695 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-42f3563a-5662-486f-a3b8-302447aa7b76 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:07.727665 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-42f3563a-5662-486f-a3b8-302447aa7b76 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:07.728460 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-42f3563a-5662-486f-a3b8-302447aa7b76 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] [instance: 650827ac-1ddc-401c-896b-ce315894fe36] instance's host None is down, deleting from database Jun 05 08:35:07.732490 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-42f3563a-5662-486f-a3b8-302447aa7b76 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] [instance: 650827ac-1ddc-401c-896b-ce315894fe36] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:35:07.856030 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-42f3563a-5662-486f-a3b8-302447aa7b76 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] [instance: 650827ac-1ddc-401c-896b-ce315894fe36] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:35:07.873933 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-42f3563a-5662-486f-a3b8-302447aa7b76 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] [instance: 650827ac-1ddc-401c-896b-ce315894fe36] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:35:08.134209 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:35:08.325212 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-42f3563a-5662-486f-a3b8-302447aa7b76 tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] 10.222.0.33 "DELETE /compute/v2.1/servers/650827ac-1ddc-401c-896b-ce315894fe36" status: 204 len: 0 microversion: 2.1 time: 0.761084 Jun 05 08:35:08.326458 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1367/2676] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:35:07 2022] DELETE /compute/v2.1/servers/650827ac-1ddc-401c-896b-ce315894fe36 => generated 0 bytes in 766 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:35:08.333035 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-23bfe4e5-8fdc-4c49-9032-274510afeb26 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] Calling method '.version_select at 0x7f2433778ca0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:08.386850 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-23bfe4e5-8fdc-4c49-9032-274510afeb26 tempest-ServersTestFqdnHostnames-327294939 tempest-ServersTestFqdnHostnames-327294939-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1357202557" status: 202 len: 0 microversion: 2.1 time: 0.058446 Jun 05 08:35:08.388744 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1368/2677] 10.222.0.33 () {58 vars in 1220 bytes} [Sun Jun 5 08:35:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1357202557 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:35:08.399404 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-82bde3ef-5f72-48cd-bb6d-d5f80f09289b tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:08.400300 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-82bde3ef-5f72-48cd-bb6d-d5f80f09289b tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] [instance: 650827ac-1ddc-401c-896b-ce315894fe36] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:08.410873 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-82bde3ef-5f72-48cd-bb6d-d5f80f09289b tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:08.415017 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-82bde3ef-5f72-48cd-bb6d-d5f80f09289b tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:08.415856 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-82bde3ef-5f72-48cd-bb6d-d5f80f09289b tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:08.416339 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-82bde3ef-5f72-48cd-bb6d-d5f80f09289b tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:08.470144 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-82bde3ef-5f72-48cd-bb6d-d5f80f09289b tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] HTTP exception thrown: Instance 650827ac-1ddc-401c-896b-ce315894fe36 could not be found. Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-82bde3ef-5f72-48cd-bb6d-d5f80f09289b tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Request method failure captured: Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/650827ac-1ddc-401c-896b-ce315894fe36 HTTP/1.1 Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGqbS389pFkMqOwtoYbgHVwm8aNqR_iUe5IuDQqG3qcFARESeqH709g5ctWQ23t6SU_lV7sPH9ND3QrqDaFu1E8jQpdeauOSLOjvuPx1R7lI45JdPb64nVxIBWVQ27VdzPteDWkTHEMx4c6S4fUfSCP8T-gJo7HpMUZfU5GV9zH7etA Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 82fde866a28a4b49badbe81e5b5ced08 Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ServersTestMultiNic-1509830942 Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/82fde866a28a4b49badbe81e5b5ced08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82fde866a28a4b49badbe81e5b5ced08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_82fde866a28a4b49badbe81e5b5ced08", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/82fde866a28a4b49badbe81e5b5ced08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ServersTestMultiNic-1509830942 Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 82fde866a28a4b49badbe81e5b5ced08 Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ServersTestMultiNic-1509830942 Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ServersTestMultiNic-1509830942-project Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: edc2ac8650ca4864ac407b2e24afdb6e Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ServersTestMultiNic-1509830942-project Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 650827ac-1ddc-401c-896b-ce315894fe36 could not be found. Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '650827ac-1ddc-401c-896b-ce315894fe36'} Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 650827ac-1ddc-401c-896b-ce315894fe36 could not be found. Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 650827ac-1ddc-401c-896b-ce315894fe36 could not be found. Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:08.471759 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:08.477154 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:08.477154 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:08.477154 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:08.477154 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:35:08.477154 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:35:08.477154 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 650827ac-1ddc-401c-896b-ce315894fe36 could not be found. Jun 05 08:35:08.477154 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:08.477154 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-82bde3ef-5f72-48cd-bb6d-d5f80f09289b tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] Returning 404 to user: Instance 650827ac-1ddc-401c-896b-ce315894fe36 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:35:08.477154 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-82bde3ef-5f72-48cd-bb6d-d5f80f09289b tempest-ServersTestMultiNic-1509830942 tempest-ServersTestMultiNic-1509830942-project] 10.222.0.33 "GET /compute/v2.1/servers/650827ac-1ddc-401c-896b-ce315894fe36" status: 404 len: 111 microversion: 2.1 time: 0.079925 Jun 05 08:35:08.477154 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1369/2678] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:35:08 2022] GET /compute/v2.1/servers/650827ac-1ddc-401c-896b-ce315894fe36 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:35:09.613910 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-e0497d8c-c298-4303-86c2-776a7b0ab810 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:35:09.614496 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-e0497d8c-c298-4303-86c2-776a7b0ab810 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:35:09.614622 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-e0497d8c-c298-4303-86c2-776a7b0ab810 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:35:09.615246 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-e0497d8c-c298-4303-86c2-776a7b0ab810 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:35:09.615813 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-e0497d8c-c298-4303-86c2-776a7b0ab810 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:35:09.618292 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=8,nova_api:UPDATE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:35:09.637393 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=27 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:35:09.646351 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e0497d8c-c298-4303-86c2-776a7b0ab810 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:09.646351 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e0497d8c-c298-4303-86c2-776a7b0ab810 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:09.646851 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e0497d8c-c298-4303-86c2-776a7b0ab810 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:09.646942 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e0497d8c-c298-4303-86c2-776a7b0ab810 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:09.691536 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-e0497d8c-c298-4303-86c2-776a7b0ab810 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Getting quotas for project aa3d7a07d4a141d4b75de9cc5bef0fb8. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:35:09.712772 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-e0497d8c-c298-4303-86c2-776a7b0ab810 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Getting quotas for user cba3076f4db44ec1936514015e3d0ed5 and project aa3d7a07d4a141d4b75de9cc5bef0fb8. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:35:09.749911 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e0497d8c-c298-4303-86c2-776a7b0ab810 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:35:09.754629 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e0497d8c-c298-4303-86c2-776a7b0ab810 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] [instance: aedca02b-24b8-4957-84c9-9d9f7c0a944e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='faebc4a8-ca5a-478f-92c9-c9ae4032fe29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:35:09.985448 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e0497d8c-c298-4303-86c2-776a7b0ab810 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.487055 Jun 05 08:35:09.986476 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1310/2679] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:35:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 2512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:35:10.014787 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1445399c-b449-45b0-80b5-e0d8014353ec tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:10.020483 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1445399c-b449-45b0-80b5-e0d8014353ec tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] [instance: aedca02b-24b8-4957-84c9-9d9f7c0a944e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:10.745053 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1445399c-b449-45b0-80b5-e0d8014353ec tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3076f4db44ec1936514015e3d0ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3d7a07d4a141d4b75de9cc5bef0fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:10.754627 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1445399c-b449-45b0-80b5-e0d8014353ec tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] 10.222.0.33 "GET /compute/v2.1/servers/aedca02b-24b8-4957-84c9-9d9f7c0a944e" status: 200 len: 1245 microversion: 2.1 time: 0.761695 Jun 05 08:35:10.755218 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1370/2680] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:35:09 2022] GET /compute/v2.1/servers/aedca02b-24b8-4957-84c9-9d9f7c0a944e => generated 1245 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:35:11.777126 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-eba8368f-0e61-49f1-adb7-9ae910e44677 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:11.777754 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-eba8368f-0e61-49f1-adb7-9ae910e44677 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] [instance: aedca02b-24b8-4957-84c9-9d9f7c0a944e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:11.799872 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-eba8368f-0e61-49f1-adb7-9ae910e44677 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:11.803863 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-eba8368f-0e61-49f1-adb7-9ae910e44677 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:11.804926 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-eba8368f-0e61-49f1-adb7-9ae910e44677 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:11.809104 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-eba8368f-0e61-49f1-adb7-9ae910e44677 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:11.909108 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-eba8368f-0e61-49f1-adb7-9ae910e44677 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:11.909945 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-eba8368f-0e61-49f1-adb7-9ae910e44677 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:11.910616 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-eba8368f-0e61-49f1-adb7-9ae910e44677 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Lazy-loading 'fault' on Instance uuid aedca02b-24b8-4957-84c9-9d9f7c0a944e {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:35:12.033421 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-eba8368f-0e61-49f1-adb7-9ae910e44677 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3076f4db44ec1936514015e3d0ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3d7a07d4a141d4b75de9cc5bef0fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:12.054615 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-eba8368f-0e61-49f1-adb7-9ae910e44677 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] 10.222.0.33 "GET /compute/v2.1/servers/aedca02b-24b8-4957-84c9-9d9f7c0a944e" status: 200 len: 1318 microversion: 2.1 time: 0.284045 Jun 05 08:35:12.055938 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1311/2681] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:35:11 2022] GET /compute/v2.1/servers/aedca02b-24b8-4957-84c9-9d9f7c0a944e => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:35:12.072449 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e423c6cd-84e9-49b3-82a6-a09fa26398e8 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:12.073024 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e423c6cd-84e9-49b3-82a6-a09fa26398e8 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] [instance: aedca02b-24b8-4957-84c9-9d9f7c0a944e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:12.095680 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e423c6cd-84e9-49b3-82a6-a09fa26398e8 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:12.096427 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e423c6cd-84e9-49b3-82a6-a09fa26398e8 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:12.097100 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e423c6cd-84e9-49b3-82a6-a09fa26398e8 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:12.097558 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e423c6cd-84e9-49b3-82a6-a09fa26398e8 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:12.169535 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e423c6cd-84e9-49b3-82a6-a09fa26398e8 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] [instance: aedca02b-24b8-4957-84c9-9d9f7c0a944e] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:35:12.300014 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e423c6cd-84e9-49b3-82a6-a09fa26398e8 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] [instance: aedca02b-24b8-4957-84c9-9d9f7c0a944e] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:35:12.301121 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e423c6cd-84e9-49b3-82a6-a09fa26398e8 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:12.301749 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e423c6cd-84e9-49b3-82a6-a09fa26398e8 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:12.302432 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-e423c6cd-84e9-49b3-82a6-a09fa26398e8 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] [instance: aedca02b-24b8-4957-84c9-9d9f7c0a944e] instance's host None is down, deleting from database Jun 05 08:35:12.308143 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-e423c6cd-84e9-49b3-82a6-a09fa26398e8 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] [instance: aedca02b-24b8-4957-84c9-9d9f7c0a944e] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:35:12.515794 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-e423c6cd-84e9-49b3-82a6-a09fa26398e8 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] [instance: aedca02b-24b8-4957-84c9-9d9f7c0a944e] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:35:12.524131 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-e423c6cd-84e9-49b3-82a6-a09fa26398e8 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] [instance: aedca02b-24b8-4957-84c9-9d9f7c0a944e] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:35:12.634881 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=76,nova_cell0:UPDATE=18,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:35:12.913370 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e423c6cd-84e9-49b3-82a6-a09fa26398e8 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] 10.222.0.33 "DELETE /compute/v2.1/servers/aedca02b-24b8-4957-84c9-9d9f7c0a944e" status: 204 len: 0 microversion: 2.1 time: 0.845504 Jun 05 08:35:12.916895 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1371/2682] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:35:12 2022] DELETE /compute/v2.1/servers/aedca02b-24b8-4957-84c9-9d9f7c0a944e => generated 0 bytes in 847 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:35:12.926555 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3157c51f-e2be-4ea2-86ed-c18ce1078d75 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:12.927475 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3157c51f-e2be-4ea2-86ed-c18ce1078d75 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] [instance: aedca02b-24b8-4957-84c9-9d9f7c0a944e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:12.943500 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3157c51f-e2be-4ea2-86ed-c18ce1078d75 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:12.944001 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3157c51f-e2be-4ea2-86ed-c18ce1078d75 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:12.944930 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3157c51f-e2be-4ea2-86ed-c18ce1078d75 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:12.945385 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3157c51f-e2be-4ea2-86ed-c18ce1078d75 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:12.958714 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=62,nova_cell0:UPDATE=30,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=4 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:35:12.987020 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-3157c51f-e2be-4ea2-86ed-c18ce1078d75 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] HTTP exception thrown: Instance aedca02b-24b8-4957-84c9-9d9f7c0a944e could not be found. Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3157c51f-e2be-4ea2-86ed-c18ce1078d75 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Request method failure captured: Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/aedca02b-24b8-4957-84c9-9d9f7c0a944e HTTP/1.1 Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGpvp0nneS-l0EnUVnPjEMhYB56Y52o24e1aSWdQXqnPQVgEOMrun6hrVjLMeqnovVFRbZ_kjpMtnaArJPw5RyzwHOXyd1P8kmDVwRadZkX4Ybf6vJzqt5M-ADiR3CiaR-ukUKqWeTqmR-Y00CxrMkFPEnBqUKnv3suY-mgB_lLeBNw Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: aa3d7a07d4a141d4b75de9cc5bef0fb8 Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1046980498 Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/aa3d7a07d4a141d4b75de9cc5bef0fb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa3d7a07d4a141d4b75de9cc5bef0fb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_aa3d7a07d4a141d4b75de9cc5bef0fb8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/aa3d7a07d4a141d4b75de9cc5bef0fb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1046980498 Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: aa3d7a07d4a141d4b75de9cc5bef0fb8 Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1046980498 Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-AttachSCSIVolumeTestJSON-1046980498-project Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: cba3076f4db44ec1936514015e3d0ed5 Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1046980498-project Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance aedca02b-24b8-4957-84c9-9d9f7c0a944e could not be found. Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'aedca02b-24b8-4957-84c9-9d9f7c0a944e'} Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aedca02b-24b8-4957-84c9-9d9f7c0a944e could not be found. Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aedca02b-24b8-4957-84c9-9d9f7c0a944e could not be found. Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:12.992131 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:35:12.996705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:12.996705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:12.996705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:12.996705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:35:12.996705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:35:12.996705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aedca02b-24b8-4957-84c9-9d9f7c0a944e could not be found. Jun 05 08:35:12.996705 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:35:13.004311 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3157c51f-e2be-4ea2-86ed-c18ce1078d75 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Returning 404 to user: Instance aedca02b-24b8-4957-84c9-9d9f7c0a944e could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:35:13.006316 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3157c51f-e2be-4ea2-86ed-c18ce1078d75 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] 10.222.0.33 "GET /compute/v2.1/servers/aedca02b-24b8-4957-84c9-9d9f7c0a944e" status: 404 len: 111 microversion: 2.1 time: 0.087065 Jun 05 08:35:13.009606 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1312/2683] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:35:12 2022] GET /compute/v2.1/servers/aedca02b-24b8-4957-84c9-9d9f7c0a944e => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:35:13.025314 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9db0a28d-1810-4ca4-afd7-bfb0fa2a2d94 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] Calling method '.version_select at 0x7f2433817550>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:13.078976 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9db0a28d-1810-4ca4-afd7-bfb0fa2a2d94 tempest-AttachSCSIVolumeTestJSON-1046980498 tempest-AttachSCSIVolumeTestJSON-1046980498-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1226972439" status: 202 len: 0 microversion: 2.1 time: 0.059393 Jun 05 08:35:13.080354 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1372/2684] 10.222.0.33 () {58 vars in 1220 bytes} [Sun Jun 5 08:35:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1226972439 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:35:22.044124 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-42f87325-6235-412a-80be-2561b97ae53d tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Action: 'create', calling method: .version_select at 0x7f2445567550>, body: {"keypair": {"name": "tempest-keypair-1279979662", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP53e2amz+O7qKk06C7IQl8haayPEhx0GIIx4x6Xk1JtgdSgABrGivb6t4aJAaJiICBX2poo/EQPAz7ZjZtWSRC8ZwiIQdWlodGqdtDwlKYutSoQ3JcwTywT6ULQXfubMw=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:35:22.055691 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=4 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:35:22.056472 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=5 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:35:22.091314 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-42f87325-6235-412a-80be-2561b97ae53d tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Getting quotas for project ce97a39ef01f4a4abddf40b68bfff99d. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:35:22.113917 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-42f87325-6235-412a-80be-2561b97ae53d tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Getting quotas for user fe434e218d5c43ddbc6124bb0cda57fe and project ce97a39ef01f4a4abddf40b68bfff99d. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:35:22.164351 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=4 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:35:22.165358 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=22 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:35:22.169732 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-96ef8f2f-0e28-483a-a5e1-258d4b8bd376 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:22.170800 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-96ef8f2f-0e28-483a-a5e1-258d4b8bd376 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:22.194951 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-96ef8f2f-0e28-483a-a5e1-258d4b8bd376 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:22.195484 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-96ef8f2f-0e28-483a-a5e1-258d4b8bd376 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:22.196396 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-96ef8f2f-0e28-483a-a5e1-258d4b8bd376 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:22.196834 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-96ef8f2f-0e28-483a-a5e1-258d4b8bd376 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:22.213491 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-42f87325-6235-412a-80be-2561b97ae53d tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.173213 Jun 05 08:35:22.214628 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1313/2685] 10.222.0.33 () {62 vars in 1199 bytes} [Sun Jun 5 08:35:22 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 178 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 05 08:35:22.245045 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-96ef8f2f-0e28-483a-a5e1-258d4b8bd376 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.082295 Jun 05 08:35:22.245877 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1373/2686] 10.222.0.33 () {60 vars in 1342 bytes} [Sun Jun 5 08:35:22 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:35:22.368187 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b9faf795-338d-4797-b14f-32fc1a56fd59 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:22.369095 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b9faf795-338d-4797-b14f-32fc1a56fd59 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:22.376572 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b9faf795-338d-4797-b14f-32fc1a56fd59 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:22.377235 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b9faf795-338d-4797-b14f-32fc1a56fd59 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:22.378183 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b9faf795-338d-4797-b14f-32fc1a56fd59 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:22.378781 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b9faf795-338d-4797-b14f-32fc1a56fd59 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:22.435793 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b9faf795-338d-4797-b14f-32fc1a56fd59 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:35:22.621730 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b9faf795-338d-4797-b14f-32fc1a56fd59 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "DELETE /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 204 len: 0 microversion: 2.20 time: 0.255280 Jun 05 08:35:22.623852 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1314/2687] 10.222.0.33 () {60 vars in 1279 bytes} [Sun Jun 5 08:35:22 2022] DELETE /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:35:22.632279 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-46798392-95e0-475a-80ce-5737b2f9219d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:22.632989 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-46798392-95e0-475a-80ce-5737b2f9219d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:22.642003 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-46798392-95e0-475a-80ce-5737b2f9219d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:22.642455 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-46798392-95e0-475a-80ce-5737b2f9219d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:22.643244 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-46798392-95e0-475a-80ce-5737b2f9219d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:22.647490 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-46798392-95e0-475a-80ce-5737b2f9219d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:22.896633 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=6,nova_cell0:UPDATE=12,nova_cell0:DELETE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:35:23.019055 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-37ac5d30-bebf-45d6-8cc7-ae6053313d35 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1435404710", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "68deb695-3f2e-416b-901b-759f07a12228"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:35:23.112666 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-37ac5d30-bebf-45d6-8cc7-ae6053313d35 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] validate_networks() for [('68deb695-3f2e-416b-901b-759f07a12228', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:35:23.509855 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-46798392-95e0-475a-80ce-5737b2f9219d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:23.518310 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-46798392-95e0-475a-80ce-5737b2f9219d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:23.518561 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-46798392-95e0-475a-80ce-5737b2f9219d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:23.519749 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-46798392-95e0-475a-80ce-5737b2f9219d tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1721 microversion: 2.20 time: 0.891777 Jun 05 08:35:23.526253 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1374/2688] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:35:22 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1721 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:35:24.032326 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-37ac5d30-bebf-45d6-8cc7-ae6053313d35 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:35:24.032751 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-37ac5d30-bebf-45d6-8cc7-ae6053313d35 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:35:24.033242 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-37ac5d30-bebf-45d6-8cc7-ae6053313d35 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:35:24.033650 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-37ac5d30-bebf-45d6-8cc7-ae6053313d35 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:35:24.034209 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-37ac5d30-bebf-45d6-8cc7-ae6053313d35 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:35:24.053160 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-37ac5d30-bebf-45d6-8cc7-ae6053313d35 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:24.053870 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-37ac5d30-bebf-45d6-8cc7-ae6053313d35 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:24.055932 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-37ac5d30-bebf-45d6-8cc7-ae6053313d35 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:24.056745 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-37ac5d30-bebf-45d6-8cc7-ae6053313d35 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:24.089488 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-37ac5d30-bebf-45d6-8cc7-ae6053313d35 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Getting quotas for project e1b10d3d3540464fb9dee3b8a5bbe12e. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:35:24.099417 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-37ac5d30-bebf-45d6-8cc7-ae6053313d35 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Getting quotas for user 45d0fce6620f4820bbac85573eeba520 and project e1b10d3d3540464fb9dee3b8a5bbe12e. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:35:24.119577 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-37ac5d30-bebf-45d6-8cc7-ae6053313d35 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:35:24.122347 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-37ac5d30-bebf-45d6-8cc7-ae6053313d35 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: 2704c655-e3a6-4e16-bf8c-18876b08a5e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:35:24.211813 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-37ac5d30-bebf-45d6-8cc7-ae6053313d35 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.391707 Jun 05 08:35:24.213067 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1315/2689] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:35:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1401 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 05 08:35:24.224421 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b863ac04-680a-4a44-bced-cfda513801d3 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:24.224943 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b863ac04-680a-4a44-bced-cfda513801d3 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: 2704c655-e3a6-4e16-bf8c-18876b08a5e4] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:24.350302 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b863ac04-680a-4a44-bced-cfda513801d3 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d0fce6620f4820bbac85573eeba520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b10d3d3540464fb9dee3b8a5bbe12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:24.360657 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b863ac04-680a-4a44-bced-cfda513801d3 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] 10.222.0.33 "GET /compute/v2.1/servers/2704c655-e3a6-4e16-bf8c-18876b08a5e4" status: 200 len: 1218 microversion: 2.1 time: 0.140091 Jun 05 08:35:24.361922 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1375/2690] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:35:24 2022] GET /compute/v2.1/servers/2704c655-e3a6-4e16-bf8c-18876b08a5e4 => generated 1218 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:35:24.556664 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fd561e44-85d8-4635-be47-7ff624be4352 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:24.558191 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-fd561e44-85d8-4635-be47-7ff624be4352 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:24.569837 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fd561e44-85d8-4635-be47-7ff624be4352 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:24.570538 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fd561e44-85d8-4635-be47-7ff624be4352 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:24.571460 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fd561e44-85d8-4635-be47-7ff624be4352 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:24.571986 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fd561e44-85d8-4635-be47-7ff624be4352 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:24.828229 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-fd561e44-85d8-4635-be47-7ff624be4352 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:24.837828 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-fd561e44-85d8-4635-be47-7ff624be4352 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:24.839739 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-fd561e44-85d8-4635-be47-7ff624be4352 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:24.841207 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fd561e44-85d8-4635-be47-7ff624be4352 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1721 microversion: 2.20 time: 0.300790 Jun 05 08:35:24.843171 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1316/2691] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:35:24 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1721 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:35:25.379126 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c442c6d5-fb39-4925-8596-f8b161034b30 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:25.379953 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c442c6d5-fb39-4925-8596-f8b161034b30 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: 2704c655-e3a6-4e16-bf8c-18876b08a5e4] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:25.387561 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c442c6d5-fb39-4925-8596-f8b161034b30 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:25.388142 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c442c6d5-fb39-4925-8596-f8b161034b30 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:25.389639 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c442c6d5-fb39-4925-8596-f8b161034b30 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:25.390483 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c442c6d5-fb39-4925-8596-f8b161034b30 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:25.449414 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c442c6d5-fb39-4925-8596-f8b161034b30 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:25.449946 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c442c6d5-fb39-4925-8596-f8b161034b30 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:25.450498 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-c442c6d5-fb39-4925-8596-f8b161034b30 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lazy-loading 'fault' on Instance uuid 2704c655-e3a6-4e16-bf8c-18876b08a5e4 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:35:25.541891 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c442c6d5-fb39-4925-8596-f8b161034b30 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d0fce6620f4820bbac85573eeba520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b10d3d3540464fb9dee3b8a5bbe12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:25.556624 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c442c6d5-fb39-4925-8596-f8b161034b30 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] 10.222.0.33 "GET /compute/v2.1/servers/2704c655-e3a6-4e16-bf8c-18876b08a5e4" status: 200 len: 1291 microversion: 2.1 time: 0.175222 Jun 05 08:35:25.556624 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1376/2692] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:35:25 2022] GET /compute/v2.1/servers/2704c655-e3a6-4e16-bf8c-18876b08a5e4 => generated 1291 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:35:25.572991 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-11343640-979a-4daf-9806-93e4a76060e6 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:25.574223 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-11343640-979a-4daf-9806-93e4a76060e6 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: 2704c655-e3a6-4e16-bf8c-18876b08a5e4] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:25.588937 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-11343640-979a-4daf-9806-93e4a76060e6 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:25.589624 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-11343640-979a-4daf-9806-93e4a76060e6 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:25.590617 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-11343640-979a-4daf-9806-93e4a76060e6 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:25.591285 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-11343640-979a-4daf-9806-93e4a76060e6 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:25.644969 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-11343640-979a-4daf-9806-93e4a76060e6 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: 2704c655-e3a6-4e16-bf8c-18876b08a5e4] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:35:25.737874 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-11343640-979a-4daf-9806-93e4a76060e6 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: 2704c655-e3a6-4e16-bf8c-18876b08a5e4] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:35:25.739232 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-11343640-979a-4daf-9806-93e4a76060e6 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:25.744620 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-11343640-979a-4daf-9806-93e4a76060e6 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:25.745101 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-11343640-979a-4daf-9806-93e4a76060e6 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: 2704c655-e3a6-4e16-bf8c-18876b08a5e4] instance's host None is down, deleting from database Jun 05 08:35:25.755983 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-11343640-979a-4daf-9806-93e4a76060e6 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: 2704c655-e3a6-4e16-bf8c-18876b08a5e4] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:35:25.839076 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-11343640-979a-4daf-9806-93e4a76060e6 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: 2704c655-e3a6-4e16-bf8c-18876b08a5e4] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:35:25.861036 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-11343640-979a-4daf-9806-93e4a76060e6 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: 2704c655-e3a6-4e16-bf8c-18876b08a5e4] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:35:25.863144 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ef25808b-7a42-4310-a98f-4ba5857c1dcd tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:25.863962 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ef25808b-7a42-4310-a98f-4ba5857c1dcd tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:25.875651 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ef25808b-7a42-4310-a98f-4ba5857c1dcd tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:25.879038 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ef25808b-7a42-4310-a98f-4ba5857c1dcd tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:25.880203 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ef25808b-7a42-4310-a98f-4ba5857c1dcd tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:25.884392 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ef25808b-7a42-4310-a98f-4ba5857c1dcd tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:26.094545 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-11343640-979a-4daf-9806-93e4a76060e6 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2704c655-e3a6-4e16-bf8c-18876b08a5e4" status: 204 len: 0 microversion: 2.1 time: 0.525221 Jun 05 08:35:26.095394 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1317/2693] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:35:25 2022] DELETE /compute/v2.1/servers/2704c655-e3a6-4e16-bf8c-18876b08a5e4 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:35:26.111394 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ea39d01c-9571-4bd1-888c-ce45c8fe58f9 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:26.113331 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ea39d01c-9571-4bd1-888c-ce45c8fe58f9 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: 2704c655-e3a6-4e16-bf8c-18876b08a5e4] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:26.130594 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ea39d01c-9571-4bd1-888c-ce45c8fe58f9 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:26.131889 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ea39d01c-9571-4bd1-888c-ce45c8fe58f9 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:26.133823 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ea39d01c-9571-4bd1-888c-ce45c8fe58f9 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:26.134481 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ea39d01c-9571-4bd1-888c-ce45c8fe58f9 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:26.169255 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-ea39d01c-9571-4bd1-888c-ce45c8fe58f9 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] HTTP exception thrown: Instance 2704c655-e3a6-4e16-bf8c-18876b08a5e4 could not be found. Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ea39d01c-9571-4bd1-888c-ce45c8fe58f9 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Request method failure captured: Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/2704c655-e3a6-4e16-bf8c-18876b08a5e4 HTTP/1.1 Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGrKkRupTL1M9tJnuCHujOLVO0zKg5a6xj3VzjbQLWsv7JTPwo_X8eKqXP6fLigijQggnrk_OlY3kwHdPAZW6bZLoVzVaUylR_wahD2uV27wspmk2RclTMQKOep386-rZc3EPsIzOy4TSgRybdKdatcEtPQjq4KbkGn_JMPZ9gH4BbY Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: e1b10d3d3540464fb9dee3b8a5bbe12e Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2015357332 Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e1b10d3d3540464fb9dee3b8a5bbe12e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1b10d3d3540464fb9dee3b8a5bbe12e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e1b10d3d3540464fb9dee3b8a5bbe12e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1b10d3d3540464fb9dee3b8a5bbe12e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ServerDiskConfigTestJSON-2015357332 Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: e1b10d3d3540464fb9dee3b8a5bbe12e Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2015357332 Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ServerDiskConfigTestJSON-2015357332-project Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 45d0fce6620f4820bbac85573eeba520 Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ServerDiskConfigTestJSON-2015357332-project Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 2704c655-e3a6-4e16-bf8c-18876b08a5e4 could not be found. Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '2704c655-e3a6-4e16-bf8c-18876b08a5e4'} Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2704c655-e3a6-4e16-bf8c-18876b08a5e4 could not be found. Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2704c655-e3a6-4e16-bf8c-18876b08a5e4 could not be found. Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:26.174878 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:35:26.179485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:26.179485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:26.179485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:26.179485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:35:26.179485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:35:26.179485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2704c655-e3a6-4e16-bf8c-18876b08a5e4 could not be found. Jun 05 08:35:26.179485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:35:26.181655 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ea39d01c-9571-4bd1-888c-ce45c8fe58f9 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Returning 404 to user: Instance 2704c655-e3a6-4e16-bf8c-18876b08a5e4 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:35:26.182963 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ea39d01c-9571-4bd1-888c-ce45c8fe58f9 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] 10.222.0.33 "GET /compute/v2.1/servers/2704c655-e3a6-4e16-bf8c-18876b08a5e4" status: 404 len: 111 microversion: 2.1 time: 0.082885 Jun 05 08:35:26.190935 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1318/2694] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:35:26 2022] GET /compute/v2.1/servers/2704c655-e3a6-4e16-bf8c-18876b08a5e4 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:35:26.358684 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fc9eeb46-7127-4bce-8216-c2b23043a301 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1175968715", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "68deb695-3f2e-416b-901b-759f07a12228"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:35:26.430943 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-fc9eeb46-7127-4bce-8216-c2b23043a301 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] validate_networks() for [('68deb695-3f2e-416b-901b-759f07a12228', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:35:26.431353 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ef25808b-7a42-4310-a98f-4ba5857c1dcd tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:26.441485 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ef25808b-7a42-4310-a98f-4ba5857c1dcd tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:26.442990 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ef25808b-7a42-4310-a98f-4ba5857c1dcd tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:26.444194 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ef25808b-7a42-4310-a98f-4ba5857c1dcd tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1721 microversion: 2.20 time: 0.586027 Jun 05 08:35:26.445132 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1377/2695] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:35:25 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1721 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:35:27.462768 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4788f832-303f-4808-81fb-226381d8917b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:27.463727 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4788f832-303f-4808-81fb-226381d8917b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:27.470613 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4788f832-303f-4808-81fb-226381d8917b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:27.471068 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4788f832-303f-4808-81fb-226381d8917b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:27.471848 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4788f832-303f-4808-81fb-226381d8917b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:27.490497 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4788f832-303f-4808-81fb-226381d8917b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:27.534469 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-fc9eeb46-7127-4bce-8216-c2b23043a301 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:35:27.535767 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-fc9eeb46-7127-4bce-8216-c2b23043a301 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:35:27.536600 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-fc9eeb46-7127-4bce-8216-c2b23043a301 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:35:27.537177 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-fc9eeb46-7127-4bce-8216-c2b23043a301 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:35:27.537809 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-fc9eeb46-7127-4bce-8216-c2b23043a301 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:35:27.553270 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fc9eeb46-7127-4bce-8216-c2b23043a301 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:27.553737 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fc9eeb46-7127-4bce-8216-c2b23043a301 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:27.554992 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fc9eeb46-7127-4bce-8216-c2b23043a301 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:27.556720 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fc9eeb46-7127-4bce-8216-c2b23043a301 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:27.610499 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-fc9eeb46-7127-4bce-8216-c2b23043a301 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Getting quotas for project e1b10d3d3540464fb9dee3b8a5bbe12e. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:35:27.620582 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-fc9eeb46-7127-4bce-8216-c2b23043a301 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Getting quotas for user 45d0fce6620f4820bbac85573eeba520 and project e1b10d3d3540464fb9dee3b8a5bbe12e. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:35:27.646109 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-fc9eeb46-7127-4bce-8216-c2b23043a301 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:35:27.648328 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-fc9eeb46-7127-4bce-8216-c2b23043a301 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: cf2cc27b-e1de-4068-84ac-5614bf6cc68b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:35:27.667860 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4788f832-303f-4808-81fb-226381d8917b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:27.679663 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4788f832-303f-4808-81fb-226381d8917b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:27.694354 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4788f832-303f-4808-81fb-226381d8917b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:27.708301 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4788f832-303f-4808-81fb-226381d8917b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1654 microversion: 2.20 time: 0.244840 Jun 05 08:35:27.709609 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1378/2696] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:35:27 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1654 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:35:27.735579 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fc9eeb46-7127-4bce-8216-c2b23043a301 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.381372 Jun 05 08:35:27.741842 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1319/2697] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:35:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:35:27.748062 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-52d9b245-71d0-4fd4-a280-abc6b713a9b7 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:27.749061 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-52d9b245-71d0-4fd4-a280-abc6b713a9b7 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: cf2cc27b-e1de-4068-84ac-5614bf6cc68b] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:27.826367 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-52d9b245-71d0-4fd4-a280-abc6b713a9b7 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d0fce6620f4820bbac85573eeba520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b10d3d3540464fb9dee3b8a5bbe12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:27.836333 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-52d9b245-71d0-4fd4-a280-abc6b713a9b7 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] 10.222.0.33 "GET /compute/v2.1/servers/cf2cc27b-e1de-4068-84ac-5614bf6cc68b" status: 200 len: 1218 microversion: 2.1 time: 0.093868 Jun 05 08:35:27.837819 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1379/2698] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:35:27 2022] GET /compute/v2.1/servers/cf2cc27b-e1de-4068-84ac-5614bf6cc68b => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:35:27.954671 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2167f484-eb43-4b9a-8f13-b4a8773811bb tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1833781254", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "ba77b749-4853-452f-9acf-9818739ed51d"}, {"port": "d1c08b3e-c9e9-4bf4-97f2-ab555daa319f", "tag": "port-1"}, {"port": "b190ff02-eb8a-4f55-9197-91861946a589", "tag": "port-2"}, {"uuid": "b4d1c1d6-ebcc-4197-8f18-1919a99d69f2", "tag": "net-1"}, {"uuid": "b4d1c1d6-ebcc-4197-8f18-1919a99d69f2"}, {"uuid": "277b2a2d-9f40-41ba-a6b0-9016f66604db", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "277b2a2d-9f40-41ba-a6b0-9016f66604db", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "7460ea05-5688-4cf0-97a8-43cac0d52ed3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "ae6512dd-798a-4d9a-8155-4306aeabb34e", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "3e272c85-31a5-4256-8422-2f62177011c1", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--93915342"}], "key_name": "tempest-keypair-1279979662", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:35:28.111987 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-2167f484-eb43-4b9a-8f13-b4a8773811bb tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] validate_networks() for [('ba77b749-4853-452f-9acf-9818739ed51d', None, None, None, None, None), (None, None, 'd1c08b3e-c9e9-4bf4-97f2-ab555daa319f', None, None, None), (None, None, 'b190ff02-eb8a-4f55-9197-91861946a589', None, None, None), ('b4d1c1d6-ebcc-4197-8f18-1919a99d69f2', None, None, None, None, None), ('b4d1c1d6-ebcc-4197-8f18-1919a99d69f2', None, None, None, None, None), ('277b2a2d-9f40-41ba-a6b0-9016f66604db', '10.2.2.100', None, None, None, None), ('277b2a2d-9f40-41ba-a6b0-9016f66604db', '10.2.2.200', None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:35:28.481406 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-bdc3be5f-8fe4-4d17-afa4-a76dea9da6d2 req-c78e99f6-5a5f-4418-974c-5a59e061e128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "040dd488-42f2-45c3-86de-1a675e78d7ca", "name": "network-vif-deleted", "tag": "93d59181-26a5-451b-8871-ccba610464fd"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:35:28.494859 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-bdc3be5f-8fe4-4d17-afa4-a76dea9da6d2 req-c78e99f6-5a5f-4418-974c-5a59e061e128 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:28.495652 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-bdc3be5f-8fe4-4d17-afa4-a76dea9da6d2 req-c78e99f6-5a5f-4418-974c-5a59e061e128 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:28.510073 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-bdc3be5f-8fe4-4d17-afa4-a76dea9da6d2 req-c78e99f6-5a5f-4418-974c-5a59e061e128 service nova] Creating event network-vif-deleted:93d59181-26a5-451b-8871-ccba610464fd for instance 040dd488-42f2-45c3-86de-1a675e78d7ca on n-h1-844739-1 Jun 05 08:35:28.518189 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-bdc3be5f-8fe4-4d17-afa4-a76dea9da6d2 req-c78e99f6-5a5f-4418-974c-5a59e061e128 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.315059 Jun 05 08:35:28.519721 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1380/2699] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:35:28.727938 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-80238443-4307-4efa-8ee5-3d57a9a85250 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:28.729051 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-80238443-4307-4efa-8ee5-3d57a9a85250 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:28.740056 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-80238443-4307-4efa-8ee5-3d57a9a85250 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:28.743822 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-80238443-4307-4efa-8ee5-3d57a9a85250 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:28.744973 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-80238443-4307-4efa-8ee5-3d57a9a85250 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:28.748589 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-80238443-4307-4efa-8ee5-3d57a9a85250 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:28.841785 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-80238443-4307-4efa-8ee5-3d57a9a85250 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:28.846816 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-80238443-4307-4efa-8ee5-3d57a9a85250 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:28.847297 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-80238443-4307-4efa-8ee5-3d57a9a85250 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lazy-loading 'fault' on Instance uuid 040dd488-42f2-45c3-86de-1a675e78d7ca {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:35:28.967059 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-80238443-4307-4efa-8ee5-3d57a9a85250 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:28.975360 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-80238443-4307-4efa-8ee5-3d57a9a85250 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:28.982720 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-80238443-4307-4efa-8ee5-3d57a9a85250 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:28.983944 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-80238443-4307-4efa-8ee5-3d57a9a85250 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1425 microversion: 2.20 time: 0.260925 Jun 05 08:35:28.996851 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1381/2700] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:35:28 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1425 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:35:29.002644 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8d8df713-b558-4663-905c-fa7deaf742d8 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:29.003278 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8d8df713-b558-4663-905c-fa7deaf742d8 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: cf2cc27b-e1de-4068-84ac-5614bf6cc68b] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:29.023732 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8d8df713-b558-4663-905c-fa7deaf742d8 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:29.024228 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8d8df713-b558-4663-905c-fa7deaf742d8 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:29.025033 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8d8df713-b558-4663-905c-fa7deaf742d8 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:29.025485 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8d8df713-b558-4663-905c-fa7deaf742d8 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:29.097492 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8d8df713-b558-4663-905c-fa7deaf742d8 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:29.098001 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8d8df713-b558-4663-905c-fa7deaf742d8 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:29.098513 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-8d8df713-b558-4663-905c-fa7deaf742d8 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lazy-loading 'fault' on Instance uuid cf2cc27b-e1de-4068-84ac-5614bf6cc68b {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:35:29.229463 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8d8df713-b558-4663-905c-fa7deaf742d8 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d0fce6620f4820bbac85573eeba520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b10d3d3540464fb9dee3b8a5bbe12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:29.240556 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8d8df713-b558-4663-905c-fa7deaf742d8 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] 10.222.0.33 "GET /compute/v2.1/servers/cf2cc27b-e1de-4068-84ac-5614bf6cc68b" status: 200 len: 1291 microversion: 2.1 time: 0.242455 Jun 05 08:35:29.267575 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1382/2701] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:35:28 2022] GET /compute/v2.1/servers/cf2cc27b-e1de-4068-84ac-5614bf6cc68b => generated 1291 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:35:29.280964 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ea43cf43-8995-4cd0-a933-13c14e14c03b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '.version_select at 0x7f2432eccca0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:29.314972 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ea43cf43-8995-4cd0-a933-13c14e14c03b tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-818595835" status: 204 len: 0 microversion: 2.20 time: 0.044747 Jun 05 08:35:29.319859 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1383/2702] 10.222.0.33 () {60 vars in 1258 bytes} [Sun Jun 5 08:35:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-818595835 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:35:29.791003 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-004607ce-cb85-4c91-bea0-8574586a96c8 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1383311169", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "ac726202-c502-43eb-8602-228f746e90fc"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:35:29.899964 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-004607ce-cb85-4c91-bea0-8574586a96c8 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] validate_networks() for [('ac726202-c502-43eb-8602-228f746e90fc', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:35:31.094146 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-004607ce-cb85-4c91-bea0-8574586a96c8 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:35:31.095750 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-004607ce-cb85-4c91-bea0-8574586a96c8 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:35:31.096521 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-004607ce-cb85-4c91-bea0-8574586a96c8 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:35:31.097279 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-004607ce-cb85-4c91-bea0-8574586a96c8 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:35:31.098663 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-004607ce-cb85-4c91-bea0-8574586a96c8 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:35:31.110999 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-004607ce-cb85-4c91-bea0-8574586a96c8 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:31.111792 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-004607ce-cb85-4c91-bea0-8574586a96c8 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:31.112921 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-004607ce-cb85-4c91-bea0-8574586a96c8 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:31.113574 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-004607ce-cb85-4c91-bea0-8574586a96c8 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:31.150737 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-004607ce-cb85-4c91-bea0-8574586a96c8 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Getting quotas for project 9545db622b3a4cb5bb585bf2dd444ea9. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:35:31.160334 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-004607ce-cb85-4c91-bea0-8574586a96c8 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Getting quotas for user 5290563c019d48baae653fb4ca2d4d48 and project 9545db622b3a4cb5bb585bf2dd444ea9. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:35:31.174816 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-004607ce-cb85-4c91-bea0-8574586a96c8 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:35:31.177765 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-004607ce-cb85-4c91-bea0-8574586a96c8 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] [instance: 96dab45f-62e0-4cb8-bb0a-d1d269606d7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:35:31.236850 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-004607ce-cb85-4c91-bea0-8574586a96c8 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.915214 Jun 05 08:35:31.237888 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1384/2703] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:35:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:35:31.250520 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1e291fce-51ff-499f-9389-b6dd7acac53d tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:31.251331 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1e291fce-51ff-499f-9389-b6dd7acac53d tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: cf2cc27b-e1de-4068-84ac-5614bf6cc68b] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:31.258005 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1e291fce-51ff-499f-9389-b6dd7acac53d tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:31.258711 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1e291fce-51ff-499f-9389-b6dd7acac53d tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:31.259717 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1e291fce-51ff-499f-9389-b6dd7acac53d tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:31.260381 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1e291fce-51ff-499f-9389-b6dd7acac53d tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:31.289135 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1e291fce-51ff-499f-9389-b6dd7acac53d tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: cf2cc27b-e1de-4068-84ac-5614bf6cc68b] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:35:31.351086 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1e291fce-51ff-499f-9389-b6dd7acac53d tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: cf2cc27b-e1de-4068-84ac-5614bf6cc68b] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:35:31.352324 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1e291fce-51ff-499f-9389-b6dd7acac53d tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:31.353001 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1e291fce-51ff-499f-9389-b6dd7acac53d tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:31.353665 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-1e291fce-51ff-499f-9389-b6dd7acac53d tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: cf2cc27b-e1de-4068-84ac-5614bf6cc68b] instance's host None is down, deleting from database Jun 05 08:35:31.358752 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-1e291fce-51ff-499f-9389-b6dd7acac53d tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: cf2cc27b-e1de-4068-84ac-5614bf6cc68b] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:35:31.441763 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-1e291fce-51ff-499f-9389-b6dd7acac53d tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: cf2cc27b-e1de-4068-84ac-5614bf6cc68b] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:35:31.454456 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-1e291fce-51ff-499f-9389-b6dd7acac53d tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: cf2cc27b-e1de-4068-84ac-5614bf6cc68b] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:35:31.745222 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1e291fce-51ff-499f-9389-b6dd7acac53d tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cf2cc27b-e1de-4068-84ac-5614bf6cc68b" status: 204 len: 0 microversion: 2.1 time: 0.505261 Jun 05 08:35:31.746167 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1385/2704] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:35:31 2022] DELETE /compute/v2.1/servers/cf2cc27b-e1de-4068-84ac-5614bf6cc68b => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:35:31.922209 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c4eed9b4-d23b-4453-9575-e9d1dd55bd73 tempest-MultipleCreateNegativeTestJSON-484577715 tempest-MultipleCreateNegativeTestJSON-484577715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1961725946", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:35:31.925459 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-c4eed9b4-d23b-4453-9575-e9d1dd55bd73 tempest-MultipleCreateNegativeTestJSON-484577715 tempest-MultipleCreateNegativeTestJSON-484577715-project] HTTP exception thrown: min_count must be <= max_count Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c4eed9b4-d23b-4453-9575-e9d1dd55bd73 tempest-MultipleCreateNegativeTestJSON-484577715 tempest-MultipleCreateNegativeTestJSON-484577715-project] Request method failure captured: Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 184 Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGrRRttRXHGJeucJkRTrd-kMHrFfOfKhk8VXIdQNB4Rx6bksixyvIRZpMAS2yfe7UfLlrxcXP21rgkAjvGpBH95rOSX2I3ljy_w2gEwQ8bQy6hLBRhBBHGRK2yNNMwqVY82xFDCZNcaOkQv3nmlb08HhJkwUT0X2AdLfcI5IbQxKeuc Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: cbee9bc615fc4740a6914d9ac14a23be Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-484577715 Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cbee9bc615fc4740a6914d9ac14a23be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cbee9bc615fc4740a6914d9ac14a23be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cbee9bc615fc4740a6914d9ac14a23be", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cbee9bc615fc4740a6914d9ac14a23be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-484577715 Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: cbee9bc615fc4740a6914d9ac14a23be Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-484577715 Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-MultipleCreateNegativeTestJSON-484577715-project Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 72ec5e54c82a46e991cf074047c14a25 Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-484577715-project Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1961725946", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: exception: min_count must be <= max_count Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1961725946', 'imageRef': '1241bde3-ef1f-41a5-b0fa-6f409216229a', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jun 05 08:35:31.931831 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:31.938772 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c4eed9b4-d23b-4453-9575-e9d1dd55bd73 tempest-MultipleCreateNegativeTestJSON-484577715 tempest-MultipleCreateNegativeTestJSON-484577715-project] Returning 400 to user: min_count must be <= max_count {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:35:31.940176 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c4eed9b4-d23b-4453-9575-e9d1dd55bd73 tempest-MultipleCreateNegativeTestJSON-484577715 tempest-MultipleCreateNegativeTestJSON-484577715-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.192877 Jun 05 08:35:31.941757 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1386/2705] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:35:31 2022] POST /compute/v2.1/servers => generated 74 bytes in 195 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 05 08:35:31.951488 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-98ec76e0-31e6-4fc4-8878-d9446830c0a5 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:31.952754 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-98ec76e0-31e6-4fc4-8878-d9446830c0a5 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] [instance: 96dab45f-62e0-4cb8-bb0a-d1d269606d7a] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:31.983940 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-98ec76e0-31e6-4fc4-8878-d9446830c0a5 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:31.988141 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-98ec76e0-31e6-4fc4-8878-d9446830c0a5 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:31.989307 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-98ec76e0-31e6-4fc4-8878-d9446830c0a5 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:31.989989 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-98ec76e0-31e6-4fc4-8878-d9446830c0a5 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:32.047493 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-98ec76e0-31e6-4fc4-8878-d9446830c0a5 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:32.048223 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-98ec76e0-31e6-4fc4-8878-d9446830c0a5 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:32.049227 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-98ec76e0-31e6-4fc4-8878-d9446830c0a5 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Lazy-loading 'fault' on Instance uuid 96dab45f-62e0-4cb8-bb0a-d1d269606d7a {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:35:32.111526 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-98ec76e0-31e6-4fc4-8878-d9446830c0a5 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5290563c019d48baae653fb4ca2d4d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9545db622b3a4cb5bb585bf2dd444ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:32.120689 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-98ec76e0-31e6-4fc4-8878-d9446830c0a5 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] 10.222.0.33 "GET /compute/v2.1/servers/96dab45f-62e0-4cb8-bb0a-d1d269606d7a" status: 200 len: 1289 microversion: 2.1 time: 0.177547 Jun 05 08:35:32.122122 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1387/2706] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:35:31 2022] GET /compute/v2.1/servers/96dab45f-62e0-4cb8-bb0a-d1d269606d7a => generated 1289 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:35:32.127865 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f0d2b7c6-c131-49ba-8beb-c55e47e87931 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:32.128885 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f0d2b7c6-c131-49ba-8beb-c55e47e87931 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: cf2cc27b-e1de-4068-84ac-5614bf6cc68b] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:32.136404 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f0d2b7c6-c131-49ba-8beb-c55e47e87931 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:32.137217 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f0d2b7c6-c131-49ba-8beb-c55e47e87931 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:32.138787 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f0d2b7c6-c131-49ba-8beb-c55e47e87931 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:32.139457 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f0d2b7c6-c131-49ba-8beb-c55e47e87931 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:32.162674 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-f0d2b7c6-c131-49ba-8beb-c55e47e87931 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] HTTP exception thrown: Instance cf2cc27b-e1de-4068-84ac-5614bf6cc68b could not be found. Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f0d2b7c6-c131-49ba-8beb-c55e47e87931 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Request method failure captured: Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/cf2cc27b-e1de-4068-84ac-5614bf6cc68b HTTP/1.1 Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGrKkRupTL1M9tJnuCHujOLVO0zKg5a6xj3VzjbQLWsv7JTPwo_X8eKqXP6fLigijQggnrk_OlY3kwHdPAZW6bZLoVzVaUylR_wahD2uV27wspmk2RclTMQKOep386-rZc3EPsIzOy4TSgRybdKdatcEtPQjq4KbkGn_JMPZ9gH4BbY Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: e1b10d3d3540464fb9dee3b8a5bbe12e Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2015357332 Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e1b10d3d3540464fb9dee3b8a5bbe12e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1b10d3d3540464fb9dee3b8a5bbe12e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e1b10d3d3540464fb9dee3b8a5bbe12e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1b10d3d3540464fb9dee3b8a5bbe12e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ServerDiskConfigTestJSON-2015357332 Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: e1b10d3d3540464fb9dee3b8a5bbe12e Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2015357332 Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ServerDiskConfigTestJSON-2015357332-project Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 45d0fce6620f4820bbac85573eeba520 Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ServerDiskConfigTestJSON-2015357332-project Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance cf2cc27b-e1de-4068-84ac-5614bf6cc68b could not be found. Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'cf2cc27b-e1de-4068-84ac-5614bf6cc68b'} Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf2cc27b-e1de-4068-84ac-5614bf6cc68b could not be found. Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf2cc27b-e1de-4068-84ac-5614bf6cc68b could not be found. Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:32.165201 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:32.168952 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:32.168952 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:32.168952 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:32.168952 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:35:32.168952 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:35:32.168952 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf2cc27b-e1de-4068-84ac-5614bf6cc68b could not be found. Jun 05 08:35:32.168952 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:32.171914 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f0d2b7c6-c131-49ba-8beb-c55e47e87931 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Returning 404 to user: Instance cf2cc27b-e1de-4068-84ac-5614bf6cc68b could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:35:32.173085 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f0d2b7c6-c131-49ba-8beb-c55e47e87931 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] 10.222.0.33 "GET /compute/v2.1/servers/cf2cc27b-e1de-4068-84ac-5614bf6cc68b" status: 404 len: 111 microversion: 2.1 time: 0.049788 Jun 05 08:35:32.174319 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1388/2707] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:35:32 2022] GET /compute/v2.1/servers/cf2cc27b-e1de-4068-84ac-5614bf6cc68b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:35:32.184657 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d5c46010-a6d0-4770-91d6-37cc217c8642 tempest-MultipleCreateNegativeTestJSON-484577715 tempest-MultipleCreateNegativeTestJSON-484577715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-649834817", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "max_count": 0}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d5c46010-a6d0-4770-91d6-37cc217c8642 tempest-MultipleCreateNegativeTestJSON-484577715 tempest-MultipleCreateNegativeTestJSON-484577715-project] Request method failure captured: Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 167 Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGrRRttRXHGJeucJkRTrd-kMHrFfOfKhk8VXIdQNB4Rx6bksixyvIRZpMAS2yfe7UfLlrxcXP21rgkAjvGpBH95rOSX2I3ljy_w2gEwQ8bQy6hLBRhBBHGRK2yNNMwqVY82xFDCZNcaOkQv3nmlb08HhJkwUT0X2AdLfcI5IbQxKeuc Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: cbee9bc615fc4740a6914d9ac14a23be Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-484577715 Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cbee9bc615fc4740a6914d9ac14a23be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cbee9bc615fc4740a6914d9ac14a23be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cbee9bc615fc4740a6914d9ac14a23be", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cbee9bc615fc4740a6914d9ac14a23be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-484577715 Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: cbee9bc615fc4740a6914d9ac14a23be Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-484577715 Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-MultipleCreateNegativeTestJSON-484577715-project Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 72ec5e54c82a46e991cf074047c14a25 Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-484577715-project Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-649834817", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "max_count": 0}} Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-649834817', 'imageRef': '1241bde3-ef1f-41a5-b0fa-6f409216229a', 'flavorRef': '452', 'max_count': 0}}} Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise error Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi 0 Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 05 08:35:32.187998 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 05 08:35:32.191896 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 05 08:35:32.191896 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 05 08:35:32.191896 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 05 08:35:32.191896 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jun 05 08:35:32.191896 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:32.191896 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:32.191896 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:32.191896 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:32.191896 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:32.191896 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:32.191896 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 05 08:35:32.191896 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 05 08:35:32.191896 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jun 05 08:35:32.191896 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:32.210869 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d5c46010-a6d0-4770-91d6-37cc217c8642 tempest-MultipleCreateNegativeTestJSON-484577715 tempest-MultipleCreateNegativeTestJSON-484577715-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:35:32.212207 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d5c46010-a6d0-4770-91d6-37cc217c8642 tempest-MultipleCreateNegativeTestJSON-484577715 tempest-MultipleCreateNegativeTestJSON-484577715-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.036644 Jun 05 08:35:32.213043 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1389/2708] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:35:32 2022] POST /compute/v2.1/servers => generated 130 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 05 08:35:32.295068 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-06a1d055-c075-4cb9-b483-8477a61b91e5 tempest-MultipleCreateNegativeTestJSON-484577715 tempest-MultipleCreateNegativeTestJSON-484577715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1348481717", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "max_count": 2.5}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-06a1d055-c075-4cb9-b483-8477a61b91e5 tempest-MultipleCreateNegativeTestJSON-484577715 tempest-MultipleCreateNegativeTestJSON-484577715-project] Request method failure captured: Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 170 Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGrRRttRXHGJeucJkRTrd-kMHrFfOfKhk8VXIdQNB4Rx6bksixyvIRZpMAS2yfe7UfLlrxcXP21rgkAjvGpBH95rOSX2I3ljy_w2gEwQ8bQy6hLBRhBBHGRK2yNNMwqVY82xFDCZNcaOkQv3nmlb08HhJkwUT0X2AdLfcI5IbQxKeuc Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: cbee9bc615fc4740a6914d9ac14a23be Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-484577715 Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cbee9bc615fc4740a6914d9ac14a23be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cbee9bc615fc4740a6914d9ac14a23be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cbee9bc615fc4740a6914d9ac14a23be", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cbee9bc615fc4740a6914d9ac14a23be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-484577715 Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: cbee9bc615fc4740a6914d9ac14a23be Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-484577715 Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-MultipleCreateNegativeTestJSON-484577715-project Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 72ec5e54c82a46e991cf074047c14a25 Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-484577715-project Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1348481717", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "max_count": 2.5}} Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1348481717', 'imageRef': '1241bde3-ef1f-41a5-b0fa-6f409216229a', 'flavorRef': '452', 'max_count': 2.5}}} Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise error Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi 2.5 Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 05 08:35:32.298271 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 05 08:35:32.302723 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 05 08:35:32.302723 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 05 08:35:32.302723 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 05 08:35:32.302723 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 05 08:35:32.302723 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 05 08:35:32.302723 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:32.302723 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:32.302723 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:32.302723 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:32.302723 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:32.302723 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:32.302723 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 05 08:35:32.302723 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 05 08:35:32.302723 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 05 08:35:32.302723 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:32.302723 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-06a1d055-c075-4cb9-b483-8477a61b91e5 tempest-MultipleCreateNegativeTestJSON-484577715 tempest-MultipleCreateNegativeTestJSON-484577715-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:35:32.303914 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-06a1d055-c075-4cb9-b483-8477a61b91e5 tempest-MultipleCreateNegativeTestJSON-484577715 tempest-MultipleCreateNegativeTestJSON-484577715-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.012186 Jun 05 08:35:32.310844 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1390/2709] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:35:32 2022] POST /compute/v2.1/servers => generated 139 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 05 08:35:32.348307 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f923764b-ae02-458d-86a4-a69fc48f1cbe tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-339353148", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "68deb695-3f2e-416b-901b-759f07a12228"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:35:32.423787 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-f923764b-ae02-458d-86a4-a69fc48f1cbe tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] validate_networks() for [('68deb695-3f2e-416b-901b-759f07a12228', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:35:32.640782 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-2167f484-eb43-4b9a-8f13-b4a8773811bb tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:35:32.642522 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-2167f484-eb43-4b9a-8f13-b4a8773811bb tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:35:32.643321 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-2167f484-eb43-4b9a-8f13-b4a8773811bb tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:35:32.643955 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-2167f484-eb43-4b9a-8f13-b4a8773811bb tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:35:32.644699 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-2167f484-eb43-4b9a-8f13-b4a8773811bb tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:35:32.660248 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2167f484-eb43-4b9a-8f13-b4a8773811bb tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:32.661040 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2167f484-eb43-4b9a-8f13-b4a8773811bb tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:32.662480 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2167f484-eb43-4b9a-8f13-b4a8773811bb tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:32.663595 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2167f484-eb43-4b9a-8f13-b4a8773811bb tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:32.729940 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-2167f484-eb43-4b9a-8f13-b4a8773811bb tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Getting quotas for project ce97a39ef01f4a4abddf40b68bfff99d. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:35:32.743725 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-2167f484-eb43-4b9a-8f13-b4a8773811bb tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Getting quotas for user fe434e218d5c43ddbc6124bb0cda57fe and project ce97a39ef01f4a4abddf40b68bfff99d. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:35:32.982770 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-f923764b-ae02-458d-86a4-a69fc48f1cbe tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:35:32.983329 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-f923764b-ae02-458d-86a4-a69fc48f1cbe tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:35:32.984007 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-f923764b-ae02-458d-86a4-a69fc48f1cbe tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:35:32.984604 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-f923764b-ae02-458d-86a4-a69fc48f1cbe tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:35:32.985199 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-f923764b-ae02-458d-86a4-a69fc48f1cbe tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:35:32.997223 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f923764b-ae02-458d-86a4-a69fc48f1cbe tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:32.997953 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f923764b-ae02-458d-86a4-a69fc48f1cbe tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:32.998988 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f923764b-ae02-458d-86a4-a69fc48f1cbe tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:32.999636 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f923764b-ae02-458d-86a4-a69fc48f1cbe tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:33.011919 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2167f484-eb43-4b9a-8f13-b4a8773811bb tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:35:33.016568 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2167f484-eb43-4b9a-8f13-b4a8773811bb tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] [instance: fbdf0c9a-fac3-4a42-a9ce-bf2fbe8f8701] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='7460ea05-5688-4cf0-97a8-43cac0d52ed3',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='ae6512dd-798a-4d9a-8155-4306aeabb34e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3e272c85-31a5-4256-8422-2f62177011c1',volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:35:33.021360 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-f923764b-ae02-458d-86a4-a69fc48f1cbe tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Getting quotas for project e1b10d3d3540464fb9dee3b8a5bbe12e. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:35:33.032210 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:35:33.033650 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-f923764b-ae02-458d-86a4-a69fc48f1cbe tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Getting quotas for user 45d0fce6620f4820bbac85573eeba520 and project e1b10d3d3540464fb9dee3b8a5bbe12e. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:35:33.063237 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f923764b-ae02-458d-86a4-a69fc48f1cbe tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:35:33.066634 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f923764b-ae02-458d-86a4-a69fc48f1cbe tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: c2b888c7-43f8-47a0-9f7d-c8204e87ee97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:35:33.184836 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f923764b-ae02-458d-86a4-a69fc48f1cbe tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.831053 Jun 05 08:35:33.187890 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1391/2710] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:35:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 05 08:35:33.205790 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-156c71a7-2182-43fc-90a3-f08439eb16ef tempest-MultipleCreateNegativeTestJSON-484577715 tempest-MultipleCreateNegativeTestJSON-484577715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-31888222", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "min_count": 0}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-156c71a7-2182-43fc-90a3-f08439eb16ef tempest-MultipleCreateNegativeTestJSON-484577715 tempest-MultipleCreateNegativeTestJSON-484577715-project] Request method failure captured: Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 166 Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGrRRttRXHGJeucJkRTrd-kMHrFfOfKhk8VXIdQNB4Rx6bksixyvIRZpMAS2yfe7UfLlrxcXP21rgkAjvGpBH95rOSX2I3ljy_w2gEwQ8bQy6hLBRhBBHGRK2yNNMwqVY82xFDCZNcaOkQv3nmlb08HhJkwUT0X2AdLfcI5IbQxKeuc Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: cbee9bc615fc4740a6914d9ac14a23be Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-484577715 Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cbee9bc615fc4740a6914d9ac14a23be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cbee9bc615fc4740a6914d9ac14a23be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cbee9bc615fc4740a6914d9ac14a23be", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cbee9bc615fc4740a6914d9ac14a23be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-484577715 Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: cbee9bc615fc4740a6914d9ac14a23be Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-484577715 Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-MultipleCreateNegativeTestJSON-484577715-project Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 72ec5e54c82a46e991cf074047c14a25 Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-484577715-project Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-31888222", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "min_count": 0}} Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-31888222', 'imageRef': '1241bde3-ef1f-41a5-b0fa-6f409216229a', 'flavorRef': '452', 'min_count': 0}}} Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise error Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi 0 Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 05 08:35:33.211127 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 05 08:35:33.214803 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 05 08:35:33.214803 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 05 08:35:33.214803 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 05 08:35:33.214803 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jun 05 08:35:33.214803 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:33.214803 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:33.214803 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:33.214803 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:33.214803 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:33.214803 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:33.214803 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 05 08:35:33.214803 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 05 08:35:33.214803 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jun 05 08:35:33.214803 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:33.217854 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-156c71a7-2182-43fc-90a3-f08439eb16ef tempest-MultipleCreateNegativeTestJSON-484577715 tempest-MultipleCreateNegativeTestJSON-484577715-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:35:33.219496 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-156c71a7-2182-43fc-90a3-f08439eb16ef tempest-MultipleCreateNegativeTestJSON-484577715 tempest-MultipleCreateNegativeTestJSON-484577715-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.028639 Jun 05 08:35:33.220347 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1392/2711] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:35:33 2022] POST /compute/v2.1/servers => generated 130 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 05 08:35:33.226960 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c8296639-cd01-4690-931f-43873dffcd7c tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:33.228008 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c8296639-cd01-4690-931f-43873dffcd7c tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] [instance: 96dab45f-62e0-4cb8-bb0a-d1d269606d7a] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:33.255037 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c8296639-cd01-4690-931f-43873dffcd7c tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:33.255733 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c8296639-cd01-4690-931f-43873dffcd7c tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:33.263935 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c8296639-cd01-4690-931f-43873dffcd7c tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:33.264863 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c8296639-cd01-4690-931f-43873dffcd7c tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:33.318902 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c8296639-cd01-4690-931f-43873dffcd7c tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:33.319840 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c8296639-cd01-4690-931f-43873dffcd7c tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:33.320535 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-c8296639-cd01-4690-931f-43873dffcd7c tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Lazy-loading 'fault' on Instance uuid 96dab45f-62e0-4cb8-bb0a-d1d269606d7a {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:35:33.385229 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c8296639-cd01-4690-931f-43873dffcd7c tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5290563c019d48baae653fb4ca2d4d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9545db622b3a4cb5bb585bf2dd444ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:33.394139 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c8296639-cd01-4690-931f-43873dffcd7c tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] 10.222.0.33 "GET /compute/v2.1/servers/96dab45f-62e0-4cb8-bb0a-d1d269606d7a" status: 200 len: 1289 microversion: 2.1 time: 0.172489 Jun 05 08:35:33.407604 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1393/2712] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:35:33 2022] GET /compute/v2.1/servers/96dab45f-62e0-4cb8-bb0a-d1d269606d7a => generated 1289 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:35:33.414285 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2736158e-5d18-43bc-9de7-ec98d7e1cd68 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:33.414900 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2736158e-5d18-43bc-9de7-ec98d7e1cd68 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: c2b888c7-43f8-47a0-9f7d-c8204e87ee97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:33.473863 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2736158e-5d18-43bc-9de7-ec98d7e1cd68 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d0fce6620f4820bbac85573eeba520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b10d3d3540464fb9dee3b8a5bbe12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:33.488590 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2736158e-5d18-43bc-9de7-ec98d7e1cd68 tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] 10.222.0.33 "GET /compute/v2.1/servers/c2b888c7-43f8-47a0-9f7d-c8204e87ee97" status: 200 len: 1217 microversion: 2.1 time: 0.078625 Jun 05 08:35:33.489187 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1394/2713] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:35:33 2022] GET /compute/v2.1/servers/c2b888c7-43f8-47a0-9f7d-c8204e87ee97 => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:35:33.505391 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=10,nova_api:UPDATE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:35:33.509303 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-18f7751e-19cb-4bcd-92f3-33eeec0f63c8 tempest-MultipleCreateNegativeTestJSON-484577715 tempest-MultipleCreateNegativeTestJSON-484577715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-354936383", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "min_count": 2.5}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-18f7751e-19cb-4bcd-92f3-33eeec0f63c8 tempest-MultipleCreateNegativeTestJSON-484577715 tempest-MultipleCreateNegativeTestJSON-484577715-project] Request method failure captured: Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 169 Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGrRRttRXHGJeucJkRTrd-kMHrFfOfKhk8VXIdQNB4Rx6bksixyvIRZpMAS2yfe7UfLlrxcXP21rgkAjvGpBH95rOSX2I3ljy_w2gEwQ8bQy6hLBRhBBHGRK2yNNMwqVY82xFDCZNcaOkQv3nmlb08HhJkwUT0X2AdLfcI5IbQxKeuc Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: cbee9bc615fc4740a6914d9ac14a23be Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-484577715 Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cbee9bc615fc4740a6914d9ac14a23be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cbee9bc615fc4740a6914d9ac14a23be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cbee9bc615fc4740a6914d9ac14a23be", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cbee9bc615fc4740a6914d9ac14a23be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-484577715 Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: cbee9bc615fc4740a6914d9ac14a23be Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-484577715 Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-MultipleCreateNegativeTestJSON-484577715-project Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 72ec5e54c82a46e991cf074047c14a25 Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-484577715-project Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-354936383", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "min_count": 2.5}} Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-354936383', 'imageRef': '1241bde3-ef1f-41a5-b0fa-6f409216229a', 'flavorRef': '452', 'min_count': 2.5}}} Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise error Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi 2.5 Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 05 08:35:33.512187 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 05 08:35:33.518309 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 05 08:35:33.518309 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 05 08:35:33.518309 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 05 08:35:33.518309 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 05 08:35:33.518309 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 05 08:35:33.518309 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:33.518309 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:33.518309 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:33.518309 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:33.518309 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:33.518309 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:33.518309 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 05 08:35:33.518309 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 05 08:35:33.518309 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 05 08:35:33.518309 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:33.518309 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-18f7751e-19cb-4bcd-92f3-33eeec0f63c8 tempest-MultipleCreateNegativeTestJSON-484577715 tempest-MultipleCreateNegativeTestJSON-484577715-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:35:33.518309 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-18f7751e-19cb-4bcd-92f3-33eeec0f63c8 tempest-MultipleCreateNegativeTestJSON-484577715 tempest-MultipleCreateNegativeTestJSON-484577715-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.023982 Jun 05 08:35:33.518309 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1395/2714] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:35:33 2022] POST /compute/v2.1/servers => generated 139 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 05 08:35:33.538703 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b0f67023-1890-4098-9bf4-489713421050 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:33.541803 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b0f67023-1890-4098-9bf4-489713421050 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] [instance: 96dab45f-62e0-4cb8-bb0a-d1d269606d7a] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:33.558164 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b0f67023-1890-4098-9bf4-489713421050 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:33.558688 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b0f67023-1890-4098-9bf4-489713421050 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:33.559489 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b0f67023-1890-4098-9bf4-489713421050 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:33.559950 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b0f67023-1890-4098-9bf4-489713421050 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:33.609894 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b0f67023-1890-4098-9bf4-489713421050 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] [instance: 96dab45f-62e0-4cb8-bb0a-d1d269606d7a] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:35:33.652515 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2167f484-eb43-4b9a-8f13-b4a8773811bb tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 5.704134 Jun 05 08:35:33.657211 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1320/2715] 10.222.0.33 () {62 vars in 1188 bytes} [Sun Jun 5 08:35:27 2022] POST /compute/v2.1/servers => generated 404 bytes in 5709 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 05 08:35:33.674990 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0b35293d-a392-4013-a732-595b896e507b tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:33.675872 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0b35293d-a392-4013-a732-595b896e507b tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] [instance: fbdf0c9a-fac3-4a42-a9ce-bf2fbe8f8701] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:33.707527 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b0f67023-1890-4098-9bf4-489713421050 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] [instance: 96dab45f-62e0-4cb8-bb0a-d1d269606d7a] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:35:33.709539 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b0f67023-1890-4098-9bf4-489713421050 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:33.710296 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b0f67023-1890-4098-9bf4-489713421050 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:33.710718 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-b0f67023-1890-4098-9bf4-489713421050 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] [instance: 96dab45f-62e0-4cb8-bb0a-d1d269606d7a] instance's host None is down, deleting from database Jun 05 08:35:33.714735 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-b0f67023-1890-4098-9bf4-489713421050 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] [instance: 96dab45f-62e0-4cb8-bb0a-d1d269606d7a] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:35:33.752593 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0b35293d-a392-4013-a732-595b896e507b tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe434e218d5c43ddbc6124bb0cda57fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce97a39ef01f4a4abddf40b68bfff99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:33.768367 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0b35293d-a392-4013-a732-595b896e507b tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe434e218d5c43ddbc6124bb0cda57fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce97a39ef01f4a4abddf40b68bfff99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:33.771466 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0b35293d-a392-4013-a732-595b896e507b tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe434e218d5c43ddbc6124bb0cda57fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce97a39ef01f4a4abddf40b68bfff99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:33.775837 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0b35293d-a392-4013-a732-595b896e507b tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] 10.222.0.33 "GET /compute/v2.1/servers/fbdf0c9a-fac3-4a42-a9ce-bf2fbe8f8701" status: 200 len: 1286 microversion: 2.32 time: 0.112543 Jun 05 08:35:33.778295 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1321/2716] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:35:33 2022] GET /compute/v2.1/servers/fbdf0c9a-fac3-4a42-a9ce-bf2fbe8f8701 => generated 1286 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:35:33.829854 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-b0f67023-1890-4098-9bf4-489713421050 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] [instance: 96dab45f-62e0-4cb8-bb0a-d1d269606d7a] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:35:33.840827 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-b0f67023-1890-4098-9bf4-489713421050 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] [instance: 96dab45f-62e0-4cb8-bb0a-d1d269606d7a] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:35:33.870074 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=77,nova_cell0:UPDATE=17,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:35:34.106516 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b0f67023-1890-4098-9bf4-489713421050 tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] 10.222.0.33 "DELETE /compute/v2.1/servers/96dab45f-62e0-4cb8-bb0a-d1d269606d7a" status: 204 len: 0 microversion: 2.1 time: 0.590348 Jun 05 08:35:34.107755 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1396/2717] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:35:33 2022] DELETE /compute/v2.1/servers/96dab45f-62e0-4cb8-bb0a-d1d269606d7a => generated 0 bytes in 592 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:35:34.118643 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5b05601a-b37b-4fc3-a454-6f230e677c2d tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:34.119497 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5b05601a-b37b-4fc3-a454-6f230e677c2d tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] [instance: 96dab45f-62e0-4cb8-bb0a-d1d269606d7a] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:34.135234 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5b05601a-b37b-4fc3-a454-6f230e677c2d tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:34.138408 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5b05601a-b37b-4fc3-a454-6f230e677c2d tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:34.140440 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5b05601a-b37b-4fc3-a454-6f230e677c2d tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:34.141094 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5b05601a-b37b-4fc3-a454-6f230e677c2d tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:34.156727 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-5b05601a-b37b-4fc3-a454-6f230e677c2d tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] HTTP exception thrown: Instance 96dab45f-62e0-4cb8-bb0a-d1d269606d7a could not be found. Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5b05601a-b37b-4fc3-a454-6f230e677c2d tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Request method failure captured: Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/96dab45f-62e0-4cb8-bb0a-d1d269606d7a HTTP/1.1 Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGrQh3TKOWNBGGE-6pDaUROMoZp9hyzx3fVy0it4oTTgMcYWdqc2xqxyw2HjnxfSyFJUq-rXQVXFSRtNg6_9gjl04rVIvMHgkgJ-3REIMXVoVD8DE6yNebYMDCWYI1GLflrfqSkj9csxd6aLXPP7EjeyxeXwTW8e-udkWt_gziHGE2c Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 9545db622b3a4cb5bb585bf2dd444ea9 Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ServerPasswordTestJSON-518156848 Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9545db622b3a4cb5bb585bf2dd444ea9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9545db622b3a4cb5bb585bf2dd444ea9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9545db622b3a4cb5bb585bf2dd444ea9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9545db622b3a4cb5bb585bf2dd444ea9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ServerPasswordTestJSON-518156848 Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 9545db622b3a4cb5bb585bf2dd444ea9 Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ServerPasswordTestJSON-518156848 Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ServerPasswordTestJSON-518156848-project Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 5290563c019d48baae653fb4ca2d4d48 Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ServerPasswordTestJSON-518156848-project Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 96dab45f-62e0-4cb8-bb0a-d1d269606d7a could not be found. Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '96dab45f-62e0-4cb8-bb0a-d1d269606d7a'} Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96dab45f-62e0-4cb8-bb0a-d1d269606d7a could not be found. Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96dab45f-62e0-4cb8-bb0a-d1d269606d7a could not be found. Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:34.159262 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:35:34.163644 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:34.163644 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:34.163644 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:34.163644 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:35:34.163644 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:35:34.163644 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96dab45f-62e0-4cb8-bb0a-d1d269606d7a could not be found. Jun 05 08:35:34.163644 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:35:34.164769 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5b05601a-b37b-4fc3-a454-6f230e677c2d tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] Returning 404 to user: Instance 96dab45f-62e0-4cb8-bb0a-d1d269606d7a could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:35:34.165623 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5b05601a-b37b-4fc3-a454-6f230e677c2d tempest-ServerPasswordTestJSON-518156848 tempest-ServerPasswordTestJSON-518156848-project] 10.222.0.33 "GET /compute/v2.1/servers/96dab45f-62e0-4cb8-bb0a-d1d269606d7a" status: 404 len: 111 microversion: 2.1 time: 0.053376 Jun 05 08:35:34.166185 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1322/2718] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:35:34 2022] GET /compute/v2.1/servers/96dab45f-62e0-4cb8-bb0a-d1d269606d7a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:35:34.506860 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-28fc57d6-5011-4a9b-8093-853f350acbdc tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:34.507481 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-28fc57d6-5011-4a9b-8093-853f350acbdc tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: c2b888c7-43f8-47a0-9f7d-c8204e87ee97] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:34.524298 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-28fc57d6-5011-4a9b-8093-853f350acbdc tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:34.527126 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-28fc57d6-5011-4a9b-8093-853f350acbdc tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:34.527126 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-28fc57d6-5011-4a9b-8093-853f350acbdc tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:34.527126 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-28fc57d6-5011-4a9b-8093-853f350acbdc tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:34.560462 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-28fc57d6-5011-4a9b-8093-853f350acbdc tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:34.560936 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-28fc57d6-5011-4a9b-8093-853f350acbdc tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:34.561490 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-28fc57d6-5011-4a9b-8093-853f350acbdc tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lazy-loading 'fault' on Instance uuid c2b888c7-43f8-47a0-9f7d-c8204e87ee97 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:35:34.648686 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-28fc57d6-5011-4a9b-8093-853f350acbdc tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d0fce6620f4820bbac85573eeba520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b10d3d3540464fb9dee3b8a5bbe12e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:34.665780 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-28fc57d6-5011-4a9b-8093-853f350acbdc tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] 10.222.0.33 "GET /compute/v2.1/servers/c2b888c7-43f8-47a0-9f7d-c8204e87ee97" status: 200 len: 1290 microversion: 2.1 time: 0.161837 Jun 05 08:35:34.668192 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1397/2719] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:35:34 2022] GET /compute/v2.1/servers/c2b888c7-43f8-47a0-9f7d-c8204e87ee97 => generated 1290 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:35:34.685504 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5a87f4fc-0a42-4c98-bc0c-6b58377d65fa tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:34.686880 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5a87f4fc-0a42-4c98-bc0c-6b58377d65fa tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: c2b888c7-43f8-47a0-9f7d-c8204e87ee97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:34.698828 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a87f4fc-0a42-4c98-bc0c-6b58377d65fa tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:34.699397 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a87f4fc-0a42-4c98-bc0c-6b58377d65fa tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:34.700244 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a87f4fc-0a42-4c98-bc0c-6b58377d65fa tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:34.700823 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a87f4fc-0a42-4c98-bc0c-6b58377d65fa tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:34.745729 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5a87f4fc-0a42-4c98-bc0c-6b58377d65fa tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: c2b888c7-43f8-47a0-9f7d-c8204e87ee97] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:35:34.802847 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-302047e0-2808-4e46-9430-9dbbdf726735 tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:34.804107 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-302047e0-2808-4e46-9430-9dbbdf726735 tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] [instance: fbdf0c9a-fac3-4a42-a9ce-bf2fbe8f8701] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:34.814806 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-302047e0-2808-4e46-9430-9dbbdf726735 tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:34.815531 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-302047e0-2808-4e46-9430-9dbbdf726735 tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:34.816615 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-302047e0-2808-4e46-9430-9dbbdf726735 tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:34.817808 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-302047e0-2808-4e46-9430-9dbbdf726735 tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:34.833074 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5a87f4fc-0a42-4c98-bc0c-6b58377d65fa tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: c2b888c7-43f8-47a0-9f7d-c8204e87ee97] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:35:34.834286 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a87f4fc-0a42-4c98-bc0c-6b58377d65fa tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:34.834893 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5a87f4fc-0a42-4c98-bc0c-6b58377d65fa tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:34.835459 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-5a87f4fc-0a42-4c98-bc0c-6b58377d65fa tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: c2b888c7-43f8-47a0-9f7d-c8204e87ee97] instance's host None is down, deleting from database Jun 05 08:35:34.844013 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-5a87f4fc-0a42-4c98-bc0c-6b58377d65fa tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: c2b888c7-43f8-47a0-9f7d-c8204e87ee97] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:35:34.928100 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-5a87f4fc-0a42-4c98-bc0c-6b58377d65fa tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: c2b888c7-43f8-47a0-9f7d-c8204e87ee97] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:35:34.936933 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-5a87f4fc-0a42-4c98-bc0c-6b58377d65fa tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: c2b888c7-43f8-47a0-9f7d-c8204e87ee97] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:35:34.990570 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-302047e0-2808-4e46-9430-9dbbdf726735 tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:34.994074 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-302047e0-2808-4e46-9430-9dbbdf726735 tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:34.994647 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-302047e0-2808-4e46-9430-9dbbdf726735 tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Lazy-loading 'fault' on Instance uuid fbdf0c9a-fac3-4a42-a9ce-bf2fbe8f8701 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:35:35.114004 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-302047e0-2808-4e46-9430-9dbbdf726735 tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe434e218d5c43ddbc6124bb0cda57fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce97a39ef01f4a4abddf40b68bfff99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:35.175219 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-302047e0-2808-4e46-9430-9dbbdf726735 tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe434e218d5c43ddbc6124bb0cda57fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce97a39ef01f4a4abddf40b68bfff99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:35.178105 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-302047e0-2808-4e46-9430-9dbbdf726735 tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe434e218d5c43ddbc6124bb0cda57fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce97a39ef01f4a4abddf40b68bfff99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:35.187944 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-302047e0-2808-4e46-9430-9dbbdf726735 tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] 10.222.0.33 "GET /compute/v2.1/servers/fbdf0c9a-fac3-4a42-a9ce-bf2fbe8f8701" status: 200 len: 1597 microversion: 2.32 time: 0.396595 Jun 05 08:35:35.189040 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1398/2720] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:35:34 2022] GET /compute/v2.1/servers/fbdf0c9a-fac3-4a42-a9ce-bf2fbe8f8701 => generated 1597 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:35:35.211224 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-19b1e56b-e4ff-4d38-9632-5eff53634bac tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:35.213853 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-19b1e56b-e4ff-4d38-9632-5eff53634bac tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] [instance: fbdf0c9a-fac3-4a42-a9ce-bf2fbe8f8701] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:35.237417 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-19b1e56b-e4ff-4d38-9632-5eff53634bac tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:35.237857 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-19b1e56b-e4ff-4d38-9632-5eff53634bac tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:35.238683 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-19b1e56b-e4ff-4d38-9632-5eff53634bac tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:35.239137 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-19b1e56b-e4ff-4d38-9632-5eff53634bac tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:35.269969 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5a87f4fc-0a42-4c98-bc0c-6b58377d65fa tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c2b888c7-43f8-47a0-9f7d-c8204e87ee97" status: 204 len: 0 microversion: 2.1 time: 0.588912 Jun 05 08:35:35.271029 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1323/2721] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:35:34 2022] DELETE /compute/v2.1/servers/c2b888c7-43f8-47a0-9f7d-c8204e87ee97 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:35:35.281693 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3f87e6ef-c702-4ac6-abf9-737bb1c0b2fe tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:35.285614 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3f87e6ef-c702-4ac6-abf9-737bb1c0b2fe tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] [instance: c2b888c7-43f8-47a0-9f7d-c8204e87ee97] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:35.305912 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3f87e6ef-c702-4ac6-abf9-737bb1c0b2fe tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:35.307194 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-19b1e56b-e4ff-4d38-9632-5eff53634bac tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] [instance: fbdf0c9a-fac3-4a42-a9ce-bf2fbe8f8701] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:35:35.307442 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3f87e6ef-c702-4ac6-abf9-737bb1c0b2fe tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:35.310974 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3f87e6ef-c702-4ac6-abf9-737bb1c0b2fe tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:35.315879 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3f87e6ef-c702-4ac6-abf9-737bb1c0b2fe tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:35.367917 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-3f87e6ef-c702-4ac6-abf9-737bb1c0b2fe tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] HTTP exception thrown: Instance c2b888c7-43f8-47a0-9f7d-c8204e87ee97 could not be found. Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3f87e6ef-c702-4ac6-abf9-737bb1c0b2fe tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Request method failure captured: Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/c2b888c7-43f8-47a0-9f7d-c8204e87ee97 HTTP/1.1 Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGrKkRupTL1M9tJnuCHujOLVO0zKg5a6xj3VzjbQLWsv7JTPwo_X8eKqXP6fLigijQggnrk_OlY3kwHdPAZW6bZLoVzVaUylR_wahD2uV27wspmk2RclTMQKOep386-rZc3EPsIzOy4TSgRybdKdatcEtPQjq4KbkGn_JMPZ9gH4BbY Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: e1b10d3d3540464fb9dee3b8a5bbe12e Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2015357332 Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e1b10d3d3540464fb9dee3b8a5bbe12e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1b10d3d3540464fb9dee3b8a5bbe12e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e1b10d3d3540464fb9dee3b8a5bbe12e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1b10d3d3540464fb9dee3b8a5bbe12e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ServerDiskConfigTestJSON-2015357332 Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: e1b10d3d3540464fb9dee3b8a5bbe12e Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2015357332 Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ServerDiskConfigTestJSON-2015357332-project Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 45d0fce6620f4820bbac85573eeba520 Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ServerDiskConfigTestJSON-2015357332-project Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance c2b888c7-43f8-47a0-9f7d-c8204e87ee97 could not be found. Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'c2b888c7-43f8-47a0-9f7d-c8204e87ee97'} Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2b888c7-43f8-47a0-9f7d-c8204e87ee97 could not be found. Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2b888c7-43f8-47a0-9f7d-c8204e87ee97 could not be found. Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:35.369654 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:35:35.374692 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:35.374692 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:35.374692 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:35.374692 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:35:35.374692 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:35:35.374692 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2b888c7-43f8-47a0-9f7d-c8204e87ee97 could not be found. Jun 05 08:35:35.374692 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:35:35.374692 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3f87e6ef-c702-4ac6-abf9-737bb1c0b2fe tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] Returning 404 to user: Instance c2b888c7-43f8-47a0-9f7d-c8204e87ee97 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:35:35.374692 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3f87e6ef-c702-4ac6-abf9-737bb1c0b2fe tempest-ServerDiskConfigTestJSON-2015357332 tempest-ServerDiskConfigTestJSON-2015357332-project] 10.222.0.33 "GET /compute/v2.1/servers/c2b888c7-43f8-47a0-9f7d-c8204e87ee97" status: 404 len: 111 microversion: 2.1 time: 0.096007 Jun 05 08:35:35.384100 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1324/2722] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:35:35 2022] GET /compute/v2.1/servers/c2b888c7-43f8-47a0-9f7d-c8204e87ee97 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:35:35.472542 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-19b1e56b-e4ff-4d38-9632-5eff53634bac tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] [instance: fbdf0c9a-fac3-4a42-a9ce-bf2fbe8f8701] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:35:35.473457 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-19b1e56b-e4ff-4d38-9632-5eff53634bac tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:35.473993 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-19b1e56b-e4ff-4d38-9632-5eff53634bac tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:35.474501 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-19b1e56b-e4ff-4d38-9632-5eff53634bac tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] [instance: fbdf0c9a-fac3-4a42-a9ce-bf2fbe8f8701] instance's host None is down, deleting from database Jun 05 08:35:35.478169 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-19b1e56b-e4ff-4d38-9632-5eff53634bac tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] [instance: fbdf0c9a-fac3-4a42-a9ce-bf2fbe8f8701] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:35:35.536846 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-19b1e56b-e4ff-4d38-9632-5eff53634bac tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] [instance: fbdf0c9a-fac3-4a42-a9ce-bf2fbe8f8701] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:35:35.547024 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-19b1e56b-e4ff-4d38-9632-5eff53634bac tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] [instance: fbdf0c9a-fac3-4a42-a9ce-bf2fbe8f8701] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:35:36.352995 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-19b1e56b-e4ff-4d38-9632-5eff53634bac tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fbdf0c9a-fac3-4a42-a9ce-bf2fbe8f8701" status: 204 len: 0 microversion: 2.32 time: 1.146564 Jun 05 08:35:36.354159 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1399/2723] 10.222.0.33 () {60 vars in 1279 bytes} [Sun Jun 5 08:35:35 2022] DELETE /compute/v2.1/servers/fbdf0c9a-fac3-4a42-a9ce-bf2fbe8f8701 => generated 0 bytes in 1148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 05 08:35:36.362932 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f295a52e-eac7-4c1f-87cf-c80834609de2 tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:36.365347 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f295a52e-eac7-4c1f-87cf-c80834609de2 tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] [instance: fbdf0c9a-fac3-4a42-a9ce-bf2fbe8f8701] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:36.375683 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f295a52e-eac7-4c1f-87cf-c80834609de2 tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:36.376459 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f295a52e-eac7-4c1f-87cf-c80834609de2 tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:36.377524 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f295a52e-eac7-4c1f-87cf-c80834609de2 tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:36.378391 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f295a52e-eac7-4c1f-87cf-c80834609de2 tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:36.478572 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=62,nova_cell0:UPDATE=30,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=4 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:35:36.528284 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-f295a52e-eac7-4c1f-87cf-c80834609de2 tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] HTTP exception thrown: Instance fbdf0c9a-fac3-4a42-a9ce-bf2fbe8f8701 could not be found. Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f295a52e-eac7-4c1f-87cf-c80834609de2 tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Request method failure captured: Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/fbdf0c9a-fac3-4a42-a9ce-bf2fbe8f8701 HTTP/1.1 Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGptWBrabcCFDaMHRa9ZjS9RfJN08coMRMl0FAcG3h6ymzYqbYKcJi7RNjm3m7x07q1knADm-1RNwGj0bFFVjLuaYFeIZvyCAUfGk3taGrAxSANdtvkg01_niodvXjTRU-eb_g2rDCDsIrCtWEzqAStfjN0foNpisPv0_T0KcBj8X28 Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: X-Openstack-Nova-Api-Version: 2.32 Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: ce97a39ef01f4a4abddf40b68bfff99d Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-TaggedBootDevicesTest-800546974 Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce97a39ef01f4a4abddf40b68bfff99d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce97a39ef01f4a4abddf40b68bfff99d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce97a39ef01f4a4abddf40b68bfff99d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce97a39ef01f4a4abddf40b68bfff99d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-TaggedBootDevicesTest-800546974 Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: ce97a39ef01f4a4abddf40b68bfff99d Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-TaggedBootDevicesTest-800546974 Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-TaggedBootDevicesTest-800546974-project Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: fe434e218d5c43ddbc6124bb0cda57fe Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-TaggedBootDevicesTest-800546974-project Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance fbdf0c9a-fac3-4a42-a9ce-bf2fbe8f8701 could not be found. Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'fbdf0c9a-fac3-4a42-a9ce-bf2fbe8f8701'} Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbdf0c9a-fac3-4a42-a9ce-bf2fbe8f8701 could not be found. Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbdf0c9a-fac3-4a42-a9ce-bf2fbe8f8701 could not be found. Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:36.532611 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:35:36.537098 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:36.537098 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:36.537098 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:36.537098 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:35:36.537098 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:35:36.537098 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbdf0c9a-fac3-4a42-a9ce-bf2fbe8f8701 could not be found. Jun 05 08:35:36.537098 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:35:36.537098 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f295a52e-eac7-4c1f-87cf-c80834609de2 tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Returning 404 to user: Instance fbdf0c9a-fac3-4a42-a9ce-bf2fbe8f8701 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:35:36.537098 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f295a52e-eac7-4c1f-87cf-c80834609de2 tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] 10.222.0.33 "GET /compute/v2.1/servers/fbdf0c9a-fac3-4a42-a9ce-bf2fbe8f8701" status: 404 len: 111 microversion: 2.32 time: 0.176731 Jun 05 08:35:36.540403 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1325/2724] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:35:36 2022] GET /compute/v2.1/servers/fbdf0c9a-fac3-4a42-a9ce-bf2fbe8f8701 => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 05 08:35:36.550448 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7100db38-aa8b-46f4-9249-b9d0cdb3a242 tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] Calling method '.version_select at 0x7f2432ef5940>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:36.595760 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7100db38-aa8b-46f4-9249-b9d0cdb3a242 tempest-TaggedBootDevicesTest-800546974 tempest-TaggedBootDevicesTest-800546974-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1279979662" status: 204 len: 0 microversion: 2.32 time: 0.049952 Jun 05 08:35:36.596974 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1400/2725] 10.222.0.33 () {60 vars in 1261 bytes} [Sun Jun 5 08:35:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1279979662 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 05 08:35:37.140223 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-27259957-a31d-409d-9351-b1607f46f468 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:37.141436 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-27259957-a31d-409d-9351-b1607f46f468 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:37.166960 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-27259957-a31d-409d-9351-b1607f46f468 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:37.167808 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-27259957-a31d-409d-9351-b1607f46f468 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:37.168837 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-27259957-a31d-409d-9351-b1607f46f468 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:37.169694 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-27259957-a31d-409d-9351-b1607f46f468 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:37.281045 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-27259957-a31d-409d-9351-b1607f46f468 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:35:37.475602 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-27259957-a31d-409d-9351-b1607f46f468 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "DELETE /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 204 len: 0 microversion: 2.20 time: 0.340619 Jun 05 08:35:37.481965 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1326/2726] 10.222.0.33 () {60 vars in 1279 bytes} [Sun Jun 5 08:35:37 2022] DELETE /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:35:37.492874 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a018a542-d98d-43c4-aaa8-a2f3db60d084 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:37.493584 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a018a542-d98d-43c4-aaa8-a2f3db60d084 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:37.506205 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a018a542-d98d-43c4-aaa8-a2f3db60d084 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:37.506673 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a018a542-d98d-43c4-aaa8-a2f3db60d084 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:37.508296 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a018a542-d98d-43c4-aaa8-a2f3db60d084 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:37.508743 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a018a542-d98d-43c4-aaa8-a2f3db60d084 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:37.595886 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a018a542-d98d-43c4-aaa8-a2f3db60d084 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:37.597055 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a018a542-d98d-43c4-aaa8-a2f3db60d084 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:37.599990 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-a018a542-d98d-43c4-aaa8-a2f3db60d084 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lazy-loading 'fault' on Instance uuid 040dd488-42f2-45c3-86de-1a675e78d7ca {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:35:38.109276 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a018a542-d98d-43c4-aaa8-a2f3db60d084 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:38.119363 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a018a542-d98d-43c4-aaa8-a2f3db60d084 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:38.122036 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a018a542-d98d-43c4-aaa8-a2f3db60d084 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:38.127041 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a018a542-d98d-43c4-aaa8-a2f3db60d084 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1431 microversion: 2.20 time: 0.640951 Jun 05 08:35:38.131370 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1401/2727] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:35:37 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1431 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:35:38.297074 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-278d1493-1f88-44ab-bb4c-1b80883c8d06 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1332441979", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": "none"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:35:38.381561 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-278d1493-1f88-44ab-bb4c-1b80883c8d06 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:35:38.381993 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-278d1493-1f88-44ab-bb4c-1b80883c8d06 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:35:38.382474 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-278d1493-1f88-44ab-bb4c-1b80883c8d06 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:35:38.382889 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-278d1493-1f88-44ab-bb4c-1b80883c8d06 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:35:38.383305 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-278d1493-1f88-44ab-bb4c-1b80883c8d06 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:35:38.402954 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-278d1493-1f88-44ab-bb4c-1b80883c8d06 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:38.405232 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-278d1493-1f88-44ab-bb4c-1b80883c8d06 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:38.406485 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-278d1493-1f88-44ab-bb4c-1b80883c8d06 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:38.407514 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-278d1493-1f88-44ab-bb4c-1b80883c8d06 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:38.441390 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-278d1493-1f88-44ab-bb4c-1b80883c8d06 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Getting quotas for project 9ca3b319f18a41438d3a07afbb0b8c8c. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:35:38.455939 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-278d1493-1f88-44ab-bb4c-1b80883c8d06 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Getting quotas for user 3792a079363f4fb18372a5d7a4a07b49 and project 9ca3b319f18a41438d3a07afbb0b8c8c. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:35:38.488961 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-278d1493-1f88-44ab-bb4c-1b80883c8d06 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:35:38.493410 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-278d1493-1f88-44ab-bb4c-1b80883c8d06 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] [instance: 0620407a-fc63-49f9-9634-f069e37f90aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:35:38.578163 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-278d1493-1f88-44ab-bb4c-1b80883c8d06 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.483546 Jun 05 08:35:38.587667 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1327/2728] 10.222.0.33 () {62 vars in 1187 bytes} [Sun Jun 5 08:35:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 05 08:35:38.590261 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3a5d77a9-1f66-472f-bf91-2f6a192bcded tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:38.600372 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3a5d77a9-1f66-472f-bf91-2f6a192bcded tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] [instance: 0620407a-fc63-49f9-9634-f069e37f90aa] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:38.775496 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3a5d77a9-1f66-472f-bf91-2f6a192bcded tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3792a079363f4fb18372a5d7a4a07b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca3b319f18a41438d3a07afbb0b8c8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:38.788441 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3a5d77a9-1f66-472f-bf91-2f6a192bcded tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3792a079363f4fb18372a5d7a4a07b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca3b319f18a41438d3a07afbb0b8c8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:38.790149 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-3a5d77a9-1f66-472f-bf91-2f6a192bcded tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3792a079363f4fb18372a5d7a4a07b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca3b319f18a41438d3a07afbb0b8c8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:38.793882 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3a5d77a9-1f66-472f-bf91-2f6a192bcded tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] 10.222.0.33 "GET /compute/v2.1/servers/0620407a-fc63-49f9-9634-f069e37f90aa" status: 200 len: 1278 microversion: 2.47 time: 0.207490 Jun 05 08:35:38.795082 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1402/2729] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:35:38 2022] GET /compute/v2.1/servers/0620407a-fc63-49f9-9634-f069e37f90aa => generated 1278 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:35:39.035264 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4842dd83-88dc-4bc2-8a33-1e093cadc839 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-586906103", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": "none"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:35:39.151043 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0d5a09b6-02e3-4d50-9d51-be8de1a81029 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:39.151910 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0d5a09b6-02e3-4d50-9d51-be8de1a81029 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: 040dd488-42f2-45c3-86de-1a675e78d7ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:39.160358 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-4842dd83-88dc-4bc2-8a33-1e093cadc839 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:35:39.163685 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-4842dd83-88dc-4bc2-8a33-1e093cadc839 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:35:39.167779 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-4842dd83-88dc-4bc2-8a33-1e093cadc839 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:35:39.168370 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-4842dd83-88dc-4bc2-8a33-1e093cadc839 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:35:39.168848 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-4842dd83-88dc-4bc2-8a33-1e093cadc839 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:35:39.173207 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0d5a09b6-02e3-4d50-9d51-be8de1a81029 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:39.176705 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0d5a09b6-02e3-4d50-9d51-be8de1a81029 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:39.179731 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0d5a09b6-02e3-4d50-9d51-be8de1a81029 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:39.181627 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0d5a09b6-02e3-4d50-9d51-be8de1a81029 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:39.208684 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4842dd83-88dc-4bc2-8a33-1e093cadc839 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:39.209138 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4842dd83-88dc-4bc2-8a33-1e093cadc839 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:39.209946 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4842dd83-88dc-4bc2-8a33-1e093cadc839 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:39.210597 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4842dd83-88dc-4bc2-8a33-1e093cadc839 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:39.243100 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-4842dd83-88dc-4bc2-8a33-1e093cadc839 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Getting quotas for project 9ca3b319f18a41438d3a07afbb0b8c8c. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:35:39.250827 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-4842dd83-88dc-4bc2-8a33-1e093cadc839 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Getting quotas for user 3792a079363f4fb18372a5d7a4a07b49 and project 9ca3b319f18a41438d3a07afbb0b8c8c. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:35:39.267178 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4842dd83-88dc-4bc2-8a33-1e093cadc839 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:35:39.270361 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4842dd83-88dc-4bc2-8a33-1e093cadc839 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] [instance: 49b3b621-46ae-435b-b6f2-39183ba2f7d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:35:39.305272 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0d5a09b6-02e3-4d50-9d51-be8de1a81029 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:39.305778 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0d5a09b6-02e3-4d50-9d51-be8de1a81029 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:39.306557 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-0d5a09b6-02e3-4d50-9d51-be8de1a81029 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lazy-loading 'fault' on Instance uuid 040dd488-42f2-45c3-86de-1a675e78d7ca {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:35:39.336747 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4842dd83-88dc-4bc2-8a33-1e093cadc839 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.305910 Jun 05 08:35:39.337834 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1328/2730] 10.222.0.33 () {62 vars in 1187 bytes} [Sun Jun 5 08:35:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 309 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 05 08:35:39.351441 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2ab77687-4cc9-4172-8802-a409c71d839d tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:35:39.354434 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2ab77687-4cc9-4172-8802-a409c71d839d tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] [instance: 49b3b621-46ae-435b-b6f2-39183ba2f7d7] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:39.455690 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2ab77687-4cc9-4172-8802-a409c71d839d tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] 10.222.0.33 "PUT /compute/v2.1/servers/49b3b621-46ae-435b-b6f2-39183ba2f7d7" status: 200 len: 991 microversion: 2.47 time: 0.109384 Jun 05 08:35:39.457321 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1329/2731] 10.222.0.33 () {62 vars in 1296 bytes} [Sun Jun 5 08:35:39 2022] PUT /compute/v2.1/servers/49b3b621-46ae-435b-b6f2-39183ba2f7d7 => generated 991 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:35:39.475014 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b699a2e8-244c-44f0-88b7-59cdce285696 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:39.475644 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b699a2e8-244c-44f0-88b7-59cdce285696 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] [instance: 49b3b621-46ae-435b-b6f2-39183ba2f7d7] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:39.494400 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0d5a09b6-02e3-4d50-9d51-be8de1a81029 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:39.503748 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0d5a09b6-02e3-4d50-9d51-be8de1a81029 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:39.514434 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0d5a09b6-02e3-4d50-9d51-be8de1a81029 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:39.519017 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0d5a09b6-02e3-4d50-9d51-be8de1a81029 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca" status: 200 len: 1431 microversion: 2.20 time: 0.372535 Jun 05 08:35:39.520715 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1403/2732] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:35:39 2022] GET /compute/v2.1/servers/040dd488-42f2-45c3-86de-1a675e78d7ca => generated 1431 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:35:39.619047 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b699a2e8-244c-44f0-88b7-59cdce285696 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3792a079363f4fb18372a5d7a4a07b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca3b319f18a41438d3a07afbb0b8c8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:39.634020 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b699a2e8-244c-44f0-88b7-59cdce285696 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3792a079363f4fb18372a5d7a4a07b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca3b319f18a41438d3a07afbb0b8c8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:39.638556 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b699a2e8-244c-44f0-88b7-59cdce285696 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3792a079363f4fb18372a5d7a4a07b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca3b319f18a41438d3a07afbb0b8c8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:39.639861 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b699a2e8-244c-44f0-88b7-59cdce285696 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] 10.222.0.33 "GET /compute/v2.1/servers/49b3b621-46ae-435b-b6f2-39183ba2f7d7" status: 200 len: 1277 microversion: 2.47 time: 0.170703 Jun 05 08:35:39.649047 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1330/2733] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:35:39 2022] GET /compute/v2.1/servers/49b3b621-46ae-435b-b6f2-39183ba2f7d7 => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:35:40.671894 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-95ca84e8-51e3-4ad8-925e-176978fa28c7 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:40.672673 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-95ca84e8-51e3-4ad8-925e-176978fa28c7 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] [instance: 49b3b621-46ae-435b-b6f2-39183ba2f7d7] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:40.692264 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-95ca84e8-51e3-4ad8-925e-176978fa28c7 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:40.692991 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-95ca84e8-51e3-4ad8-925e-176978fa28c7 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:40.694050 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-95ca84e8-51e3-4ad8-925e-176978fa28c7 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:40.694504 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-95ca84e8-51e3-4ad8-925e-176978fa28c7 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:40.768190 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-95ca84e8-51e3-4ad8-925e-176978fa28c7 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:40.771946 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-95ca84e8-51e3-4ad8-925e-176978fa28c7 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:40.772665 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-95ca84e8-51e3-4ad8-925e-176978fa28c7 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lazy-loading 'fault' on Instance uuid 49b3b621-46ae-435b-b6f2-39183ba2f7d7 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:35:40.941516 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-95ca84e8-51e3-4ad8-925e-176978fa28c7 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3792a079363f4fb18372a5d7a4a07b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca3b319f18a41438d3a07afbb0b8c8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:40.960717 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-95ca84e8-51e3-4ad8-925e-176978fa28c7 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3792a079363f4fb18372a5d7a4a07b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca3b319f18a41438d3a07afbb0b8c8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:40.964781 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-95ca84e8-51e3-4ad8-925e-176978fa28c7 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3792a079363f4fb18372a5d7a4a07b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca3b319f18a41438d3a07afbb0b8c8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:40.968123 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-95ca84e8-51e3-4ad8-925e-176978fa28c7 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] 10.222.0.33 "GET /compute/v2.1/servers/49b3b621-46ae-435b-b6f2-39183ba2f7d7" status: 200 len: 1350 microversion: 2.47 time: 0.302657 Jun 05 08:35:40.970962 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1404/2734] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:35:40 2022] GET /compute/v2.1/servers/49b3b621-46ae-435b-b6f2-39183ba2f7d7 => generated 1350 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:35:41.014336 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-67c6c4b2-d5ed-4d7e-a915-b8eeb6894d6f tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:41.015334 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-67c6c4b2-d5ed-4d7e-a915-b8eeb6894d6f tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] [instance: 49b3b621-46ae-435b-b6f2-39183ba2f7d7] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:41.036789 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-67c6c4b2-d5ed-4d7e-a915-b8eeb6894d6f tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:41.038034 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-67c6c4b2-d5ed-4d7e-a915-b8eeb6894d6f tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:41.039066 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-67c6c4b2-d5ed-4d7e-a915-b8eeb6894d6f tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:41.040253 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-67c6c4b2-d5ed-4d7e-a915-b8eeb6894d6f tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:41.081208 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-67c6c4b2-d5ed-4d7e-a915-b8eeb6894d6f tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] [instance: 49b3b621-46ae-435b-b6f2-39183ba2f7d7] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:35:41.177912 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-67c6c4b2-d5ed-4d7e-a915-b8eeb6894d6f tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] [instance: 49b3b621-46ae-435b-b6f2-39183ba2f7d7] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:35:41.178750 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-67c6c4b2-d5ed-4d7e-a915-b8eeb6894d6f tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:41.179202 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-67c6c4b2-d5ed-4d7e-a915-b8eeb6894d6f tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:41.179648 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-67c6c4b2-d5ed-4d7e-a915-b8eeb6894d6f tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] [instance: 49b3b621-46ae-435b-b6f2-39183ba2f7d7] instance's host None is down, deleting from database Jun 05 08:35:41.193185 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-67c6c4b2-d5ed-4d7e-a915-b8eeb6894d6f tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] [instance: 49b3b621-46ae-435b-b6f2-39183ba2f7d7] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:35:41.329455 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-67c6c4b2-d5ed-4d7e-a915-b8eeb6894d6f tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] [instance: 49b3b621-46ae-435b-b6f2-39183ba2f7d7] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:35:41.336671 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-67c6c4b2-d5ed-4d7e-a915-b8eeb6894d6f tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] [instance: 49b3b621-46ae-435b-b6f2-39183ba2f7d7] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:35:41.533497 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-67c6c4b2-d5ed-4d7e-a915-b8eeb6894d6f tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] 10.222.0.33 "DELETE /compute/v2.1/servers/49b3b621-46ae-435b-b6f2-39183ba2f7d7" status: 204 len: 0 microversion: 2.47 time: 0.525252 Jun 05 08:35:41.538834 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1331/2735] 10.222.0.33 () {60 vars in 1279 bytes} [Sun Jun 5 08:35:40 2022] DELETE /compute/v2.1/servers/49b3b621-46ae-435b-b6f2-39183ba2f7d7 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:35:41.543570 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d7e004b0-2672-4fd9-8872-c125caaca5b7 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:41.544560 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d7e004b0-2672-4fd9-8872-c125caaca5b7 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] [instance: 49b3b621-46ae-435b-b6f2-39183ba2f7d7] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:41.551598 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d7e004b0-2672-4fd9-8872-c125caaca5b7 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:41.552337 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d7e004b0-2672-4fd9-8872-c125caaca5b7 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:41.557605 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d7e004b0-2672-4fd9-8872-c125caaca5b7 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:41.558304 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d7e004b0-2672-4fd9-8872-c125caaca5b7 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:41.577913 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-d7e004b0-2672-4fd9-8872-c125caaca5b7 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] HTTP exception thrown: Instance 49b3b621-46ae-435b-b6f2-39183ba2f7d7 could not be found. Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d7e004b0-2672-4fd9-8872-c125caaca5b7 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Request method failure captured: Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/49b3b621-46ae-435b-b6f2-39183ba2f7d7 HTTP/1.1 Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGrZ9c3PnToJWyr5VKAJUpo9XfzG81yUUQ7SzyBpxFXyX-d5ewq5OX5GGN7YjQwPiyiqrcgaqd0Zf25_eUQM_0xnKEMoOr6CO7Gvr91myb9BnlWZHuIgAovZUol8M5sI2Lg3KVD16QhdnuhuFbfp7HZ9pwFJIR8NaNEDdzIyPaTuRjU Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: X-Openstack-Nova-Api-Version: 2.47 Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 9ca3b319f18a41438d3a07afbb0b8c8c Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ServerShowV247Test-36219851 Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9ca3b319f18a41438d3a07afbb0b8c8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9ca3b319f18a41438d3a07afbb0b8c8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9ca3b319f18a41438d3a07afbb0b8c8c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9ca3b319f18a41438d3a07afbb0b8c8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ServerShowV247Test-36219851 Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 9ca3b319f18a41438d3a07afbb0b8c8c Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ServerShowV247Test-36219851 Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ServerShowV247Test-36219851-project Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 3792a079363f4fb18372a5d7a4a07b49 Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ServerShowV247Test-36219851-project Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 49b3b621-46ae-435b-b6f2-39183ba2f7d7 could not be found. Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '49b3b621-46ae-435b-b6f2-39183ba2f7d7'} Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49b3b621-46ae-435b-b6f2-39183ba2f7d7 could not be found. Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49b3b621-46ae-435b-b6f2-39183ba2f7d7 could not be found. Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:41.581373 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:41.587131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:41.587131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:41.587131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:41.587131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:35:41.587131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:35:41.587131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49b3b621-46ae-435b-b6f2-39183ba2f7d7 could not be found. Jun 05 08:35:41.587131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:41.590537 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d7e004b0-2672-4fd9-8872-c125caaca5b7 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Returning 404 to user: Instance 49b3b621-46ae-435b-b6f2-39183ba2f7d7 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:35:41.591919 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d7e004b0-2672-4fd9-8872-c125caaca5b7 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] 10.222.0.33 "GET /compute/v2.1/servers/49b3b621-46ae-435b-b6f2-39183ba2f7d7" status: 404 len: 111 microversion: 2.47 time: 0.052020 Jun 05 08:35:41.593265 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1405/2736] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:35:41 2022] GET /compute/v2.1/servers/49b3b621-46ae-435b-b6f2-39183ba2f7d7 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 05 08:35:41.601931 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-18a48537-a416-4596-96bf-99b5777884a1 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:41.602535 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-18a48537-a416-4596-96bf-99b5777884a1 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] [instance: 0620407a-fc63-49f9-9634-f069e37f90aa] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:41.631375 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-18a48537-a416-4596-96bf-99b5777884a1 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:41.632487 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-18a48537-a416-4596-96bf-99b5777884a1 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:41.634713 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-18a48537-a416-4596-96bf-99b5777884a1 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:41.636496 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-18a48537-a416-4596-96bf-99b5777884a1 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:41.694109 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-18a48537-a416-4596-96bf-99b5777884a1 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] [instance: 0620407a-fc63-49f9-9634-f069e37f90aa] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:35:41.784221 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-18a48537-a416-4596-96bf-99b5777884a1 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] [instance: 0620407a-fc63-49f9-9634-f069e37f90aa] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:35:41.785298 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-18a48537-a416-4596-96bf-99b5777884a1 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:41.786055 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-18a48537-a416-4596-96bf-99b5777884a1 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:41.787433 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-18a48537-a416-4596-96bf-99b5777884a1 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] [instance: 0620407a-fc63-49f9-9634-f069e37f90aa] instance's host None is down, deleting from database Jun 05 08:35:41.791937 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-18a48537-a416-4596-96bf-99b5777884a1 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] [instance: 0620407a-fc63-49f9-9634-f069e37f90aa] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:35:41.886083 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-18a48537-a416-4596-96bf-99b5777884a1 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] [instance: 0620407a-fc63-49f9-9634-f069e37f90aa] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:35:41.899532 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-18a48537-a416-4596-96bf-99b5777884a1 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] [instance: 0620407a-fc63-49f9-9634-f069e37f90aa] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:35:42.243476 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-18a48537-a416-4596-96bf-99b5777884a1 tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0620407a-fc63-49f9-9634-f069e37f90aa" status: 204 len: 0 microversion: 2.47 time: 0.646129 Jun 05 08:35:42.245276 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1332/2737] 10.222.0.33 () {60 vars in 1279 bytes} [Sun Jun 5 08:35:41 2022] DELETE /compute/v2.1/servers/0620407a-fc63-49f9-9634-f069e37f90aa => generated 0 bytes in 649 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:35:42.254371 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5ead756b-a0ce-44c1-964a-fa25d8f2471e tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:42.256427 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5ead756b-a0ce-44c1-964a-fa25d8f2471e tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] [instance: 0620407a-fc63-49f9-9634-f069e37f90aa] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:42.285912 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5ead756b-a0ce-44c1-964a-fa25d8f2471e tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:42.286751 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5ead756b-a0ce-44c1-964a-fa25d8f2471e tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:42.288281 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5ead756b-a0ce-44c1-964a-fa25d8f2471e tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:42.290355 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5ead756b-a0ce-44c1-964a-fa25d8f2471e tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:42.324940 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-5ead756b-a0ce-44c1-964a-fa25d8f2471e tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] HTTP exception thrown: Instance 0620407a-fc63-49f9-9634-f069e37f90aa could not be found. Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5ead756b-a0ce-44c1-964a-fa25d8f2471e tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Request method failure captured: Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/0620407a-fc63-49f9-9634-f069e37f90aa HTTP/1.1 Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGrZ9c3PnToJWyr5VKAJUpo9XfzG81yUUQ7SzyBpxFXyX-d5ewq5OX5GGN7YjQwPiyiqrcgaqd0Zf25_eUQM_0xnKEMoOr6CO7Gvr91myb9BnlWZHuIgAovZUol8M5sI2Lg3KVD16QhdnuhuFbfp7HZ9pwFJIR8NaNEDdzIyPaTuRjU Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: X-Openstack-Nova-Api-Version: 2.47 Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 9ca3b319f18a41438d3a07afbb0b8c8c Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ServerShowV247Test-36219851 Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9ca3b319f18a41438d3a07afbb0b8c8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9ca3b319f18a41438d3a07afbb0b8c8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9ca3b319f18a41438d3a07afbb0b8c8c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9ca3b319f18a41438d3a07afbb0b8c8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ServerShowV247Test-36219851 Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 9ca3b319f18a41438d3a07afbb0b8c8c Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ServerShowV247Test-36219851 Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ServerShowV247Test-36219851-project Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 3792a079363f4fb18372a5d7a4a07b49 Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ServerShowV247Test-36219851-project Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 0620407a-fc63-49f9-9634-f069e37f90aa could not be found. Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '0620407a-fc63-49f9-9634-f069e37f90aa'} Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0620407a-fc63-49f9-9634-f069e37f90aa could not be found. Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0620407a-fc63-49f9-9634-f069e37f90aa could not be found. Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:42.333082 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:42.337527 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:42.337527 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:42.337527 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:42.337527 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:35:42.337527 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:35:42.337527 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0620407a-fc63-49f9-9634-f069e37f90aa could not be found. Jun 05 08:35:42.337527 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:42.339567 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5ead756b-a0ce-44c1-964a-fa25d8f2471e tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] Returning 404 to user: Instance 0620407a-fc63-49f9-9634-f069e37f90aa could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:35:42.340656 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5ead756b-a0ce-44c1-964a-fa25d8f2471e tempest-ServerShowV247Test-36219851 tempest-ServerShowV247Test-36219851-project] 10.222.0.33 "GET /compute/v2.1/servers/0620407a-fc63-49f9-9634-f069e37f90aa" status: 404 len: 111 microversion: 2.47 time: 0.090382 Jun 05 08:35:42.341578 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1406/2738] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:35:42 2022] GET /compute/v2.1/servers/0620407a-fc63-49f9-9634-f069e37f90aa => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 05 08:35:42.633390 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3a5de923-ada8-4977-9c1a-96d26fcf9da4 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1234310875", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "63a79244-520d-4bed-bad3-3aeac890921a"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:35:42.752587 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-3a5de923-ada8-4977-9c1a-96d26fcf9da4 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] validate_networks() for [('63a79244-520d-4bed-bad3-3aeac890921a', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:35:43.788740 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-3a5de923-ada8-4977-9c1a-96d26fcf9da4 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:35:43.789402 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-3a5de923-ada8-4977-9c1a-96d26fcf9da4 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:35:43.789906 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-3a5de923-ada8-4977-9c1a-96d26fcf9da4 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:35:43.790370 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-3a5de923-ada8-4977-9c1a-96d26fcf9da4 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:35:43.790793 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-3a5de923-ada8-4977-9c1a-96d26fcf9da4 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:35:43.807180 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3a5de923-ada8-4977-9c1a-96d26fcf9da4 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:43.808963 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3a5de923-ada8-4977-9c1a-96d26fcf9da4 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:43.811973 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3a5de923-ada8-4977-9c1a-96d26fcf9da4 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:43.812646 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3a5de923-ada8-4977-9c1a-96d26fcf9da4 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:43.841403 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=88,nova_api:UPDATE=3 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:35:43.850580 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-3a5de923-ada8-4977-9c1a-96d26fcf9da4 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Getting quotas for project e3e2ec4d2788496a93406c94a1d31588. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:35:43.857885 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-3a5de923-ada8-4977-9c1a-96d26fcf9da4 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Getting quotas for user 14df0bacb8bb4ef09153b482d0319be9 and project e3e2ec4d2788496a93406c94a1d31588. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:35:43.876985 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3a5de923-ada8-4977-9c1a-96d26fcf9da4 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:35:43.881085 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3a5de923-ada8-4977-9c1a-96d26fcf9da4 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] [instance: ba7ca59d-c2c1-436e-89af-88a0c61a46d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:35:43.960810 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3a5de923-ada8-4977-9c1a-96d26fcf9da4 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.561534 Jun 05 08:35:43.962475 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1333/2739] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:35:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:35:43.973206 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8ccaa237-3f49-4287-989f-38d4155871d2 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:43.976080 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8ccaa237-3f49-4287-989f-38d4155871d2 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] [instance: ba7ca59d-c2c1-436e-89af-88a0c61a46d7] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:44.187307 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8ccaa237-3f49-4287-989f-38d4155871d2 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14df0bacb8bb4ef09153b482d0319be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2ec4d2788496a93406c94a1d31588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:44.197946 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8ccaa237-3f49-4287-989f-38d4155871d2 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] 10.222.0.33 "GET /compute/v2.1/servers/ba7ca59d-c2c1-436e-89af-88a0c61a46d7" status: 200 len: 1225 microversion: 2.1 time: 0.228157 Jun 05 08:35:44.199546 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1407/2740] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:35:43 2022] GET /compute/v2.1/servers/ba7ca59d-c2c1-436e-89af-88a0c61a46d7 => generated 1225 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:35:45.218350 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-aa8d4953-2a85-4271-90eb-ef0160ab665e tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:45.219057 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-aa8d4953-2a85-4271-90eb-ef0160ab665e tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] [instance: ba7ca59d-c2c1-436e-89af-88a0c61a46d7] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:45.234529 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aa8d4953-2a85-4271-90eb-ef0160ab665e tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:45.236776 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aa8d4953-2a85-4271-90eb-ef0160ab665e tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:45.237818 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aa8d4953-2a85-4271-90eb-ef0160ab665e tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:45.239556 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aa8d4953-2a85-4271-90eb-ef0160ab665e tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:45.303987 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aa8d4953-2a85-4271-90eb-ef0160ab665e tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:45.311821 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aa8d4953-2a85-4271-90eb-ef0160ab665e tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:45.312856 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-aa8d4953-2a85-4271-90eb-ef0160ab665e tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Lazy-loading 'fault' on Instance uuid ba7ca59d-c2c1-436e-89af-88a0c61a46d7 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:35:45.411304 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-aa8d4953-2a85-4271-90eb-ef0160ab665e tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14df0bacb8bb4ef09153b482d0319be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e2ec4d2788496a93406c94a1d31588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:45.415644 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=62,nova_cell0:UPDATE=30,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=4 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:35:45.427139 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-aa8d4953-2a85-4271-90eb-ef0160ab665e tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] 10.222.0.33 "GET /compute/v2.1/servers/ba7ca59d-c2c1-436e-89af-88a0c61a46d7" status: 200 len: 1298 microversion: 2.1 time: 0.215692 Jun 05 08:35:45.428447 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1334/2741] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:35:45 2022] GET /compute/v2.1/servers/ba7ca59d-c2c1-436e-89af-88a0c61a46d7 => generated 1298 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:35:45.443575 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ee9aefa7-9393-4718-8233-00c16dcd3b91 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:45.444642 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ee9aefa7-9393-4718-8233-00c16dcd3b91 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] [instance: ba7ca59d-c2c1-436e-89af-88a0c61a46d7] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:45.459080 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ee9aefa7-9393-4718-8233-00c16dcd3b91 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:45.462690 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ee9aefa7-9393-4718-8233-00c16dcd3b91 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:45.464183 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ee9aefa7-9393-4718-8233-00c16dcd3b91 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:45.464852 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ee9aefa7-9393-4718-8233-00c16dcd3b91 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:45.518096 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:UPDATE=30,nova_cell0:SELECT=64,nova_cell0:DELETE=4,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:35:45.526132 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ee9aefa7-9393-4718-8233-00c16dcd3b91 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] [instance: ba7ca59d-c2c1-436e-89af-88a0c61a46d7] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:35:45.646843 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ee9aefa7-9393-4718-8233-00c16dcd3b91 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] [instance: ba7ca59d-c2c1-436e-89af-88a0c61a46d7] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:35:45.651535 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ee9aefa7-9393-4718-8233-00c16dcd3b91 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:45.655108 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ee9aefa7-9393-4718-8233-00c16dcd3b91 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:45.657725 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-ee9aefa7-9393-4718-8233-00c16dcd3b91 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] [instance: ba7ca59d-c2c1-436e-89af-88a0c61a46d7] instance's host None is down, deleting from database Jun 05 08:35:45.662611 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-ee9aefa7-9393-4718-8233-00c16dcd3b91 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] [instance: ba7ca59d-c2c1-436e-89af-88a0c61a46d7] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:35:45.827315 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-ee9aefa7-9393-4718-8233-00c16dcd3b91 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] [instance: ba7ca59d-c2c1-436e-89af-88a0c61a46d7] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:35:45.834600 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-ee9aefa7-9393-4718-8233-00c16dcd3b91 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] [instance: ba7ca59d-c2c1-436e-89af-88a0c61a46d7] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:35:46.304450 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ee9aefa7-9393-4718-8233-00c16dcd3b91 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ba7ca59d-c2c1-436e-89af-88a0c61a46d7" status: 204 len: 0 microversion: 2.1 time: 0.862925 Jun 05 08:35:46.305782 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1408/2742] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:35:45 2022] DELETE /compute/v2.1/servers/ba7ca59d-c2c1-436e-89af-88a0c61a46d7 => generated 0 bytes in 867 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:35:46.314172 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5666d707-8a1f-4fe5-a97c-62f81f0fd384 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:46.314650 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5666d707-8a1f-4fe5-a97c-62f81f0fd384 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] [instance: ba7ca59d-c2c1-436e-89af-88a0c61a46d7] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:46.360709 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5666d707-8a1f-4fe5-a97c-62f81f0fd384 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:46.361177 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5666d707-8a1f-4fe5-a97c-62f81f0fd384 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:46.362106 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5666d707-8a1f-4fe5-a97c-62f81f0fd384 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:46.362402 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5666d707-8a1f-4fe5-a97c-62f81f0fd384 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:46.410495 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-5666d707-8a1f-4fe5-a97c-62f81f0fd384 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] HTTP exception thrown: Instance ba7ca59d-c2c1-436e-89af-88a0c61a46d7 could not be found. Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5666d707-8a1f-4fe5-a97c-62f81f0fd384 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Request method failure captured: Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/ba7ca59d-c2c1-436e-89af-88a0c61a46d7 HTTP/1.1 Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGreF0hIGVDqebPSvGOtHv06HSW1ej1oHjPeZfrLgC_BOCiGnQrtJ6QXzrSc1kFTnjAo9bn3ZpOW3iGQmF9M21uacHyY9DaDeB3EnuAa2zVi9OccF4lvnIi6mZMfkH-BOdS8BBJgjhi0DTeny4at20pNba-Xgd8qvRF6F7f-nnvxBUg Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: e3e2ec4d2788496a93406c94a1d31588 Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1858465351 Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e3e2ec4d2788496a93406c94a1d31588"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3e2ec4d2788496a93406c94a1d31588"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e3e2ec4d2788496a93406c94a1d31588", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3e2ec4d2788496a93406c94a1d31588"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1858465351 Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: e3e2ec4d2788496a93406c94a1d31588 Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1858465351 Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ServerAddressesNegativeTestJSON-1858465351-project Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 14df0bacb8bb4ef09153b482d0319be9 Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1858465351-project Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance ba7ca59d-c2c1-436e-89af-88a0c61a46d7 could not be found. Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'ba7ca59d-c2c1-436e-89af-88a0c61a46d7'} Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba7ca59d-c2c1-436e-89af-88a0c61a46d7 could not be found. Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba7ca59d-c2c1-436e-89af-88a0c61a46d7 could not be found. Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:35:46.427135 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:46.431807 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:35:46.431807 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:46.431807 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:46.431807 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:46.431807 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:35:46.431807 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:35:46.431807 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba7ca59d-c2c1-436e-89af-88a0c61a46d7 could not be found. Jun 05 08:35:46.431807 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:35:46.431807 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5666d707-8a1f-4fe5-a97c-62f81f0fd384 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] Returning 404 to user: Instance ba7ca59d-c2c1-436e-89af-88a0c61a46d7 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:35:46.431807 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5666d707-8a1f-4fe5-a97c-62f81f0fd384 tempest-ServerAddressesNegativeTestJSON-1858465351 tempest-ServerAddressesNegativeTestJSON-1858465351-project] 10.222.0.33 "GET /compute/v2.1/servers/ba7ca59d-c2c1-436e-89af-88a0c61a46d7" status: 404 len: 111 microversion: 2.1 time: 0.119329 Jun 05 08:35:46.431807 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1335/2743] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:35:46 2022] GET /compute/v2.1/servers/ba7ca59d-c2c1-436e-89af-88a0c61a46d7 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:35:50.256860 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=54 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:35:50.264008 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-200bae9a-f1d9-490b-961c-f1f36f911267 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:50.264673 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-200bae9a-f1d9-490b-961c-f1f36f911267 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:50.295397 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-200bae9a-f1d9-490b-961c-f1f36f911267 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:50.298293 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-200bae9a-f1d9-490b-961c-f1f36f911267 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:50.304798 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-200bae9a-f1d9-490b-961c-f1f36f911267 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:50.312004 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-200bae9a-f1d9-490b-961c-f1f36f911267 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:50.380059 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-200bae9a-f1d9-490b-961c-f1f36f911267 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:35:50.611169 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-200bae9a-f1d9-490b-961c-f1f36f911267 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 204 len: 0 microversion: 2.20 time: 0.356050 Jun 05 08:35:50.612692 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1409/2744] 10.222.0.33 () {60 vars in 1279 bytes} [Sun Jun 5 08:35:50 2022] DELETE /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:35:50.620700 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3ce7dfc6-7c30-4532-8fda-aa86d1f427a8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:50.621444 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3ce7dfc6-7c30-4532-8fda-aa86d1f427a8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:50.635855 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3ce7dfc6-7c30-4532-8fda-aa86d1f427a8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:50.648816 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3ce7dfc6-7c30-4532-8fda-aa86d1f427a8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:50.649801 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3ce7dfc6-7c30-4532-8fda-aa86d1f427a8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:50.651989 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3ce7dfc6-7c30-4532-8fda-aa86d1f427a8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:50.768626 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3ce7dfc6-7c30-4532-8fda-aa86d1f427a8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:50.769413 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3ce7dfc6-7c30-4532-8fda-aa86d1f427a8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:50.770059 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-3ce7dfc6-7c30-4532-8fda-aa86d1f427a8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lazy-loading 'fault' on Instance uuid b271002d-4613-405c-aeed-7c06b205a045 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:35:51.150965 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3ce7dfc6-7c30-4532-8fda-aa86d1f427a8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:51.159595 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3ce7dfc6-7c30-4532-8fda-aa86d1f427a8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:51.161166 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3ce7dfc6-7c30-4532-8fda-aa86d1f427a8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:51.162326 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3ce7dfc6-7c30-4532-8fda-aa86d1f427a8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1432 microversion: 2.20 time: 0.545782 Jun 05 08:35:51.162894 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1336/2745] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:35:50 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1432 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:35:52.184824 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9f38464d-5ec6-43cf-896a-bdfce57b37c8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:52.186063 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9f38464d-5ec6-43cf-896a-bdfce57b37c8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] [instance: b271002d-4613-405c-aeed-7c06b205a045] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:52.205850 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9f38464d-5ec6-43cf-896a-bdfce57b37c8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:52.210134 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9f38464d-5ec6-43cf-896a-bdfce57b37c8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:52.211852 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9f38464d-5ec6-43cf-896a-bdfce57b37c8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:52.212486 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9f38464d-5ec6-43cf-896a-bdfce57b37c8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:52.331850 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9f38464d-5ec6-43cf-896a-bdfce57b37c8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:52.332796 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9f38464d-5ec6-43cf-896a-bdfce57b37c8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:52.334412 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-9f38464d-5ec6-43cf-896a-bdfce57b37c8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Lazy-loading 'fault' on Instance uuid b271002d-4613-405c-aeed-7c06b205a045 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:35:52.496498 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-9f38464d-5ec6-43cf-896a-bdfce57b37c8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:52.523126 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-9f38464d-5ec6-43cf-896a-bdfce57b37c8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:52.529110 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-9f38464d-5ec6-43cf-896a-bdfce57b37c8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ffd5630f41a48a694fc306c78712796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0e53a23984cea813890af8c283d0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:52.534454 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9f38464d-5ec6-43cf-896a-bdfce57b37c8 tempest-AttachVolumeShelveTestJSON-843962081 tempest-AttachVolumeShelveTestJSON-843962081-project] 10.222.0.33 "GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045" status: 200 len: 1426 microversion: 2.20 time: 0.355634 Jun 05 08:35:52.547067 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1410/2746] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:35:52 2022] GET /compute/v2.1/servers/b271002d-4613-405c-aeed-7c06b205a045 => generated 1426 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:35:53.177161 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ae86c635-cf4a-4e4b-9bfb-fc26cb8f0a86 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1934509290", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "e1c3bd17-52ca-4b91-aa27-3803f9092ec2"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:35:53.286269 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-ae86c635-cf4a-4e4b-9bfb-fc26cb8f0a86 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] validate_networks() for [('e1c3bd17-52ca-4b91-aa27-3803f9092ec2', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:35:53.867114 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=44 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:35:56.159251 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-ae86c635-cf4a-4e4b-9bfb-fc26cb8f0a86 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:35:56.161573 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-ae86c635-cf4a-4e4b-9bfb-fc26cb8f0a86 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:35:56.162211 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-ae86c635-cf4a-4e4b-9bfb-fc26cb8f0a86 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:35:56.163200 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-ae86c635-cf4a-4e4b-9bfb-fc26cb8f0a86 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:35:56.163888 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-ae86c635-cf4a-4e4b-9bfb-fc26cb8f0a86 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:35:56.194402 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ae86c635-cf4a-4e4b-9bfb-fc26cb8f0a86 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:56.197281 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ae86c635-cf4a-4e4b-9bfb-fc26cb8f0a86 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:56.201624 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ae86c635-cf4a-4e4b-9bfb-fc26cb8f0a86 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:56.203645 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ae86c635-cf4a-4e4b-9bfb-fc26cb8f0a86 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:56.233993 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:35:56.277968 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-ae86c635-cf4a-4e4b-9bfb-fc26cb8f0a86 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Getting quotas for project 97814fe8fd924ff1b4d4561240997b1a. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:35:56.293205 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-ae86c635-cf4a-4e4b-9bfb-fc26cb8f0a86 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Getting quotas for user b25868cbfee945fb8c0fdb2e75217ca1 and project 97814fe8fd924ff1b4d4561240997b1a. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:35:56.317942 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ae86c635-cf4a-4e4b-9bfb-fc26cb8f0a86 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:35:56.320409 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ae86c635-cf4a-4e4b-9bfb-fc26cb8f0a86 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] [instance: 9fd944e8-20d7-4f6c-a00b-d85d144894db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:35:56.482280 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ae86c635-cf4a-4e4b-9bfb-fc26cb8f0a86 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.597281 Jun 05 08:35:56.487920 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1337/2747] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:35:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 3604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:35:56.493344 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a410f0f3-40c2-4424-b9c4-1ce74f710120 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:56.494641 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a410f0f3-40c2-4424-b9c4-1ce74f710120 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] [instance: 9fd944e8-20d7-4f6c-a00b-d85d144894db] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:56.499162 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=22 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:35:56.502251 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=23,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:35:56.887392 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a410f0f3-40c2-4424-b9c4-1ce74f710120 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25868cbfee945fb8c0fdb2e75217ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97814fe8fd924ff1b4d4561240997b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:56.898977 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a410f0f3-40c2-4424-b9c4-1ce74f710120 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] 10.222.0.33 "GET /compute/v2.1/servers/9fd944e8-20d7-4f6c-a00b-d85d144894db" status: 200 len: 1217 microversion: 2.1 time: 0.408310 Jun 05 08:35:56.901366 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1411/2748] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:35:56 2022] GET /compute/v2.1/servers/9fd944e8-20d7-4f6c-a00b-d85d144894db => generated 1217 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:35:57.916802 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c4262641-7fbd-432e-b26b-4821f1cb3ac8 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:57.917440 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c4262641-7fbd-432e-b26b-4821f1cb3ac8 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] [instance: 9fd944e8-20d7-4f6c-a00b-d85d144894db] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:57.940882 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c4262641-7fbd-432e-b26b-4821f1cb3ac8 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:57.941466 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c4262641-7fbd-432e-b26b-4821f1cb3ac8 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:57.942311 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c4262641-7fbd-432e-b26b-4821f1cb3ac8 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:57.942760 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c4262641-7fbd-432e-b26b-4821f1cb3ac8 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:57.962209 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-28175bd9-5130-426d-aa89-23b1aefc262d tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Action: 'create', calling method: .version_select at 0x7f24331a3d30>, body: {"keypair": {"name": "tempest-keypair-140821630", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOmbJhw4hjQGa9btKa0EuckZA/3/Q0DTi24vtTE3oMo1zm+JkG+puuObrOJMCvWIhrN2VEth3b/BQy5gAjQE5ihACynZ/Bugz4BNmKXCjYjaTZqxW0jaaB8ZhqiI1k+YQ=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:35:58.027454 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-28175bd9-5130-426d-aa89-23b1aefc262d tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Getting quotas for project 2b07736bf07942bd9112facfe9f8a443. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:35:58.054612 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-28175bd9-5130-426d-aa89-23b1aefc262d tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Getting quotas for user e912f65494904c6da4955d4a941c537f and project 2b07736bf07942bd9112facfe9f8a443. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:35:58.069411 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:35:58.077101 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c4262641-7fbd-432e-b26b-4821f1cb3ac8 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:58.084899 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c4262641-7fbd-432e-b26b-4821f1cb3ac8 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:58.085713 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-c4262641-7fbd-432e-b26b-4821f1cb3ac8 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Lazy-loading 'fault' on Instance uuid 9fd944e8-20d7-4f6c-a00b-d85d144894db {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:35:58.118874 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-28175bd9-5130-426d-aa89-23b1aefc262d tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.275967 Jun 05 08:35:58.125288 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1338/2749] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:35:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:35:58.430286 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c4262641-7fbd-432e-b26b-4821f1cb3ac8 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b25868cbfee945fb8c0fdb2e75217ca1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97814fe8fd924ff1b4d4561240997b1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:35:58.438803 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c4262641-7fbd-432e-b26b-4821f1cb3ac8 tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] 10.222.0.33 "GET /compute/v2.1/servers/9fd944e8-20d7-4f6c-a00b-d85d144894db" status: 200 len: 1290 microversion: 2.1 time: 0.525856 Jun 05 08:35:58.439407 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1412/2750] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:35:57 2022] GET /compute/v2.1/servers/9fd944e8-20d7-4f6c-a00b-d85d144894db => generated 1290 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:35:58.459622 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-66ad1bf6-0e06-4b2a-a3a1-94380b99f5ca tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:58.460234 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-66ad1bf6-0e06-4b2a-a3a1-94380b99f5ca tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] [instance: 9fd944e8-20d7-4f6c-a00b-d85d144894db] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:58.472284 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-66ad1bf6-0e06-4b2a-a3a1-94380b99f5ca tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:58.476510 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-66ad1bf6-0e06-4b2a-a3a1-94380b99f5ca tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:58.477859 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-66ad1bf6-0e06-4b2a-a3a1-94380b99f5ca tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:58.478571 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-66ad1bf6-0e06-4b2a-a3a1-94380b99f5ca tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:58.540336 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-66ad1bf6-0e06-4b2a-a3a1-94380b99f5ca tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] [instance: 9fd944e8-20d7-4f6c-a00b-d85d144894db] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:35:58.662953 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-66ad1bf6-0e06-4b2a-a3a1-94380b99f5ca tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] [instance: 9fd944e8-20d7-4f6c-a00b-d85d144894db] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:35:58.663796 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-66ad1bf6-0e06-4b2a-a3a1-94380b99f5ca tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:58.664282 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-66ad1bf6-0e06-4b2a-a3a1-94380b99f5ca tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:58.664729 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-66ad1bf6-0e06-4b2a-a3a1-94380b99f5ca tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] [instance: 9fd944e8-20d7-4f6c-a00b-d85d144894db] instance's host None is down, deleting from database Jun 05 08:35:58.680568 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-66ad1bf6-0e06-4b2a-a3a1-94380b99f5ca tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] [instance: 9fd944e8-20d7-4f6c-a00b-d85d144894db] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:35:58.784743 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-66ad1bf6-0e06-4b2a-a3a1-94380b99f5ca tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] [instance: 9fd944e8-20d7-4f6c-a00b-d85d144894db] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:35:58.798083 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-66ad1bf6-0e06-4b2a-a3a1-94380b99f5ca tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] [instance: 9fd944e8-20d7-4f6c-a00b-d85d144894db] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:35:59.059941 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-66ad1bf6-0e06-4b2a-a3a1-94380b99f5ca tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9fd944e8-20d7-4f6c-a00b-d85d144894db" status: 204 len: 0 microversion: 2.1 time: 0.608335 Jun 05 08:35:59.060914 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1339/2751] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:35:58 2022] DELETE /compute/v2.1/servers/9fd944e8-20d7-4f6c-a00b-d85d144894db => generated 0 bytes in 611 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:35:59.069404 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-46b592a8-7693-4b3a-b7b4-095e3597710f tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:35:59.070032 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-46b592a8-7693-4b3a-b7b4-095e3597710f tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] [instance: 9fd944e8-20d7-4f6c-a00b-d85d144894db] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:35:59.084930 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-46b592a8-7693-4b3a-b7b4-095e3597710f tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:59.085390 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-46b592a8-7693-4b3a-b7b4-095e3597710f tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:59.086193 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-46b592a8-7693-4b3a-b7b4-095e3597710f tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:35:59.087250 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-46b592a8-7693-4b3a-b7b4-095e3597710f tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:35:59.113688 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-46b592a8-7693-4b3a-b7b4-095e3597710f tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] HTTP exception thrown: Instance 9fd944e8-20d7-4f6c-a00b-d85d144894db could not be found. Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-46b592a8-7693-4b3a-b7b4-095e3597710f tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Request method failure captured: Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/9fd944e8-20d7-4f6c-a00b-d85d144894db HTTP/1.1 Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGroEhEXrqEg9jciT1po6kgb7Lzg2AdxR6QuKV0hDosnKXry-6XtGC-P6WLDnMPHAWAJDeX9jNgoMK-fbWvBO5-n7Vrzy3rUbXvaLEuWcpAvs--jZX08FkDRfqBBqh45gyLxLS8F6p2fT9gH1kq4WhTM9DNMW11VEfIFCPaELlLwPz0 Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 97814fe8fd924ff1b4d4561240997b1a Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ServersNegativeTestJSON-462395218 Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/97814fe8fd924ff1b4d4561240997b1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/97814fe8fd924ff1b4d4561240997b1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_97814fe8fd924ff1b4d4561240997b1a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/97814fe8fd924ff1b4d4561240997b1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ServersNegativeTestJSON-462395218 Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 97814fe8fd924ff1b4d4561240997b1a Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ServersNegativeTestJSON-462395218 Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ServersNegativeTestJSON-462395218-project Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: b25868cbfee945fb8c0fdb2e75217ca1 Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ServersNegativeTestJSON-462395218-project Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 9fd944e8-20d7-4f6c-a00b-d85d144894db could not be found. Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '9fd944e8-20d7-4f6c-a00b-d85d144894db'} Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fd944e8-20d7-4f6c-a00b-d85d144894db could not be found. Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fd944e8-20d7-4f6c-a00b-d85d144894db could not be found. Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:35:59.121740 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:59.126621 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:35:59.126621 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:35:59.126621 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:35:59.126621 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:35:59.126621 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:35:59.126621 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fd944e8-20d7-4f6c-a00b-d85d144894db could not be found. Jun 05 08:35:59.126621 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:35:59.132197 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-46b592a8-7693-4b3a-b7b4-095e3597710f tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Returning 404 to user: Instance 9fd944e8-20d7-4f6c-a00b-d85d144894db could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:35:59.136874 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-46b592a8-7693-4b3a-b7b4-095e3597710f tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] 10.222.0.33 "GET /compute/v2.1/servers/9fd944e8-20d7-4f6c-a00b-d85d144894db" status: 404 len: 111 microversion: 2.1 time: 0.071191 Jun 05 08:35:59.138901 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1413/2752] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:35:59 2022] GET /compute/v2.1/servers/9fd944e8-20d7-4f6c-a00b-d85d144894db => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:36:04.923317 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-09a41d89-e7bd-4e89-a809-bc64630a0e7a tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1935794537", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d072ec6-3b3d-4314-b8e5-465bd1293bbe"}], "security_groups": [{"name": "tempest-securitygroup--66194286"}], "key_name": "tempest-keypair-140821630", "user_data": "}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:36:05.419597 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-09a41d89-e7bd-4e89-a809-bc64630a0e7a tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] validate_networks() for [('8d072ec6-3b3d-4314-b8e5-465bd1293bbe', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:36:06.283138 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:36:06.486093 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-46b592a8-7693-4b3a-b7b4-095e3597710f tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:06.487718 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-46b592a8-7693-4b3a-b7b4-095e3597710f tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001983 Jun 05 08:36:06.488321 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1414/2753] 10.222.0.33 () {56 vars in 885 bytes} [Sun Jun 5 08:36:06 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Jun 05 08:36:06.495107 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-46b592a8-7693-4b3a-b7b4-095e3597710f tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:06.496553 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-46b592a8-7693-4b3a-b7b4-095e3597710f tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] 10.222.0.33 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001882 Jun 05 08:36:06.497034 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1415/2754] 10.222.0.33 () {54 vars in 1034 bytes} [Sun Jun 5 08:36:06 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Jun 05 08:36:06.502715 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-46b592a8-7693-4b3a-b7b4-095e3597710f tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:06.505424 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-46b592a8-7693-4b3a-b7b4-095e3597710f tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002426 Jun 05 08:36:06.506621 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1416/2755] 10.222.0.33 () {54 vars in 1040 bytes} [Sun Jun 5 08:36:06 2022] GET /compute/v2.1/ => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:36:06.514159 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-46b592a8-7693-4b3a-b7b4-095e3597710f tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:06.516234 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-46b592a8-7693-4b3a-b7b4-095e3597710f tempest-ServersNegativeTestJSON-462395218 tempest-ServersNegativeTestJSON-462395218-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002504 Jun 05 08:36:06.517121 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1417/2756] 10.222.0.33 () {56 vars in 885 bytes} [Sun Jun 5 08:36:06 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 05 08:36:07.036971 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-09a41d89-e7bd-4e89-a809-bc64630a0e7a tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:36:07.037408 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-09a41d89-e7bd-4e89-a809-bc64630a0e7a tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:36:07.039912 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-09a41d89-e7bd-4e89-a809-bc64630a0e7a tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:36:07.040377 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-09a41d89-e7bd-4e89-a809-bc64630a0e7a tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:36:07.040807 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-09a41d89-e7bd-4e89-a809-bc64630a0e7a tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:36:07.069162 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-09a41d89-e7bd-4e89-a809-bc64630a0e7a tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:07.069644 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-09a41d89-e7bd-4e89-a809-bc64630a0e7a tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:07.070477 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-09a41d89-e7bd-4e89-a809-bc64630a0e7a tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:07.070925 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-09a41d89-e7bd-4e89-a809-bc64630a0e7a tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:07.117840 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-09a41d89-e7bd-4e89-a809-bc64630a0e7a tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Getting quotas for project 2b07736bf07942bd9112facfe9f8a443. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:36:07.131346 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-09a41d89-e7bd-4e89-a809-bc64630a0e7a tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Getting quotas for user e912f65494904c6da4955d4a941c537f and project 2b07736bf07942bd9112facfe9f8a443. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:36:07.159565 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-09a41d89-e7bd-4e89-a809-bc64630a0e7a tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:36:07.168280 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-09a41d89-e7bd-4e89-a809-bc64630a0e7a tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] [instance: abe558b0-6a80-4971-9237-f2e91dfaf4df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:36:07.298993 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-09a41d89-e7bd-4e89-a809-bc64630a0e7a tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.381094 Jun 05 08:36:07.311075 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1340/2757] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:36:04 2022] POST /compute/v2.1/servers => generated 407 bytes in 2394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:36:07.316232 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-99c17e7a-3eb4-4874-a96c-8279247a8389 tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:07.316854 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-99c17e7a-3eb4-4874-a96c-8279247a8389 tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] [instance: abe558b0-6a80-4971-9237-f2e91dfaf4df] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:07.327763 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:36:07.331800 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:36:07.618551 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-99c17e7a-3eb4-4874-a96c-8279247a8389 tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e912f65494904c6da4955d4a941c537f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b07736bf07942bd9112facfe9f8a443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:07.636840 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-99c17e7a-3eb4-4874-a96c-8279247a8389 tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] 10.222.0.33 "GET /compute/v2.1/servers/abe558b0-6a80-4971-9237-f2e91dfaf4df" status: 200 len: 1238 microversion: 2.1 time: 0.322393 Jun 05 08:36:07.639107 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1418/2758] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:36:07 2022] GET /compute/v2.1/servers/abe558b0-6a80-4971-9237-f2e91dfaf4df => generated 1238 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:36:08.655983 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e5efc78b-b07c-4aea-85d8-f75e10eff2ab tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:08.657676 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e5efc78b-b07c-4aea-85d8-f75e10eff2ab tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] [instance: abe558b0-6a80-4971-9237-f2e91dfaf4df] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:08.673460 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e5efc78b-b07c-4aea-85d8-f75e10eff2ab tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:08.679112 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e5efc78b-b07c-4aea-85d8-f75e10eff2ab tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:08.680863 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e5efc78b-b07c-4aea-85d8-f75e10eff2ab tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:08.696814 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e5efc78b-b07c-4aea-85d8-f75e10eff2ab tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:08.805091 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e5efc78b-b07c-4aea-85d8-f75e10eff2ab tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:08.805513 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e5efc78b-b07c-4aea-85d8-f75e10eff2ab tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:08.806060 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-e5efc78b-b07c-4aea-85d8-f75e10eff2ab tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Lazy-loading 'fault' on Instance uuid abe558b0-6a80-4971-9237-f2e91dfaf4df {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:36:09.401416 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e5efc78b-b07c-4aea-85d8-f75e10eff2ab tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e912f65494904c6da4955d4a941c537f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b07736bf07942bd9112facfe9f8a443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:09.409803 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e5efc78b-b07c-4aea-85d8-f75e10eff2ab tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] 10.222.0.33 "GET /compute/v2.1/servers/abe558b0-6a80-4971-9237-f2e91dfaf4df" status: 200 len: 1311 microversion: 2.1 time: 0.758854 Jun 05 08:36:09.415026 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1341/2759] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:36:08 2022] GET /compute/v2.1/servers/abe558b0-6a80-4971-9237-f2e91dfaf4df => generated 1311 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:36:09.427472 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e4f07910-4e64-46e7-a9af-4034991417fb tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:09.428816 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e4f07910-4e64-46e7-a9af-4034991417fb tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] [instance: abe558b0-6a80-4971-9237-f2e91dfaf4df] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:09.460011 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=10 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:36:09.469635 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e4f07910-4e64-46e7-a9af-4034991417fb tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:09.470915 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e4f07910-4e64-46e7-a9af-4034991417fb tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:09.473791 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e4f07910-4e64-46e7-a9af-4034991417fb tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:09.474400 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e4f07910-4e64-46e7-a9af-4034991417fb tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:09.554981 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e4f07910-4e64-46e7-a9af-4034991417fb tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] [instance: abe558b0-6a80-4971-9237-f2e91dfaf4df] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:36:09.686831 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e4f07910-4e64-46e7-a9af-4034991417fb tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] [instance: abe558b0-6a80-4971-9237-f2e91dfaf4df] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:36:09.690470 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e4f07910-4e64-46e7-a9af-4034991417fb tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:09.692850 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e4f07910-4e64-46e7-a9af-4034991417fb tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:09.694189 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-e4f07910-4e64-46e7-a9af-4034991417fb tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] [instance: abe558b0-6a80-4971-9237-f2e91dfaf4df] instance's host None is down, deleting from database Jun 05 08:36:09.714851 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-e4f07910-4e64-46e7-a9af-4034991417fb tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] [instance: abe558b0-6a80-4971-9237-f2e91dfaf4df] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:36:09.836911 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-e4f07910-4e64-46e7-a9af-4034991417fb tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] [instance: abe558b0-6a80-4971-9237-f2e91dfaf4df] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:36:09.844739 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-e4f07910-4e64-46e7-a9af-4034991417fb tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] [instance: abe558b0-6a80-4971-9237-f2e91dfaf4df] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:36:10.335034 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e4f07910-4e64-46e7-a9af-4034991417fb tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] 10.222.0.33 "DELETE /compute/v2.1/servers/abe558b0-6a80-4971-9237-f2e91dfaf4df" status: 204 len: 0 microversion: 2.1 time: 0.911506 Jun 05 08:36:10.338867 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1419/2760] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:36:09 2022] DELETE /compute/v2.1/servers/abe558b0-6a80-4971-9237-f2e91dfaf4df => generated 0 bytes in 913 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:36:10.345073 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-21738000-9362-4f81-923e-789b7f80278b tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:10.345749 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-21738000-9362-4f81-923e-789b7f80278b tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] [instance: abe558b0-6a80-4971-9237-f2e91dfaf4df] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:10.379547 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-21738000-9362-4f81-923e-789b7f80278b tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:10.380671 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-21738000-9362-4f81-923e-789b7f80278b tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:10.381508 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-21738000-9362-4f81-923e-789b7f80278b tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:10.381958 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-21738000-9362-4f81-923e-789b7f80278b tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:10.424640 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-21738000-9362-4f81-923e-789b7f80278b tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] HTTP exception thrown: Instance abe558b0-6a80-4971-9237-f2e91dfaf4df could not be found. Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-21738000-9362-4f81-923e-789b7f80278b tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Request method failure captured: Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/abe558b0-6a80-4971-9237-f2e91dfaf4df HTTP/1.1 Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGrtdW9tan6U77la4J8ZFr8BSxse3RE3YEuHLJGxU734gIRj973AQYeQqZ1mCIQWNbK8Z1yEpmqFLeghK82sMDfQyugtk7lJ90J145zyzCJFM_l_a35As2Lj-vcKZjKadX8agPKUZjoO0lJW3ZX8ujsKpayEXxk3yVtPTJWdJ59maHc Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 2b07736bf07942bd9112facfe9f8a443 Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ServerActionsTestJSON-1302282979 Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2b07736bf07942bd9112facfe9f8a443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2b07736bf07942bd9112facfe9f8a443"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2b07736bf07942bd9112facfe9f8a443", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2b07736bf07942bd9112facfe9f8a443"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ServerActionsTestJSON-1302282979 Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 2b07736bf07942bd9112facfe9f8a443 Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ServerActionsTestJSON-1302282979 Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ServerActionsTestJSON-1302282979-project Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: e912f65494904c6da4955d4a941c537f Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ServerActionsTestJSON-1302282979-project Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance abe558b0-6a80-4971-9237-f2e91dfaf4df could not be found. Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'abe558b0-6a80-4971-9237-f2e91dfaf4df'} Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abe558b0-6a80-4971-9237-f2e91dfaf4df could not be found. Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abe558b0-6a80-4971-9237-f2e91dfaf4df could not be found. Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:36:10.426139 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:36:10.431078 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:36:10.431078 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:36:10.431078 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:36:10.431078 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:36:10.431078 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:36:10.431078 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abe558b0-6a80-4971-9237-f2e91dfaf4df could not be found. Jun 05 08:36:10.431078 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:36:10.452832 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-21738000-9362-4f81-923e-789b7f80278b tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Returning 404 to user: Instance abe558b0-6a80-4971-9237-f2e91dfaf4df could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:36:10.453899 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-21738000-9362-4f81-923e-789b7f80278b tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] 10.222.0.33 "GET /compute/v2.1/servers/abe558b0-6a80-4971-9237-f2e91dfaf4df" status: 404 len: 111 microversion: 2.1 time: 0.113829 Jun 05 08:36:10.458605 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1342/2761] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:36:10 2022] GET /compute/v2.1/servers/abe558b0-6a80-4971-9237-f2e91dfaf4df => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:36:10.470706 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ce70d714-0e40-4aee-9f29-64907818035c tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] Calling method '.version_select at 0x7f2432d81820>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:10.537295 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ce70d714-0e40-4aee-9f29-64907818035c tempest-ServerActionsTestJSON-1302282979 tempest-ServerActionsTestJSON-1302282979-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-140821630" status: 202 len: 0 microversion: 2.1 time: 0.073516 Jun 05 08:36:10.537903 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1420/2762] 10.222.0.33 () {58 vars in 1217 bytes} [Sun Jun 5 08:36:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-140821630 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:36:11.000835 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0c088e34-82ca-4709-a14d-4cc0991d655c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:11.001631 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0c088e34-82ca-4709-a14d-4cc0991d655c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:11.009145 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0c088e34-82ca-4709-a14d-4cc0991d655c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:11.015490 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0c088e34-82ca-4709-a14d-4cc0991d655c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:11.033619 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0c088e34-82ca-4709-a14d-4cc0991d655c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:11.035802 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0c088e34-82ca-4709-a14d-4cc0991d655c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:11.164075 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0c088e34-82ca-4709-a14d-4cc0991d655c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:36:11.453962 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0c088e34-82ca-4709-a14d-4cc0991d655c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "DELETE /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 204 len: 0 microversion: 2.42 time: 0.457057 Jun 05 08:36:11.456347 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1343/2763] 10.222.0.33 () {60 vars in 1279 bytes} [Sun Jun 5 08:36:10 2022] DELETE /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:36:11.464680 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-06445ad9-866a-4a37-92b3-b379edbbf3ee tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:11.465652 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-06445ad9-866a-4a37-92b3-b379edbbf3ee tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:11.477932 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-06445ad9-866a-4a37-92b3-b379edbbf3ee tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:11.478561 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-06445ad9-866a-4a37-92b3-b379edbbf3ee tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:11.479245 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-06445ad9-866a-4a37-92b3-b379edbbf3ee tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:11.481143 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-06445ad9-866a-4a37-92b3-b379edbbf3ee tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:12.464633 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-06445ad9-866a-4a37-92b3-b379edbbf3ee tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:12.483235 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-06445ad9-866a-4a37-92b3-b379edbbf3ee tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:12.489644 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-06445ad9-866a-4a37-92b3-b379edbbf3ee tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:12.491179 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-06445ad9-866a-4a37-92b3-b379edbbf3ee tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 2954 microversion: 2.42 time: 1.030599 Jun 05 08:36:12.491746 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1421/2764] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:11 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 2954 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:36:13.515831 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e1efb6c9-4652-4df6-a8e2-64e5596deab8 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:13.517777 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e1efb6c9-4652-4df6-a8e2-64e5596deab8 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:13.545371 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e1efb6c9-4652-4df6-a8e2-64e5596deab8 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:13.548557 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e1efb6c9-4652-4df6-a8e2-64e5596deab8 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:13.550833 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e1efb6c9-4652-4df6-a8e2-64e5596deab8 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:13.561096 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e1efb6c9-4652-4df6-a8e2-64e5596deab8 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:14.608522 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e1efb6c9-4652-4df6-a8e2-64e5596deab8 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:14.617818 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e1efb6c9-4652-4df6-a8e2-64e5596deab8 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:14.625228 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e1efb6c9-4652-4df6-a8e2-64e5596deab8 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:14.626855 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e1efb6c9-4652-4df6-a8e2-64e5596deab8 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 2954 microversion: 2.42 time: 1.119394 Jun 05 08:36:14.631258 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1344/2765] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:13 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 2954 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:36:15.651859 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e87c7ce3-a9af-43f8-87d5-15c3c0379974 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:15.653948 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e87c7ce3-a9af-43f8-87d5-15c3c0379974 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:15.665603 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e87c7ce3-a9af-43f8-87d5-15c3c0379974 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:15.667437 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e87c7ce3-a9af-43f8-87d5-15c3c0379974 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:15.672678 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e87c7ce3-a9af-43f8-87d5-15c3c0379974 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:15.673236 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e87c7ce3-a9af-43f8-87d5-15c3c0379974 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:16.276032 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-124418cf-7f46-444d-9e6b-7c60dc3e9834 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1310143374", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:36:16.302565 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=10,nova_api:UPDATE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:36:16.368353 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-124418cf-7f46-444d-9e6b-7c60dc3e9834 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] validate_networks() for [('0781d4dd-95f5-4bb8-a9fc-6874cd92796d', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:36:16.383780 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e87c7ce3-a9af-43f8-87d5-15c3c0379974 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:16.398371 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e87c7ce3-a9af-43f8-87d5-15c3c0379974 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:16.400522 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e87c7ce3-a9af-43f8-87d5-15c3c0379974 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:16.402392 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e87c7ce3-a9af-43f8-87d5-15c3c0379974 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 2954 microversion: 2.42 time: 0.755064 Jun 05 08:36:16.404299 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1422/2766] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:15 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 2954 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:36:17.152253 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=16 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:36:17.254852 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-19a0c260-fb61-4fb0-8561-368c8c39b4a5 tempest-VolumesTestJSON-1321181993 tempest-VolumesTestJSON-1321181993-project] Calling method '.version_select at 0x7f2432dc5ee0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:17.339178 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-19a0c260-fb61-4fb0-8561-368c8c39b4a5 tempest-VolumesTestJSON-1321181993 tempest-VolumesTestJSON-1321181993-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/4766099f-8c48-4ac8-97d0-0e2c5505ba79" status: 200 len: 350 microversion: 2.1 time: 0.088407 Jun 05 08:36:17.340789 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1423/2767] 10.222.0.33 () {58 vars in 1244 bytes} [Sun Jun 5 08:36:17 2022] GET /compute/v2.1/os-volumes/4766099f-8c48-4ac8-97d0-0e2c5505ba79 => generated 350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:36:17.429848 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6443212a-e85a-4146-af45-ed7cf1d917c2 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:17.430495 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6443212a-e85a-4146-af45-ed7cf1d917c2 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:17.441792 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6443212a-e85a-4146-af45-ed7cf1d917c2 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:17.442401 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6443212a-e85a-4146-af45-ed7cf1d917c2 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:17.446135 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6443212a-e85a-4146-af45-ed7cf1d917c2 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:17.446746 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6443212a-e85a-4146-af45-ed7cf1d917c2 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:17.634135 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:36:18.992027 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6443212a-e85a-4146-af45-ed7cf1d917c2 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:19.003777 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6443212a-e85a-4146-af45-ed7cf1d917c2 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:19.005724 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6443212a-e85a-4146-af45-ed7cf1d917c2 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:19.009160 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6443212a-e85a-4146-af45-ed7cf1d917c2 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 2933 microversion: 2.42 time: 1.587045 Jun 05 08:36:19.010042 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1424/2768] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:17 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 2933 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:36:19.017620 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-606c8eda-1dad-4906-9a12-7018f1c064f8 req-01774c83-8586-4494-ae03-44e635b8d215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40933e98-d7d3-4d63-9012-ad5607e45085", "name": "network-vif-unplugged", "status": "completed", "tag": "2f3b34fc-705b-4063-a0c0-7ed026c1ebba"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:36:19.061554 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-606c8eda-1dad-4906-9a12-7018f1c064f8 req-01774c83-8586-4494-ae03-44e635b8d215 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:19.062668 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-606c8eda-1dad-4906-9a12-7018f1c064f8 req-01774c83-8586-4494-ae03-44e635b8d215 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:19.096794 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-606c8eda-1dad-4906-9a12-7018f1c064f8 req-01774c83-8586-4494-ae03-44e635b8d215 service nova] Creating event network-vif-unplugged:2f3b34fc-705b-4063-a0c0-7ed026c1ebba for instance 40933e98-d7d3-4d63-9012-ad5607e45085 on n-h1-844739-1 Jun 05 08:36:19.110939 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-606c8eda-1dad-4906-9a12-7018f1c064f8 req-01774c83-8586-4494-ae03-44e635b8d215 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097006 Jun 05 08:36:19.112387 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1425/2769] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:36:20.030700 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f940dfd2-9bf3-4247-96bc-31b27eefe258 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:20.031480 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f940dfd2-9bf3-4247-96bc-31b27eefe258 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:20.054135 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f940dfd2-9bf3-4247-96bc-31b27eefe258 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:20.054899 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f940dfd2-9bf3-4247-96bc-31b27eefe258 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:20.056470 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f940dfd2-9bf3-4247-96bc-31b27eefe258 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:20.056915 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f940dfd2-9bf3-4247-96bc-31b27eefe258 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:20.322049 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:36:20.375365 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-124418cf-7f46-444d-9e6b-7c60dc3e9834 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:36:20.383334 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-124418cf-7f46-444d-9e6b-7c60dc3e9834 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:36:20.385429 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-124418cf-7f46-444d-9e6b-7c60dc3e9834 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:36:20.386778 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-124418cf-7f46-444d-9e6b-7c60dc3e9834 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:36:20.391338 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-124418cf-7f46-444d-9e6b-7c60dc3e9834 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:36:20.410716 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-124418cf-7f46-444d-9e6b-7c60dc3e9834 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:20.415420 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-124418cf-7f46-444d-9e6b-7c60dc3e9834 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:20.420120 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-124418cf-7f46-444d-9e6b-7c60dc3e9834 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:20.421337 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-124418cf-7f46-444d-9e6b-7c60dc3e9834 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:20.468944 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=40,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:36:20.505895 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-124418cf-7f46-444d-9e6b-7c60dc3e9834 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Getting quotas for project 13e6941a17dd47e7a22f9235fea03f6f. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:36:20.515957 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-124418cf-7f46-444d-9e6b-7c60dc3e9834 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Getting quotas for user fd298e507057481d917baa7b9c62b74c and project 13e6941a17dd47e7a22f9235fea03f6f. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:36:20.542676 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-124418cf-7f46-444d-9e6b-7c60dc3e9834 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:36:20.546401 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-124418cf-7f46-444d-9e6b-7c60dc3e9834 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] [instance: 1ff8595c-81c0-48a3-a5dd-1bff993dcb70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:36:20.615825 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-124418cf-7f46-444d-9e6b-7c60dc3e9834 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.608618 Jun 05 08:36:20.617246 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1345/2770] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:36:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 4611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:36:20.628511 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3819e84e-ec4b-479b-b2b2-6f844dae37c3 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:20.629577 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3819e84e-ec4b-479b-b2b2-6f844dae37c3 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] [instance: 1ff8595c-81c0-48a3-a5dd-1bff993dcb70] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:20.766085 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f940dfd2-9bf3-4247-96bc-31b27eefe258 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:20.781252 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f940dfd2-9bf3-4247-96bc-31b27eefe258 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:20.783534 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f940dfd2-9bf3-4247-96bc-31b27eefe258 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:20.785032 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f940dfd2-9bf3-4247-96bc-31b27eefe258 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 2912 microversion: 2.42 time: 0.759497 Jun 05 08:36:20.786923 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1426/2771] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:20 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 2912 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:36:20.821932 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3819e84e-ec4b-479b-b2b2-6f844dae37c3 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd298e507057481d917baa7b9c62b74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e6941a17dd47e7a22f9235fea03f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:20.838806 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3819e84e-ec4b-479b-b2b2-6f844dae37c3 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] 10.222.0.33 "GET /compute/v2.1/servers/1ff8595c-81c0-48a3-a5dd-1bff993dcb70" status: 200 len: 1214 microversion: 2.1 time: 0.215160 Jun 05 08:36:20.839392 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1346/2772] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:36:20 2022] GET /compute/v2.1/servers/1ff8595c-81c0-48a3-a5dd-1bff993dcb70 => generated 1214 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:36:21.095949 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-99abf51b-83a6-410c-942c-17ba39f3039b tempest-VolumesTestJSON-1321181993 tempest-VolumesTestJSON-1321181993-project] Calling method '.version_select at 0x7f2432dd84c0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:21.149369 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-79c478a0-e8a4-4da3-9570-ba8fd7d5e4b7 req-6a6ba5f1-5f74-48df-b5d5-42c9f58a7f8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40933e98-d7d3-4d63-9012-ad5607e45085", "name": "network-vif-unplugged", "status": "completed", "tag": "4b72d95e-c895-455c-8626-04e2ca35dbf3"}, {"server_uuid": "40933e98-d7d3-4d63-9012-ad5607e45085", "name": "network-vif-unplugged", "status": "completed", "tag": "6625a448-ba61-493b-896c-b465fe36dc0c"}, {"server_uuid": "40933e98-d7d3-4d63-9012-ad5607e45085", "name": "network-vif-unplugged", "status": "completed", "tag": "50f3c778-e1df-4dd9-ba33-fc1897f015e1"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:36:21.159433 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-79c478a0-e8a4-4da3-9570-ba8fd7d5e4b7 req-6a6ba5f1-5f74-48df-b5d5-42c9f58a7f8c service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:21.160267 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-79c478a0-e8a4-4da3-9570-ba8fd7d5e4b7 req-6a6ba5f1-5f74-48df-b5d5-42c9f58a7f8c service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:21.173661 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-99abf51b-83a6-410c-942c-17ba39f3039b tempest-VolumesTestJSON-1321181993 tempest-VolumesTestJSON-1321181993-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/08a19d3b-6ef4-4fc1-9136-0cd96be274ab" status: 200 len: 350 microversion: 2.1 time: 0.082067 Jun 05 08:36:21.179939 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1427/2773] 10.222.0.33 () {58 vars in 1244 bytes} [Sun Jun 5 08:36:21 2022] GET /compute/v2.1/os-volumes/08a19d3b-6ef4-4fc1-9136-0cd96be274ab => generated 350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:36:21.186666 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-79c478a0-e8a4-4da3-9570-ba8fd7d5e4b7 req-6a6ba5f1-5f74-48df-b5d5-42c9f58a7f8c service nova] Creating event network-vif-unplugged:4b72d95e-c895-455c-8626-04e2ca35dbf3 for instance 40933e98-d7d3-4d63-9012-ad5607e45085 on n-h1-844739-1 Jun 05 08:36:21.187182 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-79c478a0-e8a4-4da3-9570-ba8fd7d5e4b7 req-6a6ba5f1-5f74-48df-b5d5-42c9f58a7f8c service nova] Creating event network-vif-unplugged:6625a448-ba61-493b-896c-b465fe36dc0c for instance 40933e98-d7d3-4d63-9012-ad5607e45085 on n-h1-844739-1 Jun 05 08:36:21.187688 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-79c478a0-e8a4-4da3-9570-ba8fd7d5e4b7 req-6a6ba5f1-5f74-48df-b5d5-42c9f58a7f8c service nova] Creating event network-vif-unplugged:50f3c778-e1df-4dd9-ba33-fc1897f015e1 for instance 40933e98-d7d3-4d63-9012-ad5607e45085 on n-h1-844739-1 Jun 05 08:36:21.229274 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-79c478a0-e8a4-4da3-9570-ba8fd7d5e4b7 req-6a6ba5f1-5f74-48df-b5d5-42c9f58a7f8c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.083935 Jun 05 08:36:21.231401 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1347/2774] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:36:21.805849 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2008cef6-cb30-4fc4-a04d-b6682d28417a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:21.806903 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2008cef6-cb30-4fc4-a04d-b6682d28417a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:21.820444 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2008cef6-cb30-4fc4-a04d-b6682d28417a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:21.820962 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2008cef6-cb30-4fc4-a04d-b6682d28417a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:21.822019 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2008cef6-cb30-4fc4-a04d-b6682d28417a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:21.826580 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2008cef6-cb30-4fc4-a04d-b6682d28417a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:21.858237 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-013c2424-79d7-48f5-b2ff-120c85a9f00d tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:21.859012 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-013c2424-79d7-48f5-b2ff-120c85a9f00d tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] [instance: 1ff8595c-81c0-48a3-a5dd-1bff993dcb70] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:21.875781 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-013c2424-79d7-48f5-b2ff-120c85a9f00d tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:21.876282 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-013c2424-79d7-48f5-b2ff-120c85a9f00d tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:21.884266 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-013c2424-79d7-48f5-b2ff-120c85a9f00d tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:21.884938 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-013c2424-79d7-48f5-b2ff-120c85a9f00d tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:21.989515 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-013c2424-79d7-48f5-b2ff-120c85a9f00d tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:21.991140 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-013c2424-79d7-48f5-b2ff-120c85a9f00d tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:21.992870 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-013c2424-79d7-48f5-b2ff-120c85a9f00d tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Lazy-loading 'fault' on Instance uuid 1ff8595c-81c0-48a3-a5dd-1bff993dcb70 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:36:22.163157 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-013c2424-79d7-48f5-b2ff-120c85a9f00d tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd298e507057481d917baa7b9c62b74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13e6941a17dd47e7a22f9235fea03f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:22.176334 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-013c2424-79d7-48f5-b2ff-120c85a9f00d tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] 10.222.0.33 "GET /compute/v2.1/servers/1ff8595c-81c0-48a3-a5dd-1bff993dcb70" status: 200 len: 1287 microversion: 2.1 time: 0.323188 Jun 05 08:36:22.193218 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1348/2775] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:36:21 2022] GET /compute/v2.1/servers/1ff8595c-81c0-48a3-a5dd-1bff993dcb70 => generated 1287 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:36:22.198509 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-eee365c7-174b-4f25-a5d4-7678568c0799 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:22.204892 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-eee365c7-174b-4f25-a5d4-7678568c0799 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] [instance: 1ff8595c-81c0-48a3-a5dd-1bff993dcb70] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:22.215910 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-eee365c7-174b-4f25-a5d4-7678568c0799 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:22.221238 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-eee365c7-174b-4f25-a5d4-7678568c0799 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:22.222400 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-eee365c7-174b-4f25-a5d4-7678568c0799 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:22.229132 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-eee365c7-174b-4f25-a5d4-7678568c0799 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:22.288001 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-eee365c7-174b-4f25-a5d4-7678568c0799 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] [instance: 1ff8595c-81c0-48a3-a5dd-1bff993dcb70] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:36:22.395246 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-eee365c7-174b-4f25-a5d4-7678568c0799 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] [instance: 1ff8595c-81c0-48a3-a5dd-1bff993dcb70] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:36:22.396390 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-eee365c7-174b-4f25-a5d4-7678568c0799 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:22.397223 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-eee365c7-174b-4f25-a5d4-7678568c0799 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:22.397828 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-eee365c7-174b-4f25-a5d4-7678568c0799 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] [instance: 1ff8595c-81c0-48a3-a5dd-1bff993dcb70] instance's host None is down, deleting from database Jun 05 08:36:22.407629 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-eee365c7-174b-4f25-a5d4-7678568c0799 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] [instance: 1ff8595c-81c0-48a3-a5dd-1bff993dcb70] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:36:22.478422 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-eee365c7-174b-4f25-a5d4-7678568c0799 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] [instance: 1ff8595c-81c0-48a3-a5dd-1bff993dcb70] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:36:22.489427 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2008cef6-cb30-4fc4-a04d-b6682d28417a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:22.491756 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-eee365c7-174b-4f25-a5d4-7678568c0799 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] [instance: 1ff8595c-81c0-48a3-a5dd-1bff993dcb70] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:36:22.505736 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2008cef6-cb30-4fc4-a04d-b6682d28417a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:22.507243 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2008cef6-cb30-4fc4-a04d-b6682d28417a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:22.508509 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2008cef6-cb30-4fc4-a04d-b6682d28417a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 2867 microversion: 2.42 time: 0.706762 Jun 05 08:36:22.509071 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1428/2776] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:21 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 2867 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:36:22.812540 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-5006cc3f-a10a-4b05-984f-79b7eb1ce12b req-53443e55-b284-4471-bbf6-e78b20050be4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40933e98-d7d3-4d63-9012-ad5607e45085", "name": "network-vif-deleted", "tag": "4b72d95e-c895-455c-8626-04e2ca35dbf3"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:36:22.818139 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-eee365c7-174b-4f25-a5d4-7678568c0799 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1ff8595c-81c0-48a3-a5dd-1bff993dcb70" status: 204 len: 0 microversion: 2.1 time: 0.623314 Jun 05 08:36:22.819274 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1349/2777] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:36:22 2022] DELETE /compute/v2.1/servers/1ff8595c-81c0-48a3-a5dd-1bff993dcb70 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:36:22.828295 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-5006cc3f-a10a-4b05-984f-79b7eb1ce12b req-53443e55-b284-4471-bbf6-e78b20050be4 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:22.831116 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a8faf53d-53d5-498e-8fd8-b7fe2aa16cb1 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:22.831679 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-5006cc3f-a10a-4b05-984f-79b7eb1ce12b req-53443e55-b284-4471-bbf6-e78b20050be4 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:22.832020 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a8faf53d-53d5-498e-8fd8-b7fe2aa16cb1 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] [instance: 1ff8595c-81c0-48a3-a5dd-1bff993dcb70] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:22.846857 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a8faf53d-53d5-498e-8fd8-b7fe2aa16cb1 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:22.849049 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a8faf53d-53d5-498e-8fd8-b7fe2aa16cb1 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:22.850128 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a8faf53d-53d5-498e-8fd8-b7fe2aa16cb1 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:22.853243 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a8faf53d-53d5-498e-8fd8-b7fe2aa16cb1 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:22.854806 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-5006cc3f-a10a-4b05-984f-79b7eb1ce12b req-53443e55-b284-4471-bbf6-e78b20050be4 service nova] Creating event network-vif-deleted:4b72d95e-c895-455c-8626-04e2ca35dbf3 for instance 40933e98-d7d3-4d63-9012-ad5607e45085 on n-h1-844739-1 Jun 05 08:36:22.874820 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-5006cc3f-a10a-4b05-984f-79b7eb1ce12b req-53443e55-b284-4471-bbf6-e78b20050be4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067004 Jun 05 08:36:22.878276 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1429/2778] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:36:22.889096 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-a8faf53d-53d5-498e-8fd8-b7fe2aa16cb1 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] HTTP exception thrown: Instance 1ff8595c-81c0-48a3-a5dd-1bff993dcb70 could not be found. Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a8faf53d-53d5-498e-8fd8-b7fe2aa16cb1 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Request method failure captured: Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/1ff8595c-81c0-48a3-a5dd-1bff993dcb70 HTTP/1.1 Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGr_aSQCUrB1SeO8CCdDGFJc_9wTRekvfqo8e7WYiPY6LfJ7-SdVZoLK-d3c6_SrEsThUbzqlHpYv5edZmzLixCvsP_oTdtB2QOiZhAehiSSS3PdVr_38gRunUYrUqAV8Dm2fJQbGGaGYAxJYaZ8YgyIxDwUeRhcrhG2aFgRynODmo4 Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 13e6941a17dd47e7a22f9235fea03f6f Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ServerRescueTestJSON-236064221 Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/13e6941a17dd47e7a22f9235fea03f6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/13e6941a17dd47e7a22f9235fea03f6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_13e6941a17dd47e7a22f9235fea03f6f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/13e6941a17dd47e7a22f9235fea03f6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ServerRescueTestJSON-236064221 Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 13e6941a17dd47e7a22f9235fea03f6f Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ServerRescueTestJSON-236064221 Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ServerRescueTestJSON-236064221-project Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: fd298e507057481d917baa7b9c62b74c Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ServerRescueTestJSON-236064221-project Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 1ff8595c-81c0-48a3-a5dd-1bff993dcb70 could not be found. Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '1ff8595c-81c0-48a3-a5dd-1bff993dcb70'} Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ff8595c-81c0-48a3-a5dd-1bff993dcb70 could not be found. Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ff8595c-81c0-48a3-a5dd-1bff993dcb70 could not be found. Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:36:22.891476 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:36:22.895117 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:36:22.895117 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:36:22.895117 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:36:22.895117 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:36:22.895117 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:36:22.895117 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ff8595c-81c0-48a3-a5dd-1bff993dcb70 could not be found. Jun 05 08:36:22.895117 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:36:22.896970 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a8faf53d-53d5-498e-8fd8-b7fe2aa16cb1 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] Returning 404 to user: Instance 1ff8595c-81c0-48a3-a5dd-1bff993dcb70 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:36:22.898052 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a8faf53d-53d5-498e-8fd8-b7fe2aa16cb1 tempest-ServerRescueTestJSON-236064221 tempest-ServerRescueTestJSON-236064221-project] 10.222.0.33 "GET /compute/v2.1/servers/1ff8595c-81c0-48a3-a5dd-1bff993dcb70" status: 404 len: 111 microversion: 2.1 time: 0.074759 Jun 05 08:36:22.904976 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1350/2779] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:36:22 2022] GET /compute/v2.1/servers/1ff8595c-81c0-48a3-a5dd-1bff993dcb70 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:36:23.286952 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-7a1af750-125a-4316-92f1-46395f5c1d25 req-9cec223f-3720-48c8-9b00-4998034fd9b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40933e98-d7d3-4d63-9012-ad5607e45085", "name": "network-vif-unplugged", "status": "completed", "tag": "0c4f6906-83f1-49f6-9951-e7976dadeb79"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:36:23.299177 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-7a1af750-125a-4316-92f1-46395f5c1d25 req-9cec223f-3720-48c8-9b00-4998034fd9b2 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:23.299621 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-7a1af750-125a-4316-92f1-46395f5c1d25 req-9cec223f-3720-48c8-9b00-4998034fd9b2 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:23.349032 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-7a1af750-125a-4316-92f1-46395f5c1d25 req-9cec223f-3720-48c8-9b00-4998034fd9b2 service nova] Creating event network-vif-unplugged:0c4f6906-83f1-49f6-9951-e7976dadeb79 for instance 40933e98-d7d3-4d63-9012-ad5607e45085 on n-h1-844739-1 Jun 05 08:36:23.361600 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-7a1af750-125a-4316-92f1-46395f5c1d25 req-9cec223f-3720-48c8-9b00-4998034fd9b2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078743 Jun 05 08:36:23.372929 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1430/2780] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:36:23.531366 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ca3aaee0-cd46-42bc-ac37-1cae9fa6d103 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:23.536779 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ca3aaee0-cd46-42bc-ac37-1cae9fa6d103 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:23.564463 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ca3aaee0-cd46-42bc-ac37-1cae9fa6d103 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:23.565184 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ca3aaee0-cd46-42bc-ac37-1cae9fa6d103 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:23.570566 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ca3aaee0-cd46-42bc-ac37-1cae9fa6d103 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:23.576382 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ca3aaee0-cd46-42bc-ac37-1cae9fa6d103 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:25.077749 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-edb0780d-9968-4ab9-8711-e5ada755a4c1 tempest-VolumesTestJSON-1321181993 tempest-VolumesTestJSON-1321181993-project] Calling method '.version_select at 0x7f2432dc5430>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:25.084115 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ca3aaee0-cd46-42bc-ac37-1cae9fa6d103 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:25.114174 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ca3aaee0-cd46-42bc-ac37-1cae9fa6d103 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:25.115707 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ca3aaee0-cd46-42bc-ac37-1cae9fa6d103 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:25.117058 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ca3aaee0-cd46-42bc-ac37-1cae9fa6d103 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 2575 microversion: 2.42 time: 1.590316 Jun 05 08:36:25.117608 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1351/2781] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:23 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 2575 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:36:25.152260 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-edb0780d-9968-4ab9-8711-e5ada755a4c1 tempest-VolumesTestJSON-1321181993 tempest-VolumesTestJSON-1321181993-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/e5b77f94-4b69-4a08-9a11-254691b8393b" status: 200 len: 351 microversion: 2.1 time: 0.080356 Jun 05 08:36:25.153386 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1431/2782] 10.222.0.33 () {58 vars in 1244 bytes} [Sun Jun 5 08:36:25 2022] GET /compute/v2.1/os-volumes/e5b77f94-4b69-4a08-9a11-254691b8393b => generated 351 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:36:25.164816 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-abd8eef7-914f-4203-9ced-bfb557ed2d54 tempest-VolumesTestJSON-1321181993 tempest-VolumesTestJSON-1321181993-project] Calling method '.version_select at 0x7f2433091af0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:25.320534 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-abd8eef7-914f-4203-9ced-bfb557ed2d54 tempest-VolumesTestJSON-1321181993 tempest-VolumesTestJSON-1321181993-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.159397 Jun 05 08:36:25.322457 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1352/2783] 10.222.0.33 () {58 vars in 1133 bytes} [Sun Jun 5 08:36:25 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:36:25.334699 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8272a231-7a3f-4b79-8a62-31cfe964372a tempest-VolumesTestJSON-1321181993 tempest-VolumesTestJSON-1321181993-project] Calling method '.version_select at 0x7f2432d81a60>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:25.472021 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8272a231-7a3f-4b79-8a62-31cfe964372a tempest-VolumesTestJSON-1321181993 tempest-VolumesTestJSON-1321181993-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.141053 Jun 05 08:36:25.472953 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1432/2784] 10.222.0.33 () {58 vars in 1148 bytes} [Sun Jun 5 08:36:25 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:36:25.487644 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0105b403-3903-4ae3-8d89-c2626dc56b50 tempest-VolumesTestJSON-1321181993 tempest-VolumesTestJSON-1321181993-project] Calling method '.version_select at 0x7f2432f7b160>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:25.647976 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0105b403-3903-4ae3-8d89-c2626dc56b50 tempest-VolumesTestJSON-1321181993 tempest-VolumesTestJSON-1321181993-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.165403 Jun 05 08:36:25.649044 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1353/2785] 10.222.0.33 () {58 vars in 1133 bytes} [Sun Jun 5 08:36:25 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:36:25.660982 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-899f9610-334a-480a-9474-688b24cbdb1d tempest-VolumesTestJSON-1321181993 tempest-VolumesTestJSON-1321181993-project] Calling method '.version_select at 0x7f2432dc5ee0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:25.903377 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-899f9610-334a-480a-9474-688b24cbdb1d tempest-VolumesTestJSON-1321181993 tempest-VolumesTestJSON-1321181993-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.246526 Jun 05 08:36:25.904210 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1433/2786] 10.222.0.33 () {58 vars in 1166 bytes} [Sun Jun 5 08:36:25 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:36:25.916955 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e736543a-8a87-43f0-b9e4-e3f38b89d93d tempest-VolumesTestJSON-1321181993 tempest-VolumesTestJSON-1321181993-project] Calling method '.version_select at 0x7f24330fca60>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:26.109800 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e736543a-8a87-43f0-b9e4-e3f38b89d93d tempest-VolumesTestJSON-1321181993 tempest-VolumesTestJSON-1321181993-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.197297 Jun 05 08:36:26.110370 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1354/2787] 10.222.0.33 () {58 vars in 1169 bytes} [Sun Jun 5 08:36:25 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:36:26.124788 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7b6d9ce8-8abc-4ee6-bfbf-8248fda8583a tempest-VolumesTestJSON-1321181993 tempest-VolumesTestJSON-1321181993-project] Calling method '.version_select at 0x7f24337ae9d0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:26.139551 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d05b17bb-a70f-4115-80d4-1117a72a4320 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:26.140710 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d05b17bb-a70f-4115-80d4-1117a72a4320 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:26.155349 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d05b17bb-a70f-4115-80d4-1117a72a4320 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:26.155830 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d05b17bb-a70f-4115-80d4-1117a72a4320 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:26.156670 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d05b17bb-a70f-4115-80d4-1117a72a4320 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:26.159319 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d05b17bb-a70f-4115-80d4-1117a72a4320 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:26.280101 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7b6d9ce8-8abc-4ee6-bfbf-8248fda8583a tempest-VolumesTestJSON-1321181993 tempest-VolumesTestJSON-1321181993-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.160581 Jun 05 08:36:26.287936 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1434/2788] 10.222.0.33 () {58 vars in 1154 bytes} [Sun Jun 5 08:36:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:36:26.293687 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-c7c51c8b-9253-4389-b4cb-12bfd5a90aca req-9e5e40cf-2fda-452f-86df-ff3fd9e82ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40933e98-d7d3-4d63-9012-ad5607e45085", "name": "network-vif-deleted", "tag": "2f3b34fc-705b-4063-a0c0-7ed026c1ebba"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:36:26.305876 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-c7c51c8b-9253-4389-b4cb-12bfd5a90aca req-9e5e40cf-2fda-452f-86df-ff3fd9e82ad6 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:26.306670 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-c7c51c8b-9253-4389-b4cb-12bfd5a90aca req-9e5e40cf-2fda-452f-86df-ff3fd9e82ad6 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:26.321822 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-c7c51c8b-9253-4389-b4cb-12bfd5a90aca req-9e5e40cf-2fda-452f-86df-ff3fd9e82ad6 service nova] Creating event network-vif-deleted:2f3b34fc-705b-4063-a0c0-7ed026c1ebba for instance 40933e98-d7d3-4d63-9012-ad5607e45085 on n-h1-844739-1 Jun 05 08:36:26.337258 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-c7c51c8b-9253-4389-b4cb-12bfd5a90aca req-9e5e40cf-2fda-452f-86df-ff3fd9e82ad6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047403 Jun 05 08:36:26.338175 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1435/2789] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:36:26.362852 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ba1df91f-2489-45a1-aba7-7571e8996b44 tempest-VolumesTestJSON-1321181993 tempest-VolumesTestJSON-1321181993-project] Calling method '.version_select at 0x7f2432dc5700>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:26.533012 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ba1df91f-2489-45a1-aba7-7571e8996b44 tempest-VolumesTestJSON-1321181993 tempest-VolumesTestJSON-1321181993-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.193161 Jun 05 08:36:26.540168 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1436/2790] 10.222.0.33 () {58 vars in 1187 bytes} [Sun Jun 5 08:36:26 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:36:26.546932 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-30d735f6-26eb-4ff2-ab65-aa552374e1d7 tempest-VolumesTestJSON-1321181993 tempest-VolumesTestJSON-1321181993-project] Calling method '.version_select at 0x7f2432da7790>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:26.680223 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-30d735f6-26eb-4ff2-ab65-aa552374e1d7 tempest-VolumesTestJSON-1321181993 tempest-VolumesTestJSON-1321181993-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.138037 Jun 05 08:36:26.681339 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1437/2791] 10.222.0.33 () {58 vars in 1154 bytes} [Sun Jun 5 08:36:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:36:27.663722 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d05b17bb-a70f-4115-80d4-1117a72a4320 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:27.681908 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d05b17bb-a70f-4115-80d4-1117a72a4320 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:27.686437 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d05b17bb-a70f-4115-80d4-1117a72a4320 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:27.693883 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d05b17bb-a70f-4115-80d4-1117a72a4320 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 2530 microversion: 2.42 time: 1.559556 Jun 05 08:36:27.698736 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1355/2792] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:26 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 2530 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:36:28.393314 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [req-48618364-1319-442a-9696-800a8c7b2f0b req-ef632ab2-405e-4ebb-a7b3-7e62e7b69a97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40933e98-d7d3-4d63-9012-ad5607e45085", "name": "network-vif-deleted", "tag": "6625a448-ba61-493b-896c-b465fe36dc0c"}]} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:36:28.410097 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:36:28.412466 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-48618364-1319-442a-9696-800a8c7b2f0b req-ef632ab2-405e-4ebb-a7b3-7e62e7b69a97 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:28.412979 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [req-48618364-1319-442a-9696-800a8c7b2f0b req-ef632ab2-405e-4ebb-a7b3-7e62e7b69a97 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:28.441659 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.compute.server_external_events [req-48618364-1319-442a-9696-800a8c7b2f0b req-ef632ab2-405e-4ebb-a7b3-7e62e7b69a97 service nova] Creating event network-vif-deleted:6625a448-ba61-493b-896c-b465fe36dc0c for instance 40933e98-d7d3-4d63-9012-ad5607e45085 on n-h1-844739-1 Jun 05 08:36:28.447466 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [req-48618364-1319-442a-9696-800a8c7b2f0b req-ef632ab2-405e-4ebb-a7b3-7e62e7b69a97 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057424 Jun 05 08:36:28.448715 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1438/2793] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:36:28.724258 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4834b6e1-eab6-4a84-a486-1dc14d2145db tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:28.728200 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4834b6e1-eab6-4a84-a486-1dc14d2145db tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:28.783698 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4834b6e1-eab6-4a84-a486-1dc14d2145db tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:28.786306 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4834b6e1-eab6-4a84-a486-1dc14d2145db tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:28.793364 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4834b6e1-eab6-4a84-a486-1dc14d2145db tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:28.794231 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4834b6e1-eab6-4a84-a486-1dc14d2145db tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:29.514115 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4834b6e1-eab6-4a84-a486-1dc14d2145db tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:29.546308 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4834b6e1-eab6-4a84-a486-1dc14d2145db tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:29.552827 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4834b6e1-eab6-4a84-a486-1dc14d2145db tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:29.559851 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4834b6e1-eab6-4a84-a486-1dc14d2145db tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 2212 microversion: 2.42 time: 0.845789 Jun 05 08:36:29.561110 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1356/2794] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:28 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 2212 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:36:30.579760 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-10880fc2-9ba8-4393-b139-834dd4c05827 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:30.580502 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-10880fc2-9ba8-4393-b139-834dd4c05827 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:30.595147 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10880fc2-9ba8-4393-b139-834dd4c05827 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:30.595804 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10880fc2-9ba8-4393-b139-834dd4c05827 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:30.596784 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10880fc2-9ba8-4393-b139-834dd4c05827 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:30.597590 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10880fc2-9ba8-4393-b139-834dd4c05827 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:30.896523 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-01569412-2c21-463e-acbc-a372acc7d377 req-08fedf85-9aae-4c90-8a5c-4f9ac4fbd42c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40933e98-d7d3-4d63-9012-ad5607e45085", "name": "network-vif-deleted", "tag": "0c4f6906-83f1-49f6-9951-e7976dadeb79"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:36:30.906594 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=8 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:36:30.918819 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-01569412-2c21-463e-acbc-a372acc7d377 req-08fedf85-9aae-4c90-8a5c-4f9ac4fbd42c service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:30.919280 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-01569412-2c21-463e-acbc-a372acc7d377 req-08fedf85-9aae-4c90-8a5c-4f9ac4fbd42c service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:30.958707 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-01569412-2c21-463e-acbc-a372acc7d377 req-08fedf85-9aae-4c90-8a5c-4f9ac4fbd42c service nova] Creating event network-vif-deleted:0c4f6906-83f1-49f6-9951-e7976dadeb79 for instance 40933e98-d7d3-4d63-9012-ad5607e45085 on n-h1-844739-1 Jun 05 08:36:30.969022 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-01569412-2c21-463e-acbc-a372acc7d377 req-08fedf85-9aae-4c90-8a5c-4f9ac4fbd42c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075769 Jun 05 08:36:30.970797 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1357/2795] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:36:31.009541 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-10880fc2-9ba8-4393-b139-834dd4c05827 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:31.041514 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-10880fc2-9ba8-4393-b139-834dd4c05827 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:31.054856 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-10880fc2-9ba8-4393-b139-834dd4c05827 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:31.058059 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-10880fc2-9ba8-4393-b139-834dd4c05827 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 2212 microversion: 2.42 time: 0.482732 Jun 05 08:36:31.061545 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1439/2796] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:30 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 2212 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:36:32.092227 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e1573bc5-3f7f-4612-bc83-0a2a2e08723f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:32.094183 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e1573bc5-3f7f-4612-bc83-0a2a2e08723f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:32.112893 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e1573bc5-3f7f-4612-bc83-0a2a2e08723f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:32.113666 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e1573bc5-3f7f-4612-bc83-0a2a2e08723f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:32.114724 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e1573bc5-3f7f-4612-bc83-0a2a2e08723f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:32.115357 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e1573bc5-3f7f-4612-bc83-0a2a2e08723f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:32.379784 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e1573bc5-3f7f-4612-bc83-0a2a2e08723f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:32.408391 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e1573bc5-3f7f-4612-bc83-0a2a2e08723f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:32.410189 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e1573bc5-3f7f-4612-bc83-0a2a2e08723f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:32.422073 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e1573bc5-3f7f-4612-bc83-0a2a2e08723f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1988 microversion: 2.42 time: 0.343954 Jun 05 08:36:32.422666 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1358/2797] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:32 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1988 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:36:32.663298 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f2349975-b86b-4c32-9a06-134a512142bd tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Action: 'create', calling method: .version_select at 0x7f2432da7ca0>, body: {"keypair": {"name": "tempest-keypair-1368950302", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCuuiyIM8AjMnmxUVG+UHmWazKS3B5/sVtd5gDRZxBXAf8Xvh08hlflP1rKG9pphONFOtS/ZLoQsJHGK7Dig/YAtutwhfZ595SkXipcTW9NTJKEsg4xiWBC1a/X3C3DoA=="}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:36:32.686542 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-f2349975-b86b-4c32-9a06-134a512142bd tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Getting quotas for project 12256b2ca66f4ea7a2eafc2dbc305caf. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:36:32.720752 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-f2349975-b86b-4c32-9a06-134a512142bd tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Getting quotas for user dec9e7d852134c96a9ce8b6f5b4e6ea0 and project 12256b2ca66f4ea7a2eafc2dbc305caf. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:36:32.775649 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f2349975-b86b-4c32-9a06-134a512142bd tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.555775 Jun 05 08:36:32.776288 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1440/2798] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:36:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:36:33.012551 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=36,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:36:33.016972 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [req-4a3b30ca-2059-4fac-9036-388131e9cfc1 req-08908937-fdbe-4e62-9c0f-7189583429d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40933e98-d7d3-4d63-9012-ad5607e45085", "name": "network-vif-deleted", "tag": "50f3c778-e1df-4dd9-ba33-fc1897f015e1"}]} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:36:33.035410 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-4a3b30ca-2059-4fac-9036-388131e9cfc1 req-08908937-fdbe-4e62-9c0f-7189583429d1 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:33.048863 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [req-4a3b30ca-2059-4fac-9036-388131e9cfc1 req-08908937-fdbe-4e62-9c0f-7189583429d1 service nova] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:33.075722 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.compute.server_external_events [req-4a3b30ca-2059-4fac-9036-388131e9cfc1 req-08908937-fdbe-4e62-9c0f-7189583429d1 service nova] Creating event network-vif-deleted:50f3c778-e1df-4dd9-ba33-fc1897f015e1 for instance 40933e98-d7d3-4d63-9012-ad5607e45085 on n-h1-844739-1 Jun 05 08:36:33.082288 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [req-4a3b30ca-2059-4fac-9036-388131e9cfc1 req-08908937-fdbe-4e62-9c0f-7189583429d1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071009 Jun 05 08:36:33.086247 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1359/2799] 10.222.0.33 () {64 vars in 1317 bytes} [Sun Jun 5 08:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:36:33.450569 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b475f4fa-21a4-4d0a-830f-8a57507e6f89 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:33.451680 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b475f4fa-21a4-4d0a-830f-8a57507e6f89 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:33.479443 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b475f4fa-21a4-4d0a-830f-8a57507e6f89 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:33.480005 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b475f4fa-21a4-4d0a-830f-8a57507e6f89 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:33.481177 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b475f4fa-21a4-4d0a-830f-8a57507e6f89 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:33.489202 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b475f4fa-21a4-4d0a-830f-8a57507e6f89 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:33.734763 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b475f4fa-21a4-4d0a-830f-8a57507e6f89 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:33.755612 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b475f4fa-21a4-4d0a-830f-8a57507e6f89 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:33.760306 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b475f4fa-21a4-4d0a-830f-8a57507e6f89 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:33.762548 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b475f4fa-21a4-4d0a-830f-8a57507e6f89 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.320564 Jun 05 08:36:33.762730 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1441/2800] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:33 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:36:34.788172 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4f5a3b9f-0bf4-488e-a638-4767bef61853 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:34.788885 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4f5a3b9f-0bf4-488e-a638-4767bef61853 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:34.813646 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4f5a3b9f-0bf4-488e-a638-4767bef61853 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:34.816105 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4f5a3b9f-0bf4-488e-a638-4767bef61853 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:34.818862 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4f5a3b9f-0bf4-488e-a638-4767bef61853 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:34.819375 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4f5a3b9f-0bf4-488e-a638-4767bef61853 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:35.191105 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4f5a3b9f-0bf4-488e-a638-4767bef61853 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:35.210234 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4f5a3b9f-0bf4-488e-a638-4767bef61853 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:35.216935 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4f5a3b9f-0bf4-488e-a638-4767bef61853 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:35.227636 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4f5a3b9f-0bf4-488e-a638-4767bef61853 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.446400 Jun 05 08:36:35.229444 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1360/2801] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:34 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:36:36.248870 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f2a623a0-c1d3-40ba-bd9e-7c00d61c301f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:36.248870 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f2a623a0-c1d3-40ba-bd9e-7c00d61c301f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:36.271802 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f2a623a0-c1d3-40ba-bd9e-7c00d61c301f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:36.272291 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f2a623a0-c1d3-40ba-bd9e-7c00d61c301f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:36.273082 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f2a623a0-c1d3-40ba-bd9e-7c00d61c301f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:36.273520 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f2a623a0-c1d3-40ba-bd9e-7c00d61c301f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:36.287460 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5d3dbb44-cf8a-4c4a-bf3f-d2324ecd3fac tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-387748707", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": "none"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:36:36.315955 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:36:36.432068 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-5d3dbb44-cf8a-4c4a-bf3f-d2324ecd3fac tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:36:36.432518 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-5d3dbb44-cf8a-4c4a-bf3f-d2324ecd3fac tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:36:36.432993 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-5d3dbb44-cf8a-4c4a-bf3f-d2324ecd3fac tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:36:36.433971 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-5d3dbb44-cf8a-4c4a-bf3f-d2324ecd3fac tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:36:36.434389 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-5d3dbb44-cf8a-4c4a-bf3f-d2324ecd3fac tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:36:36.463200 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5d3dbb44-cf8a-4c4a-bf3f-d2324ecd3fac tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:36.463656 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5d3dbb44-cf8a-4c4a-bf3f-d2324ecd3fac tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:36.477433 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5d3dbb44-cf8a-4c4a-bf3f-d2324ecd3fac tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:36.477890 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5d3dbb44-cf8a-4c4a-bf3f-d2324ecd3fac tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:36.554410 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-5d3dbb44-cf8a-4c4a-bf3f-d2324ecd3fac tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Getting quotas for project d4efff1c29a94c14b13b37ea5ae3bb4d. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:36:36.574232 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-5d3dbb44-cf8a-4c4a-bf3f-d2324ecd3fac tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Getting quotas for user b6060a9a16504031975ca8a91a6c2ea6 and project d4efff1c29a94c14b13b37ea5ae3bb4d. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:36:36.624970 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5d3dbb44-cf8a-4c4a-bf3f-d2324ecd3fac tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:36:36.627270 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5d3dbb44-cf8a-4c4a-bf3f-d2324ecd3fac tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] [instance: b306b05a-28ba-48fe-a760-3d57da51b1cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:36:36.668196 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f2a623a0-c1d3-40ba-bd9e-7c00d61c301f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:36.733934 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f2a623a0-c1d3-40ba-bd9e-7c00d61c301f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:36.739973 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f2a623a0-c1d3-40ba-bd9e-7c00d61c301f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:36.741632 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f2a623a0-c1d3-40ba-bd9e-7c00d61c301f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.498196 Jun 05 08:36:36.742231 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1361/2802] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:36 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:36:36.810954 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5d3dbb44-cf8a-4c4a-bf3f-d2324ecd3fac tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.887805 Jun 05 08:36:36.822767 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1442/2803] 10.222.0.33 () {62 vars in 1187 bytes} [Sun Jun 5 08:36:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 05 08:36:36.833941 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6984e31d-74d6-4403-b7e4-7e5d709cad68 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:36.834889 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6984e31d-74d6-4403-b7e4-7e5d709cad68 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] [instance: b306b05a-28ba-48fe-a760-3d57da51b1cb] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:37.056927 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6984e31d-74d6-4403-b7e4-7e5d709cad68 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6060a9a16504031975ca8a91a6c2ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4efff1c29a94c14b13b37ea5ae3bb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:37.077815 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6984e31d-74d6-4403-b7e4-7e5d709cad68 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6060a9a16504031975ca8a91a6c2ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4efff1c29a94c14b13b37ea5ae3bb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:37.083794 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6984e31d-74d6-4403-b7e4-7e5d709cad68 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6060a9a16504031975ca8a91a6c2ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4efff1c29a94c14b13b37ea5ae3bb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:37.089015 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6984e31d-74d6-4403-b7e4-7e5d709cad68 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] 10.222.0.33 "GET /compute/v2.1/servers/b306b05a-28ba-48fe-a760-3d57da51b1cb" status: 200 len: 1280 microversion: 2.47 time: 0.259690 Jun 05 08:36:37.096835 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1362/2804] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:36 2022] GET /compute/v2.1/servers/b306b05a-28ba-48fe-a760-3d57da51b1cb => generated 1280 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:36:37.762097 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-33ee322b-8b1f-478c-b5e1-b070c5d4f25a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:37.763407 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-33ee322b-8b1f-478c-b5e1-b070c5d4f25a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:37.787932 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-33ee322b-8b1f-478c-b5e1-b070c5d4f25a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:37.789681 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-33ee322b-8b1f-478c-b5e1-b070c5d4f25a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:37.794234 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-33ee322b-8b1f-478c-b5e1-b070c5d4f25a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:37.797302 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-33ee322b-8b1f-478c-b5e1-b070c5d4f25a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:37.910873 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=55 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:36:38.038166 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-33ee322b-8b1f-478c-b5e1-b070c5d4f25a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:38.068146 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-33ee322b-8b1f-478c-b5e1-b070c5d4f25a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:38.070499 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-33ee322b-8b1f-478c-b5e1-b070c5d4f25a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:38.077217 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-33ee322b-8b1f-478c-b5e1-b070c5d4f25a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.320788 Jun 05 08:36:38.087636 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1443/2805] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:37 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:36:38.119106 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fcc01951-8cb0-44a0-8c4f-21c887482c8b tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:38.121509 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-fcc01951-8cb0-44a0-8c4f-21c887482c8b tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] [instance: b306b05a-28ba-48fe-a760-3d57da51b1cb] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:38.152541 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fcc01951-8cb0-44a0-8c4f-21c887482c8b tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:38.158254 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fcc01951-8cb0-44a0-8c4f-21c887482c8b tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:38.159740 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fcc01951-8cb0-44a0-8c4f-21c887482c8b tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:38.160378 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fcc01951-8cb0-44a0-8c4f-21c887482c8b tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:38.354352 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fcc01951-8cb0-44a0-8c4f-21c887482c8b tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:38.360295 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fcc01951-8cb0-44a0-8c4f-21c887482c8b tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:38.361397 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-fcc01951-8cb0-44a0-8c4f-21c887482c8b tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Lazy-loading 'fault' on Instance uuid b306b05a-28ba-48fe-a760-3d57da51b1cb {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:36:38.611540 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-fcc01951-8cb0-44a0-8c4f-21c887482c8b tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6060a9a16504031975ca8a91a6c2ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4efff1c29a94c14b13b37ea5ae3bb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:38.619917 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-fcc01951-8cb0-44a0-8c4f-21c887482c8b tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6060a9a16504031975ca8a91a6c2ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4efff1c29a94c14b13b37ea5ae3bb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:38.621789 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-fcc01951-8cb0-44a0-8c4f-21c887482c8b tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6060a9a16504031975ca8a91a6c2ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4efff1c29a94c14b13b37ea5ae3bb4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:38.623166 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fcc01951-8cb0-44a0-8c4f-21c887482c8b tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] 10.222.0.33 "GET /compute/v2.1/servers/b306b05a-28ba-48fe-a760-3d57da51b1cb" status: 200 len: 1353 microversion: 2.47 time: 0.509791 Jun 05 08:36:38.623725 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1363/2806] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:38 2022] GET /compute/v2.1/servers/b306b05a-28ba-48fe-a760-3d57da51b1cb => generated 1353 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:36:38.641932 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8302aab9-a7c9-4190-99cf-4bb2d73ffaf1 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:38.642903 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8302aab9-a7c9-4190-99cf-4bb2d73ffaf1 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] [instance: b306b05a-28ba-48fe-a760-3d57da51b1cb] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:38.656406 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8302aab9-a7c9-4190-99cf-4bb2d73ffaf1 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:38.656920 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8302aab9-a7c9-4190-99cf-4bb2d73ffaf1 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:38.658870 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8302aab9-a7c9-4190-99cf-4bb2d73ffaf1 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:38.659329 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8302aab9-a7c9-4190-99cf-4bb2d73ffaf1 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:38.752456 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8302aab9-a7c9-4190-99cf-4bb2d73ffaf1 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] [instance: b306b05a-28ba-48fe-a760-3d57da51b1cb] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:36:38.918601 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8302aab9-a7c9-4190-99cf-4bb2d73ffaf1 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] [instance: b306b05a-28ba-48fe-a760-3d57da51b1cb] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:36:38.919601 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8302aab9-a7c9-4190-99cf-4bb2d73ffaf1 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:38.923812 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8302aab9-a7c9-4190-99cf-4bb2d73ffaf1 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:38.924355 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-8302aab9-a7c9-4190-99cf-4bb2d73ffaf1 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] [instance: b306b05a-28ba-48fe-a760-3d57da51b1cb] instance's host None is down, deleting from database Jun 05 08:36:38.951660 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-8302aab9-a7c9-4190-99cf-4bb2d73ffaf1 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] [instance: b306b05a-28ba-48fe-a760-3d57da51b1cb] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:36:39.084868 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-01387858-96ef-4654-8ae0-6c4e606c0ce6 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1565853850", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "cf8b6d10-455b-41ec-9179-b06740a3fc45"}], "security_groups": [{"name": "tempest-securitygroup--1673522717"}], "key_name": "tempest-keypair-1368950302", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:36:39.099408 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-8302aab9-a7c9-4190-99cf-4bb2d73ffaf1 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] [instance: b306b05a-28ba-48fe-a760-3d57da51b1cb] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:36:39.105964 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-8302aab9-a7c9-4190-99cf-4bb2d73ffaf1 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] [instance: b306b05a-28ba-48fe-a760-3d57da51b1cb] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:36:39.479197 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8302aab9-a7c9-4190-99cf-4bb2d73ffaf1 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b306b05a-28ba-48fe-a760-3d57da51b1cb" status: 204 len: 0 microversion: 2.47 time: 0.841562 Jun 05 08:36:39.479920 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1444/2807] 10.222.0.33 () {60 vars in 1279 bytes} [Sun Jun 5 08:36:38 2022] DELETE /compute/v2.1/servers/b306b05a-28ba-48fe-a760-3d57da51b1cb => generated 0 bytes in 844 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:36:39.499433 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1dec76d7-c56b-4cbf-ab37-233b433f086c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:39.500869 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1dec76d7-c56b-4cbf-ab37-233b433f086c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:39.514978 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1dec76d7-c56b-4cbf-ab37-233b433f086c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:39.519020 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1dec76d7-c56b-4cbf-ab37-233b433f086c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:39.519020 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1dec76d7-c56b-4cbf-ab37-233b433f086c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:39.519020 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1dec76d7-c56b-4cbf-ab37-233b433f086c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:39.830973 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1dec76d7-c56b-4cbf-ab37-233b433f086c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:39.847364 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1dec76d7-c56b-4cbf-ab37-233b433f086c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:39.856964 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1dec76d7-c56b-4cbf-ab37-233b433f086c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:39.862800 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1dec76d7-c56b-4cbf-ab37-233b433f086c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.379682 Jun 05 08:36:39.863402 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1445/2808] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:39 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:36:39.897952 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f83f09bb-9578-4755-bf54-adf986c4b2a2 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:39.898574 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f83f09bb-9578-4755-bf54-adf986c4b2a2 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] [instance: b306b05a-28ba-48fe-a760-3d57da51b1cb] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:39.934118 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f83f09bb-9578-4755-bf54-adf986c4b2a2 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:39.939535 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f83f09bb-9578-4755-bf54-adf986c4b2a2 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:39.943313 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f83f09bb-9578-4755-bf54-adf986c4b2a2 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:39.951656 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f83f09bb-9578-4755-bf54-adf986c4b2a2 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:40.009321 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-f83f09bb-9578-4755-bf54-adf986c4b2a2 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] HTTP exception thrown: Instance b306b05a-28ba-48fe-a760-3d57da51b1cb could not be found. Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f83f09bb-9578-4755-bf54-adf986c4b2a2 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Request method failure captured: Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/b306b05a-28ba-48fe-a760-3d57da51b1cb HTTP/1.1 Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGsTDE8wKdxqpvevQvWOsGDH6-seBefYyXn5BgWviIPuFKIu5SnxGnGVfztlpDJnNWFGnRnmx0fApn3bSyEF9OR75gSo7wtTojW_4UzFQGf0FrRqSpzgCHlvw9UP2f02nTS84SwKJ8c57M6_s34vy-tMlIxHaGa3n1ilYmNxHxAzm4I Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: X-Openstack-Nova-Api-Version: 2.47 Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: d4efff1c29a94c14b13b37ea5ae3bb4d Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ServersAaction247Test-1248554092 Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d4efff1c29a94c14b13b37ea5ae3bb4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d4efff1c29a94c14b13b37ea5ae3bb4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d4efff1c29a94c14b13b37ea5ae3bb4d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d4efff1c29a94c14b13b37ea5ae3bb4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ServersAaction247Test-1248554092 Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: d4efff1c29a94c14b13b37ea5ae3bb4d Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ServersAaction247Test-1248554092 Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ServersAaction247Test-1248554092-project Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: b6060a9a16504031975ca8a91a6c2ea6 Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ServersAaction247Test-1248554092-project Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance b306b05a-28ba-48fe-a760-3d57da51b1cb could not be found. Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'b306b05a-28ba-48fe-a760-3d57da51b1cb'} Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b306b05a-28ba-48fe-a760-3d57da51b1cb could not be found. Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b306b05a-28ba-48fe-a760-3d57da51b1cb could not be found. Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:36:40.011018 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:36:40.016933 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:36:40.016933 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:36:40.016933 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:36:40.016933 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:36:40.016933 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:36:40.016933 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b306b05a-28ba-48fe-a760-3d57da51b1cb could not be found. Jun 05 08:36:40.016933 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:36:40.017466 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f83f09bb-9578-4755-bf54-adf986c4b2a2 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] Returning 404 to user: Instance b306b05a-28ba-48fe-a760-3d57da51b1cb could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:36:40.020910 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f83f09bb-9578-4755-bf54-adf986c4b2a2 tempest-ServersAaction247Test-1248554092 tempest-ServersAaction247Test-1248554092-project] 10.222.0.33 "GET /compute/v2.1/servers/b306b05a-28ba-48fe-a760-3d57da51b1cb" status: 404 len: 111 microversion: 2.47 time: 0.137322 Jun 05 08:36:40.024182 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1446/2809] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:39 2022] GET /compute/v2.1/servers/b306b05a-28ba-48fe-a760-3d57da51b1cb => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 05 08:36:40.157062 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-01387858-96ef-4654-8ae0-6c4e606c0ce6 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] validate_networks() for [('cf8b6d10-455b-41ec-9179-b06740a3fc45', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:36:40.884081 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-bfbd933f-e6cd-481b-a721-ebec38dd850b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:40.885051 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-bfbd933f-e6cd-481b-a721-ebec38dd850b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:40.898255 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bfbd933f-e6cd-481b-a721-ebec38dd850b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:40.901668 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bfbd933f-e6cd-481b-a721-ebec38dd850b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:40.902697 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bfbd933f-e6cd-481b-a721-ebec38dd850b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:40.903555 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bfbd933f-e6cd-481b-a721-ebec38dd850b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:41.460242 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-bfbd933f-e6cd-481b-a721-ebec38dd850b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:41.474109 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-bfbd933f-e6cd-481b-a721-ebec38dd850b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:41.475771 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-bfbd933f-e6cd-481b-a721-ebec38dd850b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:41.489208 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-bfbd933f-e6cd-481b-a721-ebec38dd850b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.610634 Jun 05 08:36:41.490031 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1447/2810] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:40 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:36:41.598351 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-01387858-96ef-4654-8ae0-6c4e606c0ce6 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:36:41.599335 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-01387858-96ef-4654-8ae0-6c4e606c0ce6 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:36:41.600252 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-01387858-96ef-4654-8ae0-6c4e606c0ce6 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:36:41.600910 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-01387858-96ef-4654-8ae0-6c4e606c0ce6 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:36:41.601572 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-01387858-96ef-4654-8ae0-6c4e606c0ce6 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:36:41.623860 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-01387858-96ef-4654-8ae0-6c4e606c0ce6 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:41.624700 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-01387858-96ef-4654-8ae0-6c4e606c0ce6 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:41.625763 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-01387858-96ef-4654-8ae0-6c4e606c0ce6 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:41.626434 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-01387858-96ef-4654-8ae0-6c4e606c0ce6 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:41.656635 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-01387858-96ef-4654-8ae0-6c4e606c0ce6 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Getting quotas for project 12256b2ca66f4ea7a2eafc2dbc305caf. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:36:41.663106 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-01387858-96ef-4654-8ae0-6c4e606c0ce6 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Getting quotas for user dec9e7d852134c96a9ce8b6f5b4e6ea0 and project 12256b2ca66f4ea7a2eafc2dbc305caf. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:36:41.680487 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-01387858-96ef-4654-8ae0-6c4e606c0ce6 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:36:41.685962 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-01387858-96ef-4654-8ae0-6c4e606c0ce6 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] [instance: d98801d3-531c-4f81-8fff-612e53ca66ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:36:41.844265 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-01387858-96ef-4654-8ae0-6c4e606c0ce6 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.763114 Jun 05 08:36:41.855478 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1364/2811] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:36:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 2774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 05 08:36:41.858103 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0a0fffe8-1cda-49cb-a4c1-5fb000fa434f tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:41.858731 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0a0fffe8-1cda-49cb-a4c1-5fb000fa434f tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] [instance: d98801d3-531c-4f81-8fff-612e53ca66ee] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:41.993289 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0a0fffe8-1cda-49cb-a4c1-5fb000fa434f tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec9e7d852134c96a9ce8b6f5b4e6ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12256b2ca66f4ea7a2eafc2dbc305caf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:42.006668 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0a0fffe8-1cda-49cb-a4c1-5fb000fa434f tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] 10.222.0.33 "GET /compute/v2.1/servers/d98801d3-531c-4f81-8fff-612e53ca66ee" status: 200 len: 1242 microversion: 2.1 time: 0.152105 Jun 05 08:36:42.015963 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1448/2812] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:36:41 2022] GET /compute/v2.1/servers/d98801d3-531c-4f81-8fff-612e53ca66ee => generated 1242 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:36:42.510997 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-71956b0f-626e-4540-b55b-309942c1d046 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:42.512567 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-71956b0f-626e-4540-b55b-309942c1d046 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:42.527623 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-71956b0f-626e-4540-b55b-309942c1d046 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:42.540747 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-71956b0f-626e-4540-b55b-309942c1d046 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:42.542272 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-71956b0f-626e-4540-b55b-309942c1d046 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:42.542777 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-71956b0f-626e-4540-b55b-309942c1d046 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:42.762729 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-71956b0f-626e-4540-b55b-309942c1d046 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:42.775399 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-71956b0f-626e-4540-b55b-309942c1d046 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:42.790253 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-71956b0f-626e-4540-b55b-309942c1d046 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:42.792617 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-71956b0f-626e-4540-b55b-309942c1d046 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.286735 Jun 05 08:36:42.800635 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1365/2813] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:42 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:36:43.025799 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f6a998f6-6046-4f3f-982b-d2e284f5ea14 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:43.026618 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f6a998f6-6046-4f3f-982b-d2e284f5ea14 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] [instance: d98801d3-531c-4f81-8fff-612e53ca66ee] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:43.052617 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f6a998f6-6046-4f3f-982b-d2e284f5ea14 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:43.054333 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f6a998f6-6046-4f3f-982b-d2e284f5ea14 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:43.055731 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f6a998f6-6046-4f3f-982b-d2e284f5ea14 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:43.062356 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f6a998f6-6046-4f3f-982b-d2e284f5ea14 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:43.165485 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f6a998f6-6046-4f3f-982b-d2e284f5ea14 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:43.166113 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f6a998f6-6046-4f3f-982b-d2e284f5ea14 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:43.166700 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-f6a998f6-6046-4f3f-982b-d2e284f5ea14 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lazy-loading 'fault' on Instance uuid d98801d3-531c-4f81-8fff-612e53ca66ee {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:36:43.255782 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f6a998f6-6046-4f3f-982b-d2e284f5ea14 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec9e7d852134c96a9ce8b6f5b4e6ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12256b2ca66f4ea7a2eafc2dbc305caf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:43.272199 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f6a998f6-6046-4f3f-982b-d2e284f5ea14 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] 10.222.0.33 "GET /compute/v2.1/servers/d98801d3-531c-4f81-8fff-612e53ca66ee" status: 200 len: 1315 microversion: 2.1 time: 0.248453 Jun 05 08:36:43.273196 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1449/2814] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:36:43 2022] GET /compute/v2.1/servers/d98801d3-531c-4f81-8fff-612e53ca66ee => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:36:43.290731 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4d79bf6e-357f-449c-8654-b0f9d1c886df tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:43.291601 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4d79bf6e-357f-449c-8654-b0f9d1c886df tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] [instance: d98801d3-531c-4f81-8fff-612e53ca66ee] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:43.322047 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4d79bf6e-357f-449c-8654-b0f9d1c886df tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:43.322500 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4d79bf6e-357f-449c-8654-b0f9d1c886df tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:43.323286 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4d79bf6e-357f-449c-8654-b0f9d1c886df tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:43.324182 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4d79bf6e-357f-449c-8654-b0f9d1c886df tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:43.418197 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4d79bf6e-357f-449c-8654-b0f9d1c886df tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] [instance: d98801d3-531c-4f81-8fff-612e53ca66ee] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:36:43.578835 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4d79bf6e-357f-449c-8654-b0f9d1c886df tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] [instance: d98801d3-531c-4f81-8fff-612e53ca66ee] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:36:43.582462 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4d79bf6e-357f-449c-8654-b0f9d1c886df tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:43.582982 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4d79bf6e-357f-449c-8654-b0f9d1c886df tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:43.583434 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-4d79bf6e-357f-449c-8654-b0f9d1c886df tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] [instance: d98801d3-531c-4f81-8fff-612e53ca66ee] instance's host None is down, deleting from database Jun 05 08:36:43.593185 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-4d79bf6e-357f-449c-8654-b0f9d1c886df tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] [instance: d98801d3-531c-4f81-8fff-612e53ca66ee] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:36:43.822749 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e5609986-5f0b-425e-9279-d50c5e4b4e2f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:43.823380 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e5609986-5f0b-425e-9279-d50c5e4b4e2f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:43.851961 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e5609986-5f0b-425e-9279-d50c5e4b4e2f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:43.853420 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e5609986-5f0b-425e-9279-d50c5e4b4e2f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:43.859406 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e5609986-5f0b-425e-9279-d50c5e4b4e2f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:43.859867 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e5609986-5f0b-425e-9279-d50c5e4b4e2f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:44.329094 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e5609986-5f0b-425e-9279-d50c5e4b4e2f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:44.329725 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-4d79bf6e-357f-449c-8654-b0f9d1c886df tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] [instance: d98801d3-531c-4f81-8fff-612e53ca66ee] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:36:44.336237 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-4d79bf6e-357f-449c-8654-b0f9d1c886df tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] [instance: d98801d3-531c-4f81-8fff-612e53ca66ee] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:36:44.343890 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e5609986-5f0b-425e-9279-d50c5e4b4e2f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:44.362453 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e5609986-5f0b-425e-9279-d50c5e4b4e2f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:44.378672 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e5609986-5f0b-425e-9279-d50c5e4b4e2f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.560144 Jun 05 08:36:44.389282 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1450/2815] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:43 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:36:44.661127 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-68b3d92e-a70c-41c0-814c-7c1fdc739281 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Action: 'create', calling method: .version_select at 0x7f2432dcda60>, body: {"keypair": {"name": "tempest-keypair-590064180", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4OZ3itNHb9TPZQHApj8SG0RYQ2rnOApSaI3XcAELXnw6bswgjmXz62Ugfh+Hk7qyWgxJ1P5bRh3G5IXaJLcp+hktiYtuezjStsrbELY2/PieqA3MSfXwVkbM27ReUXXw=="}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:36:44.703593 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-68b3d92e-a70c-41c0-814c-7c1fdc739281 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Getting quotas for project 9556f4ca2eea4506a818af2bb11d5712. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:36:44.718219 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-68b3d92e-a70c-41c0-814c-7c1fdc739281 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Getting quotas for user 2d89719976f64c22bf4d9b7248da4804 and project 9556f4ca2eea4506a818af2bb11d5712. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:36:44.813496 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-68b3d92e-a70c-41c0-814c-7c1fdc739281 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.422790 Jun 05 08:36:44.821757 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1451/2816] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:36:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:36:44.836869 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4d79bf6e-357f-449c-8654-b0f9d1c886df tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d98801d3-531c-4f81-8fff-612e53ca66ee" status: 204 len: 0 microversion: 2.1 time: 1.550581 Jun 05 08:36:44.841469 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1366/2817] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:36:43 2022] DELETE /compute/v2.1/servers/d98801d3-531c-4f81-8fff-612e53ca66ee => generated 0 bytes in 1553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:36:44.848321 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ad1481a3-7eb8-4fbc-a92c-a1c6617ea919 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:44.849174 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ad1481a3-7eb8-4fbc-a92c-a1c6617ea919 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] [instance: d98801d3-531c-4f81-8fff-612e53ca66ee] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:44.864695 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ad1481a3-7eb8-4fbc-a92c-a1c6617ea919 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:44.865629 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ad1481a3-7eb8-4fbc-a92c-a1c6617ea919 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:44.872541 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ad1481a3-7eb8-4fbc-a92c-a1c6617ea919 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:44.873245 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ad1481a3-7eb8-4fbc-a92c-a1c6617ea919 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:44.906262 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-ad1481a3-7eb8-4fbc-a92c-a1c6617ea919 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] HTTP exception thrown: Instance d98801d3-531c-4f81-8fff-612e53ca66ee could not be found. Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ad1481a3-7eb8-4fbc-a92c-a1c6617ea919 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Request method failure captured: Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/d98801d3-531c-4f81-8fff-612e53ca66ee HTTP/1.1 Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGr4d6Xhz3I4KRqh8RGy36enzlbFIJqAUAv0AdxO88pIqnMI2_OdW7yM8h_K_knqPdXWEO6S9NU-XwJBay-MUyFSCIqPTxvNpABY8OwzIyFv2uGY-tAwsEzFZIb1HnYUh9F16nY2HNbRQcALZy60hoZzOKp5gnJtvSFlM2FoXgJ7ZXk Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 12256b2ca66f4ea7a2eafc2dbc305caf Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-VolumesAdminNegativeTest-352686275 Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/12256b2ca66f4ea7a2eafc2dbc305caf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/12256b2ca66f4ea7a2eafc2dbc305caf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_12256b2ca66f4ea7a2eafc2dbc305caf", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/12256b2ca66f4ea7a2eafc2dbc305caf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-VolumesAdminNegativeTest-352686275 Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 12256b2ca66f4ea7a2eafc2dbc305caf Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-352686275 Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-VolumesAdminNegativeTest-352686275-project Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: dec9e7d852134c96a9ce8b6f5b4e6ea0 Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-VolumesAdminNegativeTest-352686275-project Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance d98801d3-531c-4f81-8fff-612e53ca66ee could not be found. Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'd98801d3-531c-4f81-8fff-612e53ca66ee'} Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d98801d3-531c-4f81-8fff-612e53ca66ee could not be found. Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d98801d3-531c-4f81-8fff-612e53ca66ee could not be found. Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:36:44.908938 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:36:44.913592 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:36:44.913592 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:36:44.913592 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:36:44.913592 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:36:44.913592 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:36:44.913592 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d98801d3-531c-4f81-8fff-612e53ca66ee could not be found. Jun 05 08:36:44.913592 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:36:44.915063 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ad1481a3-7eb8-4fbc-a92c-a1c6617ea919 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Returning 404 to user: Instance d98801d3-531c-4f81-8fff-612e53ca66ee could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:36:44.916311 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ad1481a3-7eb8-4fbc-a92c-a1c6617ea919 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] 10.222.0.33 "GET /compute/v2.1/servers/d98801d3-531c-4f81-8fff-612e53ca66ee" status: 404 len: 111 microversion: 2.1 time: 0.073006 Jun 05 08:36:44.919940 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1452/2818] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:36:44 2022] GET /compute/v2.1/servers/d98801d3-531c-4f81-8fff-612e53ca66ee => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:36:45.149044 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a7cf5b6b-7020-4bcf-baec-1869eeafb0ea tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-21841340", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "cf8b6d10-455b-41ec-9179-b06740a3fc45"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:36:45.251349 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-a7cf5b6b-7020-4bcf-baec-1869eeafb0ea tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] validate_networks() for [('cf8b6d10-455b-41ec-9179-b06740a3fc45', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:36:45.399571 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-728f0de1-895b-4542-94b0-437e048110da tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:45.401097 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-728f0de1-895b-4542-94b0-437e048110da tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:45.424325 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-728f0de1-895b-4542-94b0-437e048110da tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:45.427023 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-728f0de1-895b-4542-94b0-437e048110da tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:45.427994 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-728f0de1-895b-4542-94b0-437e048110da tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:45.429091 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-728f0de1-895b-4542-94b0-437e048110da tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:45.655035 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-728f0de1-895b-4542-94b0-437e048110da tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:45.675559 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-728f0de1-895b-4542-94b0-437e048110da tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:45.676918 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-728f0de1-895b-4542-94b0-437e048110da tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:45.685968 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-728f0de1-895b-4542-94b0-437e048110da tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.290569 Jun 05 08:36:45.687256 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1453/2819] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:45 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:36:46.706560 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2e93c52b-6645-433e-af43-1c320bbbf48e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:46.707345 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2e93c52b-6645-433e-af43-1c320bbbf48e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:46.740111 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2e93c52b-6645-433e-af43-1c320bbbf48e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:46.744104 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2e93c52b-6645-433e-af43-1c320bbbf48e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:46.748009 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2e93c52b-6645-433e-af43-1c320bbbf48e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:46.750270 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2e93c52b-6645-433e-af43-1c320bbbf48e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:47.123803 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-a7cf5b6b-7020-4bcf-baec-1869eeafb0ea tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:36:47.124409 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-a7cf5b6b-7020-4bcf-baec-1869eeafb0ea tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:36:47.124901 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-a7cf5b6b-7020-4bcf-baec-1869eeafb0ea tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:36:47.125450 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-a7cf5b6b-7020-4bcf-baec-1869eeafb0ea tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:36:47.128531 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-a7cf5b6b-7020-4bcf-baec-1869eeafb0ea tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:36:47.131127 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:36:47.165731 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a7cf5b6b-7020-4bcf-baec-1869eeafb0ea tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:47.169428 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a7cf5b6b-7020-4bcf-baec-1869eeafb0ea tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:47.173117 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a7cf5b6b-7020-4bcf-baec-1869eeafb0ea tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:47.174839 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a7cf5b6b-7020-4bcf-baec-1869eeafb0ea tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:47.208000 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-a7cf5b6b-7020-4bcf-baec-1869eeafb0ea tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Getting quotas for project 12256b2ca66f4ea7a2eafc2dbc305caf. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:36:47.210970 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2e93c52b-6645-433e-af43-1c320bbbf48e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:47.215508 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-a7cf5b6b-7020-4bcf-baec-1869eeafb0ea tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Getting quotas for user dec9e7d852134c96a9ce8b6f5b4e6ea0 and project 12256b2ca66f4ea7a2eafc2dbc305caf. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:36:47.233063 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2e93c52b-6645-433e-af43-1c320bbbf48e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:47.239133 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2e93c52b-6645-433e-af43-1c320bbbf48e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:47.242285 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a7cf5b6b-7020-4bcf-baec-1869eeafb0ea tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:36:47.243201 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2e93c52b-6645-433e-af43-1c320bbbf48e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.541202 Jun 05 08:36:47.247414 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1454/2820] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:46 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:36:47.254863 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a7cf5b6b-7020-4bcf-baec-1869eeafb0ea tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] [instance: 3dcc6314-1320-474f-af4b-be632134f919] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:36:47.425088 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a7cf5b6b-7020-4bcf-baec-1869eeafb0ea tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.280245 Jun 05 08:36:47.428661 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1367/2821] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:36:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:36:47.440349 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-54eb921c-1306-4254-ba9f-ed195ba6d0f0 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:47.441278 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-54eb921c-1306-4254-ba9f-ed195ba6d0f0 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] [instance: 3dcc6314-1320-474f-af4b-be632134f919] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:47.606069 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-54eb921c-1306-4254-ba9f-ed195ba6d0f0 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec9e7d852134c96a9ce8b6f5b4e6ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12256b2ca66f4ea7a2eafc2dbc305caf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:47.616671 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-54eb921c-1306-4254-ba9f-ed195ba6d0f0 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] 10.222.0.33 "GET /compute/v2.1/servers/3dcc6314-1320-474f-af4b-be632134f919" status: 200 len: 1216 microversion: 2.1 time: 0.181138 Jun 05 08:36:47.628733 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1455/2822] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:36:47 2022] GET /compute/v2.1/servers/3dcc6314-1320-474f-af4b-be632134f919 => generated 1216 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:36:48.289420 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3a651bc1-b800-4bb6-8665-1d3ab1335405 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:48.291593 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3a651bc1-b800-4bb6-8665-1d3ab1335405 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:48.320929 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3a651bc1-b800-4bb6-8665-1d3ab1335405 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:48.321386 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3a651bc1-b800-4bb6-8665-1d3ab1335405 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:48.327195 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3a651bc1-b800-4bb6-8665-1d3ab1335405 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:48.327695 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3a651bc1-b800-4bb6-8665-1d3ab1335405 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:48.634793 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-48062d02-9461-4a33-bd15-7a5f7e9b5964 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:48.637019 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-48062d02-9461-4a33-bd15-7a5f7e9b5964 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] [instance: 3dcc6314-1320-474f-af4b-be632134f919] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:48.653823 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-48062d02-9461-4a33-bd15-7a5f7e9b5964 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:48.656452 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-48062d02-9461-4a33-bd15-7a5f7e9b5964 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:48.663136 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-48062d02-9461-4a33-bd15-7a5f7e9b5964 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:48.663936 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-48062d02-9461-4a33-bd15-7a5f7e9b5964 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:48.801387 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3a651bc1-b800-4bb6-8665-1d3ab1335405 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:48.818278 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-48062d02-9461-4a33-bd15-7a5f7e9b5964 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:48.818746 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-48062d02-9461-4a33-bd15-7a5f7e9b5964 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:48.819217 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-48062d02-9461-4a33-bd15-7a5f7e9b5964 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lazy-loading 'fault' on Instance uuid 3dcc6314-1320-474f-af4b-be632134f919 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:36:48.825305 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3a651bc1-b800-4bb6-8665-1d3ab1335405 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:48.833759 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3a651bc1-b800-4bb6-8665-1d3ab1335405 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:48.841360 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3a651bc1-b800-4bb6-8665-1d3ab1335405 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.568725 Jun 05 08:36:48.847054 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1368/2823] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:48 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:36:49.223543 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3fad9cc6-1961-4608-8fc5-516560ba1e4e tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1389410403", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": "none"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:36:49.336528 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-3fad9cc6-1961-4608-8fc5-516560ba1e4e tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:36:49.337249 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-3fad9cc6-1961-4608-8fc5-516560ba1e4e tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:36:49.337747 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-3fad9cc6-1961-4608-8fc5-516560ba1e4e tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:36:49.338166 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-3fad9cc6-1961-4608-8fc5-516560ba1e4e tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:36:49.338587 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-3fad9cc6-1961-4608-8fc5-516560ba1e4e tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:36:49.351336 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3fad9cc6-1961-4608-8fc5-516560ba1e4e tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:49.352305 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3fad9cc6-1961-4608-8fc5-516560ba1e4e tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:49.354704 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3fad9cc6-1961-4608-8fc5-516560ba1e4e tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:49.356179 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-3fad9cc6-1961-4608-8fc5-516560ba1e4e tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:49.380732 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-3fad9cc6-1961-4608-8fc5-516560ba1e4e tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Getting quotas for project 69db15f1c4e94b0dbef131d8d8911872. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:36:49.388204 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-3fad9cc6-1961-4608-8fc5-516560ba1e4e tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Getting quotas for user 9ed1965f383a4d3b97fb4ebe824cc6a7 and project 69db15f1c4e94b0dbef131d8d8911872. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:36:49.404947 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3fad9cc6-1961-4608-8fc5-516560ba1e4e tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:36:49.408503 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3fad9cc6-1961-4608-8fc5-516560ba1e4e tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] [instance: b798ee01-126a-4c5a-9951-6bc84bd2a4bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:36:49.502481 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3fad9cc6-1961-4608-8fc5-516560ba1e4e tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.583791 Jun 05 08:36:49.507110 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1369/2824] 10.222.0.33 () {62 vars in 1187 bytes} [Sun Jun 5 08:36:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 05 08:36:49.631328 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-48062d02-9461-4a33-bd15-7a5f7e9b5964 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec9e7d852134c96a9ce8b6f5b4e6ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12256b2ca66f4ea7a2eafc2dbc305caf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:49.647515 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-48062d02-9461-4a33-bd15-7a5f7e9b5964 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] 10.222.0.33 "GET /compute/v2.1/servers/3dcc6314-1320-474f-af4b-be632134f919" status: 200 len: 1289 microversion: 2.1 time: 1.016534 Jun 05 08:36:49.668470 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1456/2825] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:36:48 2022] GET /compute/v2.1/servers/3dcc6314-1320-474f-af4b-be632134f919 => generated 1289 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:36:49.689807 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a4433ef2-8c6b-4384-9d01-be6ebcdca2a5 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:49.690490 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a4433ef2-8c6b-4384-9d01-be6ebcdca2a5 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] [instance: b798ee01-126a-4c5a-9951-6bc84bd2a4bf] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:49.720521 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-49a89d73-f4df-45e6-9d55-e439171919c0 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1414023643", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "c34877a1-88bc-46ae-9009-0e216afe8e33"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:36:49.829576 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a4433ef2-8c6b-4384-9d01-be6ebcdca2a5 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed1965f383a4d3b97fb4ebe824cc6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69db15f1c4e94b0dbef131d8d8911872', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:49.841399 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a4433ef2-8c6b-4384-9d01-be6ebcdca2a5 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ed1965f383a4d3b97fb4ebe824cc6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69db15f1c4e94b0dbef131d8d8911872', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:49.846800 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a4433ef2-8c6b-4384-9d01-be6ebcdca2a5 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ed1965f383a4d3b97fb4ebe824cc6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69db15f1c4e94b0dbef131d8d8911872', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:49.851099 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-49a89d73-f4df-45e6-9d55-e439171919c0 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] validate_networks() for [('c34877a1-88bc-46ae-9009-0e216afe8e33', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:36:49.851480 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a4433ef2-8c6b-4384-9d01-be6ebcdca2a5 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] 10.222.0.33 "GET /compute/v2.1/servers/b798ee01-126a-4c5a-9951-6bc84bd2a4bf" status: 200 len: 1278 microversion: 2.54 time: 0.179927 Jun 05 08:36:49.866769 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1457/2826] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:49 2022] GET /compute/v2.1/servers/b798ee01-126a-4c5a-9951-6bc84bd2a4bf => generated 1278 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:36:49.880141 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7a6d2847-a803-4f46-8719-9a49ec670590 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:49.881349 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7a6d2847-a803-4f46-8719-9a49ec670590 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] [instance: 3dcc6314-1320-474f-af4b-be632134f919] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:49.904603 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7a6d2847-a803-4f46-8719-9a49ec670590 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:49.905620 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7a6d2847-a803-4f46-8719-9a49ec670590 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:49.908722 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7a6d2847-a803-4f46-8719-9a49ec670590 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:49.909958 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7a6d2847-a803-4f46-8719-9a49ec670590 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:49.982303 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7a6d2847-a803-4f46-8719-9a49ec670590 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] [instance: 3dcc6314-1320-474f-af4b-be632134f919] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:36:50.107768 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7a6d2847-a803-4f46-8719-9a49ec670590 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] [instance: 3dcc6314-1320-474f-af4b-be632134f919] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:36:50.111731 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7a6d2847-a803-4f46-8719-9a49ec670590 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:50.112549 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7a6d2847-a803-4f46-8719-9a49ec670590 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:50.113197 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-7a6d2847-a803-4f46-8719-9a49ec670590 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] [instance: 3dcc6314-1320-474f-af4b-be632134f919] instance's host None is down, deleting from database Jun 05 08:36:50.121717 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-7a6d2847-a803-4f46-8719-9a49ec670590 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] [instance: 3dcc6314-1320-474f-af4b-be632134f919] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:36:50.183641 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-7a6d2847-a803-4f46-8719-9a49ec670590 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] [instance: 3dcc6314-1320-474f-af4b-be632134f919] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:36:50.190943 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-7a6d2847-a803-4f46-8719-9a49ec670590 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] [instance: 3dcc6314-1320-474f-af4b-be632134f919] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:36:50.414008 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:36:50.523244 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=70,nova_cell0:UPDATE=24,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:36:50.535457 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7a6d2847-a803-4f46-8719-9a49ec670590 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3dcc6314-1320-474f-af4b-be632134f919" status: 204 len: 0 microversion: 2.1 time: 0.666616 Jun 05 08:36:50.536226 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1458/2827] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:36:49 2022] DELETE /compute/v2.1/servers/3dcc6314-1320-474f-af4b-be632134f919 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:36:50.544084 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d7d4751f-4628-4486-a748-b3a737108e2e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:50.545002 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d7d4751f-4628-4486-a748-b3a737108e2e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:50.553634 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d7d4751f-4628-4486-a748-b3a737108e2e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:50.554235 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d7d4751f-4628-4486-a748-b3a737108e2e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:50.555460 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d7d4751f-4628-4486-a748-b3a737108e2e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:50.556643 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d7d4751f-4628-4486-a748-b3a737108e2e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:50.673043 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d7d4751f-4628-4486-a748-b3a737108e2e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:50.714194 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d7d4751f-4628-4486-a748-b3a737108e2e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:50.716474 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d7d4751f-4628-4486-a748-b3a737108e2e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:50.718012 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d7d4751f-4628-4486-a748-b3a737108e2e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.180679 Jun 05 08:36:50.719187 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1459/2828] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:50 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:36:50.735776 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8e498e35-898e-4ea1-9088-fb5ad1ca39e7 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:50.736512 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8e498e35-898e-4ea1-9088-fb5ad1ca39e7 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] [instance: 3dcc6314-1320-474f-af4b-be632134f919] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:50.755338 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8e498e35-898e-4ea1-9088-fb5ad1ca39e7 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:50.757843 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8e498e35-898e-4ea1-9088-fb5ad1ca39e7 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:50.758859 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8e498e35-898e-4ea1-9088-fb5ad1ca39e7 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:50.761702 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8e498e35-898e-4ea1-9088-fb5ad1ca39e7 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:50.800571 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-8e498e35-898e-4ea1-9088-fb5ad1ca39e7 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] HTTP exception thrown: Instance 3dcc6314-1320-474f-af4b-be632134f919 could not be found. Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8e498e35-898e-4ea1-9088-fb5ad1ca39e7 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Request method failure captured: Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/3dcc6314-1320-474f-af4b-be632134f919 HTTP/1.1 Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGr4d6Xhz3I4KRqh8RGy36enzlbFIJqAUAv0AdxO88pIqnMI2_OdW7yM8h_K_knqPdXWEO6S9NU-XwJBay-MUyFSCIqPTxvNpABY8OwzIyFv2uGY-tAwsEzFZIb1HnYUh9F16nY2HNbRQcALZy60hoZzOKp5gnJtvSFlM2FoXgJ7ZXk Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 12256b2ca66f4ea7a2eafc2dbc305caf Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-VolumesAdminNegativeTest-352686275 Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/12256b2ca66f4ea7a2eafc2dbc305caf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/12256b2ca66f4ea7a2eafc2dbc305caf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_12256b2ca66f4ea7a2eafc2dbc305caf", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/12256b2ca66f4ea7a2eafc2dbc305caf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-VolumesAdminNegativeTest-352686275 Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 12256b2ca66f4ea7a2eafc2dbc305caf Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-352686275 Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-VolumesAdminNegativeTest-352686275-project Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: dec9e7d852134c96a9ce8b6f5b4e6ea0 Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-VolumesAdminNegativeTest-352686275-project Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 3dcc6314-1320-474f-af4b-be632134f919 could not be found. Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '3dcc6314-1320-474f-af4b-be632134f919'} Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dcc6314-1320-474f-af4b-be632134f919 could not be found. Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dcc6314-1320-474f-af4b-be632134f919 could not be found. Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:36:50.802444 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:36:50.806236 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:36:50.806236 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:36:50.806236 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:36:50.806236 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:36:50.806236 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:36:50.806236 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dcc6314-1320-474f-af4b-be632134f919 could not be found. Jun 05 08:36:50.806236 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:36:50.807745 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8e498e35-898e-4ea1-9088-fb5ad1ca39e7 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Returning 404 to user: Instance 3dcc6314-1320-474f-af4b-be632134f919 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:36:50.810722 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8e498e35-898e-4ea1-9088-fb5ad1ca39e7 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] 10.222.0.33 "GET /compute/v2.1/servers/3dcc6314-1320-474f-af4b-be632134f919" status: 404 len: 111 microversion: 2.1 time: 0.090278 Jun 05 08:36:50.816102 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1460/2829] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:36:50 2022] GET /compute/v2.1/servers/3dcc6314-1320-474f-af4b-be632134f919 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:36:50.828533 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-494cacff-ec12-46d6-bd8f-dc632637b893 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] Calling method '.version_select at 0x7f24337ae9d0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:50.875704 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-494cacff-ec12-46d6-bd8f-dc632637b893 tempest-VolumesAdminNegativeTest-352686275 tempest-VolumesAdminNegativeTest-352686275-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1368950302" status: 202 len: 0 microversion: 2.1 time: 0.050928 Jun 05 08:36:50.879338 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1461/2830] 10.222.0.33 () {58 vars in 1220 bytes} [Sun Jun 5 08:36:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1368950302 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 05 08:36:50.888998 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-51c7fae0-f525-4afa-8e2c-bdac5e50a14a tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:50.892283 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-51c7fae0-f525-4afa-8e2c-bdac5e50a14a tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] [instance: b798ee01-126a-4c5a-9951-6bc84bd2a4bf] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:50.908305 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-51c7fae0-f525-4afa-8e2c-bdac5e50a14a tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:50.908830 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-51c7fae0-f525-4afa-8e2c-bdac5e50a14a tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:50.909711 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-51c7fae0-f525-4afa-8e2c-bdac5e50a14a tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:50.912815 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-51c7fae0-f525-4afa-8e2c-bdac5e50a14a tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:51.025998 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-51c7fae0-f525-4afa-8e2c-bdac5e50a14a tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:51.029935 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-51c7fae0-f525-4afa-8e2c-bdac5e50a14a tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:51.030462 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-51c7fae0-f525-4afa-8e2c-bdac5e50a14a tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Lazy-loading 'fault' on Instance uuid b798ee01-126a-4c5a-9951-6bc84bd2a4bf {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:36:51.644122 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-49a89d73-f4df-45e6-9d55-e439171919c0 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:36:51.652664 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-49a89d73-f4df-45e6-9d55-e439171919c0 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:36:51.654645 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-49a89d73-f4df-45e6-9d55-e439171919c0 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:36:51.657103 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-49a89d73-f4df-45e6-9d55-e439171919c0 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:36:51.659902 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-49a89d73-f4df-45e6-9d55-e439171919c0 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:36:51.711114 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-49a89d73-f4df-45e6-9d55-e439171919c0 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:51.718960 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-49a89d73-f4df-45e6-9d55-e439171919c0 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:51.722871 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-49a89d73-f4df-45e6-9d55-e439171919c0 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:51.728368 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-49a89d73-f4df-45e6-9d55-e439171919c0 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:51.783567 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-49a89d73-f4df-45e6-9d55-e439171919c0 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Getting quotas for project 4920c7802386444ea253c63fcb5ac8d3. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:36:51.801422 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-49a89d73-f4df-45e6-9d55-e439171919c0 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Getting quotas for user 3351e9bc16af40a7b21927921d327989 and project 4920c7802386444ea253c63fcb5ac8d3. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:36:51.834054 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-49a89d73-f4df-45e6-9d55-e439171919c0 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:36:51.841920 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-49a89d73-f4df-45e6-9d55-e439171919c0 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] [instance: 9d2a8713-976c-442e-a66f-2d3e0ca83b3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:36:51.951592 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-49a89d73-f4df-45e6-9d55-e439171919c0 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.441763 Jun 05 08:36:51.952530 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1370/2831] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:36:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:36:51.970431 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-79718973-b024-49c2-be79-567e8aa318bc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:51.971071 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-79718973-b024-49c2-be79-567e8aa318bc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:52.004877 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-51c7fae0-f525-4afa-8e2c-bdac5e50a14a tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ed1965f383a4d3b97fb4ebe824cc6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69db15f1c4e94b0dbef131d8d8911872', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:52.014378 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-79718973-b024-49c2-be79-567e8aa318bc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:52.019920 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-79718973-b024-49c2-be79-567e8aa318bc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:52.023670 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-79718973-b024-49c2-be79-567e8aa318bc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:52.026092 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-51c7fae0-f525-4afa-8e2c-bdac5e50a14a tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ed1965f383a4d3b97fb4ebe824cc6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69db15f1c4e94b0dbef131d8d8911872', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:52.027043 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-79718973-b024-49c2-be79-567e8aa318bc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:52.030166 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-51c7fae0-f525-4afa-8e2c-bdac5e50a14a tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ed1965f383a4d3b97fb4ebe824cc6a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69db15f1c4e94b0dbef131d8d8911872', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:52.040221 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-51c7fae0-f525-4afa-8e2c-bdac5e50a14a tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] 10.222.0.33 "GET /compute/v2.1/servers/b798ee01-126a-4c5a-9951-6bc84bd2a4bf" status: 200 len: 1351 microversion: 2.54 time: 1.158420 Jun 05 08:36:52.046769 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1462/2832] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:50 2022] GET /compute/v2.1/servers/b798ee01-126a-4c5a-9951-6bc84bd2a4bf => generated 1351 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:36:52.058660 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8a8b41b1-740d-4e1b-9196-cf4a8406beb0 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:52.063948 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8a8b41b1-740d-4e1b-9196-cf4a8406beb0 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] [instance: 9d2a8713-976c-442e-a66f-2d3e0ca83b3e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:52.564510 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-8a8b41b1-740d-4e1b-9196-cf4a8406beb0 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3351e9bc16af40a7b21927921d327989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4920c7802386444ea253c63fcb5ac8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:52.572192 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8a8b41b1-740d-4e1b-9196-cf4a8406beb0 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] 10.222.0.33 "GET /compute/v2.1/servers/9d2a8713-976c-442e-a66f-2d3e0ca83b3e" status: 200 len: 1224 microversion: 2.1 time: 0.522566 Jun 05 08:36:52.580409 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1463/2833] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:36:52 2022] GET /compute/v2.1/servers/9d2a8713-976c-442e-a66f-2d3e0ca83b3e => generated 1224 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:36:52.586947 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-dc7f1f5d-5024-46fa-b75f-d0905b91ffd5 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:52.596900 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-dc7f1f5d-5024-46fa-b75f-d0905b91ffd5 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] [instance: b798ee01-126a-4c5a-9951-6bc84bd2a4bf] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:52.603264 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-79718973-b024-49c2-be79-567e8aa318bc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:52.613170 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-79718973-b024-49c2-be79-567e8aa318bc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:52.614715 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-79718973-b024-49c2-be79-567e8aa318bc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:52.615973 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-79718973-b024-49c2-be79-567e8aa318bc tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.662688 Jun 05 08:36:52.630022 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1371/2834] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:51 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:36:52.630931 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dc7f1f5d-5024-46fa-b75f-d0905b91ffd5 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:52.637102 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dc7f1f5d-5024-46fa-b75f-d0905b91ffd5 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:52.638331 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dc7f1f5d-5024-46fa-b75f-d0905b91ffd5 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:52.643880 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dc7f1f5d-5024-46fa-b75f-d0905b91ffd5 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:52.714183 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e8b805e9-6c65-4d4f-ba6b-ddd1378cd820 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-468843822", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "820c8fba-7d8b-4aaf-95a7-62ce3a6f35e4"}], "security_groups": [{"name": "tempest-securitygroup--906591604"}], "key_name": "tempest-keypair-590064180", "user_data": "}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:36:52.730115 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-dc7f1f5d-5024-46fa-b75f-d0905b91ffd5 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] [instance: b798ee01-126a-4c5a-9951-6bc84bd2a4bf] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:36:52.864953 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-dc7f1f5d-5024-46fa-b75f-d0905b91ffd5 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] [instance: b798ee01-126a-4c5a-9951-6bc84bd2a4bf] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:36:52.868438 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dc7f1f5d-5024-46fa-b75f-d0905b91ffd5 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:52.869541 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dc7f1f5d-5024-46fa-b75f-d0905b91ffd5 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:52.871154 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-dc7f1f5d-5024-46fa-b75f-d0905b91ffd5 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] [instance: b798ee01-126a-4c5a-9951-6bc84bd2a4bf] instance's host None is down, deleting from database Jun 05 08:36:52.877158 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-dc7f1f5d-5024-46fa-b75f-d0905b91ffd5 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] [instance: b798ee01-126a-4c5a-9951-6bc84bd2a4bf] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:36:53.019224 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-e8b805e9-6c65-4d4f-ba6b-ddd1378cd820 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] validate_networks() for [('820c8fba-7d8b-4aaf-95a7-62ce3a6f35e4', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:36:53.064776 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-dc7f1f5d-5024-46fa-b75f-d0905b91ffd5 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] [instance: b798ee01-126a-4c5a-9951-6bc84bd2a4bf] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:36:53.077856 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-dc7f1f5d-5024-46fa-b75f-d0905b91ffd5 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] [instance: b798ee01-126a-4c5a-9951-6bc84bd2a4bf] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:36:53.393417 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-dc7f1f5d-5024-46fa-b75f-d0905b91ffd5 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b798ee01-126a-4c5a-9951-6bc84bd2a4bf" status: 204 len: 0 microversion: 2.54 time: 0.811821 Jun 05 08:36:53.394260 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1464/2835] 10.222.0.33 () {60 vars in 1279 bytes} [Sun Jun 5 08:36:52 2022] DELETE /compute/v2.1/servers/b798ee01-126a-4c5a-9951-6bc84bd2a4bf => generated 0 bytes in 813 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:36:53.403778 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d47e8f60-84e5-45f4-ac94-6ada1c0299b9 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:53.404616 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d47e8f60-84e5-45f4-ac94-6ada1c0299b9 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] [instance: b798ee01-126a-4c5a-9951-6bc84bd2a4bf] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:53.414819 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d47e8f60-84e5-45f4-ac94-6ada1c0299b9 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:53.415513 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d47e8f60-84e5-45f4-ac94-6ada1c0299b9 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:53.416610 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d47e8f60-84e5-45f4-ac94-6ada1c0299b9 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:53.417938 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d47e8f60-84e5-45f4-ac94-6ada1c0299b9 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:53.438350 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-d47e8f60-84e5-45f4-ac94-6ada1c0299b9 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] HTTP exception thrown: Instance b798ee01-126a-4c5a-9951-6bc84bd2a4bf could not be found. Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d47e8f60-84e5-45f4-ac94-6ada1c0299b9 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Request method failure captured: Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/b798ee01-126a-4c5a-9951-6bc84bd2a4bf HTTP/1.1 Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGsg6rqsVuTuEVjQXoDkLOUC8t2UYgFo7AjhNCFmtoaoWSsl7NjsLLGc5OVotJBRbam5Z5P_8GKKb1XRB2KjogomwCp-44IFrKwM00GNECPPOMLAYY5yJ39kZiSHBxqm9jU1henWRJIXnnLVmDZCSY4OCRcas6Mo9OFOpOCoUKheTgY Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: X-Openstack-Nova-Api-Version: 2.54 Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 69db15f1c4e94b0dbef131d8d8911872 Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ServerShowV254Test-1514597628 Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/69db15f1c4e94b0dbef131d8d8911872"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/69db15f1c4e94b0dbef131d8d8911872"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_69db15f1c4e94b0dbef131d8d8911872", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/69db15f1c4e94b0dbef131d8d8911872"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ServerShowV254Test-1514597628 Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 69db15f1c4e94b0dbef131d8d8911872 Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ServerShowV254Test-1514597628 Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ServerShowV254Test-1514597628-project Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 9ed1965f383a4d3b97fb4ebe824cc6a7 Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ServerShowV254Test-1514597628-project Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance b798ee01-126a-4c5a-9951-6bc84bd2a4bf could not be found. Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'b798ee01-126a-4c5a-9951-6bc84bd2a4bf'} Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b798ee01-126a-4c5a-9951-6bc84bd2a4bf could not be found. Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b798ee01-126a-4c5a-9951-6bc84bd2a4bf could not be found. Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:36:53.440078 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:36:53.443840 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:36:53.443840 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:36:53.443840 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:36:53.443840 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:36:53.443840 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:36:53.443840 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b798ee01-126a-4c5a-9951-6bc84bd2a4bf could not be found. Jun 05 08:36:53.443840 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:36:53.443840 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d47e8f60-84e5-45f4-ac94-6ada1c0299b9 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] Returning 404 to user: Instance b798ee01-126a-4c5a-9951-6bc84bd2a4bf could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:36:53.443840 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d47e8f60-84e5-45f4-ac94-6ada1c0299b9 tempest-ServerShowV254Test-1514597628 tempest-ServerShowV254Test-1514597628-project] 10.222.0.33 "GET /compute/v2.1/servers/b798ee01-126a-4c5a-9951-6bc84bd2a4bf" status: 404 len: 111 microversion: 2.54 time: 0.042766 Jun 05 08:36:53.445154 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1465/2836] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:53 2022] GET /compute/v2.1/servers/b798ee01-126a-4c5a-9951-6bc84bd2a4bf => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 05 08:36:53.593047 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a690efdd-c70b-40e0-bb63-1d9048c444ef tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:53.593908 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a690efdd-c70b-40e0-bb63-1d9048c444ef tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] [instance: 9d2a8713-976c-442e-a66f-2d3e0ca83b3e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:53.615669 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a690efdd-c70b-40e0-bb63-1d9048c444ef tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:53.616547 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a690efdd-c70b-40e0-bb63-1d9048c444ef tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:53.621738 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a690efdd-c70b-40e0-bb63-1d9048c444ef tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:53.622260 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a690efdd-c70b-40e0-bb63-1d9048c444ef tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:53.824223 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a690efdd-c70b-40e0-bb63-1d9048c444ef tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:53.827456 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a690efdd-c70b-40e0-bb63-1d9048c444ef tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:53.827978 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-a690efdd-c70b-40e0-bb63-1d9048c444ef tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Lazy-loading 'fault' on Instance uuid 9d2a8713-976c-442e-a66f-2d3e0ca83b3e {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:36:54.099707 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a690efdd-c70b-40e0-bb63-1d9048c444ef tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3351e9bc16af40a7b21927921d327989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4920c7802386444ea253c63fcb5ac8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:54.110395 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a690efdd-c70b-40e0-bb63-1d9048c444ef tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] 10.222.0.33 "GET /compute/v2.1/servers/9d2a8713-976c-442e-a66f-2d3e0ca83b3e" status: 200 len: 1297 microversion: 2.1 time: 0.523181 Jun 05 08:36:54.114998 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1466/2837] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:36:53 2022] GET /compute/v2.1/servers/9d2a8713-976c-442e-a66f-2d3e0ca83b3e => generated 1297 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:36:54.123067 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2cb315a4-eb0d-4069-8220-93ec7b703821 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:54.129748 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2cb315a4-eb0d-4069-8220-93ec7b703821 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:54.145043 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2cb315a4-eb0d-4069-8220-93ec7b703821 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:54.145800 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2cb315a4-eb0d-4069-8220-93ec7b703821 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:54.146884 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2cb315a4-eb0d-4069-8220-93ec7b703821 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:54.150420 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2cb315a4-eb0d-4069-8220-93ec7b703821 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:54.421784 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2cb315a4-eb0d-4069-8220-93ec7b703821 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:54.439576 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2cb315a4-eb0d-4069-8220-93ec7b703821 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:54.443244 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2cb315a4-eb0d-4069-8220-93ec7b703821 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:54.451388 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2cb315a4-eb0d-4069-8220-93ec7b703821 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.333881 Jun 05 08:36:54.453637 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1467/2838] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:54 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:36:54.477337 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7a2afc5a-5e50-4bf5-8f3f-df81a2c06f41 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:54.480193 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7a2afc5a-5e50-4bf5-8f3f-df81a2c06f41 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] [instance: 9d2a8713-976c-442e-a66f-2d3e0ca83b3e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:54.496656 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7a2afc5a-5e50-4bf5-8f3f-df81a2c06f41 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:54.497505 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7a2afc5a-5e50-4bf5-8f3f-df81a2c06f41 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:54.498493 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7a2afc5a-5e50-4bf5-8f3f-df81a2c06f41 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:54.499098 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7a2afc5a-5e50-4bf5-8f3f-df81a2c06f41 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:54.502676 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-e8b805e9-6c65-4d4f-ba6b-ddd1378cd820 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:36:54.503271 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-e8b805e9-6c65-4d4f-ba6b-ddd1378cd820 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:36:54.503848 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-e8b805e9-6c65-4d4f-ba6b-ddd1378cd820 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:36:54.504572 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-e8b805e9-6c65-4d4f-ba6b-ddd1378cd820 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:36:54.505204 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-e8b805e9-6c65-4d4f-ba6b-ddd1378cd820 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:36:54.527904 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e8b805e9-6c65-4d4f-ba6b-ddd1378cd820 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:54.528367 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e8b805e9-6c65-4d4f-ba6b-ddd1378cd820 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:54.534427 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7a2afc5a-5e50-4bf5-8f3f-df81a2c06f41 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] [instance: 9d2a8713-976c-442e-a66f-2d3e0ca83b3e] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:36:54.535442 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e8b805e9-6c65-4d4f-ba6b-ddd1378cd820 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:54.536340 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e8b805e9-6c65-4d4f-ba6b-ddd1378cd820 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:54.562200 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-e8b805e9-6c65-4d4f-ba6b-ddd1378cd820 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Getting quotas for project 9556f4ca2eea4506a818af2bb11d5712. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:36:54.568386 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-e8b805e9-6c65-4d4f-ba6b-ddd1378cd820 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Getting quotas for user 2d89719976f64c22bf4d9b7248da4804 and project 9556f4ca2eea4506a818af2bb11d5712. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:36:54.590080 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e8b805e9-6c65-4d4f-ba6b-ddd1378cd820 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:36:54.592741 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e8b805e9-6c65-4d4f-ba6b-ddd1378cd820 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] [instance: 27a27f33-fb21-4f5b-8df7-1a716eb87b03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:36:54.655815 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7a2afc5a-5e50-4bf5-8f3f-df81a2c06f41 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] [instance: 9d2a8713-976c-442e-a66f-2d3e0ca83b3e] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:36:54.656929 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7a2afc5a-5e50-4bf5-8f3f-df81a2c06f41 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:54.657409 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7a2afc5a-5e50-4bf5-8f3f-df81a2c06f41 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:54.661393 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-7a2afc5a-5e50-4bf5-8f3f-df81a2c06f41 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] [instance: 9d2a8713-976c-442e-a66f-2d3e0ca83b3e] instance's host None is down, deleting from database Jun 05 08:36:54.669549 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-7a2afc5a-5e50-4bf5-8f3f-df81a2c06f41 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] [instance: 9d2a8713-976c-442e-a66f-2d3e0ca83b3e] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:36:54.677366 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e8b805e9-6c65-4d4f-ba6b-ddd1378cd820 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.967603 Jun 05 08:36:54.684585 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1372/2839] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:36:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 1975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 05 08:36:54.692574 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4a1e3677-7a81-4311-bcc5-ccb33f7198fe tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:54.693586 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4a1e3677-7a81-4311-bcc5-ccb33f7198fe tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] [instance: 27a27f33-fb21-4f5b-8df7-1a716eb87b03] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:54.883871 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-7a2afc5a-5e50-4bf5-8f3f-df81a2c06f41 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] [instance: 9d2a8713-976c-442e-a66f-2d3e0ca83b3e] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:36:54.892172 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-7a2afc5a-5e50-4bf5-8f3f-df81a2c06f41 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] [instance: 9d2a8713-976c-442e-a66f-2d3e0ca83b3e] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:36:54.933587 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4a1e3677-7a81-4311-bcc5-ccb33f7198fe tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d89719976f64c22bf4d9b7248da4804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9556f4ca2eea4506a818af2bb11d5712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:54.943259 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4a1e3677-7a81-4311-bcc5-ccb33f7198fe tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] 10.222.0.33 "GET /compute/v2.1/servers/27a27f33-fb21-4f5b-8df7-1a716eb87b03" status: 200 len: 1236 microversion: 2.1 time: 0.256775 Jun 05 08:36:54.946308 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1373/2840] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:36:54 2022] GET /compute/v2.1/servers/27a27f33-fb21-4f5b-8df7-1a716eb87b03 => generated 1236 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:36:55.168824 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:UPDATE=25,nova_cell0:DELETE=4,nova_cell0:SELECT=67,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:36:55.324799 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7a2afc5a-5e50-4bf5-8f3f-df81a2c06f41 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9d2a8713-976c-442e-a66f-2d3e0ca83b3e" status: 204 len: 0 microversion: 2.1 time: 0.865767 Jun 05 08:36:55.326521 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1468/2841] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:36:54 2022] DELETE /compute/v2.1/servers/9d2a8713-976c-442e-a66f-2d3e0ca83b3e => generated 0 bytes in 872 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:36:55.334373 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f53396d3-97b7-4694-ba20-f5216666e346 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:55.335370 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f53396d3-97b7-4694-ba20-f5216666e346 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] [instance: 9d2a8713-976c-442e-a66f-2d3e0ca83b3e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:55.372129 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f53396d3-97b7-4694-ba20-f5216666e346 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:55.373662 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f53396d3-97b7-4694-ba20-f5216666e346 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:55.380142 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f53396d3-97b7-4694-ba20-f5216666e346 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:55.380736 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f53396d3-97b7-4694-ba20-f5216666e346 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:55.430597 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-f53396d3-97b7-4694-ba20-f5216666e346 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] HTTP exception thrown: Instance 9d2a8713-976c-442e-a66f-2d3e0ca83b3e could not be found. Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f53396d3-97b7-4694-ba20-f5216666e346 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Request method failure captured: Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/9d2a8713-976c-442e-a66f-2d3e0ca83b3e HTTP/1.1 Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGshQV1YPr2vOI8JhEoP45pS2-ElxBWzh1E0ytMaVQGnYAlOwq474lIxd6oXIJ412ix6-N51SDARYi7QsGhGE_RoT--U6MsQ-Re48CkSFOAsj9dp8X-9rbO2j6W0fxLyjLaIG-elNMqWj9WwrGyy4kUqrEeR3kjmHUCQakY0Zaj-HQI Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 4920c7802386444ea253c63fcb5ac8d3 Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-982327606 Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4920c7802386444ea253c63fcb5ac8d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4920c7802386444ea253c63fcb5ac8d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4920c7802386444ea253c63fcb5ac8d3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4920c7802386444ea253c63fcb5ac8d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-982327606 Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 4920c7802386444ea253c63fcb5ac8d3 Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-982327606 Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ServerMetadataNegativeTestJSON-982327606-project Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 3351e9bc16af40a7b21927921d327989 Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-982327606-project Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 9d2a8713-976c-442e-a66f-2d3e0ca83b3e could not be found. Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '9d2a8713-976c-442e-a66f-2d3e0ca83b3e'} Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d2a8713-976c-442e-a66f-2d3e0ca83b3e could not be found. Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d2a8713-976c-442e-a66f-2d3e0ca83b3e could not be found. Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:36:55.434956 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:36:55.438829 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:36:55.438829 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:36:55.438829 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:36:55.438829 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:36:55.438829 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:36:55.438829 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:36:55.438829 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d2a8713-976c-442e-a66f-2d3e0ca83b3e could not be found. Jun 05 08:36:55.438829 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:36:55.445884 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f53396d3-97b7-4694-ba20-f5216666e346 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] Returning 404 to user: Instance 9d2a8713-976c-442e-a66f-2d3e0ca83b3e could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:36:55.454704 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f53396d3-97b7-4694-ba20-f5216666e346 tempest-ServerMetadataNegativeTestJSON-982327606 tempest-ServerMetadataNegativeTestJSON-982327606-project] 10.222.0.33 "GET /compute/v2.1/servers/9d2a8713-976c-442e-a66f-2d3e0ca83b3e" status: 404 len: 111 microversion: 2.1 time: 0.122348 Jun 05 08:36:55.461212 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1374/2842] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:36:55 2022] GET /compute/v2.1/servers/9d2a8713-976c-442e-a66f-2d3e0ca83b3e => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:36:55.474192 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e1af3ab8-0a03-4468-b792-00b0b496b39c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:55.475068 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e1af3ab8-0a03-4468-b792-00b0b496b39c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:55.491377 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e1af3ab8-0a03-4468-b792-00b0b496b39c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:55.492032 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e1af3ab8-0a03-4468-b792-00b0b496b39c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:55.494424 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e1af3ab8-0a03-4468-b792-00b0b496b39c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:55.496463 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e1af3ab8-0a03-4468-b792-00b0b496b39c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:55.831111 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e1af3ab8-0a03-4468-b792-00b0b496b39c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:55.852204 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e1af3ab8-0a03-4468-b792-00b0b496b39c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:55.853881 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e1af3ab8-0a03-4468-b792-00b0b496b39c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:55.859298 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e1af3ab8-0a03-4468-b792-00b0b496b39c tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.391824 Jun 05 08:36:55.863291 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1469/2843] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:55 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:36:55.998781 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6ccdd42f-7408-4d5a-b10a-10312130ccb9 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:55.999464 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6ccdd42f-7408-4d5a-b10a-10312130ccb9 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] [instance: 27a27f33-fb21-4f5b-8df7-1a716eb87b03] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:56.046288 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6ccdd42f-7408-4d5a-b10a-10312130ccb9 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:56.046747 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6ccdd42f-7408-4d5a-b10a-10312130ccb9 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:56.047515 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6ccdd42f-7408-4d5a-b10a-10312130ccb9 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:56.047952 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6ccdd42f-7408-4d5a-b10a-10312130ccb9 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:56.114817 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6ccdd42f-7408-4d5a-b10a-10312130ccb9 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:56.128222 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6ccdd42f-7408-4d5a-b10a-10312130ccb9 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:56.129330 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-6ccdd42f-7408-4d5a-b10a-10312130ccb9 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lazy-loading 'fault' on Instance uuid 27a27f33-fb21-4f5b-8df7-1a716eb87b03 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:36:56.298783 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6ccdd42f-7408-4d5a-b10a-10312130ccb9 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d89719976f64c22bf4d9b7248da4804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9556f4ca2eea4506a818af2bb11d5712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:56.329220 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6ccdd42f-7408-4d5a-b10a-10312130ccb9 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] 10.222.0.33 "GET /compute/v2.1/servers/27a27f33-fb21-4f5b-8df7-1a716eb87b03" status: 200 len: 1309 microversion: 2.1 time: 0.350861 Jun 05 08:36:56.329873 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1375/2844] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:36:55 2022] GET /compute/v2.1/servers/27a27f33-fb21-4f5b-8df7-1a716eb87b03 => generated 1309 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:36:56.350427 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fec7ce90-72fc-4eea-9ad5-013692555d80 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:56.350914 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-fec7ce90-72fc-4eea-9ad5-013692555d80 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] [instance: 27a27f33-fb21-4f5b-8df7-1a716eb87b03] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:56.366595 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fec7ce90-72fc-4eea-9ad5-013692555d80 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:56.367402 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fec7ce90-72fc-4eea-9ad5-013692555d80 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:56.369001 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fec7ce90-72fc-4eea-9ad5-013692555d80 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:56.371897 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fec7ce90-72fc-4eea-9ad5-013692555d80 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:56.478286 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-fec7ce90-72fc-4eea-9ad5-013692555d80 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] [instance: 27a27f33-fb21-4f5b-8df7-1a716eb87b03] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:36:56.647169 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-fec7ce90-72fc-4eea-9ad5-013692555d80 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] [instance: 27a27f33-fb21-4f5b-8df7-1a716eb87b03] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:36:56.649736 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fec7ce90-72fc-4eea-9ad5-013692555d80 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:56.656569 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fec7ce90-72fc-4eea-9ad5-013692555d80 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:56.658234 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-fec7ce90-72fc-4eea-9ad5-013692555d80 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] [instance: 27a27f33-fb21-4f5b-8df7-1a716eb87b03] instance's host None is down, deleting from database Jun 05 08:36:56.663755 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-fec7ce90-72fc-4eea-9ad5-013692555d80 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] [instance: 27a27f33-fb21-4f5b-8df7-1a716eb87b03] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:36:56.817089 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-fec7ce90-72fc-4eea-9ad5-013692555d80 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] [instance: 27a27f33-fb21-4f5b-8df7-1a716eb87b03] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:36:56.823971 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-fec7ce90-72fc-4eea-9ad5-013692555d80 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] [instance: 27a27f33-fb21-4f5b-8df7-1a716eb87b03] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:36:56.878695 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-59ed464e-29bb-4422-82b5-86bf1c8c58f6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:56.879597 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-59ed464e-29bb-4422-82b5-86bf1c8c58f6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:56.894896 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-59ed464e-29bb-4422-82b5-86bf1c8c58f6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:56.897026 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-59ed464e-29bb-4422-82b5-86bf1c8c58f6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:56.899791 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-59ed464e-29bb-4422-82b5-86bf1c8c58f6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:56.900463 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-59ed464e-29bb-4422-82b5-86bf1c8c58f6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:57.196516 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fec7ce90-72fc-4eea-9ad5-013692555d80 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] 10.222.0.33 "DELETE /compute/v2.1/servers/27a27f33-fb21-4f5b-8df7-1a716eb87b03" status: 204 len: 0 microversion: 2.1 time: 0.850941 Jun 05 08:36:57.202131 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1470/2845] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:36:56 2022] DELETE /compute/v2.1/servers/27a27f33-fb21-4f5b-8df7-1a716eb87b03 => generated 0 bytes in 853 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:36:57.213558 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-51c12c78-5fee-4a93-91c1-690f86602be4 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:57.215710 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-51c12c78-5fee-4a93-91c1-690f86602be4 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] [instance: 27a27f33-fb21-4f5b-8df7-1a716eb87b03] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:57.218295 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-59ed464e-29bb-4422-82b5-86bf1c8c58f6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:57.229335 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-51c12c78-5fee-4a93-91c1-690f86602be4 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:57.233022 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-51c12c78-5fee-4a93-91c1-690f86602be4 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:57.234049 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-51c12c78-5fee-4a93-91c1-690f86602be4 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:57.235776 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-51c12c78-5fee-4a93-91c1-690f86602be4 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:57.237533 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-59ed464e-29bb-4422-82b5-86bf1c8c58f6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:57.246017 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-59ed464e-29bb-4422-82b5-86bf1c8c58f6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:57.254781 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-59ed464e-29bb-4422-82b5-86bf1c8c58f6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.380912 Jun 05 08:36:57.259507 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1376/2846] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:56 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:36:57.267536 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-51c12c78-5fee-4a93-91c1-690f86602be4 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] HTTP exception thrown: Instance 27a27f33-fb21-4f5b-8df7-1a716eb87b03 could not be found. Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-51c12c78-5fee-4a93-91c1-690f86602be4 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Request method failure captured: Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/27a27f33-fb21-4f5b-8df7-1a716eb87b03 HTTP/1.1 Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGsbAEUVOy2z2Qlx-J5bm2rxvYoBcwI9Ybno1u0iXxEPGVYr9fCYpXfebuKjWulQMtvND9ZqwamWPDZUFyn9U1tkEHDFZ9XNGJRBNBp0_xqsX5aFyp75ZFmb2U9q8vCXUvzdc7SjIsqgnvufDteAbcZZPyMSLvespTw1jUFCiIlS3yY Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 9556f4ca2eea4506a818af2bb11d5712 Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-AttachVolumeTestJSON-656999486 Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9556f4ca2eea4506a818af2bb11d5712"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9556f4ca2eea4506a818af2bb11d5712"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9556f4ca2eea4506a818af2bb11d5712", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9556f4ca2eea4506a818af2bb11d5712"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-AttachVolumeTestJSON-656999486 Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 9556f4ca2eea4506a818af2bb11d5712 Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-AttachVolumeTestJSON-656999486 Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-AttachVolumeTestJSON-656999486-project Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 2d89719976f64c22bf4d9b7248da4804 Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-AttachVolumeTestJSON-656999486-project Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 27a27f33-fb21-4f5b-8df7-1a716eb87b03 could not be found. Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '27a27f33-fb21-4f5b-8df7-1a716eb87b03'} Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27a27f33-fb21-4f5b-8df7-1a716eb87b03 could not be found. Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27a27f33-fb21-4f5b-8df7-1a716eb87b03 could not be found. Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:36:57.269316 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:36:57.273868 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:36:57.273868 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:36:57.273868 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:36:57.273868 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:36:57.273868 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:36:57.273868 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27a27f33-fb21-4f5b-8df7-1a716eb87b03 could not be found. Jun 05 08:36:57.273868 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:36:57.282802 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-51c12c78-5fee-4a93-91c1-690f86602be4 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Returning 404 to user: Instance 27a27f33-fb21-4f5b-8df7-1a716eb87b03 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:36:57.285859 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-51c12c78-5fee-4a93-91c1-690f86602be4 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] 10.222.0.33 "GET /compute/v2.1/servers/27a27f33-fb21-4f5b-8df7-1a716eb87b03" status: 404 len: 111 microversion: 2.1 time: 0.080278 Jun 05 08:36:57.287310 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1471/2847] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:36:57 2022] GET /compute/v2.1/servers/27a27f33-fb21-4f5b-8df7-1a716eb87b03 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:36:57.300368 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-202446f4-5ed7-4a5b-97e7-3da8d151fe4b tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Calling method '.version_select at 0x7f2432f1d160>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:57.346580 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-202446f4-5ed7-4a5b-97e7-3da8d151fe4b tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-590064180" status: 202 len: 0 microversion: 2.1 time: 0.050543 Jun 05 08:36:57.356439 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1377/2848] 10.222.0.33 () {58 vars in 1217 bytes} [Sun Jun 5 08:36:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-590064180 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:36:58.280630 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9179f523-b7e7-4143-a081-40e2192acb5d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:58.281875 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9179f523-b7e7-4143-a081-40e2192acb5d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:58.300206 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9179f523-b7e7-4143-a081-40e2192acb5d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:58.302391 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9179f523-b7e7-4143-a081-40e2192acb5d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:58.313421 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9179f523-b7e7-4143-a081-40e2192acb5d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:58.314294 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9179f523-b7e7-4143-a081-40e2192acb5d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:58.511785 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-9179f523-b7e7-4143-a081-40e2192acb5d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:58.530001 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-9179f523-b7e7-4143-a081-40e2192acb5d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:58.532938 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-9179f523-b7e7-4143-a081-40e2192acb5d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:58.534349 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9179f523-b7e7-4143-a081-40e2192acb5d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.259777 Jun 05 08:36:58.538194 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1472/2849] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:58 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:36:59.560215 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f21ae107-5f8a-4938-88e5-f997e068785a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:36:59.561463 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f21ae107-5f8a-4938-88e5-f997e068785a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:36:59.575178 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f21ae107-5f8a-4938-88e5-f997e068785a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:59.576619 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f21ae107-5f8a-4938-88e5-f997e068785a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:59.578485 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f21ae107-5f8a-4938-88e5-f997e068785a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:36:59.580798 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f21ae107-5f8a-4938-88e5-f997e068785a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:36:59.847023 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f21ae107-5f8a-4938-88e5-f997e068785a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:59.863945 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f21ae107-5f8a-4938-88e5-f997e068785a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:59.869364 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f21ae107-5f8a-4938-88e5-f997e068785a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:36:59.871226 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f21ae107-5f8a-4938-88e5-f997e068785a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.318040 Jun 05 08:36:59.875373 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1378/2850] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:36:59 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:37:00.623284 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-63de22a1-29f2-4008-81e2-23323efc3409 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Action: 'create', calling method: .version_select at 0x7f2432dc2af0>, body: {"keypair": {"name": "tempest-keypair-1033285927", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCyJ1JGHGvTT3QxaTWdX8VZkTITlJXGjiDqYMz+Rok5x6P2ImesRniPPGJXr2dytdV5F6w2Ka/V8QKNdUdpVu7JOIKRLYIB5LYvzZk7eYd64Hu6rITNN12XrUB9LN88yiw=="}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:37:00.652284 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=23 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:37:00.660221 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-63de22a1-29f2-4008-81e2-23323efc3409 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Getting quotas for project 9556f4ca2eea4506a818af2bb11d5712. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:37:00.670961 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-63de22a1-29f2-4008-81e2-23323efc3409 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Getting quotas for user 2d89719976f64c22bf4d9b7248da4804 and project 9556f4ca2eea4506a818af2bb11d5712. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:37:00.724499 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-63de22a1-29f2-4008-81e2-23323efc3409 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.114832 Jun 05 08:37:00.732894 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1473/2851] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:37:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:37:00.892451 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f6665d75-c9ef-45f0-8182-44d758206627 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:00.893062 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f6665d75-c9ef-45f0-8182-44d758206627 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:00.907385 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f6665d75-c9ef-45f0-8182-44d758206627 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:00.911169 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f6665d75-c9ef-45f0-8182-44d758206627 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:00.912265 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f6665d75-c9ef-45f0-8182-44d758206627 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:00.912893 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f6665d75-c9ef-45f0-8182-44d758206627 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:01.162310 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f6665d75-c9ef-45f0-8182-44d758206627 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:01.179811 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f6665d75-c9ef-45f0-8182-44d758206627 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:01.185668 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f6665d75-c9ef-45f0-8182-44d758206627 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:01.189019 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f6665d75-c9ef-45f0-8182-44d758206627 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.300870 Jun 05 08:37:01.192782 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1379/2852] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:37:00 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:37:02.212190 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-95b1b6ff-a736-4ae6-a220-f293f6233f1e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:02.212929 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-95b1b6ff-a736-4ae6-a220-f293f6233f1e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:02.239789 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-95b1b6ff-a736-4ae6-a220-f293f6233f1e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:02.244437 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-95b1b6ff-a736-4ae6-a220-f293f6233f1e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:02.248238 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-95b1b6ff-a736-4ae6-a220-f293f6233f1e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:02.248777 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-95b1b6ff-a736-4ae6-a220-f293f6233f1e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:02.609094 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-95b1b6ff-a736-4ae6-a220-f293f6233f1e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:02.627298 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-95b1b6ff-a736-4ae6-a220-f293f6233f1e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:02.644150 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-95b1b6ff-a736-4ae6-a220-f293f6233f1e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:02.646213 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-95b1b6ff-a736-4ae6-a220-f293f6233f1e tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.439712 Jun 05 08:37:02.647333 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1474/2853] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:37:02 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:37:03.666141 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-623e7f63-b191-4ecf-8bcc-bd3f2b7f8f5a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:03.666761 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-623e7f63-b191-4ecf-8bcc-bd3f2b7f8f5a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:03.687068 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-623e7f63-b191-4ecf-8bcc-bd3f2b7f8f5a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:03.687849 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-623e7f63-b191-4ecf-8bcc-bd3f2b7f8f5a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:03.693219 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-623e7f63-b191-4ecf-8bcc-bd3f2b7f8f5a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:03.693875 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-623e7f63-b191-4ecf-8bcc-bd3f2b7f8f5a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:03.897053 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-623e7f63-b191-4ecf-8bcc-bd3f2b7f8f5a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:03.917632 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-623e7f63-b191-4ecf-8bcc-bd3f2b7f8f5a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:03.920568 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-623e7f63-b191-4ecf-8bcc-bd3f2b7f8f5a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:03.922250 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-623e7f63-b191-4ecf-8bcc-bd3f2b7f8f5a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.260390 Jun 05 08:37:03.923446 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1380/2854] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:37:03 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:37:04.942817 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0b77161e-0cd1-4faa-a2e0-49b897acced7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:04.943442 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0b77161e-0cd1-4faa-a2e0-49b897acced7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:04.955034 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0b77161e-0cd1-4faa-a2e0-49b897acced7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:04.955495 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0b77161e-0cd1-4faa-a2e0-49b897acced7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:04.960170 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0b77161e-0cd1-4faa-a2e0-49b897acced7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:04.962943 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0b77161e-0cd1-4faa-a2e0-49b897acced7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:05.682957 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0b77161e-0cd1-4faa-a2e0-49b897acced7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:05.697667 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0b77161e-0cd1-4faa-a2e0-49b897acced7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:05.704229 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0b77161e-0cd1-4faa-a2e0-49b897acced7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:05.707666 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0b77161e-0cd1-4faa-a2e0-49b897acced7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.768791 Jun 05 08:37:05.708284 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1475/2855] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:37:04 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:37:06.726814 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c559fc8f-fe0e-496b-8e6c-a899e800bcc6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:06.728024 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c559fc8f-fe0e-496b-8e6c-a899e800bcc6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:06.741661 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=34 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:37:06.745341 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=52,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:37:06.768588 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c559fc8f-fe0e-496b-8e6c-a899e800bcc6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:06.769172 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c559fc8f-fe0e-496b-8e6c-a899e800bcc6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:06.770090 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c559fc8f-fe0e-496b-8e6c-a899e800bcc6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:06.778393 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c559fc8f-fe0e-496b-8e6c-a899e800bcc6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:06.801624 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=58 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:37:07.076200 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c559fc8f-fe0e-496b-8e6c-a899e800bcc6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:07.120475 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c559fc8f-fe0e-496b-8e6c-a899e800bcc6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:07.122975 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c559fc8f-fe0e-496b-8e6c-a899e800bcc6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:07.131122 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c559fc8f-fe0e-496b-8e6c-a899e800bcc6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.404741 Jun 05 08:37:07.133018 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1381/2856] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:37:06 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:37:08.153470 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-928674dc-59b0-4699-82f5-f0824bbcb5f3 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:08.154181 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-928674dc-59b0-4699-82f5-f0824bbcb5f3 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:08.162189 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=27,nova_cell0:UPDATE=26,nova_cell0:DELETE=4,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:37:08.176466 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-928674dc-59b0-4699-82f5-f0824bbcb5f3 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:08.177298 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-928674dc-59b0-4699-82f5-f0824bbcb5f3 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:08.178998 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-928674dc-59b0-4699-82f5-f0824bbcb5f3 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:08.183363 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-928674dc-59b0-4699-82f5-f0824bbcb5f3 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:08.197729 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=72 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:37:08.843155 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-928674dc-59b0-4699-82f5-f0824bbcb5f3 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:08.886005 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-928674dc-59b0-4699-82f5-f0824bbcb5f3 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:08.890998 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-928674dc-59b0-4699-82f5-f0824bbcb5f3 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:08.895656 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-928674dc-59b0-4699-82f5-f0824bbcb5f3 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.746861 Jun 05 08:37:08.897893 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1476/2857] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:37:08 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:37:09.923385 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9352ba5f-386e-43e0-ad08-85be0aabb6d7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:09.924019 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9352ba5f-386e-43e0-ad08-85be0aabb6d7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:09.954716 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9352ba5f-386e-43e0-ad08-85be0aabb6d7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:09.955226 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9352ba5f-386e-43e0-ad08-85be0aabb6d7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:09.956065 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9352ba5f-386e-43e0-ad08-85be0aabb6d7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:09.964224 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9352ba5f-386e-43e0-ad08-85be0aabb6d7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:10.106448 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f54d0acf-6e29-44d3-a8de-8558b2039d2e tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-911580904", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "820c8fba-7d8b-4aaf-95a7-62ce3a6f35e4"}], "security_groups": [{"name": "tempest-securitygroup--1561104637"}], "key_name": "tempest-keypair-1033285927", "user_data": "}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:37:10.274434 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9352ba5f-386e-43e0-ad08-85be0aabb6d7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:10.305496 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9352ba5f-386e-43e0-ad08-85be0aabb6d7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:10.307041 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9352ba5f-386e-43e0-ad08-85be0aabb6d7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:10.320559 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9352ba5f-386e-43e0-ad08-85be0aabb6d7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.406819 Jun 05 08:37:10.324566 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1382/2858] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:37:09 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:37:10.688852 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=3 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:37:10.705962 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-f54d0acf-6e29-44d3-a8de-8558b2039d2e tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] validate_networks() for [('820c8fba-7d8b-4aaf-95a7-62ce3a6f35e4', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:37:11.344713 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-cb8b53ad-fb81-43ee-a466-3209f10c960b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:11.345342 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-cb8b53ad-fb81-43ee-a466-3209f10c960b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:11.366806 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cb8b53ad-fb81-43ee-a466-3209f10c960b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:11.369147 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cb8b53ad-fb81-43ee-a466-3209f10c960b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:11.371765 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cb8b53ad-fb81-43ee-a466-3209f10c960b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:11.374139 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cb8b53ad-fb81-43ee-a466-3209f10c960b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:11.823808 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-cb8b53ad-fb81-43ee-a466-3209f10c960b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:11.846417 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-cb8b53ad-fb81-43ee-a466-3209f10c960b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:11.848360 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-cb8b53ad-fb81-43ee-a466-3209f10c960b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:11.851330 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-cb8b53ad-fb81-43ee-a466-3209f10c960b tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.511678 Jun 05 08:37:11.867930 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1383/2859] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:37:11 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:37:12.873746 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-38492042-6a94-41ea-b0ed-6a80cfd6046f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:12.874474 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-38492042-6a94-41ea-b0ed-6a80cfd6046f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:12.888127 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-38492042-6a94-41ea-b0ed-6a80cfd6046f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:12.889024 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-38492042-6a94-41ea-b0ed-6a80cfd6046f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:12.892602 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-38492042-6a94-41ea-b0ed-6a80cfd6046f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:12.897523 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-38492042-6a94-41ea-b0ed-6a80cfd6046f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:13.314184 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-f54d0acf-6e29-44d3-a8de-8558b2039d2e tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:37:13.314665 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-f54d0acf-6e29-44d3-a8de-8558b2039d2e tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:37:13.315254 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-f54d0acf-6e29-44d3-a8de-8558b2039d2e tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:37:13.316048 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-f54d0acf-6e29-44d3-a8de-8558b2039d2e tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:37:13.316565 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-f54d0acf-6e29-44d3-a8de-8558b2039d2e tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:37:13.341787 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f54d0acf-6e29-44d3-a8de-8558b2039d2e tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:13.345590 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f54d0acf-6e29-44d3-a8de-8558b2039d2e tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:13.348803 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f54d0acf-6e29-44d3-a8de-8558b2039d2e tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:13.354839 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f54d0acf-6e29-44d3-a8de-8558b2039d2e tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:13.431004 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-f54d0acf-6e29-44d3-a8de-8558b2039d2e tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Getting quotas for project 9556f4ca2eea4506a818af2bb11d5712. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:37:13.444765 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-f54d0acf-6e29-44d3-a8de-8558b2039d2e tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Getting quotas for user 2d89719976f64c22bf4d9b7248da4804 and project 9556f4ca2eea4506a818af2bb11d5712. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:37:13.483612 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f54d0acf-6e29-44d3-a8de-8558b2039d2e tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:37:13.489998 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f54d0acf-6e29-44d3-a8de-8558b2039d2e tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] [instance: aa2cf07e-9c84-4cc2-80e0-2713f6edc0cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:37:13.613596 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f54d0acf-6e29-44d3-a8de-8558b2039d2e tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.511439 Jun 05 08:37:13.617122 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1477/2860] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:37:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 3516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:37:13.628492 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5c2dd781-7066-48fb-9f73-f651a7510c0e tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:13.631135 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5c2dd781-7066-48fb-9f73-f651a7510c0e tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] [instance: aa2cf07e-9c84-4cc2-80e0-2713f6edc0cd] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:13.654222 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:UPDATE=3,nova_api:INSERT=4 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:37:15.096580 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-38492042-6a94-41ea-b0ed-6a80cfd6046f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:15.126153 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-38492042-6a94-41ea-b0ed-6a80cfd6046f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:15.130380 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-38492042-6a94-41ea-b0ed-6a80cfd6046f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:15.133082 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-38492042-6a94-41ea-b0ed-6a80cfd6046f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 2.263890 Jun 05 08:37:15.149312 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1384/2861] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:37:12 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 2281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:37:15.206121 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5c2dd781-7066-48fb-9f73-f651a7510c0e tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d89719976f64c22bf4d9b7248da4804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9556f4ca2eea4506a818af2bb11d5712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:15.216415 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5c2dd781-7066-48fb-9f73-f651a7510c0e tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] 10.222.0.33 "GET /compute/v2.1/servers/aa2cf07e-9c84-4cc2-80e0-2713f6edc0cd" status: 200 len: 1237 microversion: 2.1 time: 1.593868 Jun 05 08:37:15.217052 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1478/2862] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:37:13 2022] GET /compute/v2.1/servers/aa2cf07e-9c84-4cc2-80e0-2713f6edc0cd => generated 1237 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:37:16.171943 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b9ca7587-3cd1-44d2-8650-40eef83619ff tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:16.173460 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b9ca7587-3cd1-44d2-8650-40eef83619ff tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:16.185016 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b9ca7587-3cd1-44d2-8650-40eef83619ff tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:16.185809 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b9ca7587-3cd1-44d2-8650-40eef83619ff tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:16.188941 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b9ca7587-3cd1-44d2-8650-40eef83619ff tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:16.190498 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b9ca7587-3cd1-44d2-8650-40eef83619ff tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:16.234681 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-843e5ae1-6cce-4d1e-b882-c32d265c1f46 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:16.235892 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-843e5ae1-6cce-4d1e-b882-c32d265c1f46 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] [instance: aa2cf07e-9c84-4cc2-80e0-2713f6edc0cd] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:16.242911 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-843e5ae1-6cce-4d1e-b882-c32d265c1f46 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:16.250244 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-843e5ae1-6cce-4d1e-b882-c32d265c1f46 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:16.251414 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-843e5ae1-6cce-4d1e-b882-c32d265c1f46 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:16.255113 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-843e5ae1-6cce-4d1e-b882-c32d265c1f46 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:16.346112 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b9ca7587-3cd1-44d2-8650-40eef83619ff tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:16.368843 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b9ca7587-3cd1-44d2-8650-40eef83619ff tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:16.372358 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-843e5ae1-6cce-4d1e-b882-c32d265c1f46 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:16.372813 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-843e5ae1-6cce-4d1e-b882-c32d265c1f46 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:16.373277 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-843e5ae1-6cce-4d1e-b882-c32d265c1f46 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lazy-loading 'fault' on Instance uuid aa2cf07e-9c84-4cc2-80e0-2713f6edc0cd {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:37:16.376743 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b9ca7587-3cd1-44d2-8650-40eef83619ff tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:16.384449 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b9ca7587-3cd1-44d2-8650-40eef83619ff tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.227851 Jun 05 08:37:16.397219 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1385/2863] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:37:16 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:37:16.538745 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-843e5ae1-6cce-4d1e-b882-c32d265c1f46 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d89719976f64c22bf4d9b7248da4804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9556f4ca2eea4506a818af2bb11d5712', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:16.549934 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-843e5ae1-6cce-4d1e-b882-c32d265c1f46 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] 10.222.0.33 "GET /compute/v2.1/servers/aa2cf07e-9c84-4cc2-80e0-2713f6edc0cd" status: 200 len: 1310 microversion: 2.1 time: 0.317316 Jun 05 08:37:16.553091 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1479/2864] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:37:16 2022] GET /compute/v2.1/servers/aa2cf07e-9c84-4cc2-80e0-2713f6edc0cd => generated 1310 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:37:16.568499 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5c841184-0489-4397-9fdb-63826cbd6691 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:16.569265 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5c841184-0489-4397-9fdb-63826cbd6691 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] [instance: aa2cf07e-9c84-4cc2-80e0-2713f6edc0cd] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:16.583469 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=12,nova_api:DELETE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:37:16.585588 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5c841184-0489-4397-9fdb-63826cbd6691 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:16.598345 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5c841184-0489-4397-9fdb-63826cbd6691 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:16.602050 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5c841184-0489-4397-9fdb-63826cbd6691 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:16.602913 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5c841184-0489-4397-9fdb-63826cbd6691 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:16.703255 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5c841184-0489-4397-9fdb-63826cbd6691 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] [instance: aa2cf07e-9c84-4cc2-80e0-2713f6edc0cd] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:37:16.898102 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5c841184-0489-4397-9fdb-63826cbd6691 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] [instance: aa2cf07e-9c84-4cc2-80e0-2713f6edc0cd] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:37:16.902593 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5c841184-0489-4397-9fdb-63826cbd6691 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:16.904196 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5c841184-0489-4397-9fdb-63826cbd6691 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:16.905916 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-5c841184-0489-4397-9fdb-63826cbd6691 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] [instance: aa2cf07e-9c84-4cc2-80e0-2713f6edc0cd] instance's host None is down, deleting from database Jun 05 08:37:16.919155 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-5c841184-0489-4397-9fdb-63826cbd6691 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] [instance: aa2cf07e-9c84-4cc2-80e0-2713f6edc0cd] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:37:17.277082 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-5c841184-0489-4397-9fdb-63826cbd6691 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] [instance: aa2cf07e-9c84-4cc2-80e0-2713f6edc0cd] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:37:17.285541 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-5c841184-0489-4397-9fdb-63826cbd6691 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] [instance: aa2cf07e-9c84-4cc2-80e0-2713f6edc0cd] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:37:17.405201 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4cea885f-60a3-40eb-b4f2-f9d9695d9424 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:17.406453 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4cea885f-60a3-40eb-b4f2-f9d9695d9424 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:17.421927 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4cea885f-60a3-40eb-b4f2-f9d9695d9424 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:17.425654 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4cea885f-60a3-40eb-b4f2-f9d9695d9424 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:17.431734 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4cea885f-60a3-40eb-b4f2-f9d9695d9424 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:17.432554 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4cea885f-60a3-40eb-b4f2-f9d9695d9424 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:18.103120 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5c841184-0489-4397-9fdb-63826cbd6691 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] 10.222.0.33 "DELETE /compute/v2.1/servers/aa2cf07e-9c84-4cc2-80e0-2713f6edc0cd" status: 204 len: 0 microversion: 2.1 time: 1.538863 Jun 05 08:37:18.104561 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1386/2865] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:37:16 2022] DELETE /compute/v2.1/servers/aa2cf07e-9c84-4cc2-80e0-2713f6edc0cd => generated 0 bytes in 1541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:37:18.116402 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-edc386a2-1442-4093-8b78-cd1c1e938a7b tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:18.119447 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-edc386a2-1442-4093-8b78-cd1c1e938a7b tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] [instance: aa2cf07e-9c84-4cc2-80e0-2713f6edc0cd] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:18.138282 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-edc386a2-1442-4093-8b78-cd1c1e938a7b tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:18.140782 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-edc386a2-1442-4093-8b78-cd1c1e938a7b tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:18.142165 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-edc386a2-1442-4093-8b78-cd1c1e938a7b tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:18.142758 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-edc386a2-1442-4093-8b78-cd1c1e938a7b tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:18.193304 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-edc386a2-1442-4093-8b78-cd1c1e938a7b tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] HTTP exception thrown: Instance aa2cf07e-9c84-4cc2-80e0-2713f6edc0cd could not be found. Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-edc386a2-1442-4093-8b78-cd1c1e938a7b tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Request method failure captured: Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/aa2cf07e-9c84-4cc2-80e0-2713f6edc0cd HTTP/1.1 Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGsbAEUVOy2z2Qlx-J5bm2rxvYoBcwI9Ybno1u0iXxEPGVYr9fCYpXfebuKjWulQMtvND9ZqwamWPDZUFyn9U1tkEHDFZ9XNGJRBNBp0_xqsX5aFyp75ZFmb2U9q8vCXUvzdc7SjIsqgnvufDteAbcZZPyMSLvespTw1jUFCiIlS3yY Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 9556f4ca2eea4506a818af2bb11d5712 Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-AttachVolumeTestJSON-656999486 Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9556f4ca2eea4506a818af2bb11d5712"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9556f4ca2eea4506a818af2bb11d5712"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9556f4ca2eea4506a818af2bb11d5712", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9556f4ca2eea4506a818af2bb11d5712"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-AttachVolumeTestJSON-656999486 Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 9556f4ca2eea4506a818af2bb11d5712 Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-AttachVolumeTestJSON-656999486 Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-AttachVolumeTestJSON-656999486-project Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 2d89719976f64c22bf4d9b7248da4804 Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-AttachVolumeTestJSON-656999486-project Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance aa2cf07e-9c84-4cc2-80e0-2713f6edc0cd could not be found. Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'aa2cf07e-9c84-4cc2-80e0-2713f6edc0cd'} Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa2cf07e-9c84-4cc2-80e0-2713f6edc0cd could not be found. Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa2cf07e-9c84-4cc2-80e0-2713f6edc0cd could not be found. Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:37:18.196200 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:37:18.201390 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:37:18.201390 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:37:18.201390 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:37:18.201390 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:37:18.201390 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:37:18.201390 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa2cf07e-9c84-4cc2-80e0-2713f6edc0cd could not be found. Jun 05 08:37:18.201390 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:37:18.205104 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-edc386a2-1442-4093-8b78-cd1c1e938a7b tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Returning 404 to user: Instance aa2cf07e-9c84-4cc2-80e0-2713f6edc0cd could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:37:18.206351 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-edc386a2-1442-4093-8b78-cd1c1e938a7b tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] 10.222.0.33 "GET /compute/v2.1/servers/aa2cf07e-9c84-4cc2-80e0-2713f6edc0cd" status: 404 len: 111 microversion: 2.1 time: 0.096154 Jun 05 08:37:18.208835 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1387/2866] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:37:18 2022] GET /compute/v2.1/servers/aa2cf07e-9c84-4cc2-80e0-2713f6edc0cd => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:37:18.233521 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7d06c841-c0da-42e2-b664-23981ae3fc46 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] Calling method '.version_select at 0x7f2432f110d0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:18.288656 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7d06c841-c0da-42e2-b664-23981ae3fc46 tempest-AttachVolumeTestJSON-656999486 tempest-AttachVolumeTestJSON-656999486-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1033285927" status: 202 len: 0 microversion: 2.1 time: 0.074515 Jun 05 08:37:18.289833 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1388/2867] 10.222.0.33 () {58 vars in 1220 bytes} [Sun Jun 5 08:37:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1033285927 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:37:18.574671 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4cea885f-60a3-40eb-b4f2-f9d9695d9424 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:18.606519 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4cea885f-60a3-40eb-b4f2-f9d9695d9424 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:18.608533 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4cea885f-60a3-40eb-b4f2-f9d9695d9424 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:18.609819 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4cea885f-60a3-40eb-b4f2-f9d9695d9424 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 1.209843 Jun 05 08:37:18.630564 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1480/2868] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:37:17 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:37:19.445620 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1ddabdb2-1357-41f1-a21f-c32f4762a200 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1558059821", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:37:19.559201 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-1ddabdb2-1357-41f1-a21f-c32f4762a200 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] validate_networks() for [('31fd7a73-eb00-4af3-baa6-fc5b176d4fc5', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:37:19.639295 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-056b1a96-3efb-4022-a73c-ac7ced3988fe tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:19.640063 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-056b1a96-3efb-4022-a73c-ac7ced3988fe tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:19.653461 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-056b1a96-3efb-4022-a73c-ac7ced3988fe tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:19.655273 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-056b1a96-3efb-4022-a73c-ac7ced3988fe tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:19.656194 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-056b1a96-3efb-4022-a73c-ac7ced3988fe tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:19.658954 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-056b1a96-3efb-4022-a73c-ac7ced3988fe tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:20.049525 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-056b1a96-3efb-4022-a73c-ac7ced3988fe tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:20.068740 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-056b1a96-3efb-4022-a73c-ac7ced3988fe tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:20.085743 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-056b1a96-3efb-4022-a73c-ac7ced3988fe tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:20.092474 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-056b1a96-3efb-4022-a73c-ac7ced3988fe tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.458586 Jun 05 08:37:20.093656 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1481/2869] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:37:19 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:37:21.215177 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5c929797-a461-45fa-a7cc-89a1c9ee2b7b tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-498832767", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:37:21.342382 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-5c929797-a461-45fa-a7cc-89a1c9ee2b7b tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] validate_networks() for [('de84d67e-6be8-4a5d-a628-55af06d75baa', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:37:21.843123 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-1ddabdb2-1357-41f1-a21f-c32f4762a200 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:37:21.844836 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-1ddabdb2-1357-41f1-a21f-c32f4762a200 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:37:21.845544 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-1ddabdb2-1357-41f1-a21f-c32f4762a200 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:37:21.846217 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-1ddabdb2-1357-41f1-a21f-c32f4762a200 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:37:21.846851 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-1ddabdb2-1357-41f1-a21f-c32f4762a200 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:37:21.870947 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ddabdb2-1357-41f1-a21f-c32f4762a200 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:21.872915 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ddabdb2-1357-41f1-a21f-c32f4762a200 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:21.875978 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ddabdb2-1357-41f1-a21f-c32f4762a200 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:21.876690 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ddabdb2-1357-41f1-a21f-c32f4762a200 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:21.935078 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-1ddabdb2-1357-41f1-a21f-c32f4762a200 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Getting quotas for project 363349c9906e445aa9b5e4405da90405. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:37:21.941398 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-1ddabdb2-1357-41f1-a21f-c32f4762a200 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Getting quotas for user 4bd842e930334fefb88464e119810d28 and project 363349c9906e445aa9b5e4405da90405. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:37:21.959086 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1ddabdb2-1357-41f1-a21f-c32f4762a200 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:37:21.963826 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1ddabdb2-1357-41f1-a21f-c32f4762a200 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] [instance: dc87b487-03b4-4148-95cb-bdcc2d8539c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:37:22.038537 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1ddabdb2-1357-41f1-a21f-c32f4762a200 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.487241 Jun 05 08:37:22.040130 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1389/2870] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:37:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 3490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 05 08:37:22.054364 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fe8da08a-199b-4334-a51e-bb86bba0e87a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:22.055004 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-fe8da08a-199b-4334-a51e-bb86bba0e87a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:22.072303 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fe8da08a-199b-4334-a51e-bb86bba0e87a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:22.076475 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fe8da08a-199b-4334-a51e-bb86bba0e87a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:22.078527 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fe8da08a-199b-4334-a51e-bb86bba0e87a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:22.078983 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fe8da08a-199b-4334-a51e-bb86bba0e87a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:23.720964 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-fe8da08a-199b-4334-a51e-bb86bba0e87a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:23.736917 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-fe8da08a-199b-4334-a51e-bb86bba0e87a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:23.742241 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-fe8da08a-199b-4334-a51e-bb86bba0e87a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:23.746035 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fe8da08a-199b-4334-a51e-bb86bba0e87a tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 1.702441 Jun 05 08:37:23.747282 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1390/2871] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:37:22 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:37:23.756989 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a7feff5f-d058-4739-8e84-5618b45e7b46 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:23.759813 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a7feff5f-d058-4739-8e84-5618b45e7b46 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] [instance: dc87b487-03b4-4148-95cb-bdcc2d8539c8] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:23.773383 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a7feff5f-d058-4739-8e84-5618b45e7b46 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:23.774163 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a7feff5f-d058-4739-8e84-5618b45e7b46 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:23.775889 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a7feff5f-d058-4739-8e84-5618b45e7b46 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:23.777578 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a7feff5f-d058-4739-8e84-5618b45e7b46 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:23.860657 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a7feff5f-d058-4739-8e84-5618b45e7b46 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:23.861366 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a7feff5f-d058-4739-8e84-5618b45e7b46 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:23.861987 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-a7feff5f-d058-4739-8e84-5618b45e7b46 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Lazy-loading 'fault' on Instance uuid dc87b487-03b4-4148-95cb-bdcc2d8539c8 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:37:24.055712 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a7feff5f-d058-4739-8e84-5618b45e7b46 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd842e930334fefb88464e119810d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363349c9906e445aa9b5e4405da90405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:24.064680 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a7feff5f-d058-4739-8e84-5618b45e7b46 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] 10.222.0.33 "GET /compute/v2.1/servers/dc87b487-03b4-4148-95cb-bdcc2d8539c8" status: 200 len: 1296 microversion: 2.1 time: 0.315953 Jun 05 08:37:24.075364 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1391/2872] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:37:23 2022] GET /compute/v2.1/servers/dc87b487-03b4-4148-95cb-bdcc2d8539c8 => generated 1296 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:37:24.224855 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-5c929797-a461-45fa-a7cc-89a1c9ee2b7b tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:37:24.225416 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-5c929797-a461-45fa-a7cc-89a1c9ee2b7b tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:37:24.225859 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-5c929797-a461-45fa-a7cc-89a1c9ee2b7b tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:37:24.226412 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-5c929797-a461-45fa-a7cc-89a1c9ee2b7b tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:37:24.226847 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-5c929797-a461-45fa-a7cc-89a1c9ee2b7b tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:37:24.249129 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5c929797-a461-45fa-a7cc-89a1c9ee2b7b tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:24.249562 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5c929797-a461-45fa-a7cc-89a1c9ee2b7b tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:24.250420 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5c929797-a461-45fa-a7cc-89a1c9ee2b7b tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:24.250864 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5c929797-a461-45fa-a7cc-89a1c9ee2b7b tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:24.304175 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-5c929797-a461-45fa-a7cc-89a1c9ee2b7b tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Getting quotas for project 119c9a66fb2d4bffa0f49b4acdd687c8. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:37:24.332481 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-5c929797-a461-45fa-a7cc-89a1c9ee2b7b tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Getting quotas for user 96c6b12b5ebf43b68c134c05924de220 and project 119c9a66fb2d4bffa0f49b4acdd687c8. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:37:24.353265 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5c929797-a461-45fa-a7cc-89a1c9ee2b7b tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:37:24.357522 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5c929797-a461-45fa-a7cc-89a1c9ee2b7b tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] [instance: e79d84b8-94a4-4824-bc30-c84b31da3746] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:37:24.515110 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5c929797-a461-45fa-a7cc-89a1c9ee2b7b tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.571327 Jun 05 08:37:24.520153 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1482/2873] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:37:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 3578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 05 08:37:24.528217 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-41472366-2398-470c-8bdb-65f3aa0deb8f tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:24.528841 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-41472366-2398-470c-8bdb-65f3aa0deb8f tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] [instance: e79d84b8-94a4-4824-bc30-c84b31da3746] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:24.764615 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-034fea13-b66f-47b8-ace6-54a1687cd8e4 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:24.765655 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-034fea13-b66f-47b8-ace6-54a1687cd8e4 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:24.774833 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-034fea13-b66f-47b8-ace6-54a1687cd8e4 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:24.794987 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-034fea13-b66f-47b8-ace6-54a1687cd8e4 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:24.799253 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-034fea13-b66f-47b8-ace6-54a1687cd8e4 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:24.800148 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-034fea13-b66f-47b8-ace6-54a1687cd8e4 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:24.868988 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-41472366-2398-470c-8bdb-65f3aa0deb8f tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c6b12b5ebf43b68c134c05924de220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119c9a66fb2d4bffa0f49b4acdd687c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:24.884713 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-41472366-2398-470c-8bdb-65f3aa0deb8f tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] 10.222.0.33 "GET /compute/v2.1/servers/e79d84b8-94a4-4824-bc30-c84b31da3746" status: 200 len: 1221 microversion: 2.1 time: 0.356589 Jun 05 08:37:24.905489 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1392/2874] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:37:24 2022] GET /compute/v2.1/servers/e79d84b8-94a4-4824-bc30-c84b31da3746 => generated 1221 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:37:25.083061 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-757d57cd-54ab-4cbc-b3e4-b152b10346b9 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:25.083971 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-757d57cd-54ab-4cbc-b3e4-b152b10346b9 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] [instance: dc87b487-03b4-4148-95cb-bdcc2d8539c8] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:25.097113 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-757d57cd-54ab-4cbc-b3e4-b152b10346b9 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:25.097580 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-757d57cd-54ab-4cbc-b3e4-b152b10346b9 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:25.098373 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-757d57cd-54ab-4cbc-b3e4-b152b10346b9 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:25.104250 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-757d57cd-54ab-4cbc-b3e4-b152b10346b9 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:25.184793 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-757d57cd-54ab-4cbc-b3e4-b152b10346b9 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:25.187779 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-757d57cd-54ab-4cbc-b3e4-b152b10346b9 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:25.188503 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-757d57cd-54ab-4cbc-b3e4-b152b10346b9 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Lazy-loading 'fault' on Instance uuid dc87b487-03b4-4148-95cb-bdcc2d8539c8 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:37:25.225357 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-034fea13-b66f-47b8-ace6-54a1687cd8e4 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:25.250395 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-034fea13-b66f-47b8-ace6-54a1687cd8e4 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:25.252768 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-034fea13-b66f-47b8-ace6-54a1687cd8e4 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:25.254378 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-034fea13-b66f-47b8-ace6-54a1687cd8e4 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.494088 Jun 05 08:37:25.255772 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1483/2875] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:37:24 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:37:25.281042 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-dcac19eb-c73c-441e-be8b-8279064bc67d tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1376823533", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:37:25.311213 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-757d57cd-54ab-4cbc-b3e4-b152b10346b9 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd842e930334fefb88464e119810d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363349c9906e445aa9b5e4405da90405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:25.325896 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-757d57cd-54ab-4cbc-b3e4-b152b10346b9 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] 10.222.0.33 "GET /compute/v2.1/servers/dc87b487-03b4-4148-95cb-bdcc2d8539c8" status: 200 len: 1296 microversion: 2.1 time: 0.246840 Jun 05 08:37:25.340928 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1393/2876] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:37:25 2022] GET /compute/v2.1/servers/dc87b487-03b4-4148-95cb-bdcc2d8539c8 => generated 1296 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:37:25.359976 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d92aa5b4-b9b4-4845-96b1-642e2110f3cf tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:25.361367 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d92aa5b4-b9b4-4845-96b1-642e2110f3cf tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] [instance: dc87b487-03b4-4148-95cb-bdcc2d8539c8] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:25.380268 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d92aa5b4-b9b4-4845-96b1-642e2110f3cf tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:25.382649 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d92aa5b4-b9b4-4845-96b1-642e2110f3cf tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:25.388352 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d92aa5b4-b9b4-4845-96b1-642e2110f3cf tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:25.389032 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d92aa5b4-b9b4-4845-96b1-642e2110f3cf tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:25.394962 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-dcac19eb-c73c-441e-be8b-8279064bc67d tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] validate_networks() for [('de84d67e-6be8-4a5d-a628-55af06d75baa', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:37:25.446549 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d92aa5b4-b9b4-4845-96b1-642e2110f3cf tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] [instance: dc87b487-03b4-4148-95cb-bdcc2d8539c8] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:37:25.607976 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d92aa5b4-b9b4-4845-96b1-642e2110f3cf tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] [instance: dc87b487-03b4-4148-95cb-bdcc2d8539c8] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:37:25.608833 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d92aa5b4-b9b4-4845-96b1-642e2110f3cf tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:25.609290 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d92aa5b4-b9b4-4845-96b1-642e2110f3cf tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:25.609735 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-d92aa5b4-b9b4-4845-96b1-642e2110f3cf tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] [instance: dc87b487-03b4-4148-95cb-bdcc2d8539c8] instance's host None is down, deleting from database Jun 05 08:37:25.626607 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-d92aa5b4-b9b4-4845-96b1-642e2110f3cf tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] [instance: dc87b487-03b4-4148-95cb-bdcc2d8539c8] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:37:25.768246 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-d92aa5b4-b9b4-4845-96b1-642e2110f3cf tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] [instance: dc87b487-03b4-4148-95cb-bdcc2d8539c8] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:37:25.777058 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-d92aa5b4-b9b4-4845-96b1-642e2110f3cf tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] [instance: dc87b487-03b4-4148-95cb-bdcc2d8539c8] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:37:26.095291 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=68,nova_cell0:UPDATE=26,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:37:26.116210 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d92aa5b4-b9b4-4845-96b1-642e2110f3cf tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dc87b487-03b4-4148-95cb-bdcc2d8539c8" status: 204 len: 0 microversion: 2.1 time: 0.773896 Jun 05 08:37:26.121011 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1394/2877] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:37:25 2022] DELETE /compute/v2.1/servers/dc87b487-03b4-4148-95cb-bdcc2d8539c8 => generated 0 bytes in 776 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:37:26.136359 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-58b2cebe-71d6-449d-a2d3-fbdcd181e420 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:26.137407 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-58b2cebe-71d6-449d-a2d3-fbdcd181e420 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] [instance: dc87b487-03b4-4148-95cb-bdcc2d8539c8] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:26.152895 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-58b2cebe-71d6-449d-a2d3-fbdcd181e420 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:26.154326 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-58b2cebe-71d6-449d-a2d3-fbdcd181e420 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:26.156601 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-58b2cebe-71d6-449d-a2d3-fbdcd181e420 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:26.157377 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-58b2cebe-71d6-449d-a2d3-fbdcd181e420 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:26.209923 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-58b2cebe-71d6-449d-a2d3-fbdcd181e420 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] HTTP exception thrown: Instance dc87b487-03b4-4148-95cb-bdcc2d8539c8 could not be found. Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-58b2cebe-71d6-449d-a2d3-fbdcd181e420 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Request method failure captured: Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/dc87b487-03b4-4148-95cb-bdcc2d8539c8 HTTP/1.1 Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGs-0VJ6gzp1HTpOMcP3ujSREyy4XV3f7KOFPUoUZE5ZPuQd3oyBBUpjOM0JhD3Zs0piryBukp5C8NJFA5QQq28nrckPdkLYvKRnne7POA6XsK61hntsUMgcSap0yhl0xKHVd7I8iJ4l1Zp5TwBseyQWreqDDtTRq7UySFtuLeZ0BbY Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 363349c9906e445aa9b5e4405da90405 Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-2024948601 Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/363349c9906e445aa9b5e4405da90405"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/363349c9906e445aa9b5e4405da90405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_363349c9906e445aa9b5e4405da90405", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/363349c9906e445aa9b5e4405da90405"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-2024948601 Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 363349c9906e445aa9b5e4405da90405 Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-2024948601 Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ServerRescueTestJSONUnderV235-2024948601-project Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 4bd842e930334fefb88464e119810d28 Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-2024948601-project Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance dc87b487-03b4-4148-95cb-bdcc2d8539c8 could not be found. Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'dc87b487-03b4-4148-95cb-bdcc2d8539c8'} Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc87b487-03b4-4148-95cb-bdcc2d8539c8 could not be found. Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc87b487-03b4-4148-95cb-bdcc2d8539c8 could not be found. Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:37:26.219843 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:37:26.223647 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:37:26.223647 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:37:26.223647 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:37:26.223647 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:37:26.223647 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:37:26.223647 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:37:26.223647 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc87b487-03b4-4148-95cb-bdcc2d8539c8 could not be found. Jun 05 08:37:26.223647 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:37:26.234805 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-58b2cebe-71d6-449d-a2d3-fbdcd181e420 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] Returning 404 to user: Instance dc87b487-03b4-4148-95cb-bdcc2d8539c8 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:37:26.236968 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-58b2cebe-71d6-449d-a2d3-fbdcd181e420 tempest-ServerRescueTestJSONUnderV235-2024948601 tempest-ServerRescueTestJSONUnderV235-2024948601-project] 10.222.0.33 "GET /compute/v2.1/servers/dc87b487-03b4-4148-95cb-bdcc2d8539c8" status: 404 len: 111 microversion: 2.1 time: 0.110305 Jun 05 08:37:26.239310 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1395/2878] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:37:26 2022] GET /compute/v2.1/servers/dc87b487-03b4-4148-95cb-bdcc2d8539c8 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:37:26.274239 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-879a2af7-78d7-434d-a834-335d45867940 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:26.275004 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-879a2af7-78d7-434d-a834-335d45867940 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:26.299601 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-879a2af7-78d7-434d-a834-335d45867940 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:26.302104 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-879a2af7-78d7-434d-a834-335d45867940 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:26.303267 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-879a2af7-78d7-434d-a834-335d45867940 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:26.304087 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-879a2af7-78d7-434d-a834-335d45867940 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:26.529580 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-879a2af7-78d7-434d-a834-335d45867940 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:26.570661 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-879a2af7-78d7-434d-a834-335d45867940 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:26.577762 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-879a2af7-78d7-434d-a834-335d45867940 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:26.581297 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-879a2af7-78d7-434d-a834-335d45867940 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.311089 Jun 05 08:37:26.586800 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1396/2879] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:37:26 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:37:27.240153 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-dcac19eb-c73c-441e-be8b-8279064bc67d tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:37:27.240729 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-dcac19eb-c73c-441e-be8b-8279064bc67d tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:37:27.241296 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-dcac19eb-c73c-441e-be8b-8279064bc67d tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:37:27.241903 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-dcac19eb-c73c-441e-be8b-8279064bc67d tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:37:27.242450 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-dcac19eb-c73c-441e-be8b-8279064bc67d tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:37:27.274713 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dcac19eb-c73c-441e-be8b-8279064bc67d tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:27.275752 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dcac19eb-c73c-441e-be8b-8279064bc67d tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:27.280778 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dcac19eb-c73c-441e-be8b-8279064bc67d tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:27.284640 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dcac19eb-c73c-441e-be8b-8279064bc67d tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:27.370832 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-dcac19eb-c73c-441e-be8b-8279064bc67d tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Getting quotas for project 119c9a66fb2d4bffa0f49b4acdd687c8. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:37:27.388406 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-dcac19eb-c73c-441e-be8b-8279064bc67d tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Getting quotas for user 96c6b12b5ebf43b68c134c05924de220 and project 119c9a66fb2d4bffa0f49b4acdd687c8. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:37:27.415440 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-dcac19eb-c73c-441e-be8b-8279064bc67d tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:37:27.419648 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-dcac19eb-c73c-441e-be8b-8279064bc67d tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] [instance: 4ee66737-f9c8-49ec-a044-27042720d960] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:37:27.537836 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-dcac19eb-c73c-441e-be8b-8279064bc67d tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.280422 Jun 05 08:37:27.538494 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1484/2880] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:37:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 2282 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:37:27.561082 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fcdcee91-3af8-42ee-8336-b01fe5c55fb2 tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:27.563323 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-fcdcee91-3af8-42ee-8336-b01fe5c55fb2 tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] [instance: 4ee66737-f9c8-49ec-a044-27042720d960] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:27.611580 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1a828bfd-9115-4b4a-a1bb-07967884e3de tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:27.615784 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1a828bfd-9115-4b4a-a1bb-07967884e3de tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:27.639210 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1a828bfd-9115-4b4a-a1bb-07967884e3de tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:27.643860 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1a828bfd-9115-4b4a-a1bb-07967884e3de tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:27.644957 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1a828bfd-9115-4b4a-a1bb-07967884e3de tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:27.647899 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1a828bfd-9115-4b4a-a1bb-07967884e3de tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:27.746584 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-fcdcee91-3af8-42ee-8336-b01fe5c55fb2 tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c6b12b5ebf43b68c134c05924de220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119c9a66fb2d4bffa0f49b4acdd687c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:27.757910 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fcdcee91-3af8-42ee-8336-b01fe5c55fb2 tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] 10.222.0.33 "GET /compute/v2.1/servers/4ee66737-f9c8-49ec-a044-27042720d960" status: 200 len: 1222 microversion: 2.1 time: 0.202750 Jun 05 08:37:27.761214 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1397/2881] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:37:27 2022] GET /compute/v2.1/servers/4ee66737-f9c8-49ec-a044-27042720d960 => generated 1222 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:37:28.000544 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1a828bfd-9115-4b4a-a1bb-07967884e3de tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:28.022711 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1a828bfd-9115-4b4a-a1bb-07967884e3de tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:28.028978 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1a828bfd-9115-4b4a-a1bb-07967884e3de tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:28.030269 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1a828bfd-9115-4b4a-a1bb-07967884e3de tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.429887 Jun 05 08:37:28.030837 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1485/2882] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:37:27 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:37:28.779660 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8eb437af-9d0e-433e-a835-959bc471343b tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:28.780416 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8eb437af-9d0e-433e-a835-959bc471343b tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] [instance: 4ee66737-f9c8-49ec-a044-27042720d960] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:28.804974 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8eb437af-9d0e-433e-a835-959bc471343b tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:28.805592 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8eb437af-9d0e-433e-a835-959bc471343b tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:28.806565 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8eb437af-9d0e-433e-a835-959bc471343b tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:28.810974 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8eb437af-9d0e-433e-a835-959bc471343b tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:28.893319 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8eb437af-9d0e-433e-a835-959bc471343b tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:28.895385 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8eb437af-9d0e-433e-a835-959bc471343b tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:28.898753 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-8eb437af-9d0e-433e-a835-959bc471343b tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lazy-loading 'fault' on Instance uuid 4ee66737-f9c8-49ec-a044-27042720d960 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:37:29.001815 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8eb437af-9d0e-433e-a835-959bc471343b tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96c6b12b5ebf43b68c134c05924de220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119c9a66fb2d4bffa0f49b4acdd687c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:29.016291 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8eb437af-9d0e-433e-a835-959bc471343b tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] 10.222.0.33 "GET /compute/v2.1/servers/4ee66737-f9c8-49ec-a044-27042720d960" status: 200 len: 1295 microversion: 2.1 time: 0.241979 Jun 05 08:37:29.018157 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1398/2883] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:37:28 2022] GET /compute/v2.1/servers/4ee66737-f9c8-49ec-a044-27042720d960 => generated 1295 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:37:29.034258 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a51d320f-318d-4391-9bb9-8cae31bbeb50 tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:29.034821 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a51d320f-318d-4391-9bb9-8cae31bbeb50 tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] [instance: 4ee66737-f9c8-49ec-a044-27042720d960] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:29.051785 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ba73418e-d645-4e81-85fe-82f399dc800f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:29.052014 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ba73418e-d645-4e81-85fe-82f399dc800f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:29.065336 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a51d320f-318d-4391-9bb9-8cae31bbeb50 tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:29.068376 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a51d320f-318d-4391-9bb9-8cae31bbeb50 tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:29.069644 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ba73418e-d645-4e81-85fe-82f399dc800f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:29.071200 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a51d320f-318d-4391-9bb9-8cae31bbeb50 tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:29.075362 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ba73418e-d645-4e81-85fe-82f399dc800f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:29.076355 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a51d320f-318d-4391-9bb9-8cae31bbeb50 tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:29.078376 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ba73418e-d645-4e81-85fe-82f399dc800f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:29.079470 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ba73418e-d645-4e81-85fe-82f399dc800f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:29.176274 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a51d320f-318d-4391-9bb9-8cae31bbeb50 tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] [instance: 4ee66737-f9c8-49ec-a044-27042720d960] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:37:29.299839 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ba73418e-d645-4e81-85fe-82f399dc800f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:29.316457 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ba73418e-d645-4e81-85fe-82f399dc800f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:29.317336 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a51d320f-318d-4391-9bb9-8cae31bbeb50 tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] [instance: 4ee66737-f9c8-49ec-a044-27042720d960] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:37:29.319102 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a51d320f-318d-4391-9bb9-8cae31bbeb50 tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:29.319814 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a51d320f-318d-4391-9bb9-8cae31bbeb50 tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:29.320560 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-a51d320f-318d-4391-9bb9-8cae31bbeb50 tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] [instance: 4ee66737-f9c8-49ec-a044-27042720d960] instance's host None is down, deleting from database Jun 05 08:37:29.320676 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ba73418e-d645-4e81-85fe-82f399dc800f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:29.323862 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ba73418e-d645-4e81-85fe-82f399dc800f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.276592 Jun 05 08:37:29.325101 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1399/2884] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:37:29 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:37:29.338735 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-a51d320f-318d-4391-9bb9-8cae31bbeb50 tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] [instance: 4ee66737-f9c8-49ec-a044-27042720d960] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:37:29.405491 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-a51d320f-318d-4391-9bb9-8cae31bbeb50 tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] [instance: 4ee66737-f9c8-49ec-a044-27042720d960] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:37:29.413572 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-a51d320f-318d-4391-9bb9-8cae31bbeb50 tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] [instance: 4ee66737-f9c8-49ec-a044-27042720d960] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:37:30.003744 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a51d320f-318d-4391-9bb9-8cae31bbeb50 tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4ee66737-f9c8-49ec-a044-27042720d960" status: 204 len: 0 microversion: 2.1 time: 0.973692 Jun 05 08:37:30.005926 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1486/2885] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:37:29 2022] DELETE /compute/v2.1/servers/4ee66737-f9c8-49ec-a044-27042720d960 => generated 0 bytes in 978 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:37:30.015628 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-37bd3367-6591-46e9-bc55-d136060ec0b2 tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:30.016661 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-37bd3367-6591-46e9-bc55-d136060ec0b2 tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] [instance: 4ee66737-f9c8-49ec-a044-27042720d960] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:30.034893 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-37bd3367-6591-46e9-bc55-d136060ec0b2 tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:30.038413 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-37bd3367-6591-46e9-bc55-d136060ec0b2 tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:30.039792 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-37bd3367-6591-46e9-bc55-d136060ec0b2 tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:30.041863 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-37bd3367-6591-46e9-bc55-d136060ec0b2 tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:30.090205 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-37bd3367-6591-46e9-bc55-d136060ec0b2 tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] HTTP exception thrown: Instance 4ee66737-f9c8-49ec-a044-27042720d960 could not be found. Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-37bd3367-6591-46e9-bc55-d136060ec0b2 tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Request method failure captured: Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/4ee66737-f9c8-49ec-a044-27042720d960 HTTP/1.1 Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGtA7MjmPJSPj37FlW0pYwCUR7kD8aKYiJZwYiWAX2ZtujP6mLenaw6EOmWrr_hZrxCV7uWxzna7QLkX9-XJWQt_rHKZZd3aWk5pBBWvHc_mIWkpUT36vsTrwyrgfnpjqYkgwqKj6_XLCdhxxCco0BfCbnl5R-z-b9PyGYlDXhJllWA Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 119c9a66fb2d4bffa0f49b4acdd687c8 Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2132038711 Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/119c9a66fb2d4bffa0f49b4acdd687c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/119c9a66fb2d4bffa0f49b4acdd687c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_119c9a66fb2d4bffa0f49b4acdd687c8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/119c9a66fb2d4bffa0f49b4acdd687c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2132038711 Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 119c9a66fb2d4bffa0f49b4acdd687c8 Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2132038711 Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ServerRescueNegativeTestJSON-2132038711-project Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 96c6b12b5ebf43b68c134c05924de220 Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2132038711-project Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 4ee66737-f9c8-49ec-a044-27042720d960 could not be found. Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '4ee66737-f9c8-49ec-a044-27042720d960'} Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ee66737-f9c8-49ec-a044-27042720d960 could not be found. Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ee66737-f9c8-49ec-a044-27042720d960 could not be found. Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:37:30.095080 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:37:30.099419 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:37:30.099419 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:37:30.099419 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:37:30.099419 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:37:30.099419 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:37:30.099419 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:37:30.099419 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ee66737-f9c8-49ec-a044-27042720d960 could not be found. Jun 05 08:37:30.099419 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:37:30.104075 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-37bd3367-6591-46e9-bc55-d136060ec0b2 tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Returning 404 to user: Instance 4ee66737-f9c8-49ec-a044-27042720d960 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:37:30.105438 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-37bd3367-6591-46e9-bc55-d136060ec0b2 tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] 10.222.0.33 "GET /compute/v2.1/servers/4ee66737-f9c8-49ec-a044-27042720d960" status: 404 len: 111 microversion: 2.1 time: 0.095652 Jun 05 08:37:30.115770 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1400/2886] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:37:30 2022] GET /compute/v2.1/servers/4ee66737-f9c8-49ec-a044-27042720d960 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:37:30.124165 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-eb0eb632-364e-401e-846c-65398f2039ea tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:30.124686 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-eb0eb632-364e-401e-846c-65398f2039ea tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] [instance: e79d84b8-94a4-4824-bc30-c84b31da3746] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:30.153607 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-eb0eb632-364e-401e-846c-65398f2039ea tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:30.157008 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-eb0eb632-364e-401e-846c-65398f2039ea tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:30.158098 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-eb0eb632-364e-401e-846c-65398f2039ea tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:30.158559 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-eb0eb632-364e-401e-846c-65398f2039ea tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:30.281261 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-eb0eb632-364e-401e-846c-65398f2039ea tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] [instance: e79d84b8-94a4-4824-bc30-c84b31da3746] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:37:30.343054 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e6fc7399-fcf5-4953-bcc6-f1de27932595 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:30.344296 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e6fc7399-fcf5-4953-bcc6-f1de27932595 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:30.357861 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e6fc7399-fcf5-4953-bcc6-f1de27932595 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:30.358699 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e6fc7399-fcf5-4953-bcc6-f1de27932595 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:30.359687 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e6fc7399-fcf5-4953-bcc6-f1de27932595 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:30.360361 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e6fc7399-fcf5-4953-bcc6-f1de27932595 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:30.398229 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-eb0eb632-364e-401e-846c-65398f2039ea tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] [instance: e79d84b8-94a4-4824-bc30-c84b31da3746] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:37:30.399267 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-eb0eb632-364e-401e-846c-65398f2039ea tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:30.399829 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-eb0eb632-364e-401e-846c-65398f2039ea tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:30.400319 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-eb0eb632-364e-401e-846c-65398f2039ea tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] [instance: e79d84b8-94a4-4824-bc30-c84b31da3746] instance's host None is down, deleting from database Jun 05 08:37:30.411065 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-eb0eb632-364e-401e-846c-65398f2039ea tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] [instance: e79d84b8-94a4-4824-bc30-c84b31da3746] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:37:31.300277 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-eb0eb632-364e-401e-846c-65398f2039ea tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] [instance: e79d84b8-94a4-4824-bc30-c84b31da3746] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:37:31.309890 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-eb0eb632-364e-401e-846c-65398f2039ea tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] [instance: e79d84b8-94a4-4824-bc30-c84b31da3746] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:37:31.398372 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e6fc7399-fcf5-4953-bcc6-f1de27932595 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:31.413868 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e6fc7399-fcf5-4953-bcc6-f1de27932595 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:31.416421 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e6fc7399-fcf5-4953-bcc6-f1de27932595 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:31.423001 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e6fc7399-fcf5-4953-bcc6-f1de27932595 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 1.083265 Jun 05 08:37:31.425288 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1401/2887] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:37:30 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:37:31.656261 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=62,nova_cell0:UPDATE=30,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=4 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:37:31.677825 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-eb0eb632-364e-401e-846c-65398f2039ea tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e79d84b8-94a4-4824-bc30-c84b31da3746" status: 204 len: 0 microversion: 2.1 time: 1.560626 Jun 05 08:37:31.682471 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1487/2888] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:37:30 2022] DELETE /compute/v2.1/servers/e79d84b8-94a4-4824-bc30-c84b31da3746 => generated 0 bytes in 1565 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 05 08:37:31.690424 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6b03d0fd-b5fe-403b-89e8-f08846b8be9f tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:31.691502 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6b03d0fd-b5fe-403b-89e8-f08846b8be9f tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] [instance: e79d84b8-94a4-4824-bc30-c84b31da3746] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:31.707211 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6b03d0fd-b5fe-403b-89e8-f08846b8be9f tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:31.707679 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6b03d0fd-b5fe-403b-89e8-f08846b8be9f tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:31.708506 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6b03d0fd-b5fe-403b-89e8-f08846b8be9f tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:31.708955 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6b03d0fd-b5fe-403b-89e8-f08846b8be9f tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:31.737820 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-6b03d0fd-b5fe-403b-89e8-f08846b8be9f tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] HTTP exception thrown: Instance e79d84b8-94a4-4824-bc30-c84b31da3746 could not be found. Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6b03d0fd-b5fe-403b-89e8-f08846b8be9f tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Request method failure captured: Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/e79d84b8-94a4-4824-bc30-c84b31da3746 HTTP/1.1 Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGtA7MjmPJSPj37FlW0pYwCUR7kD8aKYiJZwYiWAX2ZtujP6mLenaw6EOmWrr_hZrxCV7uWxzna7QLkX9-XJWQt_rHKZZd3aWk5pBBWvHc_mIWkpUT36vsTrwyrgfnpjqYkgwqKj6_XLCdhxxCco0BfCbnl5R-z-b9PyGYlDXhJllWA Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 119c9a66fb2d4bffa0f49b4acdd687c8 Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2132038711 Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/119c9a66fb2d4bffa0f49b4acdd687c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/119c9a66fb2d4bffa0f49b4acdd687c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_119c9a66fb2d4bffa0f49b4acdd687c8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/119c9a66fb2d4bffa0f49b4acdd687c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2132038711 Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 119c9a66fb2d4bffa0f49b4acdd687c8 Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2132038711 Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ServerRescueNegativeTestJSON-2132038711-project Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 96c6b12b5ebf43b68c134c05924de220 Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2132038711-project Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance e79d84b8-94a4-4824-bc30-c84b31da3746 could not be found. Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'e79d84b8-94a4-4824-bc30-c84b31da3746'} Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e79d84b8-94a4-4824-bc30-c84b31da3746 could not be found. Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e79d84b8-94a4-4824-bc30-c84b31da3746 could not be found. Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:37:31.739358 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:37:31.743815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:37:31.743815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:37:31.743815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:37:31.743815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:37:31.743815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:37:31.743815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:37:31.743815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e79d84b8-94a4-4824-bc30-c84b31da3746 could not be found. Jun 05 08:37:31.743815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:37:31.743815 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6b03d0fd-b5fe-403b-89e8-f08846b8be9f tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] Returning 404 to user: Instance e79d84b8-94a4-4824-bc30-c84b31da3746 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:37:31.757142 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6b03d0fd-b5fe-403b-89e8-f08846b8be9f tempest-ServerRescueNegativeTestJSON-2132038711 tempest-ServerRescueNegativeTestJSON-2132038711-project] 10.222.0.33 "GET /compute/v2.1/servers/e79d84b8-94a4-4824-bc30-c84b31da3746" status: 404 len: 111 microversion: 2.1 time: 0.070379 Jun 05 08:37:31.758004 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1402/2889] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:37:31 2022] GET /compute/v2.1/servers/e79d84b8-94a4-4824-bc30-c84b31da3746 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:37:32.445243 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b7bc7190-cce9-4cdd-a960-d1b6222ba072 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:32.446069 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b7bc7190-cce9-4cdd-a960-d1b6222ba072 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:32.497610 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b7bc7190-cce9-4cdd-a960-d1b6222ba072 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:32.498270 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b7bc7190-cce9-4cdd-a960-d1b6222ba072 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:32.499294 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b7bc7190-cce9-4cdd-a960-d1b6222ba072 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:32.499962 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b7bc7190-cce9-4cdd-a960-d1b6222ba072 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:32.670397 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b7bc7190-cce9-4cdd-a960-d1b6222ba072 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:32.690551 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b7bc7190-cce9-4cdd-a960-d1b6222ba072 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:32.693505 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b7bc7190-cce9-4cdd-a960-d1b6222ba072 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:32.700537 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b7bc7190-cce9-4cdd-a960-d1b6222ba072 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.260320 Jun 05 08:37:32.703126 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1488/2890] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:37:32 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:37:33.720778 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-60161021-8527-4a2e-81f9-b281dd9b05e7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:33.721978 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-60161021-8527-4a2e-81f9-b281dd9b05e7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:33.735892 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-60161021-8527-4a2e-81f9-b281dd9b05e7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:33.736940 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-60161021-8527-4a2e-81f9-b281dd9b05e7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:33.737919 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-60161021-8527-4a2e-81f9-b281dd9b05e7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:33.738555 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-60161021-8527-4a2e-81f9-b281dd9b05e7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:34.094506 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-60161021-8527-4a2e-81f9-b281dd9b05e7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:34.108341 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-60161021-8527-4a2e-81f9-b281dd9b05e7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:34.110370 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-60161021-8527-4a2e-81f9-b281dd9b05e7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:34.113782 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-60161021-8527-4a2e-81f9-b281dd9b05e7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.396819 Jun 05 08:37:34.116746 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1403/2891] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:37:33 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:37:35.134991 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e4f08fae-621d-4091-bd52-99ebc143b3e7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:35.135723 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e4f08fae-621d-4091-bd52-99ebc143b3e7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:35.151844 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e4f08fae-621d-4091-bd52-99ebc143b3e7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:35.152339 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e4f08fae-621d-4091-bd52-99ebc143b3e7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:35.153143 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e4f08fae-621d-4091-bd52-99ebc143b3e7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:35.153590 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e4f08fae-621d-4091-bd52-99ebc143b3e7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:35.561514 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e4f08fae-621d-4091-bd52-99ebc143b3e7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:35.574892 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e4f08fae-621d-4091-bd52-99ebc143b3e7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:35.583401 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e4f08fae-621d-4091-bd52-99ebc143b3e7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:35.590123 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e4f08fae-621d-4091-bd52-99ebc143b3e7 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.454193 Jun 05 08:37:35.591027 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1489/2892] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:37:35 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:37:36.610594 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5ddcfeb9-37fe-4775-9217-8a8e1c386e74 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:36.612351 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5ddcfeb9-37fe-4775-9217-8a8e1c386e74 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:36.635392 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5ddcfeb9-37fe-4775-9217-8a8e1c386e74 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:36.636264 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5ddcfeb9-37fe-4775-9217-8a8e1c386e74 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:36.637306 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5ddcfeb9-37fe-4775-9217-8a8e1c386e74 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:36.638007 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5ddcfeb9-37fe-4775-9217-8a8e1c386e74 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:37.085775 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5ddcfeb9-37fe-4775-9217-8a8e1c386e74 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:37.093629 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=66 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:37:37.097915 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5ddcfeb9-37fe-4775-9217-8a8e1c386e74 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:37.099941 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-5ddcfeb9-37fe-4775-9217-8a8e1c386e74 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:37.102676 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5ddcfeb9-37fe-4775-9217-8a8e1c386e74 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1604 microversion: 2.42 time: 0.496322 Jun 05 08:37:37.106720 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1404/2893] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:37:36 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1604 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:37:38.122685 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e38a14bb-6035-4f88-bb33-e41139e5076f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:38.123322 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e38a14bb-6035-4f88-bb33-e41139e5076f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:38.126914 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=20 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:37:38.150072 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e38a14bb-6035-4f88-bb33-e41139e5076f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:38.150637 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e38a14bb-6035-4f88-bb33-e41139e5076f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:38.151483 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e38a14bb-6035-4f88-bb33-e41139e5076f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:38.151939 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e38a14bb-6035-4f88-bb33-e41139e5076f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:38.248805 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e38a14bb-6035-4f88-bb33-e41139e5076f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:38.251100 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e38a14bb-6035-4f88-bb33-e41139e5076f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:38.253425 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-e38a14bb-6035-4f88-bb33-e41139e5076f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lazy-loading 'fault' on Instance uuid 40933e98-d7d3-4d63-9012-ad5607e45085 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:37:38.409233 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e38a14bb-6035-4f88-bb33-e41139e5076f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:38.414287 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=54 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:37:38.440619 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e38a14bb-6035-4f88-bb33-e41139e5076f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:38.442176 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e38a14bb-6035-4f88-bb33-e41139e5076f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:38.443428 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e38a14bb-6035-4f88-bb33-e41139e5076f tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1664 microversion: 2.42 time: 0.325640 Jun 05 08:37:38.451807 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1490/2894] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:37:38 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1664 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:37:38.469764 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bf98063a-a923-452f-a750-5b7ccc610650 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '.version_select at 0x7f24330fc3a0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:38.489329 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=10 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:37:38.534806 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bf98063a-a923-452f-a750-5b7ccc610650 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-705772990" status: 204 len: 0 microversion: 2.42 time: 0.068852 Jun 05 08:37:38.538056 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1405/2895] 10.222.0.33 () {60 vars in 1258 bytes} [Sun Jun 5 08:37:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-705772990 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:37:45.003691 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9d5804f5-c9d9-4de6-912b-9113b4c42bbd tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1809057610", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "d14ae702-0818-43c6-9436-5f9bafeed85a"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:37:45.019250 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:37:45.118301 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-9d5804f5-c9d9-4de6-912b-9113b4c42bbd tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] validate_networks() for [('d14ae702-0818-43c6-9436-5f9bafeed85a', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:37:47.503649 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:UPDATE=4,nova_cell0:DELETE=2,nova_cell0:SELECT=14 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:37:47.511566 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-aea7ca28-e3c3-48c5-a3a8-de014a59b79d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:47.512102 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-aea7ca28-e3c3-48c5-a3a8-de014a59b79d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:47.523225 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:37:47.526736 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aea7ca28-e3c3-48c5-a3a8-de014a59b79d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:47.527194 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aea7ca28-e3c3-48c5-a3a8-de014a59b79d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:47.528351 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aea7ca28-e3c3-48c5-a3a8-de014a59b79d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:47.529438 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aea7ca28-e3c3-48c5-a3a8-de014a59b79d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:47.565420 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-aea7ca28-e3c3-48c5-a3a8-de014a59b79d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:37:47.593326 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-9d5804f5-c9d9-4de6-912b-9113b4c42bbd tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:37:47.593825 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-9d5804f5-c9d9-4de6-912b-9113b4c42bbd tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:37:47.594360 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-9d5804f5-c9d9-4de6-912b-9113b4c42bbd tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:37:47.594851 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-9d5804f5-c9d9-4de6-912b-9113b4c42bbd tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:37:47.595344 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-9d5804f5-c9d9-4de6-912b-9113b4c42bbd tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:37:47.617874 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9d5804f5-c9d9-4de6-912b-9113b4c42bbd tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:47.620161 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9d5804f5-c9d9-4de6-912b-9113b4c42bbd tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:47.622795 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9d5804f5-c9d9-4de6-912b-9113b4c42bbd tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:47.623371 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-9d5804f5-c9d9-4de6-912b-9113b4c42bbd tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:47.666300 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-9d5804f5-c9d9-4de6-912b-9113b4c42bbd tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Getting quotas for project c73adcc5e87347baba506db7eebbe3c1. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:37:47.679747 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-9d5804f5-c9d9-4de6-912b-9113b4c42bbd tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Getting quotas for user cb9a4116eb4d490383172414226ac54a and project c73adcc5e87347baba506db7eebbe3c1. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:37:47.736546 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-aea7ca28-e3c3-48c5-a3a8-de014a59b79d tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "DELETE /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 204 len: 0 microversion: 2.42 time: 0.233140 Jun 05 08:37:47.740199 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9d5804f5-c9d9-4de6-912b-9113b4c42bbd tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:37:47.742390 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1406/2896] 10.222.0.33 () {60 vars in 1279 bytes} [Sun Jun 5 08:37:47 2022] DELETE /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 05 08:37:47.743563 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9d5804f5-c9d9-4de6-912b-9113b4c42bbd tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] [instance: a9d7bede-7b3d-44bb-a141-08fdbbccb216] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:37:47.756819 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bc8c2239-a215-4dd4-8460-cfbf23fbb8e6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:47.758275 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-bc8c2239-a215-4dd4-8460-cfbf23fbb8e6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:47.774319 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bc8c2239-a215-4dd4-8460-cfbf23fbb8e6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:47.776980 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bc8c2239-a215-4dd4-8460-cfbf23fbb8e6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:47.778955 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bc8c2239-a215-4dd4-8460-cfbf23fbb8e6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:47.780162 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bc8c2239-a215-4dd4-8460-cfbf23fbb8e6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:47.863293 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bc8c2239-a215-4dd4-8460-cfbf23fbb8e6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:47.864373 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bc8c2239-a215-4dd4-8460-cfbf23fbb8e6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:47.866411 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-bc8c2239-a215-4dd4-8460-cfbf23fbb8e6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lazy-loading 'fault' on Instance uuid 40933e98-d7d3-4d63-9012-ad5607e45085 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:37:47.870957 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9d5804f5-c9d9-4de6-912b-9113b4c42bbd tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.613779 Jun 05 08:37:47.876661 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1491/2897] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:37:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 3621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:37:47.884761 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7d0649a3-77c0-40a9-a914-8e89c337bc24 tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:47.885396 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7d0649a3-77c0-40a9-a914-8e89c337bc24 tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] [instance: a9d7bede-7b3d-44bb-a141-08fdbbccb216] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:48.089336 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-bc8c2239-a215-4dd4-8460-cfbf23fbb8e6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:48.118528 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-bc8c2239-a215-4dd4-8460-cfbf23fbb8e6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:48.126936 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7d0649a3-77c0-40a9-a914-8e89c337bc24 tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb9a4116eb4d490383172414226ac54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73adcc5e87347baba506db7eebbe3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:48.135369 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7d0649a3-77c0-40a9-a914-8e89c337bc24 tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] 10.222.0.33 "GET /compute/v2.1/servers/a9d7bede-7b3d-44bb-a141-08fdbbccb216" status: 200 len: 1224 microversion: 2.1 time: 0.256957 Jun 05 08:37:48.135619 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-bc8c2239-a215-4dd4-8460-cfbf23fbb8e6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:48.138194 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1492/2898] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:37:47 2022] GET /compute/v2.1/servers/a9d7bede-7b3d-44bb-a141-08fdbbccb216 => generated 1224 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:37:48.141159 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bc8c2239-a215-4dd4-8460-cfbf23fbb8e6 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1670 microversion: 2.42 time: 0.395394 Jun 05 08:37:48.148349 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1407/2899] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:37:47 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1670 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:37:49.153774 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5dc892f9-623c-4c7a-9062-4d2b872299f2 tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:49.154882 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5dc892f9-623c-4c7a-9062-4d2b872299f2 tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] [instance: a9d7bede-7b3d-44bb-a141-08fdbbccb216] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:49.169591 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5dc892f9-623c-4c7a-9062-4d2b872299f2 tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:49.169977 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-879bc5ee-fa38-47a5-8b8e-309fb6bec531 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:49.170434 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5dc892f9-623c-4c7a-9062-4d2b872299f2 tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:49.170837 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5dc892f9-623c-4c7a-9062-4d2b872299f2 tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:49.171289 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5dc892f9-623c-4c7a-9062-4d2b872299f2 tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:49.171549 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-879bc5ee-fa38-47a5-8b8e-309fb6bec531 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] [instance: 40933e98-d7d3-4d63-9012-ad5607e45085] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:49.189301 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-879bc5ee-fa38-47a5-8b8e-309fb6bec531 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:49.190062 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-879bc5ee-fa38-47a5-8b8e-309fb6bec531 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:49.191024 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-879bc5ee-fa38-47a5-8b8e-309fb6bec531 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:49.191626 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-879bc5ee-fa38-47a5-8b8e-309fb6bec531 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:49.249817 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5dc892f9-623c-4c7a-9062-4d2b872299f2 tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:49.249817 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5dc892f9-623c-4c7a-9062-4d2b872299f2 tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:49.249817 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-5dc892f9-623c-4c7a-9062-4d2b872299f2 tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Lazy-loading 'fault' on Instance uuid a9d7bede-7b3d-44bb-a141-08fdbbccb216 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:37:49.271150 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-879bc5ee-fa38-47a5-8b8e-309fb6bec531 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:49.271837 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-879bc5ee-fa38-47a5-8b8e-309fb6bec531 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:49.272957 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-879bc5ee-fa38-47a5-8b8e-309fb6bec531 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Lazy-loading 'fault' on Instance uuid 40933e98-d7d3-4d63-9012-ad5607e45085 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:37:49.406256 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5dc892f9-623c-4c7a-9062-4d2b872299f2 tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb9a4116eb4d490383172414226ac54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c73adcc5e87347baba506db7eebbe3c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:49.418765 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5dc892f9-623c-4c7a-9062-4d2b872299f2 tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] 10.222.0.33 "GET /compute/v2.1/servers/a9d7bede-7b3d-44bb-a141-08fdbbccb216" status: 200 len: 1297 microversion: 2.1 time: 0.269512 Jun 05 08:37:49.431100 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1493/2900] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:37:49 2022] GET /compute/v2.1/servers/a9d7bede-7b3d-44bb-a141-08fdbbccb216 => generated 1297 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:37:49.438471 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-abd84f1c-c1d1-4af7-9054-845a7cb02d4f tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:49.439226 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-abd84f1c-c1d1-4af7-9054-845a7cb02d4f tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] [instance: a9d7bede-7b3d-44bb-a141-08fdbbccb216] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:49.440964 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-879bc5ee-fa38-47a5-8b8e-309fb6bec531 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:49.448865 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-abd84f1c-c1d1-4af7-9054-845a7cb02d4f tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:49.449678 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-abd84f1c-c1d1-4af7-9054-845a7cb02d4f tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:49.451369 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-abd84f1c-c1d1-4af7-9054-845a7cb02d4f tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:49.452019 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-abd84f1c-c1d1-4af7-9054-845a7cb02d4f tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:49.467401 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-879bc5ee-fa38-47a5-8b8e-309fb6bec531 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:49.468962 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-879bc5ee-fa38-47a5-8b8e-309fb6bec531 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7845e5ff0904a14b7f6c4960cc54ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc6408756fb4f4f9f65f4c9d5c186dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:49.470195 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-879bc5ee-fa38-47a5-8b8e-309fb6bec531 tempest-TaggedBootDevicesTest_v242-1203098231 tempest-TaggedBootDevicesTest_v242-1203098231-project] 10.222.0.33 "GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085" status: 200 len: 1670 microversion: 2.42 time: 0.305660 Jun 05 08:37:49.489800 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-abd84f1c-c1d1-4af7-9054-845a7cb02d4f tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] [instance: a9d7bede-7b3d-44bb-a141-08fdbbccb216] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:37:49.500475 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1408/2901] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:37:49 2022] GET /compute/v2.1/servers/40933e98-d7d3-4d63-9012-ad5607e45085 => generated 1670 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:37:49.562326 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-abd84f1c-c1d1-4af7-9054-845a7cb02d4f tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] [instance: a9d7bede-7b3d-44bb-a141-08fdbbccb216] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:37:49.563866 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-abd84f1c-c1d1-4af7-9054-845a7cb02d4f tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:49.565017 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-abd84f1c-c1d1-4af7-9054-845a7cb02d4f tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:49.566213 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-abd84f1c-c1d1-4af7-9054-845a7cb02d4f tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] [instance: a9d7bede-7b3d-44bb-a141-08fdbbccb216] instance's host None is down, deleting from database Jun 05 08:37:49.573502 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-abd84f1c-c1d1-4af7-9054-845a7cb02d4f tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] [instance: a9d7bede-7b3d-44bb-a141-08fdbbccb216] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:37:49.693507 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-abd84f1c-c1d1-4af7-9054-845a7cb02d4f tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] [instance: a9d7bede-7b3d-44bb-a141-08fdbbccb216] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:37:49.700895 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-abd84f1c-c1d1-4af7-9054-845a7cb02d4f tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] [instance: a9d7bede-7b3d-44bb-a141-08fdbbccb216] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:37:49.988263 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-abd84f1c-c1d1-4af7-9054-845a7cb02d4f tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a9d7bede-7b3d-44bb-a141-08fdbbccb216" status: 204 len: 0 microversion: 2.1 time: 0.555552 Jun 05 08:37:49.990545 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1494/2902] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:37:49 2022] DELETE /compute/v2.1/servers/a9d7bede-7b3d-44bb-a141-08fdbbccb216 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:37:49.999551 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-62e25920-b469-45af-8f4a-6147211a29d3 tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:50.000200 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-62e25920-b469-45af-8f4a-6147211a29d3 tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] [instance: a9d7bede-7b3d-44bb-a141-08fdbbccb216] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:50.007778 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-62e25920-b469-45af-8f4a-6147211a29d3 tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:50.008260 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-62e25920-b469-45af-8f4a-6147211a29d3 tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:50.009778 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-62e25920-b469-45af-8f4a-6147211a29d3 tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:50.010391 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-62e25920-b469-45af-8f4a-6147211a29d3 tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:50.038708 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-62e25920-b469-45af-8f4a-6147211a29d3 tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] HTTP exception thrown: Instance a9d7bede-7b3d-44bb-a141-08fdbbccb216 could not be found. Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-62e25920-b469-45af-8f4a-6147211a29d3 tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Request method failure captured: Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/a9d7bede-7b3d-44bb-a141-08fdbbccb216 HTTP/1.1 Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGtXtQuw7UgM9QM_O4m9m-Qcvn8peCbz-yeYqlBvJ9SlY1PLZ4zGvK2QNZgmM3ajY16yjW7foMnhVqngkeXTpyebuNK2s2ByFhUbStRj3E_ua0X4sFR6BzdKZmqwN94gPjk_hwoTKXDrBoh8EmNSgVv5B9uwFme_xZORZQ43f4G5dq4 Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: c73adcc5e87347baba506db7eebbe3c1 Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-971335423 Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c73adcc5e87347baba506db7eebbe3c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "tempest-ServicesTestJSON-Type-475587695", "name": "tempest-ServicesTestJSON-Service-1677347360", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c73adcc5e87347baba506db7eebbe3c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "tempest-ServicesTestJSON-Type-86808766", "name": "tempest-ServicesTestJSON-Service-1917632323", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c73adcc5e87347baba506db7eebbe3c1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "tempest-ServicesTestJSON-Type-785886544", "name": "tempest-ServicesTestJSON-Service-1913999411", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c73adcc5e87347baba506db7eebbe3c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-971335423 Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: c73adcc5e87347baba506db7eebbe3c1 Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-971335423 Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-FloatingIPsAssociationTestJSON-971335423-project Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: cb9a4116eb4d490383172414226ac54a Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-971335423-project Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance a9d7bede-7b3d-44bb-a141-08fdbbccb216 could not be found. Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'a9d7bede-7b3d-44bb-a141-08fdbbccb216'} Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9d7bede-7b3d-44bb-a141-08fdbbccb216 could not be found. Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:37:50.040895 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:37:50.045350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:37:50.045350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9d7bede-7b3d-44bb-a141-08fdbbccb216 could not be found. Jun 05 08:37:50.045350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:37:50.045350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:37:50.045350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:37:50.045350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:37:50.045350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:37:50.045350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:37:50.045350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:37:50.045350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:37:50.045350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9d7bede-7b3d-44bb-a141-08fdbbccb216 could not be found. Jun 05 08:37:50.045350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:37:50.045350 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-62e25920-b469-45af-8f4a-6147211a29d3 tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] Returning 404 to user: Instance a9d7bede-7b3d-44bb-a141-08fdbbccb216 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:37:50.045350 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-62e25920-b469-45af-8f4a-6147211a29d3 tempest-FloatingIPsAssociationTestJSON-971335423 tempest-FloatingIPsAssociationTestJSON-971335423-project] 10.222.0.33 "GET /compute/v2.1/servers/a9d7bede-7b3d-44bb-a141-08fdbbccb216" status: 404 len: 111 microversion: 2.1 time: 0.047619 Jun 05 08:37:50.049589 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1409/2903] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:37:49 2022] GET /compute/v2.1/servers/a9d7bede-7b3d-44bb-a141-08fdbbccb216 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:37:52.385105 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-933a67ed-48b6-4642-b7a5-570c31e021c4 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-693097359", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": "none"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:37:52.474466 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-933a67ed-48b6-4642-b7a5-570c31e021c4 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:37:52.475255 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-933a67ed-48b6-4642-b7a5-570c31e021c4 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:37:52.475668 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-933a67ed-48b6-4642-b7a5-570c31e021c4 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:37:52.477566 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-933a67ed-48b6-4642-b7a5-570c31e021c4 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:37:52.478576 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-933a67ed-48b6-4642-b7a5-570c31e021c4 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:37:52.504085 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-933a67ed-48b6-4642-b7a5-570c31e021c4 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:52.504557 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-933a67ed-48b6-4642-b7a5-570c31e021c4 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:52.505452 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-933a67ed-48b6-4642-b7a5-570c31e021c4 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:52.505962 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-933a67ed-48b6-4642-b7a5-570c31e021c4 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:52.565573 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-933a67ed-48b6-4642-b7a5-570c31e021c4 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Getting quotas for project 802438fe265042e8a554ddff64966226. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:37:52.571765 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-933a67ed-48b6-4642-b7a5-570c31e021c4 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Getting quotas for user 7a3bbbfb0cb14d049902eb17c8f3bba6 and project 802438fe265042e8a554ddff64966226. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:37:52.605207 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-933a67ed-48b6-4642-b7a5-570c31e021c4 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:37:52.607443 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-933a67ed-48b6-4642-b7a5-570c31e021c4 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] [instance: edc89d49-cd7f-4ad2-8c9f-b73a50ec1c7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:37:52.704155 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-933a67ed-48b6-4642-b7a5-570c31e021c4 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.654655 Jun 05 08:37:52.716618 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0a4e99fa-86c0-4c94-bbfd-236981f78a92 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:52.717582 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1495/2904] 10.222.0.33 () {62 vars in 1187 bytes} [Sun Jun 5 08:37:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 05 08:37:52.718600 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0a4e99fa-86c0-4c94-bbfd-236981f78a92 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] [instance: edc89d49-cd7f-4ad2-8c9f-b73a50ec1c7b] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:52.846201 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0a4e99fa-86c0-4c94-bbfd-236981f78a92 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bbbfb0cb14d049902eb17c8f3bba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802438fe265042e8a554ddff64966226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:52.859239 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0a4e99fa-86c0-4c94-bbfd-236981f78a92 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a3bbbfb0cb14d049902eb17c8f3bba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802438fe265042e8a554ddff64966226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:52.863266 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0a4e99fa-86c0-4c94-bbfd-236981f78a92 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a3bbbfb0cb14d049902eb17c8f3bba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802438fe265042e8a554ddff64966226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:52.866742 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0a4e99fa-86c0-4c94-bbfd-236981f78a92 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] 10.222.0.33 "GET /compute/v2.1/servers/edc89d49-cd7f-4ad2-8c9f-b73a50ec1c7b" status: 200 len: 1277 microversion: 2.57 time: 0.155453 Jun 05 08:37:52.886137 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1410/2905] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:37:52 2022] GET /compute/v2.1/servers/edc89d49-cd7f-4ad2-8c9f-b73a50ec1c7b => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 05 08:37:53.893311 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-22e35a67-c36c-4a4f-b14a-574bb6bfff37 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:53.894162 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-22e35a67-c36c-4a4f-b14a-574bb6bfff37 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] [instance: edc89d49-cd7f-4ad2-8c9f-b73a50ec1c7b] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:53.905818 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-22e35a67-c36c-4a4f-b14a-574bb6bfff37 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:53.909085 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-22e35a67-c36c-4a4f-b14a-574bb6bfff37 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:53.912175 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-22e35a67-c36c-4a4f-b14a-574bb6bfff37 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:53.915508 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-22e35a67-c36c-4a4f-b14a-574bb6bfff37 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:54.000883 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-22e35a67-c36c-4a4f-b14a-574bb6bfff37 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:54.001634 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-22e35a67-c36c-4a4f-b14a-574bb6bfff37 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:54.005631 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-22e35a67-c36c-4a4f-b14a-574bb6bfff37 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Lazy-loading 'fault' on Instance uuid edc89d49-cd7f-4ad2-8c9f-b73a50ec1c7b {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:37:54.319090 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-22e35a67-c36c-4a4f-b14a-574bb6bfff37 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3bbbfb0cb14d049902eb17c8f3bba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802438fe265042e8a554ddff64966226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:54.340110 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-22e35a67-c36c-4a4f-b14a-574bb6bfff37 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a3bbbfb0cb14d049902eb17c8f3bba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802438fe265042e8a554ddff64966226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:54.345417 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-22e35a67-c36c-4a4f-b14a-574bb6bfff37 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a3bbbfb0cb14d049902eb17c8f3bba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '802438fe265042e8a554ddff64966226', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:37:54.350726 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-22e35a67-c36c-4a4f-b14a-574bb6bfff37 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] 10.222.0.33 "GET /compute/v2.1/servers/edc89d49-cd7f-4ad2-8c9f-b73a50ec1c7b" status: 200 len: 1350 microversion: 2.57 time: 0.462782 Jun 05 08:37:54.368743 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1496/2906] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:37:53 2022] GET /compute/v2.1/servers/edc89d49-cd7f-4ad2-8c9f-b73a50ec1c7b => generated 1350 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 05 08:37:54.370722 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-df562c98-081b-4396-bf83-7d041e345a79 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:54.371211 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-df562c98-081b-4396-bf83-7d041e345a79 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] [instance: edc89d49-cd7f-4ad2-8c9f-b73a50ec1c7b] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:54.388901 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-df562c98-081b-4396-bf83-7d041e345a79 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:54.389353 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-df562c98-081b-4396-bf83-7d041e345a79 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:54.390148 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-df562c98-081b-4396-bf83-7d041e345a79 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:54.396084 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-df562c98-081b-4396-bf83-7d041e345a79 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:54.488824 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-df562c98-081b-4396-bf83-7d041e345a79 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] [instance: edc89d49-cd7f-4ad2-8c9f-b73a50ec1c7b] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:37:54.608169 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-df562c98-081b-4396-bf83-7d041e345a79 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] [instance: edc89d49-cd7f-4ad2-8c9f-b73a50ec1c7b] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:37:54.610380 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-df562c98-081b-4396-bf83-7d041e345a79 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:54.612140 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-df562c98-081b-4396-bf83-7d041e345a79 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:54.612852 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-df562c98-081b-4396-bf83-7d041e345a79 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] [instance: edc89d49-cd7f-4ad2-8c9f-b73a50ec1c7b] instance's host None is down, deleting from database Jun 05 08:37:54.625043 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-df562c98-081b-4396-bf83-7d041e345a79 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] [instance: edc89d49-cd7f-4ad2-8c9f-b73a50ec1c7b] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:37:54.757992 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-df562c98-081b-4396-bf83-7d041e345a79 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] [instance: edc89d49-cd7f-4ad2-8c9f-b73a50ec1c7b] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:37:54.765752 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-df562c98-081b-4396-bf83-7d041e345a79 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] [instance: edc89d49-cd7f-4ad2-8c9f-b73a50ec1c7b] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:37:55.203221 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-df562c98-081b-4396-bf83-7d041e345a79 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] 10.222.0.33 "DELETE /compute/v2.1/servers/edc89d49-cd7f-4ad2-8c9f-b73a50ec1c7b" status: 204 len: 0 microversion: 2.57 time: 0.834104 Jun 05 08:37:55.208451 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1411/2907] 10.222.0.33 () {60 vars in 1279 bytes} [Sun Jun 5 08:37:54 2022] DELETE /compute/v2.1/servers/edc89d49-cd7f-4ad2-8c9f-b73a50ec1c7b => generated 0 bytes in 842 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 05 08:37:55.217903 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-728c09c1-a17c-4733-93aa-dffe23d3bac3 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:37:55.219231 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-728c09c1-a17c-4733-93aa-dffe23d3bac3 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] [instance: edc89d49-cd7f-4ad2-8c9f-b73a50ec1c7b] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:37:55.232338 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-728c09c1-a17c-4733-93aa-dffe23d3bac3 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:55.236672 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-728c09c1-a17c-4733-93aa-dffe23d3bac3 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:55.237784 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-728c09c1-a17c-4733-93aa-dffe23d3bac3 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:37:55.238862 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-728c09c1-a17c-4733-93aa-dffe23d3bac3 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:37:55.277925 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-728c09c1-a17c-4733-93aa-dffe23d3bac3 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] HTTP exception thrown: Instance edc89d49-cd7f-4ad2-8c9f-b73a50ec1c7b could not be found. Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-728c09c1-a17c-4733-93aa-dffe23d3bac3 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Request method failure captured: Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/edc89d49-cd7f-4ad2-8c9f-b73a50ec1c7b HTTP/1.1 Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGtf3gm0Jn89QCMBbteAYxTatDF3SMPQ4fuOgElFoh90LPy8LNF9M-e4vLuEieGPo_VetwE_g1MdV2DypKENPnRiAttMdHc36nMUx--P5oSG7x-S1eiSsMrFSB666B_uxt7VROtW7QFkbiCjnmCMTN-hFOA7-U71H_5LA9Nz5OOCoBM Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: X-Openstack-Nova-Api-Version: 2.57 Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 802438fe265042e8a554ddff64966226 Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ServerShowV257Test-562784539 Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/802438fe265042e8a554ddff64966226"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "tempest-type-105800075", "name": "tempest-service-150663133", "endpoints": [{"region": "tempest-region-1066214357", "internalURL": "https://url-1078067472.com"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/802438fe265042e8a554ddff64966226"}]}, {"type": "tempest-type-683491997", "name": "tempest-service-1129766094", "endpoints": [{"region": "tempest-region-1972431668", "publicURL": "https://url-1691114057.com"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_802438fe265042e8a554ddff64966226", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/802438fe265042e8a554ddff64966226"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ServerShowV257Test-562784539 Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 802438fe265042e8a554ddff64966226 Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ServerShowV257Test-562784539 Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ServerShowV257Test-562784539-project Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 7a3bbbfb0cb14d049902eb17c8f3bba6 Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ServerShowV257Test-562784539-project Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance edc89d49-cd7f-4ad2-8c9f-b73a50ec1c7b could not be found. Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'edc89d49-cd7f-4ad2-8c9f-b73a50ec1c7b'} Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc89d49-cd7f-4ad2-8c9f-b73a50ec1c7b could not be found. Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:37:55.282037 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:37:55.287367 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc89d49-cd7f-4ad2-8c9f-b73a50ec1c7b could not be found. Jun 05 08:37:55.287367 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:37:55.287367 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:37:55.287367 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:37:55.287367 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:37:55.287367 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:37:55.287367 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:37:55.287367 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:37:55.287367 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:37:55.287367 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc89d49-cd7f-4ad2-8c9f-b73a50ec1c7b could not be found. Jun 05 08:37:55.287367 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:37:55.289684 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-728c09c1-a17c-4733-93aa-dffe23d3bac3 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] Returning 404 to user: Instance edc89d49-cd7f-4ad2-8c9f-b73a50ec1c7b could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:37:55.290845 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-728c09c1-a17c-4733-93aa-dffe23d3bac3 tempest-ServerShowV257Test-562784539 tempest-ServerShowV257Test-562784539-project] 10.222.0.33 "GET /compute/v2.1/servers/edc89d49-cd7f-4ad2-8c9f-b73a50ec1c7b" status: 404 len: 111 microversion: 2.57 time: 0.077388 Jun 05 08:37:55.293668 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1497/2908] 10.222.0.33 () {60 vars in 1276 bytes} [Sun Jun 5 08:37:55 2022] GET /compute/v2.1/servers/edc89d49-cd7f-4ad2-8c9f-b73a50ec1c7b => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 05 08:38:02.544819 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:38:02.856475 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:38:03.184217 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-339bb522-20e5-4d63-9cbf-7481da0bdd99 tempest-QuotasTestJSON-1897006790 tempest-QuotasTestJSON-1897006790-project] Calling method '.version_select at 0x7f2432f11670>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:38:03.945178 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-339bb522-20e5-4d63-9cbf-7481da0bdd99 tempest-QuotasTestJSON-1897006790 tempest-QuotasTestJSON-1897006790-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/0fde862eb5444a1e979d8e5c8e36259a/defaults" status: 200 len: 371 microversion: 2.1 time: 1.409138 Jun 05 08:38:03.948650 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1412/2909] 10.222.0.33 () {58 vars in 1268 bytes} [Sun Jun 5 08:38:02 2022] GET /compute/v2.1/os-quota-sets/0fde862eb5444a1e979d8e5c8e36259a/defaults => generated 371 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:38:03.958066 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-204dd3ee-488f-45a8-a3d3-64f6f4fdddcc tempest-QuotasTestJSON-1897006790 tempest-QuotasTestJSON-1897006790-project] Calling method '.version_select at 0x7f2432ea4a60>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:38:03.968713 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=5 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:38:03.970526 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=14 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:38:04.718754 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-204dd3ee-488f-45a8-a3d3-64f6f4fdddcc tempest-QuotasTestJSON-1897006790 tempest-QuotasTestJSON-1897006790-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/0fde862eb5444a1e979d8e5c8e36259a" status: 200 len: 371 microversion: 2.1 time: 0.764405 Jun 05 08:38:04.733977 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1498/2910] 10.222.0.33 () {58 vars in 1241 bytes} [Sun Jun 5 08:38:03 2022] GET /compute/v2.1/os-quota-sets/0fde862eb5444a1e979d8e5c8e36259a => generated 371 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:38:04.738265 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2cfc928e-c247-47d6-93b0-f55c2420060a tempest-QuotasTestJSON-1897006790 tempest-QuotasTestJSON-1897006790-project] Calling method '.version_select at 0x7f2432f115e0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:38:05.183735 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=26,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:38:05.560316 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2cfc928e-c247-47d6-93b0-f55c2420060a tempest-QuotasTestJSON-1897006790 tempest-QuotasTestJSON-1897006790-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/0fde862eb5444a1e979d8e5c8e36259a/defaults" status: 200 len: 371 microversion: 2.1 time: 0.826908 Jun 05 08:38:05.562481 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1413/2911] 10.222.0.33 () {58 vars in 1268 bytes} [Sun Jun 5 08:38:04 2022] GET /compute/v2.1/os-quota-sets/0fde862eb5444a1e979d8e5c8e36259a/defaults => generated 371 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:38:05.576078 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2fa02633-79ce-47a5-9b44-22c3a8a8f099 tempest-QuotasTestJSON-1897006790 tempest-QuotasTestJSON-1897006790-project] Calling method '.version_select at 0x7f2432da0430>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:38:05.594972 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=46,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:38:06.724011 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2fa02633-79ce-47a5-9b44-22c3a8a8f099 tempest-QuotasTestJSON-1897006790 tempest-QuotasTestJSON-1897006790-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/0fde862eb5444a1e979d8e5c8e36259a" status: 200 len: 371 microversion: 2.1 time: 1.153865 Jun 05 08:38:06.730740 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1499/2912] 10.222.0.33 () {58 vars in 1241 bytes} [Sun Jun 5 08:38:05 2022] GET /compute/v2.1/os-quota-sets/0fde862eb5444a1e979d8e5c8e36259a => generated 371 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:38:06.736366 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8cb8f2c4-43e9-4390-97c2-3f4f8b11c8d4 tempest-QuotasTestJSON-1897006790 tempest-QuotasTestJSON-1897006790-project] Calling method '.version_select at 0x7f2432ebd280>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:38:08.038721 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8cb8f2c4-43e9-4390-97c2-3f4f8b11c8d4 tempest-QuotasTestJSON-1897006790 tempest-QuotasTestJSON-1897006790-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/0fde862eb5444a1e979d8e5c8e36259a?user_id=868d0f5046b344e6876b9ffb28a997b8" status: 200 len: 371 microversion: 2.1 time: 1.304998 Jun 05 08:38:08.042433 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1414/2913] 10.222.0.33 () {58 vars in 1322 bytes} [Sun Jun 5 08:38:06 2022] GET /compute/v2.1/os-quota-sets/0fde862eb5444a1e979d8e5c8e36259a?user_id=868d0f5046b344e6876b9ffb28a997b8 => generated 371 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:38:15.818555 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cdfaf764-ac3b-4fb5-ab2f-d902525446a7 tempest-FloatingIPDetailsNegativeTestJSON-218208493 tempest-FloatingIPDetailsNegativeTestJSON-218208493-project] Calling method '.version_select at 0x7f243371ddc0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:38:16.011524 n-d-844739-1 devstack@n-api.service[119050]: DEBUG neutronclient.v2_0.client [None req-cdfaf764-ac3b-4fb5-ab2f-d902525446a7 tempest-FloatingIPDetailsNegativeTestJSON-218208493 tempest-FloatingIPDetailsNegativeTestJSON-218208493-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d9da7009-c1f8-4160-9463-1ca261cb8309 could not be found", "detail": ""}} {{(pid=119050) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 05 08:38:16.012317 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-cdfaf764-ac3b-4fb5-ab2f-d902525446a7 tempest-FloatingIPDetailsNegativeTestJSON-218208493 tempest-FloatingIPDetailsNegativeTestJSON-218208493-project] HTTP exception thrown: Floating IP not found for ID d9da7009-c1f8-4160-9463-1ca261cb8309 Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cdfaf764-ac3b-4fb5-ab2f-d902525446a7 tempest-FloatingIPDetailsNegativeTestJSON-218208493 tempest-FloatingIPDetailsNegativeTestJSON-218208493-project] Request method failure captured: Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-floating-ips/d9da7009-c1f8-4160-9463-1ca261cb8309 HTTP/1.1 Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGt2AcFsBjvWb3UMLj9kGqhoZ3nF8bNYzIaaI5019DzN2naREGFqVHS3rqQkYJR6PFcRi7iZt1Dy6pGL89vHxzinfdM3uWTmXErcsTMFTQAVV557LRLU0OAnpYViexeER8-elSv_qeaQfZBooq3uQLd0lKr8EIQRwwz9Z-VutJZDEzg Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 4d227dbdac11496dbcbd717099e74a44 Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-218208493 Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4d227dbdac11496dbcbd717099e74a44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4d227dbdac11496dbcbd717099e74a44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4d227dbdac11496dbcbd717099e74a44", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4d227dbdac11496dbcbd717099e74a44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-218208493 Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 4d227dbdac11496dbcbd717099e74a44 Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-218208493 Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-218208493-project Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: e4e20434e48c45e6a83a573bd2dffbaa Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-218208493-project Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: exception: Floating IP not found for ID d9da7009-c1f8-4160-9463-1ca261cb8309 Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'd9da7009-c1f8-4160-9463-1ca261cb8309'} Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2810, in get_floating_ip Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d9da7009-c1f8-4160-9463-1ca261cb8309 could not be found Jun 05 08:38:16.016320 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2be0de2-eada-4cc2-9bf9-bb9bca7f1e19'] Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2813, in get_floating_ip Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d9da7009-c1f8-4160-9463-1ca261cb8309. Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d9da7009-c1f8-4160-9463-1ca261cb8309 Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d9da7009-c1f8-4160-9463-1ca261cb8309 Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cdfaf764-ac3b-4fb5-ab2f-d902525446a7 tempest-FloatingIPDetailsNegativeTestJSON-218208493 tempest-FloatingIPDetailsNegativeTestJSON-218208493-project] Returning 404 to user: Floating IP not found for ID d9da7009-c1f8-4160-9463-1ca261cb8309 {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-cdfaf764-ac3b-4fb5-ab2f-d902525446a7 tempest-FloatingIPDetailsNegativeTestJSON-218208493 tempest-FloatingIPDetailsNegativeTestJSON-218208493-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/d9da7009-c1f8-4160-9463-1ca261cb8309" status: 404 len: 111 microversion: 2.1 time: 0.891930 Jun 05 08:38:16.020829 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1500/2914] 10.222.0.33 () {58 vars in 1259 bytes} [Sun Jun 5 08:38:15 2022] GET /compute/v2.1/os-floating-ips/d9da7009-c1f8-4160-9463-1ca261cb8309 => generated 111 bytes in 893 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:38:32.955937 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=4 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:38:32.957161 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:38:33.426146 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=4 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:38:33.430209 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:38:33.905349 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0a1c11a1-8016-4f48-9de8-ed762d106a1f tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Action: 'create', calling method: .version_select at 0x7f2432f11f70>, body: {"keypair": {"name": "tempest-keypair-1246822177", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8NKBE6FjGCJ4W2ObMXhHf4Jx4fkMJ4C4v+AWkwLM7jNQxmlJViFL+vqPZUa017MqGMJLehjHlb3h5qSysbMK6vhyxw6E1wphyD8OzA3kG66DgY+8dNwwUImYO/9zj5bA=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:38:33.954394 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-0a1c11a1-8016-4f48-9de8-ed762d106a1f tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Getting quotas for project 72418fdfbcec401385db6b14842c7c22. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:38:33.982892 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-0a1c11a1-8016-4f48-9de8-ed762d106a1f tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Getting quotas for user b279554204824a50b3fcccc8162da141 and project 72418fdfbcec401385db6b14842c7c22. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:38:34.089375 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0a1c11a1-8016-4f48-9de8-ed762d106a1f tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.138534 Jun 05 08:38:34.090018 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1415/2915] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:38:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:38:34.735348 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ab8ad040-8c30-4701-b94c-47a9036af414 tempest-AbsoluteLimitsTestJSON-1428930307 tempest-AbsoluteLimitsTestJSON-1428930307-project] Calling method '.version_select at 0x7f24337783a0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:38:34.768374 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ab8ad040-8c30-4701-b94c-47a9036af414 tempest-AbsoluteLimitsTestJSON-1428930307 tempest-AbsoluteLimitsTestJSON-1428930307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:34.768839 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ab8ad040-8c30-4701-b94c-47a9036af414 tempest-AbsoluteLimitsTestJSON-1428930307 tempest-AbsoluteLimitsTestJSON-1428930307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:34.769657 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ab8ad040-8c30-4701-b94c-47a9036af414 tempest-AbsoluteLimitsTestJSON-1428930307 tempest-AbsoluteLimitsTestJSON-1428930307-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:34.770102 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ab8ad040-8c30-4701-b94c-47a9036af414 tempest-AbsoluteLimitsTestJSON-1428930307 tempest-AbsoluteLimitsTestJSON-1428930307-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:34.839569 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ab8ad040-8c30-4701-b94c-47a9036af414 tempest-AbsoluteLimitsTestJSON-1428930307 tempest-AbsoluteLimitsTestJSON-1428930307-project] 10.222.0.33 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 1.415121 Jun 05 08:38:34.843295 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1501/2916] 10.222.0.33 () {58 vars in 1121 bytes} [Sun Jun 5 08:38:33 2022] GET /compute/v2.1/limits => generated 511 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:38:37.718537 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2b7a93f4-97d6-45b4-9d93-274325977173 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1013632854", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f1959f42-32fe-44cb-a898-d811ca57e359"}], "security_groups": [{"name": "tempest-securitygroup--1624009519"}], "key_name": "tempest-keypair-1246822177", "user_data": "}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:38:38.512147 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-2b7a93f4-97d6-45b4-9d93-274325977173 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] validate_networks() for [('f1959f42-32fe-44cb-a898-d811ca57e359', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:38:39.342555 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-2b7a93f4-97d6-45b4-9d93-274325977173 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:38:39.351858 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-2b7a93f4-97d6-45b4-9d93-274325977173 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:38:39.351858 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-2b7a93f4-97d6-45b4-9d93-274325977173 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:38:39.351858 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-2b7a93f4-97d6-45b4-9d93-274325977173 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:38:39.351858 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-2b7a93f4-97d6-45b4-9d93-274325977173 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:38:39.365828 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2b7a93f4-97d6-45b4-9d93-274325977173 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:39.372965 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2b7a93f4-97d6-45b4-9d93-274325977173 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:39.373999 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2b7a93f4-97d6-45b4-9d93-274325977173 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:39.374488 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2b7a93f4-97d6-45b4-9d93-274325977173 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:39.395508 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-2b7a93f4-97d6-45b4-9d93-274325977173 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Getting quotas for project 72418fdfbcec401385db6b14842c7c22. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:38:39.401767 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-2b7a93f4-97d6-45b4-9d93-274325977173 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Getting quotas for user b279554204824a50b3fcccc8162da141 and project 72418fdfbcec401385db6b14842c7c22. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:38:39.415719 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2b7a93f4-97d6-45b4-9d93-274325977173 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:38:39.422329 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2b7a93f4-97d6-45b4-9d93-274325977173 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 4cd4ca5f-5442-4cd2-b241-9798ea965234] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:38:39.473160 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2b7a93f4-97d6-45b4-9d93-274325977173 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.760069 Jun 05 08:38:39.473811 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1416/2917] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:38:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 1761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:38:39.487091 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c093396c-3798-4e0d-bc9c-dd9dfa3a168f tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:38:39.488369 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c093396c-3798-4e0d-bc9c-dd9dfa3a168f tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 4cd4ca5f-5442-4cd2-b241-9798ea965234] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:38:40.302409 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c093396c-3798-4e0d-bc9c-dd9dfa3a168f tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b279554204824a50b3fcccc8162da141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72418fdfbcec401385db6b14842c7c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:38:40.317352 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c093396c-3798-4e0d-bc9c-dd9dfa3a168f tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] 10.222.0.33 "GET /compute/v2.1/servers/4cd4ca5f-5442-4cd2-b241-9798ea965234" status: 200 len: 1242 microversion: 2.1 time: 0.830778 Jun 05 08:38:40.328957 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1502/2918] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:38:39 2022] GET /compute/v2.1/servers/4cd4ca5f-5442-4cd2-b241-9798ea965234 => generated 1242 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:38:41.340305 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0e0accf2-4978-4a0e-aa36-2a3bd4cbbc99 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:38:41.341439 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0e0accf2-4978-4a0e-aa36-2a3bd4cbbc99 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 4cd4ca5f-5442-4cd2-b241-9798ea965234] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:38:41.360572 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0e0accf2-4978-4a0e-aa36-2a3bd4cbbc99 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:41.362145 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0e0accf2-4978-4a0e-aa36-2a3bd4cbbc99 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:41.363097 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0e0accf2-4978-4a0e-aa36-2a3bd4cbbc99 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:41.364612 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0e0accf2-4978-4a0e-aa36-2a3bd4cbbc99 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:41.430830 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0e0accf2-4978-4a0e-aa36-2a3bd4cbbc99 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:41.434092 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0e0accf2-4978-4a0e-aa36-2a3bd4cbbc99 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:41.434866 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-0e0accf2-4978-4a0e-aa36-2a3bd4cbbc99 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lazy-loading 'fault' on Instance uuid 4cd4ca5f-5442-4cd2-b241-9798ea965234 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:38:41.518499 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0e0accf2-4978-4a0e-aa36-2a3bd4cbbc99 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b279554204824a50b3fcccc8162da141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72418fdfbcec401385db6b14842c7c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:38:41.530928 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0e0accf2-4978-4a0e-aa36-2a3bd4cbbc99 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] 10.222.0.33 "GET /compute/v2.1/servers/4cd4ca5f-5442-4cd2-b241-9798ea965234" status: 200 len: 1315 microversion: 2.1 time: 0.199778 Jun 05 08:38:41.531514 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1417/2919] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:38:41 2022] GET /compute/v2.1/servers/4cd4ca5f-5442-4cd2-b241-9798ea965234 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:38:41.551296 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-10b99989-8b5e-4649-a4f8-01875e1fb287 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:38:41.553289 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-10b99989-8b5e-4649-a4f8-01875e1fb287 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 4cd4ca5f-5442-4cd2-b241-9798ea965234] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:38:41.563988 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10b99989-8b5e-4649-a4f8-01875e1fb287 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:41.564818 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10b99989-8b5e-4649-a4f8-01875e1fb287 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:41.565857 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10b99989-8b5e-4649-a4f8-01875e1fb287 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:41.566465 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10b99989-8b5e-4649-a4f8-01875e1fb287 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:41.598382 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-10b99989-8b5e-4649-a4f8-01875e1fb287 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 4cd4ca5f-5442-4cd2-b241-9798ea965234] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:38:41.663556 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-10b99989-8b5e-4649-a4f8-01875e1fb287 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 4cd4ca5f-5442-4cd2-b241-9798ea965234] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:38:41.665304 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10b99989-8b5e-4649-a4f8-01875e1fb287 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:41.666075 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-10b99989-8b5e-4649-a4f8-01875e1fb287 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:41.666689 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-10b99989-8b5e-4649-a4f8-01875e1fb287 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 4cd4ca5f-5442-4cd2-b241-9798ea965234] instance's host None is down, deleting from database Jun 05 08:38:41.671168 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-10b99989-8b5e-4649-a4f8-01875e1fb287 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 4cd4ca5f-5442-4cd2-b241-9798ea965234] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:38:41.745237 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-10b99989-8b5e-4649-a4f8-01875e1fb287 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 4cd4ca5f-5442-4cd2-b241-9798ea965234] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:38:41.753432 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-10b99989-8b5e-4649-a4f8-01875e1fb287 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 4cd4ca5f-5442-4cd2-b241-9798ea965234] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:38:41.987079 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-10b99989-8b5e-4649-a4f8-01875e1fb287 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4cd4ca5f-5442-4cd2-b241-9798ea965234" status: 204 len: 0 microversion: 2.1 time: 0.440598 Jun 05 08:38:41.989850 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1503/2920] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:38:41 2022] DELETE /compute/v2.1/servers/4cd4ca5f-5442-4cd2-b241-9798ea965234 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:38:42.001545 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c290ef7d-faf6-4f96-a7c0-e903e844994d tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:38:42.002510 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c290ef7d-faf6-4f96-a7c0-e903e844994d tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 4cd4ca5f-5442-4cd2-b241-9798ea965234] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:38:42.012691 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c290ef7d-faf6-4f96-a7c0-e903e844994d tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:42.013664 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c290ef7d-faf6-4f96-a7c0-e903e844994d tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:42.016228 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c290ef7d-faf6-4f96-a7c0-e903e844994d tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:42.017477 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c290ef7d-faf6-4f96-a7c0-e903e844994d tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:42.040736 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-c290ef7d-faf6-4f96-a7c0-e903e844994d tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] HTTP exception thrown: Instance 4cd4ca5f-5442-4cd2-b241-9798ea965234 could not be found. Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c290ef7d-faf6-4f96-a7c0-e903e844994d tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Request method failure captured: Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/4cd4ca5f-5442-4cd2-b241-9798ea965234 HTTP/1.1 Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGuIjuMyU1nqlYCZnZ0BFDL2W5-jFokL2jpzfih0G_vJ5DXl4nMjSW4R9AMLFfr5-KfvTxaKfUG3_Czis1cNAGjAnNPObZji0CeBq50nkKLppI00r6nEJP4Elew78JwvJKUA6xTMlic1WnYzMGC0YBmVaJ4tk_SzwBPkk9xXA-5aQ5g Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 72418fdfbcec401385db6b14842c7c22 Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-AttachVolumeNegativeTest-322049477 Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/72418fdfbcec401385db6b14842c7c22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/72418fdfbcec401385db6b14842c7c22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_72418fdfbcec401385db6b14842c7c22", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/72418fdfbcec401385db6b14842c7c22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-AttachVolumeNegativeTest-322049477 Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 72418fdfbcec401385db6b14842c7c22 Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-322049477 Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-AttachVolumeNegativeTest-322049477-project Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: b279554204824a50b3fcccc8162da141 Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-AttachVolumeNegativeTest-322049477-project Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 4cd4ca5f-5442-4cd2-b241-9798ea965234 could not be found. Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '4cd4ca5f-5442-4cd2-b241-9798ea965234'} Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cd4ca5f-5442-4cd2-b241-9798ea965234 could not be found. Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cd4ca5f-5442-4cd2-b241-9798ea965234 could not be found. Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:38:42.043001 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:38:42.048023 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:38:42.048023 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:38:42.048023 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:38:42.048023 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:38:42.048023 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:38:42.048023 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cd4ca5f-5442-4cd2-b241-9798ea965234 could not be found. Jun 05 08:38:42.048023 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:38:42.050497 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c290ef7d-faf6-4f96-a7c0-e903e844994d tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Returning 404 to user: Instance 4cd4ca5f-5442-4cd2-b241-9798ea965234 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:38:42.052945 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c290ef7d-faf6-4f96-a7c0-e903e844994d tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] 10.222.0.33 "GET /compute/v2.1/servers/4cd4ca5f-5442-4cd2-b241-9798ea965234" status: 404 len: 111 microversion: 2.1 time: 0.058194 Jun 05 08:38:42.054142 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1418/2921] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:38:41 2022] GET /compute/v2.1/servers/4cd4ca5f-5442-4cd2-b241-9798ea965234 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:38:42.073162 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9e114c98-9080-4c8a-bbd6-13a73274b69a tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Calling method '.version_select at 0x7f24337e3f70>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:38:42.107778 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9e114c98-9080-4c8a-bbd6-13a73274b69a tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1246822177" status: 202 len: 0 microversion: 2.1 time: 0.038891 Jun 05 08:38:42.110373 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1504/2922] 10.222.0.33 () {58 vars in 1220 bytes} [Sun Jun 5 08:38:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1246822177 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:38:43.718749 n-d-844739-1 devstack@n-api.service[119050]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 08:38:43.719472 n-d-844739-1 devstack@n-api.service[119050]: Sun Jun 5 08:38:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 08:38:44.059441 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-63aec651-347f-487f-a255-d9ab46488e00 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Action: 'create', calling method: .version_select at 0x7f2432ee2f70>, body: {"keypair": {"name": "tempest-keypair-699263570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOk7MU4lWqS28x08+q2moy0k1HoQcGO98M1JGVKEzg2AnbeiIolSYS2YM7WHsEEsFzKzpKJnuUCMZKHBArh8isOpEufKJu1r5eyHZiwaeNXRNCn/ikN6OHQCbkoz0aBsg=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:38:44.088201 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-63aec651-347f-487f-a255-d9ab46488e00 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Getting quotas for project 72418fdfbcec401385db6b14842c7c22. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:38:44.103089 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-63aec651-347f-487f-a255-d9ab46488e00 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Getting quotas for user b279554204824a50b3fcccc8162da141 and project 72418fdfbcec401385db6b14842c7c22. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:38:44.169035 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-63aec651-347f-487f-a255-d9ab46488e00 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.115661 Jun 05 08:38:44.175083 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1419/2923] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:38:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:38:45.618755 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:38:46.192874 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-aa0064c2-1428-43c2-8a15-cf9c04874b08 tempest-SecurityGroupsNegativeTestJSON-1013326371 tempest-SecurityGroupsNegativeTestJSON-1013326371-project] Calling method '.version_select at 0x7f24337e35e0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:38:46.231375 n-d-844739-1 devstack@n-api.service[119050]: DEBUG neutronclient.v2_0.client [None req-aa0064c2-1428-43c2-8a15-cf9c04874b08 tempest-SecurityGroupsNegativeTestJSON-1013326371 tempest-SecurityGroupsNegativeTestJSON-1013326371-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d607a80b-3114-447e-91f7-6000de4f66c7 does not exist", "detail": ""}} {{(pid=119050) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 05 08:38:46.232344 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.security_group_api [None req-aa0064c2-1428-43c2-8a15-cf9c04874b08 tempest-SecurityGroupsNegativeTestJSON-1013326371 tempest-SecurityGroupsNegativeTestJSON-1013326371-project] Neutron security group d607a80b-3114-447e-91f7-6000de4f66c7 not found {{(pid=119050) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 05 08:38:46.232956 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-aa0064c2-1428-43c2-8a15-cf9c04874b08 tempest-SecurityGroupsNegativeTestJSON-1013326371 tempest-SecurityGroupsNegativeTestJSON-1013326371-project] HTTP exception thrown: Security group d607a80b-3114-447e-91f7-6000de4f66c7 does not exist Jun 05 08:38:46.232956 n-d-844739-1 devstack@n-api.service[119050]: Neutron server returns request_ids: ['req-d138f7e2-8d2c-4f60-a9b0-54b458a73eef'] Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-aa0064c2-1428-43c2-8a15-cf9c04874b08 tempest-SecurityGroupsNegativeTestJSON-1013326371 tempest-SecurityGroupsNegativeTestJSON-1013326371-project] Request method failure captured: Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: request: DELETE /compute/v2.1/os-security-groups/d607a80b-3114-447e-91f7-6000de4f66c7 HTTP/1.1 Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGuVn0IQ6pm8IoICfVkMaAaJsBVTy4eSarEH5B581WjuVK50F76sRMZc7mPjAOh30DrQaZm1iD9oyIz1E7Sn0xyPPx8L20TkjyWdStIcjbkZI4v8HfVskHi_upOWyosD25g8BhenlbSOJePLZta1HX7OnwIOI45gu8y2jPoI_fM3e8U Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 14cb9188119d41dabb31d4afd09f96f4 Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1013326371 Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/14cb9188119d41dabb31d4afd09f96f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/14cb9188119d41dabb31d4afd09f96f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_14cb9188119d41dabb31d4afd09f96f4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/14cb9188119d41dabb31d4afd09f96f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1013326371 Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 14cb9188119d41dabb31d4afd09f96f4 Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1013326371 Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-SecurityGroupsNegativeTestJSON-1013326371-project Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: a20309314c374c0b8329cbacb5ad0500 Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1013326371-project Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: exception: Security group d607a80b-3114-447e-91f7-6000de4f66c7 does not exist Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: Neutron server returns request_ids: ['req-d138f7e2-8d2c-4f60-a9b0-54b458a73eef'] Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'd607a80b-3114-447e-91f7-6000de4f66c7'} Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 05 08:38:46.235362 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d607a80b-3114-447e-91f7-6000de4f66c7 does not exist Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d138f7e2-8d2c-4f60-a9b0-54b458a73eef'] Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d607a80b-3114-447e-91f7-6000de4f66c7 does not exist Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d138f7e2-8d2c-4f60-a9b0-54b458a73eef'] Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d607a80b-3114-447e-91f7-6000de4f66c7 does not exist Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d138f7e2-8d2c-4f60-a9b0-54b458a73eef'] Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d607a80b-3114-447e-91f7-6000de4f66c7 does not exist Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d138f7e2-8d2c-4f60-a9b0-54b458a73eef'] Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-aa0064c2-1428-43c2-8a15-cf9c04874b08 tempest-SecurityGroupsNegativeTestJSON-1013326371 tempest-SecurityGroupsNegativeTestJSON-1013326371-project] Returning 404 to user: Security group d607a80b-3114-447e-91f7-6000de4f66c7 does not exist Jun 05 08:38:46.239853 n-d-844739-1 devstack@n-api.service[119050]: Neutron server returns request_ids: ['req-d138f7e2-8d2c-4f60-a9b0-54b458a73eef'] {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:38:46.248074 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-aa0064c2-1428-43c2-8a15-cf9c04874b08 tempest-SecurityGroupsNegativeTestJSON-1013326371 tempest-SecurityGroupsNegativeTestJSON-1013326371-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/d607a80b-3114-447e-91f7-6000de4f66c7" status: 404 len: 194 microversion: 2.1 time: 0.625482 Jun 05 08:38:46.248074 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1505/2924] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:38:45 2022] DELETE /compute/v2.1/os-security-groups/d607a80b-3114-447e-91f7-6000de4f66c7 => generated 194 bytes in 630 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:38:46.255490 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-21fadc21-c865-4d2d-ba10-0ea358242687 tempest-SecurityGroupsNegativeTestJSON-1013326371 tempest-SecurityGroupsNegativeTestJSON-1013326371-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.003968 Jun 05 08:38:46.257951 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1420/2925] 10.222.0.33 () {58 vars in 1163 bytes} [Sun Jun 5 08:38:46 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 05 08:38:46.269334 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6aa2d47e-5ea6-49bc-be95-5519404f30a7 tempest-SecurityGroupsNegativeTestJSON-1013326371 tempest-SecurityGroupsNegativeTestJSON-1013326371-project] Calling method '.version_select at 0x7f243386c550>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:38:46.581514 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6aa2d47e-5ea6-49bc-be95-5519404f30a7 tempest-SecurityGroupsNegativeTestJSON-1013326371 tempest-SecurityGroupsNegativeTestJSON-1013326371-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.315090 Jun 05 08:38:46.582795 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1506/2926] 10.222.0.33 () {58 vars in 1157 bytes} [Sun Jun 5 08:38:46 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:38:46.595222 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e274a516-9245-4a9a-bcaa-4dcb55b202b6 tempest-SecurityGroupsNegativeTestJSON-1013326371 tempest-SecurityGroupsNegativeTestJSON-1013326371-project] Calling method '.version_select at 0x7f2432eeb430>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:38:46.851891 n-d-844739-1 devstack@n-api.service[119049]: DEBUG neutronclient.v2_0.client [None req-e274a516-9245-4a9a-bcaa-4dcb55b202b6 tempest-SecurityGroupsNegativeTestJSON-1013326371 tempest-SecurityGroupsNegativeTestJSON-1013326371-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=119049) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 05 08:38:46.852876 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-e274a516-9245-4a9a-bcaa-4dcb55b202b6 tempest-SecurityGroupsNegativeTestJSON-1013326371 tempest-SecurityGroupsNegativeTestJSON-1013326371-project] HTTP exception thrown: Insufficient rights for removing default security group. Jun 05 08:38:46.852876 n-d-844739-1 devstack@n-api.service[119049]: Neutron server returns request_ids: ['req-bd5fed26-edb4-4ddc-83c2-e7b1660e6353'] Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e274a516-9245-4a9a-bcaa-4dcb55b202b6 tempest-SecurityGroupsNegativeTestJSON-1013326371 tempest-SecurityGroupsNegativeTestJSON-1013326371-project] Request method failure captured: Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: request: DELETE /compute/v2.1/os-security-groups/2938d95f-0d90-42f8-a4af-f1804570a03c HTTP/1.1 Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGuVn0IQ6pm8IoICfVkMaAaJsBVTy4eSarEH5B581WjuVK50F76sRMZc7mPjAOh30DrQaZm1iD9oyIz1E7Sn0xyPPx8L20TkjyWdStIcjbkZI4v8HfVskHi_upOWyosD25g8BhenlbSOJePLZta1HX7OnwIOI45gu8y2jPoI_fM3e8U Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 14cb9188119d41dabb31d4afd09f96f4 Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1013326371 Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/14cb9188119d41dabb31d4afd09f96f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/14cb9188119d41dabb31d4afd09f96f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_14cb9188119d41dabb31d4afd09f96f4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/14cb9188119d41dabb31d4afd09f96f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1013326371 Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 14cb9188119d41dabb31d4afd09f96f4 Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1013326371 Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-SecurityGroupsNegativeTestJSON-1013326371-project Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: a20309314c374c0b8329cbacb5ad0500 Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1013326371-project Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: exception: Insufficient rights for removing default security group. Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: Neutron server returns request_ids: ['req-bd5fed26-edb4-4ddc-83c2-e7b1660e6353'] Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '2938d95f-0d90-42f8-a4af-f1804570a03c'} Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 05 08:38:46.855075 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd5fed26-edb4-4ddc-83c2-e7b1660e6353'] Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd5fed26-edb4-4ddc-83c2-e7b1660e6353'] Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd5fed26-edb4-4ddc-83c2-e7b1660e6353'] Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd5fed26-edb4-4ddc-83c2-e7b1660e6353'] Jun 05 08:38:46.859414 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:38:46.865874 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e274a516-9245-4a9a-bcaa-4dcb55b202b6 tempest-SecurityGroupsNegativeTestJSON-1013326371 tempest-SecurityGroupsNegativeTestJSON-1013326371-project] Returning 400 to user: Insufficient rights for removing default security group. Jun 05 08:38:46.865874 n-d-844739-1 devstack@n-api.service[119049]: Neutron server returns request_ids: ['req-bd5fed26-edb4-4ddc-83c2-e7b1660e6353'] {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:38:46.866981 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e274a516-9245-4a9a-bcaa-4dcb55b202b6 tempest-SecurityGroupsNegativeTestJSON-1013326371 tempest-SecurityGroupsNegativeTestJSON-1013326371-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/2938d95f-0d90-42f8-a4af-f1804570a03c" status: 400 len: 182 microversion: 2.1 time: 0.275465 Jun 05 08:38:46.867549 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1421/2927] 10.222.0.33 () {58 vars in 1271 bytes} [Sun Jun 5 08:38:46 2022] DELETE /compute/v2.1/os-security-groups/2938d95f-0d90-42f8-a4af-f1804570a03c => generated 182 bytes in 277 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 05 08:38:46.880943 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a5e484a0-e379-436e-8e12-20df3e7c49b4 tempest-SecurityGroupsNegativeTestJSON-1013326371 tempest-SecurityGroupsNegativeTestJSON-1013326371-project] Calling method '.version_select at 0x7f24417678b0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:38:46.925645 n-d-844739-1 devstack@n-api.service[119050]: DEBUG neutronclient.v2_0.client [None req-a5e484a0-e379-436e-8e12-20df3e7c49b4 tempest-SecurityGroupsNegativeTestJSON-1013326371 tempest-SecurityGroupsNegativeTestJSON-1013326371-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 050e4edb-fe9c-4f53-9b4a-feeec2135b12 does not exist", "detail": ""}} {{(pid=119050) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 05 08:38:46.926258 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.security_group_api [None req-a5e484a0-e379-436e-8e12-20df3e7c49b4 tempest-SecurityGroupsNegativeTestJSON-1013326371 tempest-SecurityGroupsNegativeTestJSON-1013326371-project] Neutron security group 050e4edb-fe9c-4f53-9b4a-feeec2135b12 not found {{(pid=119050) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 05 08:38:46.926838 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-a5e484a0-e379-436e-8e12-20df3e7c49b4 tempest-SecurityGroupsNegativeTestJSON-1013326371 tempest-SecurityGroupsNegativeTestJSON-1013326371-project] HTTP exception thrown: Security group 050e4edb-fe9c-4f53-9b4a-feeec2135b12 does not exist Jun 05 08:38:46.926838 n-d-844739-1 devstack@n-api.service[119050]: Neutron server returns request_ids: ['req-d4756221-7085-4cb7-8b7f-c6cfd4111b30'] Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a5e484a0-e379-436e-8e12-20df3e7c49b4 tempest-SecurityGroupsNegativeTestJSON-1013326371 tempest-SecurityGroupsNegativeTestJSON-1013326371-project] Request method failure captured: Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-security-groups/050e4edb-fe9c-4f53-9b4a-feeec2135b12 HTTP/1.1 Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGuVn0IQ6pm8IoICfVkMaAaJsBVTy4eSarEH5B581WjuVK50F76sRMZc7mPjAOh30DrQaZm1iD9oyIz1E7Sn0xyPPx8L20TkjyWdStIcjbkZI4v8HfVskHi_upOWyosD25g8BhenlbSOJePLZta1HX7OnwIOI45gu8y2jPoI_fM3e8U Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 14cb9188119d41dabb31d4afd09f96f4 Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1013326371 Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/14cb9188119d41dabb31d4afd09f96f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/14cb9188119d41dabb31d4afd09f96f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_14cb9188119d41dabb31d4afd09f96f4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/14cb9188119d41dabb31d4afd09f96f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1013326371 Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 14cb9188119d41dabb31d4afd09f96f4 Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1013326371 Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-SecurityGroupsNegativeTestJSON-1013326371-project Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: a20309314c374c0b8329cbacb5ad0500 Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1013326371-project Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: exception: Security group 050e4edb-fe9c-4f53-9b4a-feeec2135b12 does not exist Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: Neutron server returns request_ids: ['req-d4756221-7085-4cb7-8b7f-c6cfd4111b30'] Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '050e4edb-fe9c-4f53-9b4a-feeec2135b12'} Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 05 08:38:46.928693 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 050e4edb-fe9c-4f53-9b4a-feeec2135b12 does not exist Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d4756221-7085-4cb7-8b7f-c6cfd4111b30'] Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 050e4edb-fe9c-4f53-9b4a-feeec2135b12 does not exist Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d4756221-7085-4cb7-8b7f-c6cfd4111b30'] Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 050e4edb-fe9c-4f53-9b4a-feeec2135b12 does not exist Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d4756221-7085-4cb7-8b7f-c6cfd4111b30'] Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 050e4edb-fe9c-4f53-9b4a-feeec2135b12 does not exist Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d4756221-7085-4cb7-8b7f-c6cfd4111b30'] Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a5e484a0-e379-436e-8e12-20df3e7c49b4 tempest-SecurityGroupsNegativeTestJSON-1013326371 tempest-SecurityGroupsNegativeTestJSON-1013326371-project] Returning 404 to user: Security group 050e4edb-fe9c-4f53-9b4a-feeec2135b12 does not exist Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: Neutron server returns request_ids: ['req-d4756221-7085-4cb7-8b7f-c6cfd4111b30'] {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:38:46.932686 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a5e484a0-e379-436e-8e12-20df3e7c49b4 tempest-SecurityGroupsNegativeTestJSON-1013326371 tempest-SecurityGroupsNegativeTestJSON-1013326371-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/050e4edb-fe9c-4f53-9b4a-feeec2135b12" status: 404 len: 194 microversion: 2.1 time: 0.054074 Jun 05 08:38:46.940660 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4efa6c26-0886-4fad-94a2-5817a932f7e8 tempest-SecurityGroupsNegativeTestJSON-1013326371 tempest-SecurityGroupsNegativeTestJSON-1013326371-project] Action: 'update', calling method: .version_select at 0x7f2432e9a5e0>, body: {"security_group": {"name": "tempest-sg-1846111610", "description": "tempest-description-197702461"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:38:46.946987 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1507/2928] 10.222.0.33 () {58 vars in 1268 bytes} [Sun Jun 5 08:38:46 2022] GET /compute/v2.1/os-security-groups/050e4edb-fe9c-4f53-9b4a-feeec2135b12 => generated 194 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:38:46.988297 n-d-844739-1 devstack@n-api.service[119049]: DEBUG neutronclient.v2_0.client [None req-4efa6c26-0886-4fad-94a2-5817a932f7e8 tempest-SecurityGroupsNegativeTestJSON-1013326371 tempest-SecurityGroupsNegativeTestJSON-1013326371-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2bdae33f-a035-48c3-89be-26692bcbb9ae does not exist", "detail": ""}} {{(pid=119049) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 05 08:38:46.988903 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.security_group_api [None req-4efa6c26-0886-4fad-94a2-5817a932f7e8 tempest-SecurityGroupsNegativeTestJSON-1013326371 tempest-SecurityGroupsNegativeTestJSON-1013326371-project] Neutron security group 2bdae33f-a035-48c3-89be-26692bcbb9ae not found {{(pid=119049) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 05 08:38:46.989443 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-4efa6c26-0886-4fad-94a2-5817a932f7e8 tempest-SecurityGroupsNegativeTestJSON-1013326371 tempest-SecurityGroupsNegativeTestJSON-1013326371-project] HTTP exception thrown: Security group 2bdae33f-a035-48c3-89be-26692bcbb9ae does not exist Jun 05 08:38:46.989443 n-d-844739-1 devstack@n-api.service[119049]: Neutron server returns request_ids: ['req-59210552-d460-4a68-8c95-8fdfd8fea1e6'] Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4efa6c26-0886-4fad-94a2-5817a932f7e8 tempest-SecurityGroupsNegativeTestJSON-1013326371 tempest-SecurityGroupsNegativeTestJSON-1013326371-project] Request method failure captured: Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: request: PUT /compute/v2.1/os-security-groups/2bdae33f-a035-48c3-89be-26692bcbb9ae HTTP/1.1 Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 101 Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGuVn0IQ6pm8IoICfVkMaAaJsBVTy4eSarEH5B581WjuVK50F76sRMZc7mPjAOh30DrQaZm1iD9oyIz1E7Sn0xyPPx8L20TkjyWdStIcjbkZI4v8HfVskHi_upOWyosD25g8BhenlbSOJePLZta1HX7OnwIOI45gu8y2jPoI_fM3e8U Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 14cb9188119d41dabb31d4afd09f96f4 Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1013326371 Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/14cb9188119d41dabb31d4afd09f96f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/14cb9188119d41dabb31d4afd09f96f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_14cb9188119d41dabb31d4afd09f96f4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/14cb9188119d41dabb31d4afd09f96f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1013326371 Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 14cb9188119d41dabb31d4afd09f96f4 Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1013326371 Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-SecurityGroupsNegativeTestJSON-1013326371-project Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: a20309314c374c0b8329cbacb5ad0500 Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1013326371-project Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: {"security_group": {"name": "tempest-sg-1846111610", "description": "tempest-description-197702461"}} Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: exception: Security group 2bdae33f-a035-48c3-89be-26692bcbb9ae does not exist Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: Neutron server returns request_ids: ['req-59210552-d460-4a68-8c95-8fdfd8fea1e6'] Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '2bdae33f-a035-48c3-89be-26692bcbb9ae', 'body': {'security_group': {'name': 'tempest-sg-1846111610', 'description': 'tempest-description-197702461'}}} Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 05 08:38:46.991327 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2bdae33f-a035-48c3-89be-26692bcbb9ae does not exist Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59210552-d460-4a68-8c95-8fdfd8fea1e6'] Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2bdae33f-a035-48c3-89be-26692bcbb9ae does not exist Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59210552-d460-4a68-8c95-8fdfd8fea1e6'] Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2bdae33f-a035-48c3-89be-26692bcbb9ae does not exist Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59210552-d460-4a68-8c95-8fdfd8fea1e6'] Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2bdae33f-a035-48c3-89be-26692bcbb9ae does not exist Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59210552-d460-4a68-8c95-8fdfd8fea1e6'] Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4efa6c26-0886-4fad-94a2-5817a932f7e8 tempest-SecurityGroupsNegativeTestJSON-1013326371 tempest-SecurityGroupsNegativeTestJSON-1013326371-project] Returning 404 to user: Security group 2bdae33f-a035-48c3-89be-26692bcbb9ae does not exist Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: Neutron server returns request_ids: ['req-59210552-d460-4a68-8c95-8fdfd8fea1e6'] {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:38:46.995981 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4efa6c26-0886-4fad-94a2-5817a932f7e8 tempest-SecurityGroupsNegativeTestJSON-1013326371 tempest-SecurityGroupsNegativeTestJSON-1013326371-project] 10.222.0.33 "PUT /compute/v2.1/os-security-groups/2bdae33f-a035-48c3-89be-26692bcbb9ae" status: 404 len: 194 microversion: 2.1 time: 0.056609 Jun 05 08:38:47.003397 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1422/2929] 10.222.0.33 () {60 vars in 1289 bytes} [Sun Jun 5 08:38:46 2022] PUT /compute/v2.1/os-security-groups/2bdae33f-a035-48c3-89be-26692bcbb9ae => generated 194 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:38:48.272781 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7ecd76b6-806c-4585-ac38-54bb2a88b146 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-803824521", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f1959f42-32fe-44cb-a898-d811ca57e359"}], "security_groups": [{"name": "tempest-securitygroup--2125244578"}], "key_name": "tempest-keypair-699263570", "user_data": "}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:38:48.594606 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-7ecd76b6-806c-4585-ac38-54bb2a88b146 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] validate_networks() for [('f1959f42-32fe-44cb-a898-d811ca57e359', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:38:49.584261 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-7ecd76b6-806c-4585-ac38-54bb2a88b146 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:38:49.585584 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-7ecd76b6-806c-4585-ac38-54bb2a88b146 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:38:49.586623 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-7ecd76b6-806c-4585-ac38-54bb2a88b146 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:38:49.587505 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-7ecd76b6-806c-4585-ac38-54bb2a88b146 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:38:49.587946 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-7ecd76b6-806c-4585-ac38-54bb2a88b146 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:38:49.604845 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7ecd76b6-806c-4585-ac38-54bb2a88b146 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:49.605289 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7ecd76b6-806c-4585-ac38-54bb2a88b146 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:49.611431 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7ecd76b6-806c-4585-ac38-54bb2a88b146 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:49.611892 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7ecd76b6-806c-4585-ac38-54bb2a88b146 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:49.663450 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-7ecd76b6-806c-4585-ac38-54bb2a88b146 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Getting quotas for project 72418fdfbcec401385db6b14842c7c22. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:38:49.676476 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-7ecd76b6-806c-4585-ac38-54bb2a88b146 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Getting quotas for user b279554204824a50b3fcccc8162da141 and project 72418fdfbcec401385db6b14842c7c22. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:38:49.728928 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7ecd76b6-806c-4585-ac38-54bb2a88b146 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:38:49.731201 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7ecd76b6-806c-4585-ac38-54bb2a88b146 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 37670665-1717-4a94-8544-688c93eb5725] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:38:49.852380 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7ecd76b6-806c-4585-ac38-54bb2a88b146 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.582982 Jun 05 08:38:49.853409 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1508/2930] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:38:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 1587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:38:49.862575 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:38:49.870774 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7d92ba45-f569-49d1-b2b3-68753c8309c5 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:38:49.875124 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7d92ba45-f569-49d1-b2b3-68753c8309c5 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 37670665-1717-4a94-8544-688c93eb5725] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:38:50.302449 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7d92ba45-f569-49d1-b2b3-68753c8309c5 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b279554204824a50b3fcccc8162da141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72418fdfbcec401385db6b14842c7c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:38:50.314197 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7d92ba45-f569-49d1-b2b3-68753c8309c5 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] 10.222.0.33 "GET /compute/v2.1/servers/37670665-1717-4a94-8544-688c93eb5725" status: 200 len: 1240 microversion: 2.1 time: 0.454863 Jun 05 08:38:50.316684 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1423/2931] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:38:49 2022] GET /compute/v2.1/servers/37670665-1717-4a94-8544-688c93eb5725 => generated 1240 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:38:51.341973 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1cd52da7-5ebf-492e-8f28-0535e1433332 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:38:51.342592 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1cd52da7-5ebf-492e-8f28-0535e1433332 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 37670665-1717-4a94-8544-688c93eb5725] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:38:51.355418 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1cd52da7-5ebf-492e-8f28-0535e1433332 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:51.360214 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1cd52da7-5ebf-492e-8f28-0535e1433332 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:51.361029 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1cd52da7-5ebf-492e-8f28-0535e1433332 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:51.361473 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1cd52da7-5ebf-492e-8f28-0535e1433332 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:51.435301 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1cd52da7-5ebf-492e-8f28-0535e1433332 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:51.435964 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1cd52da7-5ebf-492e-8f28-0535e1433332 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:51.438096 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-1cd52da7-5ebf-492e-8f28-0535e1433332 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lazy-loading 'fault' on Instance uuid 37670665-1717-4a94-8544-688c93eb5725 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:38:51.512350 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1cd52da7-5ebf-492e-8f28-0535e1433332 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b279554204824a50b3fcccc8162da141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72418fdfbcec401385db6b14842c7c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:38:51.520377 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1cd52da7-5ebf-492e-8f28-0535e1433332 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] 10.222.0.33 "GET /compute/v2.1/servers/37670665-1717-4a94-8544-688c93eb5725" status: 200 len: 1313 microversion: 2.1 time: 0.184712 Jun 05 08:38:51.524419 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1509/2932] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:38:51 2022] GET /compute/v2.1/servers/37670665-1717-4a94-8544-688c93eb5725 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:38:51.536611 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a5958f08-5dbc-435c-846d-31a47f86a2a3 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:38:51.537090 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a5958f08-5dbc-435c-846d-31a47f86a2a3 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 37670665-1717-4a94-8544-688c93eb5725] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:38:51.547502 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a5958f08-5dbc-435c-846d-31a47f86a2a3 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:51.548016 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a5958f08-5dbc-435c-846d-31a47f86a2a3 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:51.548851 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a5958f08-5dbc-435c-846d-31a47f86a2a3 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:51.556004 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a5958f08-5dbc-435c-846d-31a47f86a2a3 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:51.615927 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a5958f08-5dbc-435c-846d-31a47f86a2a3 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 37670665-1717-4a94-8544-688c93eb5725] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:38:51.755635 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a5958f08-5dbc-435c-846d-31a47f86a2a3 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 37670665-1717-4a94-8544-688c93eb5725] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:38:51.757135 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a5958f08-5dbc-435c-846d-31a47f86a2a3 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:51.759694 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a5958f08-5dbc-435c-846d-31a47f86a2a3 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:51.760394 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-a5958f08-5dbc-435c-846d-31a47f86a2a3 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 37670665-1717-4a94-8544-688c93eb5725] instance's host None is down, deleting from database Jun 05 08:38:51.772224 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-a5958f08-5dbc-435c-846d-31a47f86a2a3 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 37670665-1717-4a94-8544-688c93eb5725] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:38:51.891592 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-a5958f08-5dbc-435c-846d-31a47f86a2a3 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 37670665-1717-4a94-8544-688c93eb5725] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:38:51.901091 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-a5958f08-5dbc-435c-846d-31a47f86a2a3 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 37670665-1717-4a94-8544-688c93eb5725] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:38:52.249905 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a5958f08-5dbc-435c-846d-31a47f86a2a3 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] 10.222.0.33 "DELETE /compute/v2.1/servers/37670665-1717-4a94-8544-688c93eb5725" status: 204 len: 0 microversion: 2.1 time: 0.717277 Jun 05 08:38:52.255180 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1424/2933] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:38:51 2022] DELETE /compute/v2.1/servers/37670665-1717-4a94-8544-688c93eb5725 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:38:52.266495 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b249453b-978c-4391-b3bd-c6efcdf300e9 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:38:52.269334 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b249453b-978c-4391-b3bd-c6efcdf300e9 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 37670665-1717-4a94-8544-688c93eb5725] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:38:52.270195 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-15c1b925-456e-4336-b11b-f29efe23d203 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-565745838", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "23f74f01-3564-4d1a-83dc-9c13fe4de6e6"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:38:52.296265 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b249453b-978c-4391-b3bd-c6efcdf300e9 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:52.296744 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b249453b-978c-4391-b3bd-c6efcdf300e9 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:52.299586 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b249453b-978c-4391-b3bd-c6efcdf300e9 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:52.300060 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b249453b-978c-4391-b3bd-c6efcdf300e9 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:52.349232 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-b249453b-978c-4391-b3bd-c6efcdf300e9 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] HTTP exception thrown: Instance 37670665-1717-4a94-8544-688c93eb5725 could not be found. Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b249453b-978c-4391-b3bd-c6efcdf300e9 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Request method failure captured: Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/37670665-1717-4a94-8544-688c93eb5725 HTTP/1.1 Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGuIjuMyU1nqlYCZnZ0BFDL2W5-jFokL2jpzfih0G_vJ5DXl4nMjSW4R9AMLFfr5-KfvTxaKfUG3_Czis1cNAGjAnNPObZji0CeBq50nkKLppI00r6nEJP4Elew78JwvJKUA6xTMlic1WnYzMGC0YBmVaJ4tk_SzwBPkk9xXA-5aQ5g Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 72418fdfbcec401385db6b14842c7c22 Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-AttachVolumeNegativeTest-322049477 Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/72418fdfbcec401385db6b14842c7c22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/72418fdfbcec401385db6b14842c7c22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_72418fdfbcec401385db6b14842c7c22", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/72418fdfbcec401385db6b14842c7c22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-AttachVolumeNegativeTest-322049477 Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 72418fdfbcec401385db6b14842c7c22 Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-322049477 Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-AttachVolumeNegativeTest-322049477-project Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: b279554204824a50b3fcccc8162da141 Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-AttachVolumeNegativeTest-322049477-project Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 37670665-1717-4a94-8544-688c93eb5725 could not be found. Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '37670665-1717-4a94-8544-688c93eb5725'} Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37670665-1717-4a94-8544-688c93eb5725 could not be found. Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37670665-1717-4a94-8544-688c93eb5725 could not be found. Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:38:52.350816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:38:52.357251 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:38:52.357251 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:38:52.357251 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:38:52.357251 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:38:52.357251 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:38:52.357251 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37670665-1717-4a94-8544-688c93eb5725 could not be found. Jun 05 08:38:52.357251 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:38:52.357251 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b249453b-978c-4391-b3bd-c6efcdf300e9 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Returning 404 to user: Instance 37670665-1717-4a94-8544-688c93eb5725 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:38:52.365043 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b249453b-978c-4391-b3bd-c6efcdf300e9 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] 10.222.0.33 "GET /compute/v2.1/servers/37670665-1717-4a94-8544-688c93eb5725" status: 404 len: 111 microversion: 2.1 time: 0.095796 Jun 05 08:38:52.368619 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1425/2934] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:38:52 2022] GET /compute/v2.1/servers/37670665-1717-4a94-8544-688c93eb5725 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:38:52.387048 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-15c1b925-456e-4336-b11b-f29efe23d203 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] validate_networks() for [('23f74f01-3564-4d1a-83dc-9c13fe4de6e6', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:38:52.395056 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b5595c68-8c25-4ba8-a765-fde1663c9a29 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Calling method '.version_select at 0x7f243307fa60>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:38:52.478990 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b5595c68-8c25-4ba8-a765-fde1663c9a29 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-699263570" status: 202 len: 0 microversion: 2.1 time: 0.095572 Jun 05 08:38:52.481567 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1426/2935] 10.222.0.33 () {58 vars in 1217 bytes} [Sun Jun 5 08:38:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-699263570 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:38:53.596546 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-15c1b925-456e-4336-b11b-f29efe23d203 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:38:53.597157 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-15c1b925-456e-4336-b11b-f29efe23d203 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:38:53.597433 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-15c1b925-456e-4336-b11b-f29efe23d203 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:38:53.597849 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-15c1b925-456e-4336-b11b-f29efe23d203 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:38:53.598260 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-15c1b925-456e-4336-b11b-f29efe23d203 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:38:53.624062 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-15c1b925-456e-4336-b11b-f29efe23d203 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:53.624741 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-15c1b925-456e-4336-b11b-f29efe23d203 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:53.625558 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-15c1b925-456e-4336-b11b-f29efe23d203 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:53.626001 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-15c1b925-456e-4336-b11b-f29efe23d203 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:53.670405 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-15c1b925-456e-4336-b11b-f29efe23d203 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Getting quotas for project 3550df3d68ce4aa4ae099624834f232d. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:38:53.678082 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-15c1b925-456e-4336-b11b-f29efe23d203 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Getting quotas for user 0f5ab53ed5984e46a71f0b42fc91895c and project 3550df3d68ce4aa4ae099624834f232d. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:38:53.734547 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-15c1b925-456e-4336-b11b-f29efe23d203 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:38:53.737076 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-15c1b925-456e-4336-b11b-f29efe23d203 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] [instance: c55e1380-724f-440e-821b-838e8f60ba20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:38:53.895206 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-15c1b925-456e-4336-b11b-f29efe23d203 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.297983 Jun 05 08:38:53.901897 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1510/2936] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:38:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2305 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:38:54.602453 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c05bfaa9-83d4-4503-b294-e011471f42af tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Action: 'create', calling method: .version_select at 0x7f2432f85af0>, body: {"keypair": {"name": "tempest-keypair-1331392890", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCZlXGsAtwj7bfDbJ8IyxYeW5x73Q4A335xDdL5w69/aPcFGR59QzTZOY7hzZ0SzkyZdDh0fYFoUameNGLx56oVsvRrpNYBrwXK2+Lg8FAfehnyHHdEWFCUM1vKJScbbQ=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:38:54.665668 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-c05bfaa9-83d4-4503-b294-e011471f42af tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Getting quotas for project 72418fdfbcec401385db6b14842c7c22. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:38:54.679930 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-c05bfaa9-83d4-4503-b294-e011471f42af tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Getting quotas for user b279554204824a50b3fcccc8162da141 and project 72418fdfbcec401385db6b14842c7c22. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:38:54.713178 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cfa0e550-87e9-4b93-9662-0ae841ab8cdb tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1115455869", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "23f74f01-3564-4d1a-83dc-9c13fe4de6e6"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:38:54.717764 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c05bfaa9-83d4-4503-b294-e011471f42af tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.123075 Jun 05 08:38:54.718869 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1427/2937] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:38:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:38:54.813233 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-cfa0e550-87e9-4b93-9662-0ae841ab8cdb tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] validate_networks() for [('23f74f01-3564-4d1a-83dc-9c13fe4de6e6', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:38:56.157372 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-cfa0e550-87e9-4b93-9662-0ae841ab8cdb tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:38:56.157930 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-cfa0e550-87e9-4b93-9662-0ae841ab8cdb tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:38:56.158679 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-cfa0e550-87e9-4b93-9662-0ae841ab8cdb tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:38:56.159108 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-cfa0e550-87e9-4b93-9662-0ae841ab8cdb tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:38:56.159595 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-cfa0e550-87e9-4b93-9662-0ae841ab8cdb tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:38:56.174225 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cfa0e550-87e9-4b93-9662-0ae841ab8cdb tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:56.174862 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cfa0e550-87e9-4b93-9662-0ae841ab8cdb tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:56.175776 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cfa0e550-87e9-4b93-9662-0ae841ab8cdb tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:56.176518 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cfa0e550-87e9-4b93-9662-0ae841ab8cdb tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:56.244591 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-cfa0e550-87e9-4b93-9662-0ae841ab8cdb tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Getting quotas for project 3550df3d68ce4aa4ae099624834f232d. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:38:56.254812 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-cfa0e550-87e9-4b93-9662-0ae841ab8cdb tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Getting quotas for user 0f5ab53ed5984e46a71f0b42fc91895c and project 3550df3d68ce4aa4ae099624834f232d. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:38:56.272349 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-cfa0e550-87e9-4b93-9662-0ae841ab8cdb tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:38:56.277631 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-cfa0e550-87e9-4b93-9662-0ae841ab8cdb tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] [instance: 30a592b2-6763-4c92-96c9-8b63e9710c39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:38:56.425318 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-cfa0e550-87e9-4b93-9662-0ae841ab8cdb tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.721003 Jun 05 08:38:56.440595 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1511/2938] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:38:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:38:56.886965 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ce8864c7-2d24-4307-9373-83bfd9f50178 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1575418984", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "451", "networks": [{"uuid": "23f74f01-3564-4d1a-83dc-9c13fe4de6e6"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:38:56.991699 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-ce8864c7-2d24-4307-9373-83bfd9f50178 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] validate_networks() for [('23f74f01-3564-4d1a-83dc-9c13fe4de6e6', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:38:58.061258 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-ce8864c7-2d24-4307-9373-83bfd9f50178 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:38:58.063676 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-ce8864c7-2d24-4307-9373-83bfd9f50178 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:38:58.065197 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-ce8864c7-2d24-4307-9373-83bfd9f50178 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:38:58.065894 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-ce8864c7-2d24-4307-9373-83bfd9f50178 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:38:58.066753 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-ce8864c7-2d24-4307-9373-83bfd9f50178 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:38:58.092729 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ce8864c7-2d24-4307-9373-83bfd9f50178 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:58.094121 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ce8864c7-2d24-4307-9373-83bfd9f50178 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:58.098023 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ce8864c7-2d24-4307-9373-83bfd9f50178 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:58.098827 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ce8864c7-2d24-4307-9373-83bfd9f50178 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:58.149487 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-ce8864c7-2d24-4307-9373-83bfd9f50178 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Getting quotas for project 3550df3d68ce4aa4ae099624834f232d. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:38:58.167518 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-ce8864c7-2d24-4307-9373-83bfd9f50178 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Getting quotas for user 0f5ab53ed5984e46a71f0b42fc91895c and project 3550df3d68ce4aa4ae099624834f232d. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:38:58.209490 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ce8864c7-2d24-4307-9373-83bfd9f50178 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:38:58.211745 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ce8864c7-2d24-4307-9373-83bfd9f50178 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] [instance: d938debf-c327-4645-a096-9b218c6b3107] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:38:58.330568 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ce8864c7-2d24-4307-9373-83bfd9f50178 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.450180 Jun 05 08:38:58.333828 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1428/2939] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:38:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 05 08:38:58.345203 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6705330e-1ddb-46a7-a8af-b4ef8fbc9f95 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:38:58.346041 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6705330e-1ddb-46a7-a8af-b4ef8fbc9f95 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] [instance: d938debf-c327-4645-a096-9b218c6b3107] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:38:58.450290 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6705330e-1ddb-46a7-a8af-b4ef8fbc9f95 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5ab53ed5984e46a71f0b42fc91895c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3550df3d68ce4aa4ae099624834f232d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:38:58.459127 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6705330e-1ddb-46a7-a8af-b4ef8fbc9f95 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] 10.222.0.33 "GET /compute/v2.1/servers/d938debf-c327-4645-a096-9b218c6b3107" status: 200 len: 1221 microversion: 2.1 time: 0.118755 Jun 05 08:38:58.460578 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1512/2940] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:38:58 2022] GET /compute/v2.1/servers/d938debf-c327-4645-a096-9b218c6b3107 => generated 1221 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:38:59.480866 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5301b0cf-a227-45d2-9127-02da93d5a89e tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:38:59.482032 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5301b0cf-a227-45d2-9127-02da93d5a89e tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] [instance: d938debf-c327-4645-a096-9b218c6b3107] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:38:59.500363 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5301b0cf-a227-45d2-9127-02da93d5a89e tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:59.502711 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5301b0cf-a227-45d2-9127-02da93d5a89e tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:59.504724 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5301b0cf-a227-45d2-9127-02da93d5a89e tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:59.505204 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5301b0cf-a227-45d2-9127-02da93d5a89e tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:59.526062 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-27a6ded2-1f40-4f34-8069-c4b092d678c9 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-152697874", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "df0c08f3-d9ea-456c-b815-73705146cae6"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:38:59.602367 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5301b0cf-a227-45d2-9127-02da93d5a89e tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:38:59.602572 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5301b0cf-a227-45d2-9127-02da93d5a89e tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:38:59.606877 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-5301b0cf-a227-45d2-9127-02da93d5a89e tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lazy-loading 'fault' on Instance uuid d938debf-c327-4645-a096-9b218c6b3107 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:38:59.615080 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-27a6ded2-1f40-4f34-8069-c4b092d678c9 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] validate_networks() for [('df0c08f3-d9ea-456c-b815-73705146cae6', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:38:59.813325 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-5301b0cf-a227-45d2-9127-02da93d5a89e tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5ab53ed5984e46a71f0b42fc91895c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3550df3d68ce4aa4ae099624834f232d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:38:59.828467 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5301b0cf-a227-45d2-9127-02da93d5a89e tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] 10.222.0.33 "GET /compute/v2.1/servers/d938debf-c327-4645-a096-9b218c6b3107" status: 200 len: 1294 microversion: 2.1 time: 0.352556 Jun 05 08:38:59.841090 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1513/2941] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:38:59 2022] GET /compute/v2.1/servers/d938debf-c327-4645-a096-9b218c6b3107 => generated 1294 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:38:59.847309 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6e35458b-161f-4c8d-a1ef-8bfbb268fcfd tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-377506477", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f1959f42-32fe-44cb-a898-d811ca57e359"}], "security_groups": [{"name": "tempest-securitygroup--613513529"}], "key_name": "tempest-keypair-1331392890", "user_data": "}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:39:00.279024 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-6e35458b-161f-4c8d-a1ef-8bfbb268fcfd tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] validate_networks() for [('f1959f42-32fe-44cb-a898-d811ca57e359', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:39:00.732141 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-27a6ded2-1f40-4f34-8069-c4b092d678c9 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:39:00.732932 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-27a6ded2-1f40-4f34-8069-c4b092d678c9 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:39:00.734217 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-27a6ded2-1f40-4f34-8069-c4b092d678c9 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:39:00.734903 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-27a6ded2-1f40-4f34-8069-c4b092d678c9 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:39:00.736228 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-27a6ded2-1f40-4f34-8069-c4b092d678c9 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:39:00.741743 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:39:00.751914 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-27a6ded2-1f40-4f34-8069-c4b092d678c9 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:00.753071 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-27a6ded2-1f40-4f34-8069-c4b092d678c9 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:00.755308 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-27a6ded2-1f40-4f34-8069-c4b092d678c9 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:00.758208 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-27a6ded2-1f40-4f34-8069-c4b092d678c9 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:00.808517 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-27a6ded2-1f40-4f34-8069-c4b092d678c9 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Getting quotas for project 4590e8fc717b4f0ca1208e985bff3c08. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:39:00.815910 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-27a6ded2-1f40-4f34-8069-c4b092d678c9 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Getting quotas for user 4abbed5a3fe3465597898cf556159264 and project 4590e8fc717b4f0ca1208e985bff3c08. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:39:00.836654 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-27a6ded2-1f40-4f34-8069-c4b092d678c9 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:39:00.840680 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-27a6ded2-1f40-4f34-8069-c4b092d678c9 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] [instance: beb99f48-e959-42f7-bce8-e3cdd5b1e810] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:39:00.948314 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-27a6ded2-1f40-4f34-8069-c4b092d678c9 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.842925 Jun 05 08:39:00.958822 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1429/2942] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:38:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:39:00.967776 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d3466c1a-763f-4b0e-b852-a1c01b0d8a6d tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:00.968676 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d3466c1a-763f-4b0e-b852-a1c01b0d8a6d tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] [instance: d938debf-c327-4645-a096-9b218c6b3107] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:00.976352 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d3466c1a-763f-4b0e-b852-a1c01b0d8a6d tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:00.977747 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d3466c1a-763f-4b0e-b852-a1c01b0d8a6d tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:00.978785 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d3466c1a-763f-4b0e-b852-a1c01b0d8a6d tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:00.979438 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d3466c1a-763f-4b0e-b852-a1c01b0d8a6d tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:01.009153 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d3466c1a-763f-4b0e-b852-a1c01b0d8a6d tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] [instance: d938debf-c327-4645-a096-9b218c6b3107] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:39:01.076922 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d3466c1a-763f-4b0e-b852-a1c01b0d8a6d tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] [instance: d938debf-c327-4645-a096-9b218c6b3107] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:39:01.078612 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d3466c1a-763f-4b0e-b852-a1c01b0d8a6d tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:01.079565 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d3466c1a-763f-4b0e-b852-a1c01b0d8a6d tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:01.080326 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-d3466c1a-763f-4b0e-b852-a1c01b0d8a6d tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] [instance: d938debf-c327-4645-a096-9b218c6b3107] instance's host None is down, deleting from database Jun 05 08:39:01.085778 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-d3466c1a-763f-4b0e-b852-a1c01b0d8a6d tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] [instance: d938debf-c327-4645-a096-9b218c6b3107] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:39:01.205571 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-d3466c1a-763f-4b0e-b852-a1c01b0d8a6d tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] [instance: d938debf-c327-4645-a096-9b218c6b3107] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:39:01.220127 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-6e35458b-161f-4c8d-a1ef-8bfbb268fcfd tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:39:01.220627 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-6e35458b-161f-4c8d-a1ef-8bfbb268fcfd tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:39:01.221327 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-6e35458b-161f-4c8d-a1ef-8bfbb268fcfd tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:39:01.221759 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-6e35458b-161f-4c8d-a1ef-8bfbb268fcfd tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:39:01.222248 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-6e35458b-161f-4c8d-a1ef-8bfbb268fcfd tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:39:01.223860 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-d3466c1a-763f-4b0e-b852-a1c01b0d8a6d tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] [instance: d938debf-c327-4645-a096-9b218c6b3107] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:39:01.253232 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6e35458b-161f-4c8d-a1ef-8bfbb268fcfd tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:01.256147 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6e35458b-161f-4c8d-a1ef-8bfbb268fcfd tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:01.262455 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6e35458b-161f-4c8d-a1ef-8bfbb268fcfd tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:01.264957 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6e35458b-161f-4c8d-a1ef-8bfbb268fcfd tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:01.375847 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-6e35458b-161f-4c8d-a1ef-8bfbb268fcfd tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Getting quotas for project 72418fdfbcec401385db6b14842c7c22. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:39:01.407875 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-6e35458b-161f-4c8d-a1ef-8bfbb268fcfd tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Getting quotas for user b279554204824a50b3fcccc8162da141 and project 72418fdfbcec401385db6b14842c7c22. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:39:01.449865 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=9 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:39:01.455939 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6e35458b-161f-4c8d-a1ef-8bfbb268fcfd tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:39:01.459282 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6e35458b-161f-4c8d-a1ef-8bfbb268fcfd tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 1c1f1389-1a0b-4f40-8939-aea1e8e36a69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:39:01.617486 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=66,nova_cell0:UPDATE=28,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:39:01.620737 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6e35458b-161f-4c8d-a1ef-8bfbb268fcfd tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.775774 Jun 05 08:39:01.621415 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1514/2943] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:38:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 1780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:39:01.626614 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e2e49a10-e098-4f41-91d5-7323e807a77e tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:01.633968 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e2e49a10-e098-4f41-91d5-7323e807a77e tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] [instance: beb99f48-e959-42f7-bce8-e3cdd5b1e810] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:01.634108 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d3466c1a-763f-4b0e-b852-a1c01b0d8a6d tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d938debf-c327-4645-a096-9b218c6b3107" status: 204 len: 0 microversion: 2.1 time: 0.673800 Jun 05 08:39:01.635067 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1430/2944] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:39:00 2022] DELETE /compute/v2.1/servers/d938debf-c327-4645-a096-9b218c6b3107 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:39:01.642021 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4b33825a-eea6-4693-b727-447c9a3bcecc tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:01.642841 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4b33825a-eea6-4693-b727-447c9a3bcecc tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 1c1f1389-1a0b-4f40-8939-aea1e8e36a69] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:01.645373 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e2e49a10-e098-4f41-91d5-7323e807a77e tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:01.646015 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e2e49a10-e098-4f41-91d5-7323e807a77e tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:01.646967 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e2e49a10-e098-4f41-91d5-7323e807a77e tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:01.647595 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e2e49a10-e098-4f41-91d5-7323e807a77e tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:01.740087 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e2e49a10-e098-4f41-91d5-7323e807a77e tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:01.740822 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e2e49a10-e098-4f41-91d5-7323e807a77e tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:01.744131 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-e2e49a10-e098-4f41-91d5-7323e807a77e tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Lazy-loading 'fault' on Instance uuid beb99f48-e959-42f7-bce8-e3cdd5b1e810 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:39:01.794528 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4b33825a-eea6-4693-b727-447c9a3bcecc tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b279554204824a50b3fcccc8162da141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72418fdfbcec401385db6b14842c7c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:39:01.806805 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4b33825a-eea6-4693-b727-447c9a3bcecc tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] 10.222.0.33 "GET /compute/v2.1/servers/1c1f1389-1a0b-4f40-8939-aea1e8e36a69" status: 200 len: 1241 microversion: 2.1 time: 0.167665 Jun 05 08:39:01.821004 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1431/2945] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:01 2022] GET /compute/v2.1/servers/1c1f1389-1a0b-4f40-8939-aea1e8e36a69 => generated 1241 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:39:01.832663 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f5f38237-0539-4324-b39a-77449ae7b861 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:01.833450 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f5f38237-0539-4324-b39a-77449ae7b861 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] [instance: d938debf-c327-4645-a096-9b218c6b3107] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:01.857378 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f5f38237-0539-4324-b39a-77449ae7b861 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:01.859337 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f5f38237-0539-4324-b39a-77449ae7b861 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:01.860228 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f5f38237-0539-4324-b39a-77449ae7b861 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:01.862954 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f5f38237-0539-4324-b39a-77449ae7b861 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:01.892430 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-f5f38237-0539-4324-b39a-77449ae7b861 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] HTTP exception thrown: Instance d938debf-c327-4645-a096-9b218c6b3107 could not be found. Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f5f38237-0539-4324-b39a-77449ae7b861 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Request method failure captured: Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/d938debf-c327-4645-a096-9b218c6b3107 HTTP/1.1 Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGuaQ6AbFwGT_rXZF3fOUYvVOdzPUmcUzh3x2syDI8Ht_fLNsEfGF0KBm_XjrgEinvwEy4XMJ5M1ahDy7hnt3Vh6mQvRqB2yE7N_Ba48xTuovypUyo8IvKwym7qx1AwNohhh5uRt3alkxdFtNZDm-va7UqaUlCX3cMnUanVa4rkvnvQ Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 3550df3d68ce4aa4ae099624834f232d Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ListServerFiltersTestJSON-1180858907 Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3550df3d68ce4aa4ae099624834f232d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3550df3d68ce4aa4ae099624834f232d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3550df3d68ce4aa4ae099624834f232d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3550df3d68ce4aa4ae099624834f232d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ListServerFiltersTestJSON-1180858907 Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 3550df3d68ce4aa4ae099624834f232d Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1180858907 Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ListServerFiltersTestJSON-1180858907-project Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 0f5ab53ed5984e46a71f0b42fc91895c Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ListServerFiltersTestJSON-1180858907-project Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance d938debf-c327-4645-a096-9b218c6b3107 could not be found. Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'd938debf-c327-4645-a096-9b218c6b3107'} Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d938debf-c327-4645-a096-9b218c6b3107 could not be found. Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d938debf-c327-4645-a096-9b218c6b3107 could not be found. Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:01.894815 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:01.901031 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:01.901031 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:01.901031 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:01.901031 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:39:01.901031 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:39:01.901031 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d938debf-c327-4645-a096-9b218c6b3107 could not be found. Jun 05 08:39:01.901031 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:01.901031 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f5f38237-0539-4324-b39a-77449ae7b861 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Returning 404 to user: Instance d938debf-c327-4645-a096-9b218c6b3107 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:39:01.903020 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f5f38237-0539-4324-b39a-77449ae7b861 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] 10.222.0.33 "GET /compute/v2.1/servers/d938debf-c327-4645-a096-9b218c6b3107" status: 404 len: 111 microversion: 2.1 time: 0.079918 Jun 05 08:39:01.905494 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-e2e49a10-e098-4f41-91d5-7323e807a77e tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4abbed5a3fe3465597898cf556159264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4590e8fc717b4f0ca1208e985bff3c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:39:01.905916 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1432/2946] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:01 2022] GET /compute/v2.1/servers/d938debf-c327-4645-a096-9b218c6b3107 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:39:01.911608 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e6747dca-1abd-4704-af69-3b0d8198df12 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:01.918153 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e6747dca-1abd-4704-af69-3b0d8198df12 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] [instance: 30a592b2-6763-4c92-96c9-8b63e9710c39] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:01.926328 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e2e49a10-e098-4f41-91d5-7323e807a77e tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] 10.222.0.33 "GET /compute/v2.1/servers/beb99f48-e959-42f7-bce8-e3cdd5b1e810" status: 200 len: 1289 microversion: 2.1 time: 0.298703 Jun 05 08:39:01.938394 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1515/2947] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:01 2022] GET /compute/v2.1/servers/beb99f48-e959-42f7-bce8-e3cdd5b1e810 => generated 1289 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:39:01.940603 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e6747dca-1abd-4704-af69-3b0d8198df12 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:01.940923 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e6747dca-1abd-4704-af69-3b0d8198df12 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:01.941770 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e6747dca-1abd-4704-af69-3b0d8198df12 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:01.942280 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e6747dca-1abd-4704-af69-3b0d8198df12 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:01.996649 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e6747dca-1abd-4704-af69-3b0d8198df12 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] [instance: 30a592b2-6763-4c92-96c9-8b63e9710c39] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:39:02.103467 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e6747dca-1abd-4704-af69-3b0d8198df12 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] [instance: 30a592b2-6763-4c92-96c9-8b63e9710c39] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:39:02.104311 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e6747dca-1abd-4704-af69-3b0d8198df12 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:02.104756 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e6747dca-1abd-4704-af69-3b0d8198df12 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:02.105375 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-e6747dca-1abd-4704-af69-3b0d8198df12 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] [instance: 30a592b2-6763-4c92-96c9-8b63e9710c39] instance's host None is down, deleting from database Jun 05 08:39:02.110676 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-e6747dca-1abd-4704-af69-3b0d8198df12 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] [instance: 30a592b2-6763-4c92-96c9-8b63e9710c39] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:39:02.713786 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-e6747dca-1abd-4704-af69-3b0d8198df12 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] [instance: 30a592b2-6763-4c92-96c9-8b63e9710c39] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:39:02.719832 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-e6747dca-1abd-4704-af69-3b0d8198df12 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] [instance: 30a592b2-6763-4c92-96c9-8b63e9710c39] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:39:02.826885 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d02ab6e8-3f08-4697-bdaa-a7f1bad66daa tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:02.827574 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d02ab6e8-3f08-4697-bdaa-a7f1bad66daa tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 1c1f1389-1a0b-4f40-8939-aea1e8e36a69] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:02.843985 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d02ab6e8-3f08-4697-bdaa-a7f1bad66daa tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:02.846899 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d02ab6e8-3f08-4697-bdaa-a7f1bad66daa tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:02.847812 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d02ab6e8-3f08-4697-bdaa-a7f1bad66daa tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:02.848296 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d02ab6e8-3f08-4697-bdaa-a7f1bad66daa tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:02.936787 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e6747dca-1abd-4704-af69-3b0d8198df12 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] 10.222.0.33 "DELETE /compute/v2.1/servers/30a592b2-6763-4c92-96c9-8b63e9710c39" status: 204 len: 0 microversion: 2.1 time: 1.029025 Jun 05 08:39:02.938350 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1433/2948] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:39:01 2022] DELETE /compute/v2.1/servers/30a592b2-6763-4c92-96c9-8b63e9710c39 => generated 0 bytes in 1030 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:39:02.948442 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d02ab6e8-3f08-4697-bdaa-a7f1bad66daa tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:02.949226 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d02ab6e8-3f08-4697-bdaa-a7f1bad66daa tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:02.949843 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-d02ab6e8-3f08-4697-bdaa-a7f1bad66daa tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lazy-loading 'fault' on Instance uuid 1c1f1389-1a0b-4f40-8939-aea1e8e36a69 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:39:02.950000 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1a395df4-6ba4-46a4-90cf-1dcdd18caf3e tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:02.950623 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1a395df4-6ba4-46a4-90cf-1dcdd18caf3e tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] [instance: beb99f48-e959-42f7-bce8-e3cdd5b1e810] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:02.957815 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1a395df4-6ba4-46a4-90cf-1dcdd18caf3e tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:02.958265 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1a395df4-6ba4-46a4-90cf-1dcdd18caf3e tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:02.959237 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1a395df4-6ba4-46a4-90cf-1dcdd18caf3e tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:02.959870 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1a395df4-6ba4-46a4-90cf-1dcdd18caf3e tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:03.013733 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d02ab6e8-3f08-4697-bdaa-a7f1bad66daa tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b279554204824a50b3fcccc8162da141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72418fdfbcec401385db6b14842c7c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:39:03.027803 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d02ab6e8-3f08-4697-bdaa-a7f1bad66daa tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] 10.222.0.33 "GET /compute/v2.1/servers/1c1f1389-1a0b-4f40-8939-aea1e8e36a69" status: 200 len: 1314 microversion: 2.1 time: 0.203549 Jun 05 08:39:03.029151 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1516/2949] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:02 2022] GET /compute/v2.1/servers/1c1f1389-1a0b-4f40-8939-aea1e8e36a69 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:39:03.034518 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-09bea478-3d06-4082-9456-33f074fd64a6 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:03.035485 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-09bea478-3d06-4082-9456-33f074fd64a6 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] [instance: 30a592b2-6763-4c92-96c9-8b63e9710c39] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:03.045290 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-09bea478-3d06-4082-9456-33f074fd64a6 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:03.046274 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-09bea478-3d06-4082-9456-33f074fd64a6 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:03.047410 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-09bea478-3d06-4082-9456-33f074fd64a6 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:03.048085 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-09bea478-3d06-4082-9456-33f074fd64a6 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:03.048736 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1a395df4-6ba4-46a4-90cf-1dcdd18caf3e tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:03.049336 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1a395df4-6ba4-46a4-90cf-1dcdd18caf3e tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:03.049870 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-1a395df4-6ba4-46a4-90cf-1dcdd18caf3e tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Lazy-loading 'fault' on Instance uuid beb99f48-e959-42f7-bce8-e3cdd5b1e810 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:39:03.072664 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-09bea478-3d06-4082-9456-33f074fd64a6 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] HTTP exception thrown: Instance 30a592b2-6763-4c92-96c9-8b63e9710c39 could not be found. Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-09bea478-3d06-4082-9456-33f074fd64a6 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Request method failure captured: Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/30a592b2-6763-4c92-96c9-8b63e9710c39 HTTP/1.1 Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGuaQ6AbFwGT_rXZF3fOUYvVOdzPUmcUzh3x2syDI8Ht_fLNsEfGF0KBm_XjrgEinvwEy4XMJ5M1ahDy7hnt3Vh6mQvRqB2yE7N_Ba48xTuovypUyo8IvKwym7qx1AwNohhh5uRt3alkxdFtNZDm-va7UqaUlCX3cMnUanVa4rkvnvQ Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 3550df3d68ce4aa4ae099624834f232d Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ListServerFiltersTestJSON-1180858907 Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3550df3d68ce4aa4ae099624834f232d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3550df3d68ce4aa4ae099624834f232d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3550df3d68ce4aa4ae099624834f232d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3550df3d68ce4aa4ae099624834f232d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ListServerFiltersTestJSON-1180858907 Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 3550df3d68ce4aa4ae099624834f232d Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1180858907 Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ListServerFiltersTestJSON-1180858907-project Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 0f5ab53ed5984e46a71f0b42fc91895c Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ListServerFiltersTestJSON-1180858907-project Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 30a592b2-6763-4c92-96c9-8b63e9710c39 could not be found. Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '30a592b2-6763-4c92-96c9-8b63e9710c39'} Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30a592b2-6763-4c92-96c9-8b63e9710c39 could not be found. Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30a592b2-6763-4c92-96c9-8b63e9710c39 could not be found. Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:03.074500 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:03.079255 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:03.079255 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:03.079255 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:03.079255 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:39:03.079255 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:39:03.079255 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30a592b2-6763-4c92-96c9-8b63e9710c39 could not be found. Jun 05 08:39:03.079255 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:03.080457 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-09bea478-3d06-4082-9456-33f074fd64a6 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Returning 404 to user: Instance 30a592b2-6763-4c92-96c9-8b63e9710c39 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:39:03.081494 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-09bea478-3d06-4082-9456-33f074fd64a6 tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] 10.222.0.33 "GET /compute/v2.1/servers/30a592b2-6763-4c92-96c9-8b63e9710c39" status: 404 len: 111 microversion: 2.1 time: 0.051253 Jun 05 08:39:03.086169 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1517/2950] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:03 2022] GET /compute/v2.1/servers/30a592b2-6763-4c92-96c9-8b63e9710c39 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:39:03.091201 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b5800d26-03de-4f6b-958c-c16d5dbc1afb tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:03.091893 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b5800d26-03de-4f6b-958c-c16d5dbc1afb tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 1c1f1389-1a0b-4f40-8939-aea1e8e36a69] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:03.100344 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b5800d26-03de-4f6b-958c-c16d5dbc1afb tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:03.101571 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b5800d26-03de-4f6b-958c-c16d5dbc1afb tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:03.102734 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b5800d26-03de-4f6b-958c-c16d5dbc1afb tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:03.103390 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b5800d26-03de-4f6b-958c-c16d5dbc1afb tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:03.138776 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b5800d26-03de-4f6b-958c-c16d5dbc1afb tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 1c1f1389-1a0b-4f40-8939-aea1e8e36a69] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:39:03.141592 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-1a395df4-6ba4-46a4-90cf-1dcdd18caf3e tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4abbed5a3fe3465597898cf556159264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4590e8fc717b4f0ca1208e985bff3c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:39:03.155915 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1a395df4-6ba4-46a4-90cf-1dcdd18caf3e tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] 10.222.0.33 "GET /compute/v2.1/servers/beb99f48-e959-42f7-bce8-e3cdd5b1e810" status: 200 len: 1289 microversion: 2.1 time: 0.212844 Jun 05 08:39:03.167023 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1434/2951] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:02 2022] GET /compute/v2.1/servers/beb99f48-e959-42f7-bce8-e3cdd5b1e810 => generated 1289 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:39:03.167023 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-afd6d426-d9ca-47e2-b152-bcf48a7082ea tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:03.167740 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-afd6d426-d9ca-47e2-b152-bcf48a7082ea tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] [instance: c55e1380-724f-440e-821b-838e8f60ba20] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:03.177002 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-afd6d426-d9ca-47e2-b152-bcf48a7082ea tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:03.177614 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-afd6d426-d9ca-47e2-b152-bcf48a7082ea tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:03.178831 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-afd6d426-d9ca-47e2-b152-bcf48a7082ea tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:03.179544 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-afd6d426-d9ca-47e2-b152-bcf48a7082ea tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:03.205575 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b5800d26-03de-4f6b-958c-c16d5dbc1afb tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 1c1f1389-1a0b-4f40-8939-aea1e8e36a69] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:39:03.206784 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b5800d26-03de-4f6b-958c-c16d5dbc1afb tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:03.207498 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b5800d26-03de-4f6b-958c-c16d5dbc1afb tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:03.208130 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-b5800d26-03de-4f6b-958c-c16d5dbc1afb tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 1c1f1389-1a0b-4f40-8939-aea1e8e36a69] instance's host None is down, deleting from database Jun 05 08:39:03.213500 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-b5800d26-03de-4f6b-958c-c16d5dbc1afb tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 1c1f1389-1a0b-4f40-8939-aea1e8e36a69] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:39:03.214855 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-afd6d426-d9ca-47e2-b152-bcf48a7082ea tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] [instance: c55e1380-724f-440e-821b-838e8f60ba20] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:39:03.275575 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-afd6d426-d9ca-47e2-b152-bcf48a7082ea tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] [instance: c55e1380-724f-440e-821b-838e8f60ba20] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:39:03.276404 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-afd6d426-d9ca-47e2-b152-bcf48a7082ea tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:03.276850 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-afd6d426-d9ca-47e2-b152-bcf48a7082ea tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:03.277283 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-afd6d426-d9ca-47e2-b152-bcf48a7082ea tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] [instance: c55e1380-724f-440e-821b-838e8f60ba20] instance's host None is down, deleting from database Jun 05 08:39:03.280596 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-b5800d26-03de-4f6b-958c-c16d5dbc1afb tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 1c1f1389-1a0b-4f40-8939-aea1e8e36a69] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:39:03.280745 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-afd6d426-d9ca-47e2-b152-bcf48a7082ea tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] [instance: c55e1380-724f-440e-821b-838e8f60ba20] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:39:03.284007 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=80,nova_cell0:UPDATE=16,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:39:03.288965 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-b5800d26-03de-4f6b-958c-c16d5dbc1afb tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 1c1f1389-1a0b-4f40-8939-aea1e8e36a69] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:39:03.357888 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-afd6d426-d9ca-47e2-b152-bcf48a7082ea tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] [instance: c55e1380-724f-440e-821b-838e8f60ba20] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:39:03.368142 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-afd6d426-d9ca-47e2-b152-bcf48a7082ea tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] [instance: c55e1380-724f-440e-821b-838e8f60ba20] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:39:03.549922 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b5800d26-03de-4f6b-958c-c16d5dbc1afb tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1c1f1389-1a0b-4f40-8939-aea1e8e36a69" status: 204 len: 0 microversion: 2.1 time: 0.460716 Jun 05 08:39:03.552605 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1518/2952] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:39:03 2022] DELETE /compute/v2.1/servers/1c1f1389-1a0b-4f40-8939-aea1e8e36a69 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:39:03.570437 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-93a32e43-2b31-488a-a2fc-264a4e0ea8a7 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:03.571619 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-93a32e43-2b31-488a-a2fc-264a4e0ea8a7 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] [instance: beb99f48-e959-42f7-bce8-e3cdd5b1e810] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:03.590057 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-93a32e43-2b31-488a-a2fc-264a4e0ea8a7 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:03.590747 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:UPDATE=32,nova_cell0:DELETE=6,nova_cell0:SELECT=58,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:39:03.591299 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-93a32e43-2b31-488a-a2fc-264a4e0ea8a7 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:03.592899 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-93a32e43-2b31-488a-a2fc-264a4e0ea8a7 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:03.593848 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-93a32e43-2b31-488a-a2fc-264a4e0ea8a7 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:03.609292 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-afd6d426-d9ca-47e2-b152-bcf48a7082ea tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c55e1380-724f-440e-821b-838e8f60ba20" status: 204 len: 0 microversion: 2.1 time: 0.450006 Jun 05 08:39:03.612883 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1435/2953] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:39:03 2022] DELETE /compute/v2.1/servers/c55e1380-724f-440e-821b-838e8f60ba20 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:39:03.616073 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a1fc2b7b-40e9-476f-8cde-9bfd1872eed4 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:03.618040 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a1fc2b7b-40e9-476f-8cde-9bfd1872eed4 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] [instance: 1c1f1389-1a0b-4f40-8939-aea1e8e36a69] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:03.625331 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a1fc2b7b-40e9-476f-8cde-9bfd1872eed4 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:03.625886 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a1fc2b7b-40e9-476f-8cde-9bfd1872eed4 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:03.626661 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a1fc2b7b-40e9-476f-8cde-9bfd1872eed4 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:03.627098 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a1fc2b7b-40e9-476f-8cde-9bfd1872eed4 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:03.646526 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-a1fc2b7b-40e9-476f-8cde-9bfd1872eed4 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] HTTP exception thrown: Instance 1c1f1389-1a0b-4f40-8939-aea1e8e36a69 could not be found. Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a1fc2b7b-40e9-476f-8cde-9bfd1872eed4 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Request method failure captured: Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/1c1f1389-1a0b-4f40-8939-aea1e8e36a69 HTTP/1.1 Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGuIjuMyU1nqlYCZnZ0BFDL2W5-jFokL2jpzfih0G_vJ5DXl4nMjSW4R9AMLFfr5-KfvTxaKfUG3_Czis1cNAGjAnNPObZji0CeBq50nkKLppI00r6nEJP4Elew78JwvJKUA6xTMlic1WnYzMGC0YBmVaJ4tk_SzwBPkk9xXA-5aQ5g Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 72418fdfbcec401385db6b14842c7c22 Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-AttachVolumeNegativeTest-322049477 Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/72418fdfbcec401385db6b14842c7c22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/72418fdfbcec401385db6b14842c7c22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_72418fdfbcec401385db6b14842c7c22", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/72418fdfbcec401385db6b14842c7c22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-AttachVolumeNegativeTest-322049477 Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 72418fdfbcec401385db6b14842c7c22 Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-322049477 Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-AttachVolumeNegativeTest-322049477-project Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: b279554204824a50b3fcccc8162da141 Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-AttachVolumeNegativeTest-322049477-project Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 1c1f1389-1a0b-4f40-8939-aea1e8e36a69 could not be found. Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '1c1f1389-1a0b-4f40-8939-aea1e8e36a69'} Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c1f1389-1a0b-4f40-8939-aea1e8e36a69 could not be found. Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c1f1389-1a0b-4f40-8939-aea1e8e36a69 could not be found. Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:03.648350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:03.653273 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:03.653273 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:03.653273 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:03.653273 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:39:03.653273 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:39:03.653273 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c1f1389-1a0b-4f40-8939-aea1e8e36a69 could not be found. Jun 05 08:39:03.653273 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:03.653273 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a1fc2b7b-40e9-476f-8cde-9bfd1872eed4 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Returning 404 to user: Instance 1c1f1389-1a0b-4f40-8939-aea1e8e36a69 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:39:03.653273 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a1fc2b7b-40e9-476f-8cde-9bfd1872eed4 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] 10.222.0.33 "GET /compute/v2.1/servers/1c1f1389-1a0b-4f40-8939-aea1e8e36a69" status: 404 len: 111 microversion: 2.1 time: 0.038650 Jun 05 08:39:03.654296 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1436/2954] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:03 2022] GET /compute/v2.1/servers/1c1f1389-1a0b-4f40-8939-aea1e8e36a69 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:39:03.660130 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c231dd5d-19b2-47e4-8ba5-b68ec751ac9d tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:03.661351 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c231dd5d-19b2-47e4-8ba5-b68ec751ac9d tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] [instance: c55e1380-724f-440e-821b-838e8f60ba20] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:03.668949 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c231dd5d-19b2-47e4-8ba5-b68ec751ac9d tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:03.669680 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c231dd5d-19b2-47e4-8ba5-b68ec751ac9d tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:03.670467 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c231dd5d-19b2-47e4-8ba5-b68ec751ac9d tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:03.670904 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c231dd5d-19b2-47e4-8ba5-b68ec751ac9d tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:03.686224 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-93a32e43-2b31-488a-a2fc-264a4e0ea8a7 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] [instance: beb99f48-e959-42f7-bce8-e3cdd5b1e810] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:39:03.703313 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-c231dd5d-19b2-47e4-8ba5-b68ec751ac9d tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] HTTP exception thrown: Instance c55e1380-724f-440e-821b-838e8f60ba20 could not be found. Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c231dd5d-19b2-47e4-8ba5-b68ec751ac9d tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Request method failure captured: Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/c55e1380-724f-440e-821b-838e8f60ba20 HTTP/1.1 Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGuaQ6AbFwGT_rXZF3fOUYvVOdzPUmcUzh3x2syDI8Ht_fLNsEfGF0KBm_XjrgEinvwEy4XMJ5M1ahDy7hnt3Vh6mQvRqB2yE7N_Ba48xTuovypUyo8IvKwym7qx1AwNohhh5uRt3alkxdFtNZDm-va7UqaUlCX3cMnUanVa4rkvnvQ Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 3550df3d68ce4aa4ae099624834f232d Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ListServerFiltersTestJSON-1180858907 Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3550df3d68ce4aa4ae099624834f232d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3550df3d68ce4aa4ae099624834f232d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3550df3d68ce4aa4ae099624834f232d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3550df3d68ce4aa4ae099624834f232d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ListServerFiltersTestJSON-1180858907 Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 3550df3d68ce4aa4ae099624834f232d Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1180858907 Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ListServerFiltersTestJSON-1180858907-project Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 0f5ab53ed5984e46a71f0b42fc91895c Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ListServerFiltersTestJSON-1180858907-project Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance c55e1380-724f-440e-821b-838e8f60ba20 could not be found. Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'c55e1380-724f-440e-821b-838e8f60ba20'} Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c55e1380-724f-440e-821b-838e8f60ba20 could not be found. Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c55e1380-724f-440e-821b-838e8f60ba20 could not be found. Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:03.706448 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:03.714747 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:03.714747 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:03.714747 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:03.714747 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:39:03.714747 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:39:03.714747 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c55e1380-724f-440e-821b-838e8f60ba20 could not be found. Jun 05 08:39:03.714747 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:03.714747 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c231dd5d-19b2-47e4-8ba5-b68ec751ac9d tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] Returning 404 to user: Instance c55e1380-724f-440e-821b-838e8f60ba20 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:39:03.714747 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c231dd5d-19b2-47e4-8ba5-b68ec751ac9d tempest-ListServerFiltersTestJSON-1180858907 tempest-ListServerFiltersTestJSON-1180858907-project] 10.222.0.33 "GET /compute/v2.1/servers/c55e1380-724f-440e-821b-838e8f60ba20" status: 404 len: 111 microversion: 2.1 time: 0.053956 Jun 05 08:39:03.718017 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1437/2955] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:03 2022] GET /compute/v2.1/servers/c55e1380-724f-440e-821b-838e8f60ba20 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:39:03.720389 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a434903c-fca1-4bab-9dd9-8e2bfda6e182 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] Calling method '.version_select at 0x7f2432e461f0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:03.742658 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a434903c-fca1-4bab-9dd9-8e2bfda6e182 tempest-AttachVolumeNegativeTest-322049477 tempest-AttachVolumeNegativeTest-322049477-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1331392890" status: 202 len: 0 microversion: 2.1 time: 0.026048 Jun 05 08:39:03.756386 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1438/2956] 10.222.0.33 () {58 vars in 1220 bytes} [Sun Jun 5 08:39:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1331392890 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:39:03.846247 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-93a32e43-2b31-488a-a2fc-264a4e0ea8a7 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] [instance: beb99f48-e959-42f7-bce8-e3cdd5b1e810] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:39:03.849463 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-93a32e43-2b31-488a-a2fc-264a4e0ea8a7 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:03.850447 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-93a32e43-2b31-488a-a2fc-264a4e0ea8a7 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:03.852403 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-93a32e43-2b31-488a-a2fc-264a4e0ea8a7 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] [instance: beb99f48-e959-42f7-bce8-e3cdd5b1e810] instance's host None is down, deleting from database Jun 05 08:39:03.869565 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-93a32e43-2b31-488a-a2fc-264a4e0ea8a7 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] [instance: beb99f48-e959-42f7-bce8-e3cdd5b1e810] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:39:04.044741 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-93a32e43-2b31-488a-a2fc-264a4e0ea8a7 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] [instance: beb99f48-e959-42f7-bce8-e3cdd5b1e810] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:39:04.052912 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-93a32e43-2b31-488a-a2fc-264a4e0ea8a7 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] [instance: beb99f48-e959-42f7-bce8-e3cdd5b1e810] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:39:04.329734 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-93a32e43-2b31-488a-a2fc-264a4e0ea8a7 tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] 10.222.0.33 "DELETE /compute/v2.1/servers/beb99f48-e959-42f7-bce8-e3cdd5b1e810" status: 204 len: 0 microversion: 2.1 time: 0.773980 Jun 05 08:39:04.334409 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1519/2957] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:39:03 2022] DELETE /compute/v2.1/servers/beb99f48-e959-42f7-bce8-e3cdd5b1e810 => generated 0 bytes in 778 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:39:04.342060 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bb3b80d0-b6f5-40a1-87ac-d2e0548cc2ff tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:04.342711 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-bb3b80d0-b6f5-40a1-87ac-d2e0548cc2ff tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] [instance: beb99f48-e959-42f7-bce8-e3cdd5b1e810] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:04.361053 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bb3b80d0-b6f5-40a1-87ac-d2e0548cc2ff tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:04.361517 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bb3b80d0-b6f5-40a1-87ac-d2e0548cc2ff tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:04.364823 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bb3b80d0-b6f5-40a1-87ac-d2e0548cc2ff tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:04.367659 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-bb3b80d0-b6f5-40a1-87ac-d2e0548cc2ff tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:04.406678 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-bb3b80d0-b6f5-40a1-87ac-d2e0548cc2ff tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] HTTP exception thrown: Instance beb99f48-e959-42f7-bce8-e3cdd5b1e810 could not be found. Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bb3b80d0-b6f5-40a1-87ac-d2e0548cc2ff tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Request method failure captured: Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/beb99f48-e959-42f7-bce8-e3cdd5b1e810 HTTP/1.1 Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGuiEUzJZBpmksXwJYcfN79FOdSiE2bgZiKLzttZFxrHL--fSuEesOW2rygGGYq1dHc_WkxXi9lCWuwtXZ0aRZ8wMovhuFqPGIPnEX15OMtq8OLLz_LWY-2gSm_i7IMDJahFKEUVS8CAat3_EdE1XAdZhPa_v7JFM9BFW_mlcRuFMaM Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 4590e8fc717b4f0ca1208e985bff3c08 Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ServerAddressesTestJSON-608226258 Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4590e8fc717b4f0ca1208e985bff3c08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4590e8fc717b4f0ca1208e985bff3c08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4590e8fc717b4f0ca1208e985bff3c08", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4590e8fc717b4f0ca1208e985bff3c08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ServerAddressesTestJSON-608226258 Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 4590e8fc717b4f0ca1208e985bff3c08 Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ServerAddressesTestJSON-608226258 Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ServerAddressesTestJSON-608226258-project Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 4abbed5a3fe3465597898cf556159264 Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ServerAddressesTestJSON-608226258-project Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance beb99f48-e959-42f7-bce8-e3cdd5b1e810 could not be found. Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'beb99f48-e959-42f7-bce8-e3cdd5b1e810'} Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance beb99f48-e959-42f7-bce8-e3cdd5b1e810 could not be found. Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance beb99f48-e959-42f7-bce8-e3cdd5b1e810 could not be found. Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:04.409168 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:04.414735 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:04.414735 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:04.414735 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:04.414735 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:39:04.414735 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:39:04.414735 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance beb99f48-e959-42f7-bce8-e3cdd5b1e810 could not be found. Jun 05 08:39:04.414735 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:04.421054 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bb3b80d0-b6f5-40a1-87ac-d2e0548cc2ff tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] Returning 404 to user: Instance beb99f48-e959-42f7-bce8-e3cdd5b1e810 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:39:04.433283 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bb3b80d0-b6f5-40a1-87ac-d2e0548cc2ff tempest-ServerAddressesTestJSON-608226258 tempest-ServerAddressesTestJSON-608226258-project] 10.222.0.33 "GET /compute/v2.1/servers/beb99f48-e959-42f7-bce8-e3cdd5b1e810" status: 404 len: 111 microversion: 2.1 time: 0.094627 Jun 05 08:39:04.433995 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1439/2958] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:04 2022] GET /compute/v2.1/servers/beb99f48-e959-42f7-bce8-e3cdd5b1e810 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:39:18.152188 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=8 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:39:18.152964 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=30 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:39:18.153835 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:39:18.154550 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:UPDATE=29,nova_cell0:SELECT=36,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=4 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:39:18.216526 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=4 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:39:18.217839 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=34 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:39:18.218815 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:39:18.219638 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=6 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:39:19.190486 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fefa988a-73a6-4288-b6d3-3d7e812b7aee tempest-ServerGroup264TestJSON-536666329 tempest-ServerGroup264TestJSON-536666329-project] Action: 'create', calling method: .version_select at 0x7f2432e463a0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:39:19.228114 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-fefa988a-73a6-4288-b6d3-3d7e812b7aee tempest-ServerGroup264TestJSON-536666329 tempest-ServerGroup264TestJSON-536666329-project] Getting quotas for project e5458471673445f09b4263bc013c7e9e. Resources: {'server_groups'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:39:19.243792 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-fefa988a-73a6-4288-b6d3-3d7e812b7aee tempest-ServerGroup264TestJSON-536666329 tempest-ServerGroup264TestJSON-536666329-project] Getting quotas for user 865ac6b7b490443caa607b87759cc0c0 and project e5458471673445f09b4263bc013c7e9e. Resources: {'server_groups'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:39:19.305927 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fc717974-6e6e-4711-89be-04c0bf196399 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-151537258", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "9cadba9d-5f73-40e2-9cd2-86024f7f62a4"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:39:19.385193 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-fefa988a-73a6-4288-b6d3-3d7e812b7aee tempest-ServerGroup264TestJSON-536666329 tempest-ServerGroup264TestJSON-536666329-project] Getting quotas for project e5458471673445f09b4263bc013c7e9e. Resources: {'server_groups'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:39:19.399296 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-fefa988a-73a6-4288-b6d3-3d7e812b7aee tempest-ServerGroup264TestJSON-536666329 tempest-ServerGroup264TestJSON-536666329-project] Getting quotas for user 865ac6b7b490443caa607b87759cc0c0 and project e5458471673445f09b4263bc013c7e9e. Resources: {'server_groups'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:39:19.409308 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-fc717974-6e6e-4711-89be-04c0bf196399 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] validate_networks() for [('9cadba9d-5f73-40e2-9cd2-86024f7f62a4', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:39:19.432412 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fefa988a-73a6-4288-b6d3-3d7e812b7aee tempest-ServerGroup264TestJSON-536666329 tempest-ServerGroup264TestJSON-536666329-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 1.220653 Jun 05 08:39:19.436504 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1440/2959] 10.222.0.33 () {62 vars in 1213 bytes} [Sun Jun 5 08:39:18 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:39:19.450914 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-470ffa5c-cd37-4c08-b1e9-f1044b06ad4f tempest-ServerGroup264TestJSON-536666329 tempest-ServerGroup264TestJSON-536666329-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:19.495701 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-470ffa5c-cd37-4c08-b1e9-f1044b06ad4f tempest-ServerGroup264TestJSON-536666329 tempest-ServerGroup264TestJSON-536666329-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.054430 Jun 05 08:39:19.498535 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1441/2960] 10.222.0.33 () {60 vars in 1192 bytes} [Sun Jun 5 08:39:19 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:39:19.519714 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f90c1c70-5d15-4c27-a0a5-46944de40dac tempest-ServerGroup264TestJSON-536666329 tempest-ServerGroup264TestJSON-536666329-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:19.535139 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f90c1c70-5d15-4c27-a0a5-46944de40dac tempest-ServerGroup264TestJSON-536666329 tempest-ServerGroup264TestJSON-536666329-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/3a31a640-b3e3-4bec-84c9-d72ecc66c5d8" status: 200 len: 235 microversion: 2.64 time: 0.029836 Jun 05 08:39:19.535683 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1442/2961] 10.222.0.33 () {60 vars in 1303 bytes} [Sun Jun 5 08:39:19 2022] GET /compute/v2.1/os-server-groups/3a31a640-b3e3-4bec-84c9-d72ecc66c5d8 => generated 235 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 05 08:39:19.549251 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fa3b5292-2fdf-44b8-b27e-a0ba27539824 tempest-ServerGroup264TestJSON-536666329 tempest-ServerGroup264TestJSON-536666329-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:19.589187 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fa3b5292-2fdf-44b8-b27e-a0ba27539824 tempest-ServerGroup264TestJSON-536666329 tempest-ServerGroup264TestJSON-536666329-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/3a31a640-b3e3-4bec-84c9-d72ecc66c5d8" status: 204 len: 0 microversion: 2.64 time: 0.044715 Jun 05 08:39:19.595792 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1443/2962] 10.222.0.33 () {60 vars in 1306 bytes} [Sun Jun 5 08:39:19 2022] DELETE /compute/v2.1/os-server-groups/3a31a640-b3e3-4bec-84c9-d72ecc66c5d8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 05 08:39:19.603448 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9a1ffdca-0952-4079-8506-992c403321c8 tempest-ServerGroup264TestJSON-536666329 tempest-ServerGroup264TestJSON-536666329-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:19.621805 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-9a1ffdca-0952-4079-8506-992c403321c8 tempest-ServerGroup264TestJSON-536666329 tempest-ServerGroup264TestJSON-536666329-project] HTTP exception thrown: Instance group 3a31a640-b3e3-4bec-84c9-d72ecc66c5d8 could not be found. Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9a1ffdca-0952-4079-8506-992c403321c8 tempest-ServerGroup264TestJSON-536666329 tempest-ServerGroup264TestJSON-536666329-project] Request method failure captured: Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: request: DELETE /compute/v2.1/os-server-groups/3a31a640-b3e3-4bec-84c9-d72ecc66c5d8 HTTP/1.1 Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGu2G9v26hWTpx4-aTqHWadsXjM9wjdwFzjor-6Ywf3fFFSFPpOuQtrFJ1YNb81vOtetfuVFo9YcI3ubWh6Z7UM7TRfrt5uOthQNu8yAihPMaOW1N4o4WbsTC3DyStCkfYHLByWDeo0my0zqSpUdR9aPjdLSWq1TTvbZ0dwtNw-IGeo Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: X-Openstack-Nova-Api-Version: 2.64 Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: e5458471673445f09b4263bc013c7e9e Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ServerGroup264TestJSON-536666329 Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e5458471673445f09b4263bc013c7e9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e5458471673445f09b4263bc013c7e9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e5458471673445f09b4263bc013c7e9e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e5458471673445f09b4263bc013c7e9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ServerGroup264TestJSON-536666329 Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: e5458471673445f09b4263bc013c7e9e Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ServerGroup264TestJSON-536666329 Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ServerGroup264TestJSON-536666329-project Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 865ac6b7b490443caa607b87759cc0c0 Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ServerGroup264TestJSON-536666329-project Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance group 3a31a640-b3e3-4bec-84c9-d72ecc66c5d8 could not be found. Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '3a31a640-b3e3-4bec-84c9-d72ecc66c5d8'} Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 3a31a640-b3e3-4bec-84c9-d72ecc66c5d8 could not be found. Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 3a31a640-b3e3-4bec-84c9-d72ecc66c5d8 could not be found. Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:19.638316 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:19.648485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:19.648485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:19.648485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:39:19.648485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:39:19.648485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 3a31a640-b3e3-4bec-84c9-d72ecc66c5d8 could not be found. Jun 05 08:39:19.648485 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:19.648485 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9a1ffdca-0952-4079-8506-992c403321c8 tempest-ServerGroup264TestJSON-536666329 tempest-ServerGroup264TestJSON-536666329-project] Returning 404 to user: Instance group 3a31a640-b3e3-4bec-84c9-d72ecc66c5d8 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:39:19.648485 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9a1ffdca-0952-4079-8506-992c403321c8 tempest-ServerGroup264TestJSON-536666329 tempest-ServerGroup264TestJSON-536666329-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/3a31a640-b3e3-4bec-84c9-d72ecc66c5d8" status: 404 len: 117 microversion: 2.64 time: 0.042432 Jun 05 08:39:19.648485 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1444/2963] 10.222.0.33 () {60 vars in 1306 bytes} [Sun Jun 5 08:39:19 2022] DELETE /compute/v2.1/os-server-groups/3a31a640-b3e3-4bec-84c9-d72ecc66c5d8 => generated 117 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 05 08:39:21.524025 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-fc717974-6e6e-4711-89be-04c0bf196399 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:39:21.524552 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-fc717974-6e6e-4711-89be-04c0bf196399 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:39:21.525037 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-fc717974-6e6e-4711-89be-04c0bf196399 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:39:21.525459 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-fc717974-6e6e-4711-89be-04c0bf196399 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:39:21.525881 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-fc717974-6e6e-4711-89be-04c0bf196399 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:39:21.540420 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fc717974-6e6e-4711-89be-04c0bf196399 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:21.541242 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fc717974-6e6e-4711-89be-04c0bf196399 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:21.542618 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fc717974-6e6e-4711-89be-04c0bf196399 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:21.543325 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fc717974-6e6e-4711-89be-04c0bf196399 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:21.568155 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-fc717974-6e6e-4711-89be-04c0bf196399 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Getting quotas for project e0a74e63775d49dbafd25b2c7257f817. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:39:21.575020 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-fc717974-6e6e-4711-89be-04c0bf196399 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Getting quotas for user 65a3e3ac4a994d55a3c87e51b3be024c and project e0a74e63775d49dbafd25b2c7257f817. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:39:21.594842 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-fc717974-6e6e-4711-89be-04c0bf196399 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:39:21.599310 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-fc717974-6e6e-4711-89be-04c0bf196399 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 69fd726f-91f5-4f57-bb30-0ecd496402e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:39:21.675402 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fc717974-6e6e-4711-89be-04c0bf196399 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.525055 Jun 05 08:39:21.688249 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1a7aadf8-2f8a-4f57-9d6c-2268fd7cbc02 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:21.689557 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1a7aadf8-2f8a-4f57-9d6c-2268fd7cbc02 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 69fd726f-91f5-4f57-bb30-0ecd496402e3] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:21.692274 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1520/2964] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:39:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:39:22.143332 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-1a7aadf8-2f8a-4f57-9d6c-2268fd7cbc02 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a3e3ac4a994d55a3c87e51b3be024c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a74e63775d49dbafd25b2c7257f817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:39:22.157931 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1a7aadf8-2f8a-4f57-9d6c-2268fd7cbc02 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "GET /compute/v2.1/servers/69fd726f-91f5-4f57-bb30-0ecd496402e3" status: 200 len: 1192 microversion: 2.1 time: 0.475366 Jun 05 08:39:22.164240 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1445/2965] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:21 2022] GET /compute/v2.1/servers/69fd726f-91f5-4f57-bb30-0ecd496402e3 => generated 1192 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:39:23.180923 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-622fc178-fe77-4592-a0ad-63400a8d9b88 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:23.181737 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-622fc178-fe77-4592-a0ad-63400a8d9b88 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 69fd726f-91f5-4f57-bb30-0ecd496402e3] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:23.201049 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-622fc178-fe77-4592-a0ad-63400a8d9b88 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:23.201819 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-622fc178-fe77-4592-a0ad-63400a8d9b88 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:23.205052 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-622fc178-fe77-4592-a0ad-63400a8d9b88 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:23.207368 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-622fc178-fe77-4592-a0ad-63400a8d9b88 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:23.300018 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-622fc178-fe77-4592-a0ad-63400a8d9b88 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:23.303818 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-622fc178-fe77-4592-a0ad-63400a8d9b88 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:23.304627 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-622fc178-fe77-4592-a0ad-63400a8d9b88 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lazy-loading 'fault' on Instance uuid 69fd726f-91f5-4f57-bb30-0ecd496402e3 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:39:23.391258 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-622fc178-fe77-4592-a0ad-63400a8d9b88 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a3e3ac4a994d55a3c87e51b3be024c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a74e63775d49dbafd25b2c7257f817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:39:23.401875 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-622fc178-fe77-4592-a0ad-63400a8d9b88 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "GET /compute/v2.1/servers/69fd726f-91f5-4f57-bb30-0ecd496402e3" status: 200 len: 1265 microversion: 2.1 time: 0.225213 Jun 05 08:39:23.409632 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1521/2966] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:23 2022] GET /compute/v2.1/servers/69fd726f-91f5-4f57-bb30-0ecd496402e3 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:39:23.434038 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-558d794e-03f6-4b5c-aa5b-9c1860113bbd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:23.435171 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-558d794e-03f6-4b5c-aa5b-9c1860113bbd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 69fd726f-91f5-4f57-bb30-0ecd496402e3] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:23.443432 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-558d794e-03f6-4b5c-aa5b-9c1860113bbd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:23.447535 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-558d794e-03f6-4b5c-aa5b-9c1860113bbd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:23.449896 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-558d794e-03f6-4b5c-aa5b-9c1860113bbd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:23.450629 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-558d794e-03f6-4b5c-aa5b-9c1860113bbd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:23.519753 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-558d794e-03f6-4b5c-aa5b-9c1860113bbd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 69fd726f-91f5-4f57-bb30-0ecd496402e3] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:39:23.627295 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-558d794e-03f6-4b5c-aa5b-9c1860113bbd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 69fd726f-91f5-4f57-bb30-0ecd496402e3] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:39:23.628096 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-558d794e-03f6-4b5c-aa5b-9c1860113bbd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:23.632394 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-558d794e-03f6-4b5c-aa5b-9c1860113bbd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:23.632925 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-558d794e-03f6-4b5c-aa5b-9c1860113bbd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 69fd726f-91f5-4f57-bb30-0ecd496402e3] instance's host None is down, deleting from database Jun 05 08:39:23.645444 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-558d794e-03f6-4b5c-aa5b-9c1860113bbd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 69fd726f-91f5-4f57-bb30-0ecd496402e3] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:39:23.722509 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-558d794e-03f6-4b5c-aa5b-9c1860113bbd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 69fd726f-91f5-4f57-bb30-0ecd496402e3] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:39:23.738476 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-558d794e-03f6-4b5c-aa5b-9c1860113bbd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 69fd726f-91f5-4f57-bb30-0ecd496402e3] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:39:24.124184 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-558d794e-03f6-4b5c-aa5b-9c1860113bbd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "DELETE /compute/v2.1/servers/69fd726f-91f5-4f57-bb30-0ecd496402e3" status: 204 len: 0 microversion: 2.1 time: 0.693743 Jun 05 08:39:24.125382 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1446/2967] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:39:23 2022] DELETE /compute/v2.1/servers/69fd726f-91f5-4f57-bb30-0ecd496402e3 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:39:24.136879 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4383dcf6-b035-44ed-9c46-2fb8765f2830 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:24.137542 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4383dcf6-b035-44ed-9c46-2fb8765f2830 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 69fd726f-91f5-4f57-bb30-0ecd496402e3] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:24.166187 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4383dcf6-b035-44ed-9c46-2fb8765f2830 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:24.166997 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4383dcf6-b035-44ed-9c46-2fb8765f2830 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:24.169906 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4383dcf6-b035-44ed-9c46-2fb8765f2830 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:24.170367 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4383dcf6-b035-44ed-9c46-2fb8765f2830 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:24.218807 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-4383dcf6-b035-44ed-9c46-2fb8765f2830 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] HTTP exception thrown: Instance 69fd726f-91f5-4f57-bb30-0ecd496402e3 could not be found. Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4383dcf6-b035-44ed-9c46-2fb8765f2830 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Request method failure captured: Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/69fd726f-91f5-4f57-bb30-0ecd496402e3 HTTP/1.1 Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGu1vFCwWen85d3HsPe2yp3Ue0qTRVzpHRvnDC2K9Zq7dXy-upJpVvCiFKsXFfl02PIgLY8X82xPfb_LVHLyaFDpNYpAMesTIyWh9bIwUEf7Ktz2z92xAdpstdBaCJfFxBdlDjs-RRoYJtmtUKpjlscLHodDrvmqbYQWg0V1EvcLdS8 Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: e0a74e63775d49dbafd25b2c7257f817 Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ServersTestJSON-1445963553 Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e0a74e63775d49dbafd25b2c7257f817"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0a74e63775d49dbafd25b2c7257f817"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e0a74e63775d49dbafd25b2c7257f817", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0a74e63775d49dbafd25b2c7257f817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ServersTestJSON-1445963553 Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: e0a74e63775d49dbafd25b2c7257f817 Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ServersTestJSON-1445963553 Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ServersTestJSON-1445963553-project Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 65a3e3ac4a994d55a3c87e51b3be024c Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ServersTestJSON-1445963553-project Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 69fd726f-91f5-4f57-bb30-0ecd496402e3 could not be found. Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '69fd726f-91f5-4f57-bb30-0ecd496402e3'} Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69fd726f-91f5-4f57-bb30-0ecd496402e3 could not be found. Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69fd726f-91f5-4f57-bb30-0ecd496402e3 could not be found. Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:24.221948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:24.228349 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:24.228349 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:24.228349 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:39:24.228349 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:39:24.228349 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69fd726f-91f5-4f57-bb30-0ecd496402e3 could not be found. Jun 05 08:39:24.228349 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:24.228349 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4383dcf6-b035-44ed-9c46-2fb8765f2830 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Returning 404 to user: Instance 69fd726f-91f5-4f57-bb30-0ecd496402e3 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:39:24.228349 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4383dcf6-b035-44ed-9c46-2fb8765f2830 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "GET /compute/v2.1/servers/69fd726f-91f5-4f57-bb30-0ecd496402e3" status: 404 len: 111 microversion: 2.1 time: 0.091857 Jun 05 08:39:24.228349 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1522/2968] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:24 2022] GET /compute/v2.1/servers/69fd726f-91f5-4f57-bb30-0ecd496402e3 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:39:24.572818 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-cb90fdf9-33d3-4b73-b75b-f706d18db6fd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1582321535", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:39:24.652215 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-cb90fdf9-33d3-4b73-b75b-f706d18db6fd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] validate_networks() for [('9cadba9d-5f73-40e2-9cd2-86024f7f62a4', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:39:25.347128 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-890132c4-54b2-4211-9b6b-0c287c1ad3cf tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Action: 'create', calling method: .version_select at 0x7f24337b6820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2949844"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:39:25.512977 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-cb90fdf9-33d3-4b73-b75b-f706d18db6fd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:39:25.514208 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-cb90fdf9-33d3-4b73-b75b-f706d18db6fd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:39:25.514886 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-cb90fdf9-33d3-4b73-b75b-f706d18db6fd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:39:25.516843 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-cb90fdf9-33d3-4b73-b75b-f706d18db6fd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:39:25.517737 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-cb90fdf9-33d3-4b73-b75b-f706d18db6fd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:39:25.535380 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cb90fdf9-33d3-4b73-b75b-f706d18db6fd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:25.538572 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cb90fdf9-33d3-4b73-b75b-f706d18db6fd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:25.539643 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cb90fdf9-33d3-4b73-b75b-f706d18db6fd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:25.542516 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-cb90fdf9-33d3-4b73-b75b-f706d18db6fd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:25.597929 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-cb90fdf9-33d3-4b73-b75b-f706d18db6fd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Getting quotas for project e0a74e63775d49dbafd25b2c7257f817. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:39:25.614595 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-cb90fdf9-33d3-4b73-b75b-f706d18db6fd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Getting quotas for user 65a3e3ac4a994d55a3c87e51b3be024c and project e0a74e63775d49dbafd25b2c7257f817. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:39:25.651736 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-cb90fdf9-33d3-4b73-b75b-f706d18db6fd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:39:25.658215 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-cb90fdf9-33d3-4b73-b75b-f706d18db6fd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: e57b1da6-59e4-408e-b2df-1161fe5a062c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:39:25.799767 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-cb90fdf9-33d3-4b73-b75b-f706d18db6fd tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.230766 Jun 05 08:39:25.801355 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1447/2969] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:39:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:39:25.819841 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-199086e9-cf77-4f40-9bcd-09d5ae1e8281 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:25.821237 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-199086e9-cf77-4f40-9bcd-09d5ae1e8281 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: e57b1da6-59e4-408e-b2df-1161fe5a062c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:25.902686 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-199086e9-cf77-4f40-9bcd-09d5ae1e8281 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: e57b1da6-59e4-408e-b2df-1161fe5a062c] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:39:26.086713 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-890132c4-54b2-4211-9b6b-0c287c1ad3cf tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 342 microversion: 2.1 time: 1.296829 Jun 05 08:39:26.087501 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1523/2970] 10.222.0.33 () {60 vars in 1154 bytes} [Sun Jun 5 08:39:24 2022] POST /compute/v2.1/os-volumes => generated 342 bytes in 1298 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 05 08:39:26.100099 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1811c3f0-2899-40a8-a4c5-802f28199bb4 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Calling method '.version_select at 0x7f24337e3040>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:26.166998 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-199086e9-cf77-4f40-9bcd-09d5ae1e8281 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e57b1da6-59e4-408e-b2df-1161fe5a062c" status: 204 len: 0 microversion: 2.1 time: 0.359087 Jun 05 08:39:26.174013 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1448/2971] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:39:25 2022] DELETE /compute/v2.1/servers/e57b1da6-59e4-408e-b2df-1161fe5a062c => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:39:26.180550 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a191dba0-4420-47ef-be02-dcf7379c8004 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:26.181667 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a191dba0-4420-47ef-be02-dcf7379c8004 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: e57b1da6-59e4-408e-b2df-1161fe5a062c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:26.190962 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a191dba0-4420-47ef-be02-dcf7379c8004 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:26.191657 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a191dba0-4420-47ef-be02-dcf7379c8004 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:26.193139 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a191dba0-4420-47ef-be02-dcf7379c8004 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:26.194580 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a191dba0-4420-47ef-be02-dcf7379c8004 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:26.230081 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1811c3f0-2899-40a8-a4c5-802f28199bb4 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c7ce442a-0ff9-4a46-b57e-e7cd84260792" status: 200 len: 342 microversion: 2.1 time: 0.134816 Jun 05 08:39:26.234893 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1524/2972] 10.222.0.33 () {58 vars in 1244 bytes} [Sun Jun 5 08:39:26 2022] GET /compute/v2.1/os-volumes/c7ce442a-0ff9-4a46-b57e-e7cd84260792 => generated 342 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:39:26.339091 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a191dba0-4420-47ef-be02-dcf7379c8004 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a3e3ac4a994d55a3c87e51b3be024c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a74e63775d49dbafd25b2c7257f817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:39:26.354557 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a191dba0-4420-47ef-be02-dcf7379c8004 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "GET /compute/v2.1/servers/e57b1da6-59e4-408e-b2df-1161fe5a062c" status: 200 len: 1209 microversion: 2.1 time: 0.179043 Jun 05 08:39:26.367070 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1449/2973] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:26 2022] GET /compute/v2.1/servers/e57b1da6-59e4-408e-b2df-1161fe5a062c => generated 1209 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:39:27.245705 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7a28dc83-4f88-47a9-b333-86221daab328 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Calling method '.version_select at 0x7f24337b6c10>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:27.358518 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7a28dc83-4f88-47a9-b333-86221daab328 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c7ce442a-0ff9-4a46-b57e-e7cd84260792" status: 200 len: 342 microversion: 2.1 time: 0.119730 Jun 05 08:39:27.359427 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1525/2974] 10.222.0.33 () {58 vars in 1244 bytes} [Sun Jun 5 08:39:27 2022] GET /compute/v2.1/os-volumes/c7ce442a-0ff9-4a46-b57e-e7cd84260792 => generated 342 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:27.379600 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f6b6b12b-0c72-49f1-9c2d-252609591f12 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:27.380265 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f6b6b12b-0c72-49f1-9c2d-252609591f12 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: e57b1da6-59e4-408e-b2df-1161fe5a062c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:27.391751 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f6b6b12b-0c72-49f1-9c2d-252609591f12 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:27.391751 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f6b6b12b-0c72-49f1-9c2d-252609591f12 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:27.391751 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f6b6b12b-0c72-49f1-9c2d-252609591f12 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:27.391751 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f6b6b12b-0c72-49f1-9c2d-252609591f12 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:27.428658 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-f6b6b12b-0c72-49f1-9c2d-252609591f12 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] HTTP exception thrown: Instance e57b1da6-59e4-408e-b2df-1161fe5a062c could not be found. Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f6b6b12b-0c72-49f1-9c2d-252609591f12 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Request method failure captured: Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/e57b1da6-59e4-408e-b2df-1161fe5a062c HTTP/1.1 Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGu1vFCwWen85d3HsPe2yp3Ue0qTRVzpHRvnDC2K9Zq7dXy-upJpVvCiFKsXFfl02PIgLY8X82xPfb_LVHLyaFDpNYpAMesTIyWh9bIwUEf7Ktz2z92xAdpstdBaCJfFxBdlDjs-RRoYJtmtUKpjlscLHodDrvmqbYQWg0V1EvcLdS8 Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: e0a74e63775d49dbafd25b2c7257f817 Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ServersTestJSON-1445963553 Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e0a74e63775d49dbafd25b2c7257f817"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0a74e63775d49dbafd25b2c7257f817"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e0a74e63775d49dbafd25b2c7257f817", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0a74e63775d49dbafd25b2c7257f817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ServersTestJSON-1445963553 Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: e0a74e63775d49dbafd25b2c7257f817 Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ServersTestJSON-1445963553 Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ServersTestJSON-1445963553-project Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 65a3e3ac4a994d55a3c87e51b3be024c Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ServersTestJSON-1445963553-project Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance e57b1da6-59e4-408e-b2df-1161fe5a062c could not be found. Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'e57b1da6-59e4-408e-b2df-1161fe5a062c'} Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e57b1da6-59e4-408e-b2df-1161fe5a062c could not be found. Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e57b1da6-59e4-408e-b2df-1161fe5a062c could not be found. Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:27.430663 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:27.435721 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:27.435721 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:27.435721 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:39:27.435721 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:39:27.435721 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e57b1da6-59e4-408e-b2df-1161fe5a062c could not be found. Jun 05 08:39:27.435721 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:27.440129 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f6b6b12b-0c72-49f1-9c2d-252609591f12 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Returning 404 to user: Instance e57b1da6-59e4-408e-b2df-1161fe5a062c could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:39:27.441461 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f6b6b12b-0c72-49f1-9c2d-252609591f12 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "GET /compute/v2.1/servers/e57b1da6-59e4-408e-b2df-1161fe5a062c" status: 404 len: 111 microversion: 2.1 time: 0.072531 Jun 05 08:39:27.453065 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1450/2975] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:27 2022] GET /compute/v2.1/servers/e57b1da6-59e4-408e-b2df-1161fe5a062c => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:39:28.196873 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8362efc8-5cf7-4863-898f-31fca8cca55b tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1515935858", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "9cadba9d-5f73-40e2-9cd2-86024f7f62a4"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:39:28.308916 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-8362efc8-5cf7-4863-898f-31fca8cca55b tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] validate_networks() for [('9cadba9d-5f73-40e2-9cd2-86024f7f62a4', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:39:28.371137 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7540eae6-4897-4906-b17a-eebb62e2f2b5 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Calling method '.version_select at 0x7f2432e7b0d0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:28.512712 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7540eae6-4897-4906-b17a-eebb62e2f2b5 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c7ce442a-0ff9-4a46-b57e-e7cd84260792" status: 200 len: 342 microversion: 2.1 time: 0.145679 Jun 05 08:39:28.514285 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1451/2976] 10.222.0.33 () {58 vars in 1244 bytes} [Sun Jun 5 08:39:28 2022] GET /compute/v2.1/os-volumes/c7ce442a-0ff9-4a46-b57e-e7cd84260792 => generated 342 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:29.529356 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5a7e3a02-17fc-4079-aefb-187cc08fb16b tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Calling method '.version_select at 0x7f2432dde310>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:29.589642 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5a7e3a02-17fc-4079-aefb-187cc08fb16b tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c7ce442a-0ff9-4a46-b57e-e7cd84260792" status: 200 len: 343 microversion: 2.1 time: 0.067420 Jun 05 08:39:29.590538 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1452/2977] 10.222.0.33 () {58 vars in 1244 bytes} [Sun Jun 5 08:39:29 2022] GET /compute/v2.1/os-volumes/c7ce442a-0ff9-4a46-b57e-e7cd84260792 => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:29.602312 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-385e40d1-54d3-40e1-a07d-a68c3bdfc904 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Action: 'create', calling method: .version_select at 0x7f2432eeb700>, body: {"snapshot": {"volume_id": "c7ce442a-0ff9-4a46-b57e-e7cd84260792", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1879547515"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:39:29.867943 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-385e40d1-54d3-40e1-a07d-a68c3bdfc904 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.270037 Jun 05 08:39:29.874072 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1453/2978] 10.222.0.33 () {60 vars in 1161 bytes} [Sun Jun 5 08:39:29 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:29.879497 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8a56257f-47ae-4a75-b8b8-262d09339507 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Calling method '.version_select at 0x7f2432dc3ca0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:30.018784 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8a56257f-47ae-4a75-b8b8-262d09339507 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/645bd118-7365-4a2a-8b0d-ed588c7e4635" status: 200 len: 287 microversion: 2.1 time: 0.143389 Jun 05 08:39:30.025645 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1454/2979] 10.222.0.33 () {58 vars in 1250 bytes} [Sun Jun 5 08:39:29 2022] GET /compute/v2.1/os-snapshots/645bd118-7365-4a2a-8b0d-ed588c7e4635 => generated 287 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:30.030592 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6d18cc28-4ad4-4da2-82e3-250cca358acb tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Calling method '.version_select at 0x7f2432dc39d0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:30.103741 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6d18cc28-4ad4-4da2-82e3-250cca358acb tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.076687 Jun 05 08:39:30.104130 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-8362efc8-5cf7-4863-898f-31fca8cca55b tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:39:30.104553 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-8362efc8-5cf7-4863-898f-31fca8cca55b tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:39:30.105051 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-8362efc8-5cf7-4863-898f-31fca8cca55b tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:39:30.110345 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-8362efc8-5cf7-4863-898f-31fca8cca55b tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:39:30.110345 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-8362efc8-5cf7-4863-898f-31fca8cca55b tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:39:30.111791 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1455/2980] 10.222.0.33 () {58 vars in 1139 bytes} [Sun Jun 5 08:39:30 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:30.117399 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3485800a-647d-40a7-983e-6af4a780e528 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Calling method '.version_select at 0x7f2432dc3550>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:30.131317 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8362efc8-5cf7-4863-898f-31fca8cca55b tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:30.131884 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8362efc8-5cf7-4863-898f-31fca8cca55b tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:30.132741 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8362efc8-5cf7-4863-898f-31fca8cca55b tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:30.133536 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8362efc8-5cf7-4863-898f-31fca8cca55b tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:30.161890 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3485800a-647d-40a7-983e-6af4a780e528 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/645bd118-7365-4a2a-8b0d-ed588c7e4635" status: 200 len: 287 microversion: 2.1 time: 0.048564 Jun 05 08:39:30.170255 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1456/2981] 10.222.0.33 () {58 vars in 1250 bytes} [Sun Jun 5 08:39:30 2022] GET /compute/v2.1/os-snapshots/645bd118-7365-4a2a-8b0d-ed588c7e4635 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:30.201182 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-8362efc8-5cf7-4863-898f-31fca8cca55b tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Getting quotas for project e0a74e63775d49dbafd25b2c7257f817. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:39:30.215694 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-8362efc8-5cf7-4863-898f-31fca8cca55b tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Getting quotas for user 65a3e3ac4a994d55a3c87e51b3be024c and project e0a74e63775d49dbafd25b2c7257f817. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:39:30.249078 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8362efc8-5cf7-4863-898f-31fca8cca55b tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:39:30.249078 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8362efc8-5cf7-4863-898f-31fca8cca55b tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: b6c4e3b1-1555-4d02-b0bb-01c62615ae3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:39:30.357655 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8362efc8-5cf7-4863-898f-31fca8cca55b tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.165956 Jun 05 08:39:30.358935 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1526/2982] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:39:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:39:30.369282 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-07ce38e8-8e87-4c01-b1c1-58a81488410e tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:30.371099 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-07ce38e8-8e87-4c01-b1c1-58a81488410e tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: b6c4e3b1-1555-4d02-b0bb-01c62615ae3f] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:31.032745 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-07ce38e8-8e87-4c01-b1c1-58a81488410e tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a3e3ac4a994d55a3c87e51b3be024c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a74e63775d49dbafd25b2c7257f817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:39:31.056718 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-07ce38e8-8e87-4c01-b1c1-58a81488410e tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "GET /compute/v2.1/servers/b6c4e3b1-1555-4d02-b0bb-01c62615ae3f" status: 200 len: 1221 microversion: 2.1 time: 0.691116 Jun 05 08:39:31.069392 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1457/2983] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:30 2022] GET /compute/v2.1/servers/b6c4e3b1-1555-4d02-b0bb-01c62615ae3f => generated 1221 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:39:31.178567 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b42a38ad-82c3-45b7-b94e-627a9de72d89 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Calling method '.version_select at 0x7f24337e3670>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:31.239948 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b42a38ad-82c3-45b7-b94e-627a9de72d89 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/645bd118-7365-4a2a-8b0d-ed588c7e4635" status: 200 len: 287 microversion: 2.1 time: 0.065852 Jun 05 08:39:31.241218 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1527/2984] 10.222.0.33 () {58 vars in 1250 bytes} [Sun Jun 5 08:39:31 2022] GET /compute/v2.1/os-snapshots/645bd118-7365-4a2a-8b0d-ed588c7e4635 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:32.076730 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-22939a61-6df3-4d13-a921-b941318850a2 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:32.077996 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-22939a61-6df3-4d13-a921-b941318850a2 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: b6c4e3b1-1555-4d02-b0bb-01c62615ae3f] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:32.091484 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-22939a61-6df3-4d13-a921-b941318850a2 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:32.092638 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-22939a61-6df3-4d13-a921-b941318850a2 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:32.094478 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-22939a61-6df3-4d13-a921-b941318850a2 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:32.096588 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-22939a61-6df3-4d13-a921-b941318850a2 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:32.141061 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-22939a61-6df3-4d13-a921-b941318850a2 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:32.144783 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-22939a61-6df3-4d13-a921-b941318850a2 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:32.146006 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-22939a61-6df3-4d13-a921-b941318850a2 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lazy-loading 'fault' on Instance uuid b6c4e3b1-1555-4d02-b0bb-01c62615ae3f {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:39:32.264910 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-22939a61-6df3-4d13-a921-b941318850a2 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a3e3ac4a994d55a3c87e51b3be024c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a74e63775d49dbafd25b2c7257f817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:39:32.272901 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-22939a61-6df3-4d13-a921-b941318850a2 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "GET /compute/v2.1/servers/b6c4e3b1-1555-4d02-b0bb-01c62615ae3f" status: 200 len: 1294 microversion: 2.1 time: 0.200969 Jun 05 08:39:32.278669 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1528/2985] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:32 2022] GET /compute/v2.1/servers/b6c4e3b1-1555-4d02-b0bb-01c62615ae3f => generated 1294 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:39:32.295219 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-eaec313d-9c21-453a-af12-c26c0d8de206 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Calling method '.version_select at 0x7f243386c8b0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:32.335370 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-97d30a78-5ec0-43cc-95f8-ed2fbe496771 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Action: 'create', calling method: .version_select at 0x7f2432e97ee0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1685741709", "policies": ["affinity"]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:39:32.364237 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-eaec313d-9c21-453a-af12-c26c0d8de206 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/645bd118-7365-4a2a-8b0d-ed588c7e4635" status: 200 len: 287 microversion: 2.1 time: 0.083880 Jun 05 08:39:32.364940 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1529/2986] 10.222.0.33 () {58 vars in 1250 bytes} [Sun Jun 5 08:39:32 2022] GET /compute/v2.1/os-snapshots/645bd118-7365-4a2a-8b0d-ed588c7e4635 => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:32.370518 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-dd85aae2-9360-4518-8c06-19c07d042854 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:32.371025 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-dd85aae2-9360-4518-8c06-19c07d042854 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: b6c4e3b1-1555-4d02-b0bb-01c62615ae3f] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:32.374779 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=4,nova_api:UPDATE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:39:32.388840 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-97d30a78-5ec0-43cc-95f8-ed2fbe496771 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Getting quotas for project d4487d6dbf0d41929133bb6cd08bafca. Resources: {'server_groups'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:39:32.399594 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-97d30a78-5ec0-43cc-95f8-ed2fbe496771 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Getting quotas for user 876108eee7cd434fa3351bf2546d3152 and project d4487d6dbf0d41929133bb6cd08bafca. Resources: {'server_groups'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:39:32.400066 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dd85aae2-9360-4518-8c06-19c07d042854 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:32.400603 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dd85aae2-9360-4518-8c06-19c07d042854 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:32.401456 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dd85aae2-9360-4518-8c06-19c07d042854 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:32.401903 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dd85aae2-9360-4518-8c06-19c07d042854 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:32.482307 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-97d30a78-5ec0-43cc-95f8-ed2fbe496771 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Getting quotas for project d4487d6dbf0d41929133bb6cd08bafca. Resources: {'server_groups'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:39:32.482565 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-dd85aae2-9360-4518-8c06-19c07d042854 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: b6c4e3b1-1555-4d02-b0bb-01c62615ae3f] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:39:32.492323 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-97d30a78-5ec0-43cc-95f8-ed2fbe496771 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Getting quotas for user 876108eee7cd434fa3351bf2546d3152 and project d4487d6dbf0d41929133bb6cd08bafca. Resources: {'server_groups'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:39:32.524472 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-97d30a78-5ec0-43cc-95f8-ed2fbe496771 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.902065 Jun 05 08:39:32.532730 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1458/2987] 10.222.0.33 () {60 vars in 1173 bytes} [Sun Jun 5 08:39:31 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:32.539556 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8fe9d6a4-c1ec-43e8-9047-4513eb9026ca tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Action: 'create', calling method: .version_select at 0x7f2432ed1790>, body: {"server_group": {"name": "tempest-server-group-1005555140", "policies": ["affinity"]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:39:32.586439 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-8fe9d6a4-c1ec-43e8-9047-4513eb9026ca tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Getting quotas for project d4487d6dbf0d41929133bb6cd08bafca. Resources: {'server_groups'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:39:32.595403 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-8fe9d6a4-c1ec-43e8-9047-4513eb9026ca tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Getting quotas for user 876108eee7cd434fa3351bf2546d3152 and project d4487d6dbf0d41929133bb6cd08bafca. Resources: {'server_groups'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:39:32.627851 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-dd85aae2-9360-4518-8c06-19c07d042854 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: b6c4e3b1-1555-4d02-b0bb-01c62615ae3f] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:39:32.632100 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dd85aae2-9360-4518-8c06-19c07d042854 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:32.633883 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dd85aae2-9360-4518-8c06-19c07d042854 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:32.634780 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-dd85aae2-9360-4518-8c06-19c07d042854 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: b6c4e3b1-1555-4d02-b0bb-01c62615ae3f] instance's host None is down, deleting from database Jun 05 08:39:32.659963 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-dd85aae2-9360-4518-8c06-19c07d042854 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: b6c4e3b1-1555-4d02-b0bb-01c62615ae3f] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:39:32.697416 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-8fe9d6a4-c1ec-43e8-9047-4513eb9026ca tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Getting quotas for project d4487d6dbf0d41929133bb6cd08bafca. Resources: {'server_groups'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:39:32.708276 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-8fe9d6a4-c1ec-43e8-9047-4513eb9026ca tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Getting quotas for user 876108eee7cd434fa3351bf2546d3152 and project d4487d6dbf0d41929133bb6cd08bafca. Resources: {'server_groups'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:39:32.734421 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8fe9d6a4-c1ec-43e8-9047-4513eb9026ca tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.199605 Jun 05 08:39:32.742956 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1459/2988] 10.222.0.33 () {60 vars in 1172 bytes} [Sun Jun 5 08:39:32 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:32.749625 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-63a56fb2-f300-4a00-932b-dad85705b79f tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Action: 'create', calling method: .version_select at 0x7f2432dc3820>, body: {"server_group": {"name": "tempest-server-group-1005555140", "policies": ["affinity"]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:39:32.799496 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-63a56fb2-f300-4a00-932b-dad85705b79f tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Getting quotas for project d4487d6dbf0d41929133bb6cd08bafca. Resources: {'server_groups'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:39:32.809018 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-63a56fb2-f300-4a00-932b-dad85705b79f tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Getting quotas for user 876108eee7cd434fa3351bf2546d3152 and project d4487d6dbf0d41929133bb6cd08bafca. Resources: {'server_groups'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:39:32.826375 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-dd85aae2-9360-4518-8c06-19c07d042854 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: b6c4e3b1-1555-4d02-b0bb-01c62615ae3f] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:39:32.833261 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-dd85aae2-9360-4518-8c06-19c07d042854 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: b6c4e3b1-1555-4d02-b0bb-01c62615ae3f] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:39:32.975234 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-63a56fb2-f300-4a00-932b-dad85705b79f tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Getting quotas for project d4487d6dbf0d41929133bb6cd08bafca. Resources: {'server_groups'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:39:33.012698 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-63a56fb2-f300-4a00-932b-dad85705b79f tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Getting quotas for user 876108eee7cd434fa3351bf2546d3152 and project d4487d6dbf0d41929133bb6cd08bafca. Resources: {'server_groups'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:39:33.046218 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-63a56fb2-f300-4a00-932b-dad85705b79f tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.301537 Jun 05 08:39:33.047135 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1460/2989] 10.222.0.33 () {60 vars in 1172 bytes} [Sun Jun 5 08:39:32 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:33.073198 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f3e0ea91-f15e-4961-8157-76c7e2b50cca tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:33.142273 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f3e0ea91-f15e-4961-8157-76c7e2b50cca tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/027e02f0-2373-4539-8c12-244ada357f9e" status: 204 len: 0 microversion: 2.1 time: 0.086980 Jun 05 08:39:33.144076 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1461/2990] 10.222.0.33 () {58 vars in 1265 bytes} [Sun Jun 5 08:39:33 2022] DELETE /compute/v2.1/os-server-groups/027e02f0-2373-4539-8c12-244ada357f9e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:39:33.185800 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c62f90b8-6464-4665-bafc-ae7efa2ee1f6 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:33.233339 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c62f90b8-6464-4665-bafc-ae7efa2ee1f6 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.056309 Jun 05 08:39:33.242560 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1462/2991] 10.222.0.33 () {58 vars in 1151 bytes} [Sun Jun 5 08:39:33 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:33.266123 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5acbc8c7-fb2c-44a8-90cd-befc25ac5cdd tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:33.271191 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-dd85aae2-9360-4518-8c06-19c07d042854 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b6c4e3b1-1555-4d02-b0bb-01c62615ae3f" status: 204 len: 0 microversion: 2.1 time: 0.904373 Jun 05 08:39:33.272682 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1530/2992] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:39:32 2022] DELETE /compute/v2.1/servers/b6c4e3b1-1555-4d02-b0bb-01c62615ae3f => generated 0 bytes in 907 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:39:33.285580 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6eff5c7c-3060-4313-b9ad-b75d69d2c1b8 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:33.286414 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6eff5c7c-3060-4313-b9ad-b75d69d2c1b8 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: b6c4e3b1-1555-4d02-b0bb-01c62615ae3f] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:33.304539 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6eff5c7c-3060-4313-b9ad-b75d69d2c1b8 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:33.304996 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6eff5c7c-3060-4313-b9ad-b75d69d2c1b8 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:33.313745 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6eff5c7c-3060-4313-b9ad-b75d69d2c1b8 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:33.314473 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6eff5c7c-3060-4313-b9ad-b75d69d2c1b8 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:33.339398 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5acbc8c7-fb2c-44a8-90cd-befc25ac5cdd tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/ddef2150-8545-414a-a62e-deb1aaa6b832" status: 204 len: 0 microversion: 2.1 time: 0.091371 Jun 05 08:39:33.343219 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1463/2993] 10.222.0.33 () {58 vars in 1265 bytes} [Sun Jun 5 08:39:33 2022] DELETE /compute/v2.1/os-server-groups/ddef2150-8545-414a-a62e-deb1aaa6b832 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:39:33.343366 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-6eff5c7c-3060-4313-b9ad-b75d69d2c1b8 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] HTTP exception thrown: Instance b6c4e3b1-1555-4d02-b0bb-01c62615ae3f could not be found. Jun 05 08:39:33.348114 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a244e405-d93e-4921-90de-4385966df905 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6eff5c7c-3060-4313-b9ad-b75d69d2c1b8 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Request method failure captured: Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/b6c4e3b1-1555-4d02-b0bb-01c62615ae3f HTTP/1.1 Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGu1vFCwWen85d3HsPe2yp3Ue0qTRVzpHRvnDC2K9Zq7dXy-upJpVvCiFKsXFfl02PIgLY8X82xPfb_LVHLyaFDpNYpAMesTIyWh9bIwUEf7Ktz2z92xAdpstdBaCJfFxBdlDjs-RRoYJtmtUKpjlscLHodDrvmqbYQWg0V1EvcLdS8 Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: e0a74e63775d49dbafd25b2c7257f817 Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ServersTestJSON-1445963553 Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e0a74e63775d49dbafd25b2c7257f817"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0a74e63775d49dbafd25b2c7257f817"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e0a74e63775d49dbafd25b2c7257f817", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0a74e63775d49dbafd25b2c7257f817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ServersTestJSON-1445963553 Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: e0a74e63775d49dbafd25b2c7257f817 Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ServersTestJSON-1445963553 Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ServersTestJSON-1445963553-project Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 65a3e3ac4a994d55a3c87e51b3be024c Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ServersTestJSON-1445963553-project Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance b6c4e3b1-1555-4d02-b0bb-01c62615ae3f could not be found. Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'b6c4e3b1-1555-4d02-b0bb-01c62615ae3f'} Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6c4e3b1-1555-4d02-b0bb-01c62615ae3f could not be found. Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6c4e3b1-1555-4d02-b0bb-01c62615ae3f could not be found. Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:33.353278 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:33.358408 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:33.358408 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:33.358408 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:39:33.358408 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:39:33.358408 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6c4e3b1-1555-4d02-b0bb-01c62615ae3f could not be found. Jun 05 08:39:33.358408 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:33.360517 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6eff5c7c-3060-4313-b9ad-b75d69d2c1b8 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Returning 404 to user: Instance b6c4e3b1-1555-4d02-b0bb-01c62615ae3f could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:39:33.363627 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6eff5c7c-3060-4313-b9ad-b75d69d2c1b8 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "GET /compute/v2.1/servers/b6c4e3b1-1555-4d02-b0bb-01c62615ae3f" status: 404 len: 111 microversion: 2.1 time: 0.082209 Jun 05 08:39:33.364415 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1531/2994] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:33 2022] GET /compute/v2.1/servers/b6c4e3b1-1555-4d02-b0bb-01c62615ae3f => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:39:33.376882 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a244e405-d93e-4921-90de-4385966df905 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.032361 Jun 05 08:39:33.379644 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-85d962e3-f569-4c3d-a273-117c5657b933 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Calling method '.version_select at 0x7f24337cae50>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:33.384438 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1464/2995] 10.222.0.33 () {58 vars in 1151 bytes} [Sun Jun 5 08:39:33 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:33.389259 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f4bb78fa-ff8d-4237-80d6-abc752bbb5d5 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Action: 'create', calling method: .version_select at 0x7f2432f85d30>, body: {"keypair": {"name": "tempest-key-2079898197", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBr2Sc8TzR0MBYtjwKlDLWSP/jRBAHHnkRnXraRkbVwNPqBoXJTtbyRWZ+xK78HAi5c/4UL+Kr0nRmfWPgdZIzEpqvgp9E+EBaqbg2Eb0PoPZX3zU07q3/navcfe5yTwFw=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:39:33.416337 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:DELETE=6 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:39:33.439912 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-f4bb78fa-ff8d-4237-80d6-abc752bbb5d5 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Getting quotas for project e0a74e63775d49dbafd25b2c7257f817. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:39:33.462447 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-f4bb78fa-ff8d-4237-80d6-abc752bbb5d5 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Getting quotas for user 65a3e3ac4a994d55a3c87e51b3be024c and project e0a74e63775d49dbafd25b2c7257f817. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:39:33.469432 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-85d962e3-f569-4c3d-a273-117c5657b933 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/645bd118-7365-4a2a-8b0d-ed588c7e4635" status: 200 len: 287 microversion: 2.1 time: 0.094770 Jun 05 08:39:33.469841 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1532/2996] 10.222.0.33 () {58 vars in 1250 bytes} [Sun Jun 5 08:39:33 2022] GET /compute/v2.1/os-snapshots/645bd118-7365-4a2a-8b0d-ed588c7e4635 => generated 287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:33.474582 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d69d5295-9f96-44c4-952f-63dfcd51d9d6 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Action: 'create', calling method: .version_select at 0x7f24336b8940>, body: {"server_group": {"name": "tempest-server-group-717642702", "policies": ["affinity"]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:39:33.542428 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-d69d5295-9f96-44c4-952f-63dfcd51d9d6 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Getting quotas for project d4487d6dbf0d41929133bb6cd08bafca. Resources: {'server_groups'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:39:33.560569 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f4bb78fa-ff8d-4237-80d6-abc752bbb5d5 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.174866 Jun 05 08:39:33.565505 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1465/2997] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:39:33 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:33.565672 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-d69d5295-9f96-44c4-952f-63dfcd51d9d6 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Getting quotas for user 876108eee7cd434fa3351bf2546d3152 and project d4487d6dbf0d41929133bb6cd08bafca. Resources: {'server_groups'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:39:33.571044 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-95f14e9d-f321-49f3-854d-3397e496fc8b tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '.version_select at 0x7f2432e9a1f0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:33.579081 n-d-844739-1 devstack@n-api.service[119049]: WARNING oslo_db.sqlalchemy.utils [None req-95f14e9d-f321-49f3-854d-3397e496fc8b tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 05 08:39:33.605803 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-95f14e9d-f321-49f3-854d-3397e496fc8b tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.039021 Jun 05 08:39:33.606405 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1466/2998] 10.222.0.33 () {58 vars in 1136 bytes} [Sun Jun 5 08:39:33 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:39:33.723154 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-d69d5295-9f96-44c4-952f-63dfcd51d9d6 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Getting quotas for project d4487d6dbf0d41929133bb6cd08bafca. Resources: {'server_groups'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:39:33.741344 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-d69d5295-9f96-44c4-952f-63dfcd51d9d6 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Getting quotas for user 876108eee7cd434fa3351bf2546d3152 and project d4487d6dbf0d41929133bb6cd08bafca. Resources: {'server_groups'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:39:33.775870 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d69d5295-9f96-44c4-952f-63dfcd51d9d6 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.304744 Jun 05 08:39:33.782746 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1533/2999] 10.222.0.33 () {60 vars in 1172 bytes} [Sun Jun 5 08:39:33 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:33.788375 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7f800ae1-0a9d-4842-b43c-cc5f893271a8 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:33.883128 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7f800ae1-0a9d-4842-b43c-cc5f893271a8 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/7dc3f2a5-f1c2-4474-9875-bb38d1589085" status: 204 len: 0 microversion: 2.1 time: 0.099546 Jun 05 08:39:33.884010 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1467/3000] 10.222.0.33 () {58 vars in 1265 bytes} [Sun Jun 5 08:39:33 2022] DELETE /compute/v2.1/os-server-groups/7dc3f2a5-f1c2-4474-9875-bb38d1589085 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 05 08:39:33.898008 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-94b03db8-e9b9-4816-8108-a6e6e7e8611f tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:33.951639 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-94b03db8-e9b9-4816-8108-a6e6e7e8611f tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.057469 Jun 05 08:39:33.953770 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1534/3001] 10.222.0.33 () {58 vars in 1151 bytes} [Sun Jun 5 08:39:33 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:33.968983 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-dc8521be-da2a-4842-90c9-9b3cd3ae42a3 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Action: 'create', calling method: .version_select at 0x7f2432ed1a60>, body: {"server_group": {"name": "tempest-server-group-14278391", "policies": ["anti-affinity"]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:39:33.981488 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6b7b8806-958f-404d-8e75-5a17b60f4f18 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-127436844", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "key_name": "tempest-key-2079898197", "networks": [{"uuid": "9cadba9d-5f73-40e2-9cd2-86024f7f62a4"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:39:34.043748 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-dc8521be-da2a-4842-90c9-9b3cd3ae42a3 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Getting quotas for project d4487d6dbf0d41929133bb6cd08bafca. Resources: {'server_groups'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:39:34.070407 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-dc8521be-da2a-4842-90c9-9b3cd3ae42a3 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Getting quotas for user 876108eee7cd434fa3351bf2546d3152 and project d4487d6dbf0d41929133bb6cd08bafca. Resources: {'server_groups'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:39:34.108268 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-6b7b8806-958f-404d-8e75-5a17b60f4f18 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] validate_networks() for [('9cadba9d-5f73-40e2-9cd2-86024f7f62a4', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:39:34.203789 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-dc8521be-da2a-4842-90c9-9b3cd3ae42a3 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Getting quotas for project d4487d6dbf0d41929133bb6cd08bafca. Resources: {'server_groups'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:39:34.209368 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-dc8521be-da2a-4842-90c9-9b3cd3ae42a3 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Getting quotas for user 876108eee7cd434fa3351bf2546d3152 and project d4487d6dbf0d41929133bb6cd08bafca. Resources: {'server_groups'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:39:34.238914 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-dc8521be-da2a-4842-90c9-9b3cd3ae42a3 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 167 microversion: 2.1 time: 0.273765 Jun 05 08:39:34.239859 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1468/3002] 10.222.0.33 () {60 vars in 1172 bytes} [Sun Jun 5 08:39:33 2022] POST /compute/v2.1/os-server-groups => generated 167 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:34.250399 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-43da75b7-1f23-4257-a26c-38eb115fd75e tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:34.304947 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-43da75b7-1f23-4257-a26c-38eb115fd75e tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/ee7fe1e7-d88c-4f2a-a1e6-1f4cd722987e" status: 204 len: 0 microversion: 2.1 time: 0.058519 Jun 05 08:39:34.306295 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1469/3003] 10.222.0.33 () {58 vars in 1265 bytes} [Sun Jun 5 08:39:34 2022] DELETE /compute/v2.1/os-server-groups/ee7fe1e7-d88c-4f2a-a1e6-1f4cd722987e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 05 08:39:34.315380 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b24b26a2-65e1-4ef9-ba83-8c6bed5622f9 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:34.353297 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b24b26a2-65e1-4ef9-ba83-8c6bed5622f9 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.042905 Jun 05 08:39:34.367305 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1470/3004] 10.222.0.33 () {58 vars in 1151 bytes} [Sun Jun 5 08:39:34 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:39:34.485673 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5c88cbc9-a748-4d53-9251-7c3ea770b150 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Calling method '.version_select at 0x7f2432dc31f0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:34.569431 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5c88cbc9-a748-4d53-9251-7c3ea770b150 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/645bd118-7365-4a2a-8b0d-ed588c7e4635" status: 200 len: 287 microversion: 2.1 time: 0.087705 Jun 05 08:39:34.570137 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1471/3005] 10.222.0.33 () {58 vars in 1250 bytes} [Sun Jun 5 08:39:34 2022] GET /compute/v2.1/os-snapshots/645bd118-7365-4a2a-8b0d-ed588c7e4635 => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:39:34.785542 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-644a3384-ac5e-4e45-9e99-bccbd9842865 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1040251143", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "f02ca34e-4fbe-4c04-b760-1aa71e0f41ea"}]}, "os:scheduler_hints": {"group": "5c48a781-e82f-4427-9d0c-075348c89ea2"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:39:34.928136 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-644a3384-ac5e-4e45-9e99-bccbd9842865 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] validate_networks() for [('f02ca34e-4fbe-4c04-b760-1aa71e0f41ea', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:39:35.564963 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:39:35.581952 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-6b7b8806-958f-404d-8e75-5a17b60f4f18 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:39:35.588215 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-6b7b8806-958f-404d-8e75-5a17b60f4f18 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:39:35.588568 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-6b7b8806-958f-404d-8e75-5a17b60f4f18 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:39:35.589184 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-6b7b8806-958f-404d-8e75-5a17b60f4f18 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:39:35.590081 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-6b7b8806-958f-404d-8e75-5a17b60f4f18 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:39:35.611465 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6b7b8806-958f-404d-8e75-5a17b60f4f18 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:35.612134 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6b7b8806-958f-404d-8e75-5a17b60f4f18 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:35.613379 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6b7b8806-958f-404d-8e75-5a17b60f4f18 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:35.613992 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6b7b8806-958f-404d-8e75-5a17b60f4f18 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:35.665258 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-6b7b8806-958f-404d-8e75-5a17b60f4f18 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Getting quotas for project e0a74e63775d49dbafd25b2c7257f817. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:39:35.681820 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-6b7b8806-958f-404d-8e75-5a17b60f4f18 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Getting quotas for user 65a3e3ac4a994d55a3c87e51b3be024c and project e0a74e63775d49dbafd25b2c7257f817. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:39:35.730475 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6b7b8806-958f-404d-8e75-5a17b60f4f18 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:39:35.734741 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6b7b8806-958f-404d-8e75-5a17b60f4f18 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: e0d5a329-83a0-48e3-a5b6-6e4718686605] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:39:35.796692 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10,nova_api:UPDATE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:39:35.868527 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6b7b8806-958f-404d-8e75-5a17b60f4f18 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.893641 Jun 05 08:39:35.875546 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1535/3006] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:39:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:39:35.883480 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b46bb280-6bdf-4156-a26a-38d8c1fb5e3b tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Calling method '.version_select at 0x7f243362d0d0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:35.932296 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b46bb280-6bdf-4156-a26a-38d8c1fb5e3b tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/645bd118-7365-4a2a-8b0d-ed588c7e4635" status: 200 len: 288 microversion: 2.1 time: 0.054650 Jun 05 08:39:35.933326 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1536/3007] 10.222.0.33 () {58 vars in 1250 bytes} [Sun Jun 5 08:39:35 2022] GET /compute/v2.1/os-snapshots/645bd118-7365-4a2a-8b0d-ed588c7e4635 => generated 288 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:35.940521 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2ab3335c-4efb-454d-8ee3-710de4f2d662 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:35.941956 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2ab3335c-4efb-454d-8ee3-710de4f2d662 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: e0d5a329-83a0-48e3-a5b6-6e4718686605] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:36.079409 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2ab3335c-4efb-454d-8ee3-710de4f2d662 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a3e3ac4a994d55a3c87e51b3be024c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a74e63775d49dbafd25b2c7257f817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:39:36.110452 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2ab3335c-4efb-454d-8ee3-710de4f2d662 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "GET /compute/v2.1/servers/e0d5a329-83a0-48e3-a5b6-6e4718686605" status: 200 len: 1228 microversion: 2.1 time: 0.175693 Jun 05 08:39:36.113747 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1537/3008] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:35 2022] GET /compute/v2.1/servers/e0d5a329-83a0-48e3-a5b6-6e4718686605 => generated 1228 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:39:36.129380 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5f097fb1-e301-4131-af19-b35d2b3ac974 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Calling method '.version_select at 0x7f24339969d0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:36.331813 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5f097fb1-e301-4131-af19-b35d2b3ac974 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/645bd118-7365-4a2a-8b0d-ed588c7e4635" status: 202 len: 0 microversion: 2.1 time: 0.216543 Jun 05 08:39:36.332498 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1538/3009] 10.222.0.33 () {58 vars in 1253 bytes} [Sun Jun 5 08:39:36 2022] DELETE /compute/v2.1/os-snapshots/645bd118-7365-4a2a-8b0d-ed588c7e4635 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:39:36.343782 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ce34763e-6a38-4ba0-af90-4dfdae76b957 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Calling method '.version_select at 0x7f24337e3b80>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:36.425312 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ce34763e-6a38-4ba0-af90-4dfdae76b957 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/645bd118-7365-4a2a-8b0d-ed588c7e4635" status: 200 len: 287 microversion: 2.1 time: 0.087411 Jun 05 08:39:36.429928 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1539/3010] 10.222.0.33 () {58 vars in 1250 bytes} [Sun Jun 5 08:39:36 2022] GET /compute/v2.1/os-snapshots/645bd118-7365-4a2a-8b0d-ed588c7e4635 => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:37.041995 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-644a3384-ac5e-4e45-9e99-bccbd9842865 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:39:37.043275 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-644a3384-ac5e-4e45-9e99-bccbd9842865 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:39:37.044007 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-644a3384-ac5e-4e45-9e99-bccbd9842865 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:39:37.044596 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-644a3384-ac5e-4e45-9e99-bccbd9842865 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:39:37.045587 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-644a3384-ac5e-4e45-9e99-bccbd9842865 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:39:37.072103 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-644a3384-ac5e-4e45-9e99-bccbd9842865 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:37.072842 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-644a3384-ac5e-4e45-9e99-bccbd9842865 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:37.074820 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-644a3384-ac5e-4e45-9e99-bccbd9842865 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:37.075791 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-644a3384-ac5e-4e45-9e99-bccbd9842865 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:37.108230 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-644a3384-ac5e-4e45-9e99-bccbd9842865 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Getting quotas for project d4487d6dbf0d41929133bb6cd08bafca. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:39:37.117490 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-644a3384-ac5e-4e45-9e99-bccbd9842865 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Getting quotas for user 876108eee7cd434fa3351bf2546d3152 and project d4487d6dbf0d41929133bb6cd08bafca. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:39:37.129170 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-67662f64-7f8a-4d39-9ba3-af556e4f61ad tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:37.131066 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-67662f64-7f8a-4d39-9ba3-af556e4f61ad tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: e0d5a329-83a0-48e3-a5b6-6e4718686605] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:37.139717 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-644a3384-ac5e-4e45-9e99-bccbd9842865 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:39:37.143219 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-644a3384-ac5e-4e45-9e99-bccbd9842865 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] [instance: c6a5526d-58bf-492a-a006-1407afd6b7d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:39:37.146547 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-67662f64-7f8a-4d39-9ba3-af556e4f61ad tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:37.148285 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-67662f64-7f8a-4d39-9ba3-af556e4f61ad tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:37.151719 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-67662f64-7f8a-4d39-9ba3-af556e4f61ad tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:37.155641 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-67662f64-7f8a-4d39-9ba3-af556e4f61ad tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:37.244297 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-644a3384-ac5e-4e45-9e99-bccbd9842865 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Getting quotas for project d4487d6dbf0d41929133bb6cd08bafca. Resources: {'server_group_members'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:39:37.255649 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-644a3384-ac5e-4e45-9e99-bccbd9842865 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Getting quotas for user 876108eee7cd434fa3351bf2546d3152 and project d4487d6dbf0d41929133bb6cd08bafca. Resources: {'server_group_members'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:39:37.261397 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-67662f64-7f8a-4d39-9ba3-af556e4f61ad tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:37.263398 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-67662f64-7f8a-4d39-9ba3-af556e4f61ad tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:37.263919 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-67662f64-7f8a-4d39-9ba3-af556e4f61ad tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lazy-loading 'fault' on Instance uuid e0d5a329-83a0-48e3-a5b6-6e4718686605 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:39:37.324827 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-644a3384-ac5e-4e45-9e99-bccbd9842865 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Getting quotas for project d4487d6dbf0d41929133bb6cd08bafca. Resources: {'server_group_members'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:39:37.337121 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-644a3384-ac5e-4e45-9e99-bccbd9842865 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Getting quotas for user 876108eee7cd434fa3351bf2546d3152 and project d4487d6dbf0d41929133bb6cd08bafca. Resources: {'server_group_members'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:39:37.382968 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-644a3384-ac5e-4e45-9e99-bccbd9842865 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.604520 Jun 05 08:39:37.390854 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1472/3011] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:39:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:39:37.398355 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-df3c0db6-ffae-4e20-8cca-9d3af73b809c tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:37.399579 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-df3c0db6-ffae-4e20-8cca-9d3af73b809c tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] [instance: c6a5526d-58bf-492a-a006-1407afd6b7d5] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:37.401995 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-67662f64-7f8a-4d39-9ba3-af556e4f61ad tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a3e3ac4a994d55a3c87e51b3be024c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a74e63775d49dbafd25b2c7257f817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:39:37.416830 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-67662f64-7f8a-4d39-9ba3-af556e4f61ad tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "GET /compute/v2.1/servers/e0d5a329-83a0-48e3-a5b6-6e4718686605" status: 200 len: 1301 microversion: 2.1 time: 0.292461 Jun 05 08:39:37.419158 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:39:37.425391 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1540/3012] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:37 2022] GET /compute/v2.1/servers/e0d5a329-83a0-48e3-a5b6-6e4718686605 => generated 1301 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:39:37.455313 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7482bde7-d1d5-45b2-ad92-8a69a982b528 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Calling method '.version_select at 0x7f2433a22310>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:37.555555 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7482bde7-d1d5-45b2-ad92-8a69a982b528 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/645bd118-7365-4a2a-8b0d-ed588c7e4635" status: 200 len: 287 microversion: 2.1 time: 0.117066 Jun 05 08:39:37.558908 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1541/3013] 10.222.0.33 () {58 vars in 1250 bytes} [Sun Jun 5 08:39:37 2022] GET /compute/v2.1/os-snapshots/645bd118-7365-4a2a-8b0d-ed588c7e4635 => generated 287 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:37.588220 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2cfd24a0-a021-4c7e-8b60-be664f77b831 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:37.588220 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2cfd24a0-a021-4c7e-8b60-be664f77b831 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: e0d5a329-83a0-48e3-a5b6-6e4718686605] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:37.598253 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2cfd24a0-a021-4c7e-8b60-be664f77b831 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:37.598706 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2cfd24a0-a021-4c7e-8b60-be664f77b831 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:37.613211 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2cfd24a0-a021-4c7e-8b60-be664f77b831 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:37.613941 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2cfd24a0-a021-4c7e-8b60-be664f77b831 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:37.681908 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-df3c0db6-ffae-4e20-8cca-9d3af73b809c tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876108eee7cd434fa3351bf2546d3152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4487d6dbf0d41929133bb6cd08bafca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:39:37.696859 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-df3c0db6-ffae-4e20-8cca-9d3af73b809c tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] 10.222.0.33 "GET /compute/v2.1/servers/c6a5526d-58bf-492a-a006-1407afd6b7d5" status: 200 len: 1213 microversion: 2.1 time: 0.304484 Jun 05 08:39:37.710474 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2cfd24a0-a021-4c7e-8b60-be664f77b831 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: e0d5a329-83a0-48e3-a5b6-6e4718686605] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:39:37.722668 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1473/3014] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:37 2022] GET /compute/v2.1/servers/c6a5526d-58bf-492a-a006-1407afd6b7d5 => generated 1213 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:39:37.868972 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2cfd24a0-a021-4c7e-8b60-be664f77b831 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: e0d5a329-83a0-48e3-a5b6-6e4718686605] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:39:37.869935 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2cfd24a0-a021-4c7e-8b60-be664f77b831 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:37.876760 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2cfd24a0-a021-4c7e-8b60-be664f77b831 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:37.877447 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-2cfd24a0-a021-4c7e-8b60-be664f77b831 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: e0d5a329-83a0-48e3-a5b6-6e4718686605] instance's host None is down, deleting from database Jun 05 08:39:37.898301 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-2cfd24a0-a021-4c7e-8b60-be664f77b831 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: e0d5a329-83a0-48e3-a5b6-6e4718686605] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:39:38.013786 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-2cfd24a0-a021-4c7e-8b60-be664f77b831 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: e0d5a329-83a0-48e3-a5b6-6e4718686605] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:39:38.025808 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-2cfd24a0-a021-4c7e-8b60-be664f77b831 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: e0d5a329-83a0-48e3-a5b6-6e4718686605] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:39:38.159979 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=76,nova_cell0:UPDATE=18,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:39:38.459328 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2cfd24a0-a021-4c7e-8b60-be664f77b831 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e0d5a329-83a0-48e3-a5b6-6e4718686605" status: 204 len: 0 microversion: 2.1 time: 0.897700 Jun 05 08:39:38.469977 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1542/3015] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:39:37 2022] DELETE /compute/v2.1/servers/e0d5a329-83a0-48e3-a5b6-6e4718686605 => generated 0 bytes in 904 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:39:38.474007 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9c764cce-8c7c-49ec-8918-b228173baccc tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:38.475183 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9c764cce-8c7c-49ec-8918-b228173baccc tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: e0d5a329-83a0-48e3-a5b6-6e4718686605] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:38.487959 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9c764cce-8c7c-49ec-8918-b228173baccc tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:38.489675 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9c764cce-8c7c-49ec-8918-b228173baccc tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:38.490535 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9c764cce-8c7c-49ec-8918-b228173baccc tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:38.493556 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9c764cce-8c7c-49ec-8918-b228173baccc tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:38.527013 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-9c764cce-8c7c-49ec-8918-b228173baccc tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] HTTP exception thrown: Instance e0d5a329-83a0-48e3-a5b6-6e4718686605 could not be found. Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9c764cce-8c7c-49ec-8918-b228173baccc tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Request method failure captured: Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/e0d5a329-83a0-48e3-a5b6-6e4718686605 HTTP/1.1 Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGu1vFCwWen85d3HsPe2yp3Ue0qTRVzpHRvnDC2K9Zq7dXy-upJpVvCiFKsXFfl02PIgLY8X82xPfb_LVHLyaFDpNYpAMesTIyWh9bIwUEf7Ktz2z92xAdpstdBaCJfFxBdlDjs-RRoYJtmtUKpjlscLHodDrvmqbYQWg0V1EvcLdS8 Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: e0a74e63775d49dbafd25b2c7257f817 Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ServersTestJSON-1445963553 Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e0a74e63775d49dbafd25b2c7257f817"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0a74e63775d49dbafd25b2c7257f817"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e0a74e63775d49dbafd25b2c7257f817", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0a74e63775d49dbafd25b2c7257f817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ServersTestJSON-1445963553 Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: e0a74e63775d49dbafd25b2c7257f817 Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ServersTestJSON-1445963553 Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ServersTestJSON-1445963553-project Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 65a3e3ac4a994d55a3c87e51b3be024c Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ServersTestJSON-1445963553-project Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance e0d5a329-83a0-48e3-a5b6-6e4718686605 could not be found. Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'e0d5a329-83a0-48e3-a5b6-6e4718686605'} Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0d5a329-83a0-48e3-a5b6-6e4718686605 could not be found. Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0d5a329-83a0-48e3-a5b6-6e4718686605 could not be found. Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:38.528330 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:38.533865 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:38.533865 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:38.533865 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:39:38.533865 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:39:38.533865 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0d5a329-83a0-48e3-a5b6-6e4718686605 could not be found. Jun 05 08:39:38.533865 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:38.533865 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9c764cce-8c7c-49ec-8918-b228173baccc tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Returning 404 to user: Instance e0d5a329-83a0-48e3-a5b6-6e4718686605 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:39:38.535137 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9c764cce-8c7c-49ec-8918-b228173baccc tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "GET /compute/v2.1/servers/e0d5a329-83a0-48e3-a5b6-6e4718686605" status: 404 len: 111 microversion: 2.1 time: 0.061106 Jun 05 08:39:38.537585 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1474/3016] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:38 2022] GET /compute/v2.1/servers/e0d5a329-83a0-48e3-a5b6-6e4718686605 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:39:38.545713 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-22a96efc-3f68-41ef-a1aa-a8beff0c70a1 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '.version_select at 0x7f2433817e50>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:38.573794 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4464d544-5c7d-4624-a4a5-82050fb63a25 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Calling method '.version_select at 0x7f2432de2160>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:38.588203 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-22a96efc-3f68-41ef-a1aa-a8beff0c70a1 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-key-2079898197" status: 202 len: 0 microversion: 2.1 time: 0.042691 Jun 05 08:39:38.605272 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1543/3017] 10.222.0.33 () {58 vars in 1208 bytes} [Sun Jun 5 08:39:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-2079898197 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 05 08:39:38.655743 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4464d544-5c7d-4624-a4a5-82050fb63a25 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/645bd118-7365-4a2a-8b0d-ed588c7e4635" status: 200 len: 287 microversion: 2.1 time: 0.087697 Jun 05 08:39:38.656373 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1475/3018] 10.222.0.33 () {58 vars in 1250 bytes} [Sun Jun 5 08:39:38 2022] GET /compute/v2.1/os-snapshots/645bd118-7365-4a2a-8b0d-ed588c7e4635 => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:38.715413 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7705b92f-7f5e-4dd6-adfb-482e6a34c89e tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:38.716095 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7705b92f-7f5e-4dd6-adfb-482e6a34c89e tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] [instance: c6a5526d-58bf-492a-a006-1407afd6b7d5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:38.727810 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7705b92f-7f5e-4dd6-adfb-482e6a34c89e tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:38.730534 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7705b92f-7f5e-4dd6-adfb-482e6a34c89e tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:38.733055 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7705b92f-7f5e-4dd6-adfb-482e6a34c89e tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:38.733596 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7705b92f-7f5e-4dd6-adfb-482e6a34c89e tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:38.778686 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7705b92f-7f5e-4dd6-adfb-482e6a34c89e tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:38.779076 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7705b92f-7f5e-4dd6-adfb-482e6a34c89e tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:38.779543 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-7705b92f-7f5e-4dd6-adfb-482e6a34c89e tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Lazy-loading 'fault' on Instance uuid c6a5526d-58bf-492a-a006-1407afd6b7d5 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:39:38.856407 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2bb23ca5-6aed-4da9-8211-d4df92778f30 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1336350534", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "9cadba9d-5f73-40e2-9cd2-86024f7f62a4"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:39:38.861809 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7705b92f-7f5e-4dd6-adfb-482e6a34c89e tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '876108eee7cd434fa3351bf2546d3152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4487d6dbf0d41929133bb6cd08bafca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:39:38.880461 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7705b92f-7f5e-4dd6-adfb-482e6a34c89e tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] 10.222.0.33 "GET /compute/v2.1/servers/c6a5526d-58bf-492a-a006-1407afd6b7d5" status: 200 len: 1286 microversion: 2.1 time: 0.168306 Jun 05 08:39:38.885096 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1544/3019] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:38 2022] GET /compute/v2.1/servers/c6a5526d-58bf-492a-a006-1407afd6b7d5 => generated 1286 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:39:38.905217 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-42a49ce6-188a-4a43-a221-e1e43b8ba536 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:38.908735 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-42a49ce6-188a-4a43-a221-e1e43b8ba536 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] [instance: c6a5526d-58bf-492a-a006-1407afd6b7d5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:38.931333 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-42a49ce6-188a-4a43-a221-e1e43b8ba536 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:38.933683 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-42a49ce6-188a-4a43-a221-e1e43b8ba536 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:38.936984 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-42a49ce6-188a-4a43-a221-e1e43b8ba536 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:38.937782 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-42a49ce6-188a-4a43-a221-e1e43b8ba536 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:38.975964 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-2bb23ca5-6aed-4da9-8211-d4df92778f30 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] validate_networks() for [('9cadba9d-5f73-40e2-9cd2-86024f7f62a4', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:39:39.029702 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-42a49ce6-188a-4a43-a221-e1e43b8ba536 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] [instance: c6a5526d-58bf-492a-a006-1407afd6b7d5] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:39:39.123949 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-42a49ce6-188a-4a43-a221-e1e43b8ba536 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] [instance: c6a5526d-58bf-492a-a006-1407afd6b7d5] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:39:39.126381 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-42a49ce6-188a-4a43-a221-e1e43b8ba536 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:39.128114 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-42a49ce6-188a-4a43-a221-e1e43b8ba536 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:39.128822 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-42a49ce6-188a-4a43-a221-e1e43b8ba536 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] [instance: c6a5526d-58bf-492a-a006-1407afd6b7d5] instance's host None is down, deleting from database Jun 05 08:39:39.135984 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-42a49ce6-188a-4a43-a221-e1e43b8ba536 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] [instance: c6a5526d-58bf-492a-a006-1407afd6b7d5] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:39:39.642276 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-42a49ce6-188a-4a43-a221-e1e43b8ba536 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] [instance: c6a5526d-58bf-492a-a006-1407afd6b7d5] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:39:39.650939 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-42a49ce6-188a-4a43-a221-e1e43b8ba536 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] [instance: c6a5526d-58bf-492a-a006-1407afd6b7d5] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:39:39.971020 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-42a49ce6-188a-4a43-a221-e1e43b8ba536 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c6a5526d-58bf-492a-a006-1407afd6b7d5" status: 204 len: 0 microversion: 2.1 time: 1.072067 Jun 05 08:39:39.971625 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1545/3020] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:39:38 2022] DELETE /compute/v2.1/servers/c6a5526d-58bf-492a-a006-1407afd6b7d5 => generated 0 bytes in 1076 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 05 08:39:39.983471 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5a198b9f-f726-4392-b8dc-339d47a94d86 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Calling method '.version_select at 0x7f2433996c10>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:40.050566 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5a198b9f-f726-4392-b8dc-339d47a94d86 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/645bd118-7365-4a2a-8b0d-ed588c7e4635" status: 200 len: 287 microversion: 2.1 time: 0.077758 Jun 05 08:39:40.051463 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1546/3021] 10.222.0.33 () {58 vars in 1250 bytes} [Sun Jun 5 08:39:39 2022] GET /compute/v2.1/os-snapshots/645bd118-7365-4a2a-8b0d-ed588c7e4635 => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:40.058687 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0c5105fe-132b-43c2-883d-83a1bdb22676 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:40.059325 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0c5105fe-132b-43c2-883d-83a1bdb22676 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] [instance: c6a5526d-58bf-492a-a006-1407afd6b7d5] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:40.079005 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0c5105fe-132b-43c2-883d-83a1bdb22676 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:40.079352 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0c5105fe-132b-43c2-883d-83a1bdb22676 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:40.086439 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0c5105fe-132b-43c2-883d-83a1bdb22676 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:40.086985 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0c5105fe-132b-43c2-883d-83a1bdb22676 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:40.158749 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-0c5105fe-132b-43c2-883d-83a1bdb22676 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] HTTP exception thrown: Instance c6a5526d-58bf-492a-a006-1407afd6b7d5 could not be found. Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0c5105fe-132b-43c2-883d-83a1bdb22676 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Request method failure captured: Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/c6a5526d-58bf-492a-a006-1407afd6b7d5 HTTP/1.1 Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGvDYok3nRAuF58ENLcL1s3a7bozJ3VN3pAV_Fq1u36qmp3p9b3Z6CngqgaYXgFJHLn6eev2R0LgBSGZA26GiuINwGGebbWexKsKh20oszwwUJJMfNMMegFe_MJSzuDIs-3Fv8BIG6viphXqDbr1Pq5YnpLflFRTj8-bkYY6xZwA2T8 Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: d4487d6dbf0d41929133bb6cd08bafca Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ServerGroupTestJSON-2077707328 Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d4487d6dbf0d41929133bb6cd08bafca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d4487d6dbf0d41929133bb6cd08bafca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d4487d6dbf0d41929133bb6cd08bafca", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d4487d6dbf0d41929133bb6cd08bafca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ServerGroupTestJSON-2077707328 Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: d4487d6dbf0d41929133bb6cd08bafca Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ServerGroupTestJSON-2077707328 Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ServerGroupTestJSON-2077707328-project Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 876108eee7cd434fa3351bf2546d3152 Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ServerGroupTestJSON-2077707328-project Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance c6a5526d-58bf-492a-a006-1407afd6b7d5 could not be found. Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'c6a5526d-58bf-492a-a006-1407afd6b7d5'} Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6a5526d-58bf-492a-a006-1407afd6b7d5 could not be found. Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6a5526d-58bf-492a-a006-1407afd6b7d5 could not be found. Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:40.160586 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:40.169345 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:40.169345 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:40.169345 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:40.169345 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:39:40.169345 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:39:40.169345 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6a5526d-58bf-492a-a006-1407afd6b7d5 could not be found. Jun 05 08:39:40.169345 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:40.169345 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0c5105fe-132b-43c2-883d-83a1bdb22676 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Returning 404 to user: Instance c6a5526d-58bf-492a-a006-1407afd6b7d5 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:39:40.169345 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0c5105fe-132b-43c2-883d-83a1bdb22676 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] 10.222.0.33 "GET /compute/v2.1/servers/c6a5526d-58bf-492a-a006-1407afd6b7d5" status: 404 len: 111 microversion: 2.1 time: 0.109637 Jun 05 08:39:40.169345 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1547/3022] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:40 2022] GET /compute/v2.1/servers/c6a5526d-58bf-492a-a006-1407afd6b7d5 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:39:40.186753 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a2dac580-2083-43ea-8432-a293732aa146 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:40.242789 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.compute.server_groups [None req-a2dac580-2083-43ea-8432-a293732aa146 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Querying cell 00000000-0000-0000-0000-000000000000(cell0) for 1 instances {{(pid=119050) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 05 08:39:40.243622 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a2dac580-2083-43ea-8432-a293732aa146 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:40.244116 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a2dac580-2083-43ea-8432-a293732aa146 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:40.298761 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a2dac580-2083-43ea-8432-a293732aa146 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.115794 Jun 05 08:39:40.306032 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1548/3023] 10.222.0.33 () {58 vars in 1151 bytes} [Sun Jun 5 08:39:40 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:40.313762 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d521bdc0-921d-4014-88db-4a21a29949de tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:40.337588 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.compute.server_groups [None req-d521bdc0-921d-4014-88db-4a21a29949de tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Querying cell 00000000-0000-0000-0000-000000000000(cell0) for 1 instances {{(pid=119050) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 05 08:39:40.338902 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d521bdc0-921d-4014-88db-4a21a29949de tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:40.339428 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d521bdc0-921d-4014-88db-4a21a29949de tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:40.361620 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d521bdc0-921d-4014-88db-4a21a29949de tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/5c48a781-e82f-4427-9d0c-075348c89ea2" status: 200 len: 184 microversion: 2.1 time: 0.053839 Jun 05 08:39:40.370727 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1549/3024] 10.222.0.33 () {58 vars in 1262 bytes} [Sun Jun 5 08:39:40 2022] GET /compute/v2.1/os-server-groups/5c48a781-e82f-4427-9d0c-075348c89ea2 => generated 184 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:40.376117 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-53b4a421-9120-4324-9cd8-ac9627e1258e tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:40.386649 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-53b4a421-9120-4324-9cd8-ac9627e1258e tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] HTTP exception thrown: Instance group ee7fe1e7-d88c-4f2a-a1e6-1f4cd722987e could not be found. Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-53b4a421-9120-4324-9cd8-ac9627e1258e tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Request method failure captured: Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: request: DELETE /compute/v2.1/os-server-groups/ee7fe1e7-d88c-4f2a-a1e6-1f4cd722987e HTTP/1.1 Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGvDYok3nRAuF58ENLcL1s3a7bozJ3VN3pAV_Fq1u36qmp3p9b3Z6CngqgaYXgFJHLn6eev2R0LgBSGZA26GiuINwGGebbWexKsKh20oszwwUJJMfNMMegFe_MJSzuDIs-3Fv8BIG6viphXqDbr1Pq5YnpLflFRTj8-bkYY6xZwA2T8 Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: d4487d6dbf0d41929133bb6cd08bafca Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ServerGroupTestJSON-2077707328 Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d4487d6dbf0d41929133bb6cd08bafca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d4487d6dbf0d41929133bb6cd08bafca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d4487d6dbf0d41929133bb6cd08bafca", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d4487d6dbf0d41929133bb6cd08bafca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ServerGroupTestJSON-2077707328 Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: d4487d6dbf0d41929133bb6cd08bafca Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ServerGroupTestJSON-2077707328 Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ServerGroupTestJSON-2077707328-project Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 876108eee7cd434fa3351bf2546d3152 Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ServerGroupTestJSON-2077707328-project Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance group ee7fe1e7-d88c-4f2a-a1e6-1f4cd722987e could not be found. Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'ee7fe1e7-d88c-4f2a-a1e6-1f4cd722987e'} Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ee7fe1e7-d88c-4f2a-a1e6-1f4cd722987e could not be found. Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ee7fe1e7-d88c-4f2a-a1e6-1f4cd722987e could not be found. Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:40.391469 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:40.398248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:40.398248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:40.398248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:39:40.398248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:39:40.398248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ee7fe1e7-d88c-4f2a-a1e6-1f4cd722987e could not be found. Jun 05 08:39:40.398248 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:40.398248 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-53b4a421-9120-4324-9cd8-ac9627e1258e tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Returning 404 to user: Instance group ee7fe1e7-d88c-4f2a-a1e6-1f4cd722987e could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:39:40.398248 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-53b4a421-9120-4324-9cd8-ac9627e1258e tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/ee7fe1e7-d88c-4f2a-a1e6-1f4cd722987e" status: 404 len: 117 microversion: 2.1 time: 0.022069 Jun 05 08:39:40.399204 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1550/3025] 10.222.0.33 () {58 vars in 1265 bytes} [Sun Jun 5 08:39:40 2022] DELETE /compute/v2.1/os-server-groups/ee7fe1e7-d88c-4f2a-a1e6-1f4cd722987e => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:39:40.407681 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9680630c-e387-4c3c-9f1b-5029268b8394 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:40.435746 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-9680630c-e387-4c3c-9f1b-5029268b8394 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] HTTP exception thrown: Instance group 7dc3f2a5-f1c2-4474-9875-bb38d1589085 could not be found. Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9680630c-e387-4c3c-9f1b-5029268b8394 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Request method failure captured: Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: request: DELETE /compute/v2.1/os-server-groups/7dc3f2a5-f1c2-4474-9875-bb38d1589085 HTTP/1.1 Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGvDYok3nRAuF58ENLcL1s3a7bozJ3VN3pAV_Fq1u36qmp3p9b3Z6CngqgaYXgFJHLn6eev2R0LgBSGZA26GiuINwGGebbWexKsKh20oszwwUJJMfNMMegFe_MJSzuDIs-3Fv8BIG6viphXqDbr1Pq5YnpLflFRTj8-bkYY6xZwA2T8 Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: d4487d6dbf0d41929133bb6cd08bafca Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ServerGroupTestJSON-2077707328 Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d4487d6dbf0d41929133bb6cd08bafca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d4487d6dbf0d41929133bb6cd08bafca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d4487d6dbf0d41929133bb6cd08bafca", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d4487d6dbf0d41929133bb6cd08bafca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ServerGroupTestJSON-2077707328 Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: d4487d6dbf0d41929133bb6cd08bafca Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ServerGroupTestJSON-2077707328 Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ServerGroupTestJSON-2077707328-project Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 876108eee7cd434fa3351bf2546d3152 Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ServerGroupTestJSON-2077707328-project Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance group 7dc3f2a5-f1c2-4474-9875-bb38d1589085 could not be found. Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '7dc3f2a5-f1c2-4474-9875-bb38d1589085'} Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 7dc3f2a5-f1c2-4474-9875-bb38d1589085 could not be found. Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 7dc3f2a5-f1c2-4474-9875-bb38d1589085 could not be found. Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:40.452570 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:40.458022 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:40.458022 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:40.458022 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:39:40.458022 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:39:40.458022 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 7dc3f2a5-f1c2-4474-9875-bb38d1589085 could not be found. Jun 05 08:39:40.458022 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:40.458022 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9680630c-e387-4c3c-9f1b-5029268b8394 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Returning 404 to user: Instance group 7dc3f2a5-f1c2-4474-9875-bb38d1589085 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:39:40.458591 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9680630c-e387-4c3c-9f1b-5029268b8394 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/7dc3f2a5-f1c2-4474-9875-bb38d1589085" status: 404 len: 117 microversion: 2.1 time: 0.057787 Jun 05 08:39:40.459382 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1551/3026] 10.222.0.33 () {58 vars in 1265 bytes} [Sun Jun 5 08:39:40 2022] DELETE /compute/v2.1/os-server-groups/7dc3f2a5-f1c2-4474-9875-bb38d1589085 => generated 117 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:39:40.474900 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ec03c9da-e29d-462f-a1f4-a9f9c57b8db5 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:40.509644 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-ec03c9da-e29d-462f-a1f4-a9f9c57b8db5 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] HTTP exception thrown: Instance group ddef2150-8545-414a-a62e-deb1aaa6b832 could not be found. Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ec03c9da-e29d-462f-a1f4-a9f9c57b8db5 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Request method failure captured: Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: request: DELETE /compute/v2.1/os-server-groups/ddef2150-8545-414a-a62e-deb1aaa6b832 HTTP/1.1 Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGvDYok3nRAuF58ENLcL1s3a7bozJ3VN3pAV_Fq1u36qmp3p9b3Z6CngqgaYXgFJHLn6eev2R0LgBSGZA26GiuINwGGebbWexKsKh20oszwwUJJMfNMMegFe_MJSzuDIs-3Fv8BIG6viphXqDbr1Pq5YnpLflFRTj8-bkYY6xZwA2T8 Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: d4487d6dbf0d41929133bb6cd08bafca Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ServerGroupTestJSON-2077707328 Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d4487d6dbf0d41929133bb6cd08bafca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d4487d6dbf0d41929133bb6cd08bafca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d4487d6dbf0d41929133bb6cd08bafca", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d4487d6dbf0d41929133bb6cd08bafca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ServerGroupTestJSON-2077707328 Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: d4487d6dbf0d41929133bb6cd08bafca Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ServerGroupTestJSON-2077707328 Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ServerGroupTestJSON-2077707328-project Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 876108eee7cd434fa3351bf2546d3152 Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ServerGroupTestJSON-2077707328-project Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance group ddef2150-8545-414a-a62e-deb1aaa6b832 could not be found. Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'ddef2150-8545-414a-a62e-deb1aaa6b832'} Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ddef2150-8545-414a-a62e-deb1aaa6b832 could not be found. Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ddef2150-8545-414a-a62e-deb1aaa6b832 could not be found. Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:40.522015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:40.527172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:40.527172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:40.527172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:39:40.527172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:39:40.527172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ddef2150-8545-414a-a62e-deb1aaa6b832 could not be found. Jun 05 08:39:40.527172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:40.529209 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ec03c9da-e29d-462f-a1f4-a9f9c57b8db5 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Returning 404 to user: Instance group ddef2150-8545-414a-a62e-deb1aaa6b832 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:39:40.534980 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ec03c9da-e29d-462f-a1f4-a9f9c57b8db5 tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/ddef2150-8545-414a-a62e-deb1aaa6b832" status: 404 len: 117 microversion: 2.1 time: 0.061513 Jun 05 08:39:40.534980 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1552/3027] 10.222.0.33 () {58 vars in 1265 bytes} [Sun Jun 5 08:39:40 2022] DELETE /compute/v2.1/os-server-groups/ddef2150-8545-414a-a62e-deb1aaa6b832 => generated 117 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:39:40.545079 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-139e7977-2f92-4fce-9115-8c6a5fd5a0ad tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:40.557384 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-139e7977-2f92-4fce-9115-8c6a5fd5a0ad tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] HTTP exception thrown: Instance group 027e02f0-2373-4539-8c12-244ada357f9e could not be found. Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-139e7977-2f92-4fce-9115-8c6a5fd5a0ad tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Request method failure captured: Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: request: DELETE /compute/v2.1/os-server-groups/027e02f0-2373-4539-8c12-244ada357f9e HTTP/1.1 Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGvDYok3nRAuF58ENLcL1s3a7bozJ3VN3pAV_Fq1u36qmp3p9b3Z6CngqgaYXgFJHLn6eev2R0LgBSGZA26GiuINwGGebbWexKsKh20oszwwUJJMfNMMegFe_MJSzuDIs-3Fv8BIG6viphXqDbr1Pq5YnpLflFRTj8-bkYY6xZwA2T8 Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: d4487d6dbf0d41929133bb6cd08bafca Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ServerGroupTestJSON-2077707328 Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d4487d6dbf0d41929133bb6cd08bafca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d4487d6dbf0d41929133bb6cd08bafca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d4487d6dbf0d41929133bb6cd08bafca", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d4487d6dbf0d41929133bb6cd08bafca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ServerGroupTestJSON-2077707328 Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: d4487d6dbf0d41929133bb6cd08bafca Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ServerGroupTestJSON-2077707328 Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ServerGroupTestJSON-2077707328-project Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 876108eee7cd434fa3351bf2546d3152 Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ServerGroupTestJSON-2077707328-project Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance group 027e02f0-2373-4539-8c12-244ada357f9e could not be found. Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '027e02f0-2373-4539-8c12-244ada357f9e'} Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 027e02f0-2373-4539-8c12-244ada357f9e could not be found. Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 027e02f0-2373-4539-8c12-244ada357f9e could not be found. Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:40.558946 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:40.563243 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:40.563243 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:40.563243 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:39:40.563243 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:39:40.563243 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 027e02f0-2373-4539-8c12-244ada357f9e could not be found. Jun 05 08:39:40.563243 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:40.565015 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-139e7977-2f92-4fce-9115-8c6a5fd5a0ad tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Returning 404 to user: Instance group 027e02f0-2373-4539-8c12-244ada357f9e could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:39:40.565943 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-139e7977-2f92-4fce-9115-8c6a5fd5a0ad tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/027e02f0-2373-4539-8c12-244ada357f9e" status: 404 len: 117 microversion: 2.1 time: 0.024757 Jun 05 08:39:40.571919 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1553/3028] 10.222.0.33 () {58 vars in 1265 bytes} [Sun Jun 5 08:39:40 2022] DELETE /compute/v2.1/os-server-groups/027e02f0-2373-4539-8c12-244ada357f9e => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:39:40.585106 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f23051ce-25b0-4df6-bfd8-38d07ca512dc tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:40.642821 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f23051ce-25b0-4df6-bfd8-38d07ca512dc tempest-ServerGroupTestJSON-2077707328 tempest-ServerGroupTestJSON-2077707328-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/5c48a781-e82f-4427-9d0c-075348c89ea2" status: 204 len: 0 microversion: 2.1 time: 0.061933 Jun 05 08:39:40.644604 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1554/3029] 10.222.0.33 () {58 vars in 1265 bytes} [Sun Jun 5 08:39:40 2022] DELETE /compute/v2.1/os-server-groups/5c48a781-e82f-4427-9d0c-075348c89ea2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:39:41.070458 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ab4a2f93-a049-4aa1-b27e-e12714d5b2cf tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Calling method '.version_select at 0x7f243375c5e0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:41.141152 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ab4a2f93-a049-4aa1-b27e-e12714d5b2cf tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/645bd118-7365-4a2a-8b0d-ed588c7e4635" status: 200 len: 287 microversion: 2.1 time: 0.080402 Jun 05 08:39:41.142829 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1555/3030] 10.222.0.33 () {58 vars in 1250 bytes} [Sun Jun 5 08:39:41 2022] GET /compute/v2.1/os-snapshots/645bd118-7365-4a2a-8b0d-ed588c7e4635 => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:41.991375 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-2bb23ca5-6aed-4da9-8211-d4df92778f30 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:39:41.992109 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-2bb23ca5-6aed-4da9-8211-d4df92778f30 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:39:41.992109 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-2bb23ca5-6aed-4da9-8211-d4df92778f30 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:39:41.992493 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-2bb23ca5-6aed-4da9-8211-d4df92778f30 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:39:41.995521 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-2bb23ca5-6aed-4da9-8211-d4df92778f30 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:39:42.011321 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2bb23ca5-6aed-4da9-8211-d4df92778f30 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:42.011910 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2bb23ca5-6aed-4da9-8211-d4df92778f30 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:42.012760 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2bb23ca5-6aed-4da9-8211-d4df92778f30 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:42.013205 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2bb23ca5-6aed-4da9-8211-d4df92778f30 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:42.074170 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-2bb23ca5-6aed-4da9-8211-d4df92778f30 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Getting quotas for project e0a74e63775d49dbafd25b2c7257f817. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:39:42.087155 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-2bb23ca5-6aed-4da9-8211-d4df92778f30 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Getting quotas for user 65a3e3ac4a994d55a3c87e51b3be024c and project e0a74e63775d49dbafd25b2c7257f817. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:39:42.109134 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2bb23ca5-6aed-4da9-8211-d4df92778f30 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:39:42.114669 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2bb23ca5-6aed-4da9-8211-d4df92778f30 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 95ce97cb-122f-4fb7-b80c-729c67c1be47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:39:42.159926 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-baf3e95a-3e3d-48af-991c-bc0dc5d0878e tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Calling method '.version_select at 0x7f243386c280>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:42.223270 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2bb23ca5-6aed-4da9-8211-d4df92778f30 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.372125 Jun 05 08:39:42.223942 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1476/3031] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:39:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 3374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:39:42.239331 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-baf3e95a-3e3d-48af-991c-bc0dc5d0878e tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] HTTP exception thrown: Snapshot 645bd118-7365-4a2a-8b0d-ed588c7e4635 could not be found. Jun 05 08:39:42.245600 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-63e0943e-ec14-4c00-95b4-56c3bf5061c6 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:42.246914 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-63e0943e-ec14-4c00-95b4-56c3bf5061c6 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 95ce97cb-122f-4fb7-b80c-729c67c1be47] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-baf3e95a-3e3d-48af-991c-bc0dc5d0878e tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Request method failure captured: Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-snapshots/645bd118-7365-4a2a-8b0d-ed588c7e4635 HTTP/1.1 Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGu8MLnJpHQOgNgvz2ha6KhZnondRd2Clrv9VjEl0pd7_JlTkyLTn1xeQbfx_z-87McDh-R5i5eemDwXWRtI9JxHrXNl6S1b3nJ1FD62m58FAqX3jogY56K39zxWXfZ6IU-T3dTKky1LHtnm4NxJd91gw84jm4zGy_k1DomfXOOakQ0 Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 62c05fb4eb01476c93871ecf5f1e55bd Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1343262135 Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/62c05fb4eb01476c93871ecf5f1e55bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62c05fb4eb01476c93871ecf5f1e55bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_62c05fb4eb01476c93871ecf5f1e55bd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62c05fb4eb01476c93871ecf5f1e55bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1343262135 Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 62c05fb4eb01476c93871ecf5f1e55bd Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1343262135 Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-VolumesSnapshotsTestJSON-1343262135-project Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 0e5aeca61b864d139017a2c8cbdc37dc Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1343262135-project Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: exception: Snapshot 645bd118-7365-4a2a-8b0d-ed588c7e4635 could not be found. Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '645bd118-7365-4a2a-8b0d-ed588c7e4635'} Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 645bd118-7365-4a2a-8b0d-ed588c7e4635 could not be found. (HTTP 404) (Request-ID: req-03e3a02e-56df-449e-a763-7fc2a39b3b6d) Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 05 08:39:42.277948 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 645bd118-7365-4a2a-8b0d-ed588c7e4635 could not be found. Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 645bd118-7365-4a2a-8b0d-ed588c7e4635 could not be found. Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 645bd118-7365-4a2a-8b0d-ed588c7e4635 could not be found. Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-baf3e95a-3e3d-48af-991c-bc0dc5d0878e tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Returning 404 to user: Snapshot 645bd118-7365-4a2a-8b0d-ed588c7e4635 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:39:42.282291 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-baf3e95a-3e3d-48af-991c-bc0dc5d0878e tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/645bd118-7365-4a2a-8b0d-ed588c7e4635" status: 404 len: 111 microversion: 2.1 time: 0.125531 Jun 05 08:39:42.288890 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1556/3032] 10.222.0.33 () {58 vars in 1250 bytes} [Sun Jun 5 08:39:42 2022] GET /compute/v2.1/os-snapshots/645bd118-7365-4a2a-8b0d-ed588c7e4635 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 05 08:39:42.293822 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7c412ce4-9239-4446-9bfa-1a9a16a484eb tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Calling method '.version_select at 0x7f243386c5e0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:42.420218 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-63e0943e-ec14-4c00-95b4-56c3bf5061c6 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a3e3ac4a994d55a3c87e51b3be024c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a74e63775d49dbafd25b2c7257f817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:39:42.428757 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-63e0943e-ec14-4c00-95b4-56c3bf5061c6 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "GET /compute/v2.1/servers/95ce97cb-122f-4fb7-b80c-729c67c1be47" status: 200 len: 1209 microversion: 2.1 time: 0.195628 Jun 05 08:39:42.440260 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1477/3033] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:42 2022] GET /compute/v2.1/servers/95ce97cb-122f-4fb7-b80c-729c67c1be47 => generated 1209 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:39:42.457281 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7c412ce4-9239-4446-9bfa-1a9a16a484eb tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/c7ce442a-0ff9-4a46-b57e-e7cd84260792" status: 202 len: 0 microversion: 2.1 time: 0.171094 Jun 05 08:39:42.457857 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1557/3034] 10.222.0.33 () {58 vars in 1247 bytes} [Sun Jun 5 08:39:42 2022] DELETE /compute/v2.1/os-volumes/c7ce442a-0ff9-4a46-b57e-e7cd84260792 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:39:42.466653 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-aa7395d7-5ce9-489d-990b-8453e02ef27c tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Calling method '.version_select at 0x7f2432df9c10>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:42.604571 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-aa7395d7-5ce9-489d-990b-8453e02ef27c tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c7ce442a-0ff9-4a46-b57e-e7cd84260792" status: 200 len: 342 microversion: 2.1 time: 0.141454 Jun 05 08:39:42.610804 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1478/3035] 10.222.0.33 () {58 vars in 1244 bytes} [Sun Jun 5 08:39:42 2022] GET /compute/v2.1/os-volumes/c7ce442a-0ff9-4a46-b57e-e7cd84260792 => generated 342 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:43.453100 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-bd54f4c2-728a-4a54-bd01-97df0e6ca518 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:43.454593 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-bd54f4c2-728a-4a54-bd01-97df0e6ca518 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 95ce97cb-122f-4fb7-b80c-729c67c1be47] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:43.479420 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bd54f4c2-728a-4a54-bd01-97df0e6ca518 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:43.481833 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bd54f4c2-728a-4a54-bd01-97df0e6ca518 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:43.484436 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bd54f4c2-728a-4a54-bd01-97df0e6ca518 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:43.485953 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bd54f4c2-728a-4a54-bd01-97df0e6ca518 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:43.594809 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bd54f4c2-728a-4a54-bd01-97df0e6ca518 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:43.595602 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bd54f4c2-728a-4a54-bd01-97df0e6ca518 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:43.596358 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-bd54f4c2-728a-4a54-bd01-97df0e6ca518 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lazy-loading 'fault' on Instance uuid 95ce97cb-122f-4fb7-b80c-729c67c1be47 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:39:43.622606 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-42787534-e458-4a32-8347-6b6396db3f25 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Calling method '.version_select at 0x7f2432e42d30>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:43.772998 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-42787534-e458-4a32-8347-6b6396db3f25 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c7ce442a-0ff9-4a46-b57e-e7cd84260792" status: 200 len: 342 microversion: 2.1 time: 0.152778 Jun 05 08:39:43.780944 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1479/3036] 10.222.0.33 () {58 vars in 1244 bytes} [Sun Jun 5 08:39:43 2022] GET /compute/v2.1/os-volumes/c7ce442a-0ff9-4a46-b57e-e7cd84260792 => generated 342 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:39:43.877681 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-bd54f4c2-728a-4a54-bd01-97df0e6ca518 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a3e3ac4a994d55a3c87e51b3be024c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a74e63775d49dbafd25b2c7257f817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:39:43.890103 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-bd54f4c2-728a-4a54-bd01-97df0e6ca518 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "GET /compute/v2.1/servers/95ce97cb-122f-4fb7-b80c-729c67c1be47" status: 200 len: 1282 microversion: 2.1 time: 0.440070 Jun 05 08:39:43.890833 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1558/3037] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:43 2022] GET /compute/v2.1/servers/95ce97cb-122f-4fb7-b80c-729c67c1be47 => generated 1282 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:39:43.907728 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-57591300-1a0f-4ec9-ab2f-87e6bee56170 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:43.908709 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-57591300-1a0f-4ec9-ab2f-87e6bee56170 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 95ce97cb-122f-4fb7-b80c-729c67c1be47] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:43.922486 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-57591300-1a0f-4ec9-ab2f-87e6bee56170 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:43.923157 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-57591300-1a0f-4ec9-ab2f-87e6bee56170 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:43.924247 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-57591300-1a0f-4ec9-ab2f-87e6bee56170 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:43.924797 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-57591300-1a0f-4ec9-ab2f-87e6bee56170 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:43.979355 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-57591300-1a0f-4ec9-ab2f-87e6bee56170 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 95ce97cb-122f-4fb7-b80c-729c67c1be47] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:39:44.051638 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-57591300-1a0f-4ec9-ab2f-87e6bee56170 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 95ce97cb-122f-4fb7-b80c-729c67c1be47] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:39:44.053325 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-57591300-1a0f-4ec9-ab2f-87e6bee56170 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:44.054149 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-57591300-1a0f-4ec9-ab2f-87e6bee56170 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:44.055101 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-57591300-1a0f-4ec9-ab2f-87e6bee56170 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 95ce97cb-122f-4fb7-b80c-729c67c1be47] instance's host None is down, deleting from database Jun 05 08:39:44.067411 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-57591300-1a0f-4ec9-ab2f-87e6bee56170 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 95ce97cb-122f-4fb7-b80c-729c67c1be47] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:39:44.239073 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-57591300-1a0f-4ec9-ab2f-87e6bee56170 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 95ce97cb-122f-4fb7-b80c-729c67c1be47] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:39:44.249251 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-57591300-1a0f-4ec9-ab2f-87e6bee56170 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 95ce97cb-122f-4fb7-b80c-729c67c1be47] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:39:44.471089 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=64,nova_cell0:UPDATE=30,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:39:44.496379 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-57591300-1a0f-4ec9-ab2f-87e6bee56170 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "DELETE /compute/v2.1/servers/95ce97cb-122f-4fb7-b80c-729c67c1be47" status: 204 len: 0 microversion: 2.1 time: 0.592545 Jun 05 08:39:44.497595 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1480/3038] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:39:43 2022] DELETE /compute/v2.1/servers/95ce97cb-122f-4fb7-b80c-729c67c1be47 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:39:44.507036 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cac07ba6-97a5-4ef7-ba11-2f9209bb7013 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:44.508285 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-cac07ba6-97a5-4ef7-ba11-2f9209bb7013 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 95ce97cb-122f-4fb7-b80c-729c67c1be47] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:44.515649 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cac07ba6-97a5-4ef7-ba11-2f9209bb7013 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:44.516420 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cac07ba6-97a5-4ef7-ba11-2f9209bb7013 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:44.517394 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cac07ba6-97a5-4ef7-ba11-2f9209bb7013 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:44.518015 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cac07ba6-97a5-4ef7-ba11-2f9209bb7013 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:44.534877 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-cac07ba6-97a5-4ef7-ba11-2f9209bb7013 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] HTTP exception thrown: Instance 95ce97cb-122f-4fb7-b80c-729c67c1be47 could not be found. Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cac07ba6-97a5-4ef7-ba11-2f9209bb7013 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Request method failure captured: Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/95ce97cb-122f-4fb7-b80c-729c67c1be47 HTTP/1.1 Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGu1vFCwWen85d3HsPe2yp3Ue0qTRVzpHRvnDC2K9Zq7dXy-upJpVvCiFKsXFfl02PIgLY8X82xPfb_LVHLyaFDpNYpAMesTIyWh9bIwUEf7Ktz2z92xAdpstdBaCJfFxBdlDjs-RRoYJtmtUKpjlscLHodDrvmqbYQWg0V1EvcLdS8 Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: e0a74e63775d49dbafd25b2c7257f817 Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ServersTestJSON-1445963553 Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e0a74e63775d49dbafd25b2c7257f817"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0a74e63775d49dbafd25b2c7257f817"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e0a74e63775d49dbafd25b2c7257f817", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0a74e63775d49dbafd25b2c7257f817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ServersTestJSON-1445963553 Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: e0a74e63775d49dbafd25b2c7257f817 Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ServersTestJSON-1445963553 Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ServersTestJSON-1445963553-project Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 65a3e3ac4a994d55a3c87e51b3be024c Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ServersTestJSON-1445963553-project Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 95ce97cb-122f-4fb7-b80c-729c67c1be47 could not be found. Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '95ce97cb-122f-4fb7-b80c-729c67c1be47'} Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95ce97cb-122f-4fb7-b80c-729c67c1be47 could not be found. Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95ce97cb-122f-4fb7-b80c-729c67c1be47 could not be found. Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:44.537322 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:44.542071 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:44.542071 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:44.542071 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:39:44.542071 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:39:44.542071 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95ce97cb-122f-4fb7-b80c-729c67c1be47 could not be found. Jun 05 08:39:44.542071 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:44.543930 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cac07ba6-97a5-4ef7-ba11-2f9209bb7013 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Returning 404 to user: Instance 95ce97cb-122f-4fb7-b80c-729c67c1be47 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:39:44.545101 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-cac07ba6-97a5-4ef7-ba11-2f9209bb7013 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "GET /compute/v2.1/servers/95ce97cb-122f-4fb7-b80c-729c67c1be47" status: 404 len: 111 microversion: 2.1 time: 0.043278 Jun 05 08:39:44.557860 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1559/3039] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:44 2022] GET /compute/v2.1/servers/95ce97cb-122f-4fb7-b80c-729c67c1be47 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:39:44.764514 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d315d8c9-83ea-422c-bfef-9c8fdf6412ea tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1721438010", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "9cadba9d-5f73-40e2-9cd2-86024f7f62a4"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:39:44.789318 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6c932379-2f60-4524-8db6-eabe2b6840f1 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Calling method '.version_select at 0x7f24339dce50>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:44.882216 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-d315d8c9-83ea-422c-bfef-9c8fdf6412ea tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] validate_networks() for [('9cadba9d-5f73-40e2-9cd2-86024f7f62a4', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:39:44.909154 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6c932379-2f60-4524-8db6-eabe2b6840f1 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c7ce442a-0ff9-4a46-b57e-e7cd84260792" status: 200 len: 342 microversion: 2.1 time: 0.127033 Jun 05 08:39:44.909815 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1560/3040] 10.222.0.33 () {58 vars in 1244 bytes} [Sun Jun 5 08:39:44 2022] GET /compute/v2.1/os-volumes/c7ce442a-0ff9-4a46-b57e-e7cd84260792 => generated 342 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:39:45.915580 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-d315d8c9-83ea-422c-bfef-9c8fdf6412ea tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:39:45.916849 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-d315d8c9-83ea-422c-bfef-9c8fdf6412ea tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:39:45.930657 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-984e4734-2298-41d8-bdbd-e988f86dc8d1 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Calling method '.version_select at 0x7f2433699280>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:45.931715 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-d315d8c9-83ea-422c-bfef-9c8fdf6412ea tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:39:45.932429 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-d315d8c9-83ea-422c-bfef-9c8fdf6412ea tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:39:45.933239 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-d315d8c9-83ea-422c-bfef-9c8fdf6412ea tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:39:45.957970 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d315d8c9-83ea-422c-bfef-9c8fdf6412ea tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:45.959880 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=6 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:39:45.960711 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d315d8c9-83ea-422c-bfef-9c8fdf6412ea tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:45.963136 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d315d8c9-83ea-422c-bfef-9c8fdf6412ea tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:45.964329 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d315d8c9-83ea-422c-bfef-9c8fdf6412ea tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:45.990639 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-d315d8c9-83ea-422c-bfef-9c8fdf6412ea tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Getting quotas for project e0a74e63775d49dbafd25b2c7257f817. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:39:46.013409 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-d315d8c9-83ea-422c-bfef-9c8fdf6412ea tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Getting quotas for user 65a3e3ac4a994d55a3c87e51b3be024c and project e0a74e63775d49dbafd25b2c7257f817. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:39:46.049339 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d315d8c9-83ea-422c-bfef-9c8fdf6412ea tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:39:46.050717 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-984e4734-2298-41d8-bdbd-e988f86dc8d1 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c7ce442a-0ff9-4a46-b57e-e7cd84260792" status: 200 len: 342 microversion: 2.1 time: 0.132285 Jun 05 08:39:46.052022 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1561/3041] 10.222.0.33 () {58 vars in 1244 bytes} [Sun Jun 5 08:39:45 2022] GET /compute/v2.1/os-volumes/c7ce442a-0ff9-4a46-b57e-e7cd84260792 => generated 342 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:39:46.054891 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d315d8c9-83ea-422c-bfef-9c8fdf6412ea tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 1a643019-faab-4807-bb98-981a3efcb6e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:39:46.146369 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d315d8c9-83ea-422c-bfef-9c8fdf6412ea tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.391523 Jun 05 08:39:46.167365 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-489b7f4c-b026-4977-b11a-008bd84c8c53 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:46.168495 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-489b7f4c-b026-4977-b11a-008bd84c8c53 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 1a643019-faab-4807-bb98-981a3efcb6e2] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:46.173623 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1481/3042] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:39:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:39:46.178503 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=28 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:39:46.330955 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-489b7f4c-b026-4977-b11a-008bd84c8c53 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a3e3ac4a994d55a3c87e51b3be024c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a74e63775d49dbafd25b2c7257f817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:39:46.341908 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-489b7f4c-b026-4977-b11a-008bd84c8c53 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "GET /compute/v2.1/servers/1a643019-faab-4807-bb98-981a3efcb6e2" status: 200 len: 1209 microversion: 2.1 time: 0.181694 Jun 05 08:39:46.343581 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1562/3043] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:46 2022] GET /compute/v2.1/servers/1a643019-faab-4807-bb98-981a3efcb6e2 => generated 1209 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:39:47.069790 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-11f69bda-425c-4467-92c0-13136c733a2f tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Calling method '.version_select at 0x7f2432d97160>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:47.190544 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-11f69bda-425c-4467-92c0-13136c733a2f tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c7ce442a-0ff9-4a46-b57e-e7cd84260792" status: 200 len: 342 microversion: 2.1 time: 0.130125 Jun 05 08:39:47.191116 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1482/3044] 10.222.0.33 () {58 vars in 1244 bytes} [Sun Jun 5 08:39:47 2022] GET /compute/v2.1/os-volumes/c7ce442a-0ff9-4a46-b57e-e7cd84260792 => generated 342 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:47.358871 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2f452a37-e664-4483-92d5-57ecb8902d37 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:47.359566 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2f452a37-e664-4483-92d5-57ecb8902d37 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 1a643019-faab-4807-bb98-981a3efcb6e2] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:47.375536 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2f452a37-e664-4483-92d5-57ecb8902d37 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:47.376006 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2f452a37-e664-4483-92d5-57ecb8902d37 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:47.378743 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2f452a37-e664-4483-92d5-57ecb8902d37 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:47.379201 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2f452a37-e664-4483-92d5-57ecb8902d37 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:47.479187 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2f452a37-e664-4483-92d5-57ecb8902d37 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:47.480991 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2f452a37-e664-4483-92d5-57ecb8902d37 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:47.482727 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-2f452a37-e664-4483-92d5-57ecb8902d37 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lazy-loading 'fault' on Instance uuid 1a643019-faab-4807-bb98-981a3efcb6e2 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:39:47.557905 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2f452a37-e664-4483-92d5-57ecb8902d37 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a3e3ac4a994d55a3c87e51b3be024c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a74e63775d49dbafd25b2c7257f817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:39:47.576112 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2f452a37-e664-4483-92d5-57ecb8902d37 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "GET /compute/v2.1/servers/1a643019-faab-4807-bb98-981a3efcb6e2" status: 200 len: 1282 microversion: 2.1 time: 0.218942 Jun 05 08:39:47.581232 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1563/3045] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:47 2022] GET /compute/v2.1/servers/1a643019-faab-4807-bb98-981a3efcb6e2 => generated 1282 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:39:47.597307 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-dd228ae7-2c0a-48f8-b511-f322690b70fa tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:47.598076 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-dd228ae7-2c0a-48f8-b511-f322690b70fa tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 1a643019-faab-4807-bb98-981a3efcb6e2] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:47.611118 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dd228ae7-2c0a-48f8-b511-f322690b70fa tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:47.613233 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dd228ae7-2c0a-48f8-b511-f322690b70fa tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:47.614249 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dd228ae7-2c0a-48f8-b511-f322690b70fa tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:47.617776 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dd228ae7-2c0a-48f8-b511-f322690b70fa tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:47.666564 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-dd228ae7-2c0a-48f8-b511-f322690b70fa tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 1a643019-faab-4807-bb98-981a3efcb6e2] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:39:47.738195 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-dd228ae7-2c0a-48f8-b511-f322690b70fa tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 1a643019-faab-4807-bb98-981a3efcb6e2] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:39:47.741852 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dd228ae7-2c0a-48f8-b511-f322690b70fa tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:47.743180 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-dd228ae7-2c0a-48f8-b511-f322690b70fa tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:47.744616 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-dd228ae7-2c0a-48f8-b511-f322690b70fa tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 1a643019-faab-4807-bb98-981a3efcb6e2] instance's host None is down, deleting from database Jun 05 08:39:47.748433 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-dd228ae7-2c0a-48f8-b511-f322690b70fa tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 1a643019-faab-4807-bb98-981a3efcb6e2] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:39:47.804861 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-dd228ae7-2c0a-48f8-b511-f322690b70fa tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 1a643019-faab-4807-bb98-981a3efcb6e2] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:39:47.813201 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-dd228ae7-2c0a-48f8-b511-f322690b70fa tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 1a643019-faab-4807-bb98-981a3efcb6e2] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:39:48.113609 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-dd228ae7-2c0a-48f8-b511-f322690b70fa tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1a643019-faab-4807-bb98-981a3efcb6e2" status: 204 len: 0 microversion: 2.1 time: 0.520124 Jun 05 08:39:48.115943 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1483/3046] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:39:47 2022] DELETE /compute/v2.1/servers/1a643019-faab-4807-bb98-981a3efcb6e2 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:39:48.124463 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0d91fc20-440a-4551-96eb-e66546ced91c tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:48.125258 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0d91fc20-440a-4551-96eb-e66546ced91c tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: 1a643019-faab-4807-bb98-981a3efcb6e2] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:48.135039 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0d91fc20-440a-4551-96eb-e66546ced91c tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:48.136179 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0d91fc20-440a-4551-96eb-e66546ced91c tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:48.137300 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0d91fc20-440a-4551-96eb-e66546ced91c tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:48.138342 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0d91fc20-440a-4551-96eb-e66546ced91c tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:48.155359 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-0d91fc20-440a-4551-96eb-e66546ced91c tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] HTTP exception thrown: Instance 1a643019-faab-4807-bb98-981a3efcb6e2 could not be found. Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0d91fc20-440a-4551-96eb-e66546ced91c tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Request method failure captured: Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/1a643019-faab-4807-bb98-981a3efcb6e2 HTTP/1.1 Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGu1vFCwWen85d3HsPe2yp3Ue0qTRVzpHRvnDC2K9Zq7dXy-upJpVvCiFKsXFfl02PIgLY8X82xPfb_LVHLyaFDpNYpAMesTIyWh9bIwUEf7Ktz2z92xAdpstdBaCJfFxBdlDjs-RRoYJtmtUKpjlscLHodDrvmqbYQWg0V1EvcLdS8 Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: e0a74e63775d49dbafd25b2c7257f817 Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ServersTestJSON-1445963553 Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e0a74e63775d49dbafd25b2c7257f817"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0a74e63775d49dbafd25b2c7257f817"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e0a74e63775d49dbafd25b2c7257f817", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0a74e63775d49dbafd25b2c7257f817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ServersTestJSON-1445963553 Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: e0a74e63775d49dbafd25b2c7257f817 Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ServersTestJSON-1445963553 Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ServersTestJSON-1445963553-project Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 65a3e3ac4a994d55a3c87e51b3be024c Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ServersTestJSON-1445963553-project Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 1a643019-faab-4807-bb98-981a3efcb6e2 could not be found. Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '1a643019-faab-4807-bb98-981a3efcb6e2'} Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a643019-faab-4807-bb98-981a3efcb6e2 could not be found. Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a643019-faab-4807-bb98-981a3efcb6e2 could not be found. Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:48.157391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:48.162956 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:48.162956 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:48.162956 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:39:48.162956 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:39:48.162956 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a643019-faab-4807-bb98-981a3efcb6e2 could not be found. Jun 05 08:39:48.162956 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:48.164352 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0d91fc20-440a-4551-96eb-e66546ced91c tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Returning 404 to user: Instance 1a643019-faab-4807-bb98-981a3efcb6e2 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:39:48.165785 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0d91fc20-440a-4551-96eb-e66546ced91c tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "GET /compute/v2.1/servers/1a643019-faab-4807-bb98-981a3efcb6e2" status: 404 len: 111 microversion: 2.1 time: 0.045604 Jun 05 08:39:48.166627 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1564/3047] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:48 2022] GET /compute/v2.1/servers/1a643019-faab-4807-bb98-981a3efcb6e2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:39:48.203619 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f3d4281e-4c4c-4d60-b215-72db12c47f8a tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Calling method '.version_select at 0x7f2432e42d30>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:48.249810 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-f3d4281e-4c4c-4d60-b215-72db12c47f8a tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] HTTP exception thrown: Volume c7ce442a-0ff9-4a46-b57e-e7cd84260792 could not be found. Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f3d4281e-4c4c-4d60-b215-72db12c47f8a tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Request method failure captured: Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/os-volumes/c7ce442a-0ff9-4a46-b57e-e7cd84260792 HTTP/1.1 Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGu8MLnJpHQOgNgvz2ha6KhZnondRd2Clrv9VjEl0pd7_JlTkyLTn1xeQbfx_z-87McDh-R5i5eemDwXWRtI9JxHrXNl6S1b3nJ1FD62m58FAqX3jogY56K39zxWXfZ6IU-T3dTKky1LHtnm4NxJd91gw84jm4zGy_k1DomfXOOakQ0 Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 62c05fb4eb01476c93871ecf5f1e55bd Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1343262135 Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/62c05fb4eb01476c93871ecf5f1e55bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62c05fb4eb01476c93871ecf5f1e55bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_62c05fb4eb01476c93871ecf5f1e55bd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62c05fb4eb01476c93871ecf5f1e55bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1343262135 Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 62c05fb4eb01476c93871ecf5f1e55bd Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1343262135 Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-VolumesSnapshotsTestJSON-1343262135-project Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 0e5aeca61b864d139017a2c8cbdc37dc Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1343262135-project Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: exception: Volume c7ce442a-0ff9-4a46-b57e-e7cd84260792 could not be found. Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'c7ce442a-0ff9-4a46-b57e-e7cd84260792'} Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c7ce442a-0ff9-4a46-b57e-e7cd84260792 could not be found. (HTTP 404) (Request-ID: req-0f7b7c1e-a328-48c7-baf5-88124bba15e7) Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 05 08:39:48.256601 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c7ce442a-0ff9-4a46-b57e-e7cd84260792 could not be found. Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c7ce442a-0ff9-4a46-b57e-e7cd84260792 could not be found. Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c7ce442a-0ff9-4a46-b57e-e7cd84260792 could not be found. Jun 05 08:39:48.261741 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:48.266691 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f3d4281e-4c4c-4d60-b215-72db12c47f8a tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Returning 404 to user: Volume c7ce442a-0ff9-4a46-b57e-e7cd84260792 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:39:48.268526 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f3d4281e-4c4c-4d60-b215-72db12c47f8a tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c7ce442a-0ff9-4a46-b57e-e7cd84260792" status: 404 len: 109 microversion: 2.1 time: 0.069066 Jun 05 08:39:48.269550 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1484/3048] 10.222.0.33 () {58 vars in 1244 bytes} [Sun Jun 5 08:39:48 2022] GET /compute/v2.1/os-volumes/c7ce442a-0ff9-4a46-b57e-e7cd84260792 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:39:48.282562 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e8d00ccc-d98a-40a8-acc1-7ede5edb49de tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Calling method '.version_select at 0x7f24339dc700>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:48.331383 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-e8d00ccc-d98a-40a8-acc1-7ede5edb49de tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] HTTP exception thrown: Volume c7ce442a-0ff9-4a46-b57e-e7cd84260792 could not be found. Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e8d00ccc-d98a-40a8-acc1-7ede5edb49de tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Request method failure captured: Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: request: DELETE /compute/v2.1/os-volumes/c7ce442a-0ff9-4a46-b57e-e7cd84260792 HTTP/1.1 Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGu8MLnJpHQOgNgvz2ha6KhZnondRd2Clrv9VjEl0pd7_JlTkyLTn1xeQbfx_z-87McDh-R5i5eemDwXWRtI9JxHrXNl6S1b3nJ1FD62m58FAqX3jogY56K39zxWXfZ6IU-T3dTKky1LHtnm4NxJd91gw84jm4zGy_k1DomfXOOakQ0 Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 62c05fb4eb01476c93871ecf5f1e55bd Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1343262135 Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/62c05fb4eb01476c93871ecf5f1e55bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62c05fb4eb01476c93871ecf5f1e55bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_62c05fb4eb01476c93871ecf5f1e55bd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62c05fb4eb01476c93871ecf5f1e55bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1343262135 Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 62c05fb4eb01476c93871ecf5f1e55bd Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1343262135 Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-VolumesSnapshotsTestJSON-1343262135-project Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 0e5aeca61b864d139017a2c8cbdc37dc Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1343262135-project Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: exception: Volume c7ce442a-0ff9-4a46-b57e-e7cd84260792 could not be found. Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'c7ce442a-0ff9-4a46-b57e-e7cd84260792'} Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c7ce442a-0ff9-4a46-b57e-e7cd84260792 could not be found. (HTTP 404) (Request-ID: req-5df4ecdb-a6bf-4405-a890-dbc649b45eba) Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 05 08:39:48.334346 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c7ce442a-0ff9-4a46-b57e-e7cd84260792 could not be found. Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c7ce442a-0ff9-4a46-b57e-e7cd84260792 could not be found. Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c7ce442a-0ff9-4a46-b57e-e7cd84260792 could not be found. Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e8d00ccc-d98a-40a8-acc1-7ede5edb49de tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Returning 404 to user: Volume c7ce442a-0ff9-4a46-b57e-e7cd84260792 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e8d00ccc-d98a-40a8-acc1-7ede5edb49de tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/c7ce442a-0ff9-4a46-b57e-e7cd84260792" status: 404 len: 109 microversion: 2.1 time: 0.059247 Jun 05 08:39:48.339901 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1565/3049] 10.222.0.33 () {58 vars in 1247 bytes} [Sun Jun 5 08:39:48 2022] DELETE /compute/v2.1/os-volumes/c7ce442a-0ff9-4a46-b57e-e7cd84260792 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:39:48.347951 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1fe149e7-281a-49c2-b3c8-39e9b728c376 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Calling method '.version_select at 0x7f2432dde700>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:48.387889 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-1fe149e7-281a-49c2-b3c8-39e9b728c376 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] HTTP exception thrown: Volume c7ce442a-0ff9-4a46-b57e-e7cd84260792 could not be found. Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1fe149e7-281a-49c2-b3c8-39e9b728c376 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Request method failure captured: Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/os-volumes/c7ce442a-0ff9-4a46-b57e-e7cd84260792 HTTP/1.1 Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGu8MLnJpHQOgNgvz2ha6KhZnondRd2Clrv9VjEl0pd7_JlTkyLTn1xeQbfx_z-87McDh-R5i5eemDwXWRtI9JxHrXNl6S1b3nJ1FD62m58FAqX3jogY56K39zxWXfZ6IU-T3dTKky1LHtnm4NxJd91gw84jm4zGy_k1DomfXOOakQ0 Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 62c05fb4eb01476c93871ecf5f1e55bd Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1343262135 Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/62c05fb4eb01476c93871ecf5f1e55bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62c05fb4eb01476c93871ecf5f1e55bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_62c05fb4eb01476c93871ecf5f1e55bd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62c05fb4eb01476c93871ecf5f1e55bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1343262135 Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 62c05fb4eb01476c93871ecf5f1e55bd Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1343262135 Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-VolumesSnapshotsTestJSON-1343262135-project Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 0e5aeca61b864d139017a2c8cbdc37dc Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1343262135-project Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: method: Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: exception: Volume c7ce442a-0ff9-4a46-b57e-e7cd84260792 could not be found. Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'c7ce442a-0ff9-4a46-b57e-e7cd84260792'} Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c7ce442a-0ff9-4a46-b57e-e7cd84260792 could not be found. (HTTP 404) (Request-ID: req-e5ae01b9-aa61-43a2-8be6-b6d50f9ca997) Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 05 08:39:48.390025 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c7ce442a-0ff9-4a46-b57e-e7cd84260792 could not be found. Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c7ce442a-0ff9-4a46-b57e-e7cd84260792 could not be found. Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c7ce442a-0ff9-4a46-b57e-e7cd84260792 could not be found. Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1fe149e7-281a-49c2-b3c8-39e9b728c376 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] Returning 404 to user: Volume c7ce442a-0ff9-4a46-b57e-e7cd84260792 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:39:48.395634 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1fe149e7-281a-49c2-b3c8-39e9b728c376 tempest-VolumesSnapshotsTestJSON-1343262135 tempest-VolumesSnapshotsTestJSON-1343262135-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c7ce442a-0ff9-4a46-b57e-e7cd84260792" status: 404 len: 109 microversion: 2.1 time: 0.050854 Jun 05 08:39:48.399669 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1485/3050] 10.222.0.33 () {58 vars in 1244 bytes} [Sun Jun 5 08:39:48 2022] GET /compute/v2.1/os-volumes/c7ce442a-0ff9-4a46-b57e-e7cd84260792 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:39:48.578135 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1c2533e0-3270-4a78-a551-e2fbe813658d tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-164032972", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "9cadba9d-5f73-40e2-9cd2-86024f7f62a4"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:39:48.692441 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-1c2533e0-3270-4a78-a551-e2fbe813658d tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] validate_networks() for [('9cadba9d-5f73-40e2-9cd2-86024f7f62a4', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:39:49.160011 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-1c2533e0-3270-4a78-a551-e2fbe813658d tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:39:49.160456 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-1c2533e0-3270-4a78-a551-e2fbe813658d tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:39:49.160931 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-1c2533e0-3270-4a78-a551-e2fbe813658d tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:39:49.161571 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-1c2533e0-3270-4a78-a551-e2fbe813658d tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:39:49.162175 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-1c2533e0-3270-4a78-a551-e2fbe813658d tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:39:49.173778 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1c2533e0-3270-4a78-a551-e2fbe813658d tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:49.174599 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1c2533e0-3270-4a78-a551-e2fbe813658d tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:49.175987 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1c2533e0-3270-4a78-a551-e2fbe813658d tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:49.176744 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1c2533e0-3270-4a78-a551-e2fbe813658d tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:49.216345 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-1c2533e0-3270-4a78-a551-e2fbe813658d tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Getting quotas for project e0a74e63775d49dbafd25b2c7257f817. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:39:49.225538 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-1c2533e0-3270-4a78-a551-e2fbe813658d tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Getting quotas for user 65a3e3ac4a994d55a3c87e51b3be024c and project e0a74e63775d49dbafd25b2c7257f817. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:39:49.253842 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1c2533e0-3270-4a78-a551-e2fbe813658d tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:39:49.258291 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1c2533e0-3270-4a78-a551-e2fbe813658d tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: c3e40a19-4a8a-4fd7-833f-87a0a4359824] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:39:49.353143 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1c2533e0-3270-4a78-a551-e2fbe813658d tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.782893 Jun 05 08:39:49.364418 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1566/3051] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:39:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:39:49.366449 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-29962b46-4dd4-4dba-b3a1-cdaf1e9ddcce tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:49.367077 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-29962b46-4dd4-4dba-b3a1-cdaf1e9ddcce tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: c3e40a19-4a8a-4fd7-833f-87a0a4359824] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:49.531366 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-29962b46-4dd4-4dba-b3a1-cdaf1e9ddcce tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a3e3ac4a994d55a3c87e51b3be024c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a74e63775d49dbafd25b2c7257f817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:39:49.536013 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=87 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:39:49.555090 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-29962b46-4dd4-4dba-b3a1-cdaf1e9ddcce tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "GET /compute/v2.1/servers/c3e40a19-4a8a-4fd7-833f-87a0a4359824" status: 200 len: 1208 microversion: 2.1 time: 0.189840 Jun 05 08:39:49.556057 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1486/3052] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:49 2022] GET /compute/v2.1/servers/c3e40a19-4a8a-4fd7-833f-87a0a4359824 => generated 1208 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:39:50.579742 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4f239e4e-b792-4719-a8a7-01062a9e1bc1 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:50.580588 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4f239e4e-b792-4719-a8a7-01062a9e1bc1 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: c3e40a19-4a8a-4fd7-833f-87a0a4359824] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:50.600406 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4f239e4e-b792-4719-a8a7-01062a9e1bc1 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:50.600889 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4f239e4e-b792-4719-a8a7-01062a9e1bc1 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:50.603261 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4f239e4e-b792-4719-a8a7-01062a9e1bc1 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:50.603728 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4f239e4e-b792-4719-a8a7-01062a9e1bc1 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:50.614918 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=67,nova_cell0:UPDATE=27,nova_cell0:DELETE=4,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:39:50.679653 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4f239e4e-b792-4719-a8a7-01062a9e1bc1 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:50.680065 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4f239e4e-b792-4719-a8a7-01062a9e1bc1 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:50.680551 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-4f239e4e-b792-4719-a8a7-01062a9e1bc1 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lazy-loading 'fault' on Instance uuid c3e40a19-4a8a-4fd7-833f-87a0a4359824 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:39:50.803325 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4f239e4e-b792-4719-a8a7-01062a9e1bc1 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a3e3ac4a994d55a3c87e51b3be024c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a74e63775d49dbafd25b2c7257f817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:39:50.818613 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4f239e4e-b792-4719-a8a7-01062a9e1bc1 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "GET /compute/v2.1/servers/c3e40a19-4a8a-4fd7-833f-87a0a4359824" status: 200 len: 1281 microversion: 2.1 time: 0.244482 Jun 05 08:39:50.820092 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1567/3053] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:50 2022] GET /compute/v2.1/servers/c3e40a19-4a8a-4fd7-833f-87a0a4359824 => generated 1281 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:39:50.836231 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9135b74b-7eda-495f-882d-1084a54b840c tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:50.836795 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9135b74b-7eda-495f-882d-1084a54b840c tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: c3e40a19-4a8a-4fd7-833f-87a0a4359824] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:50.852478 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9135b74b-7eda-495f-882d-1084a54b840c tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:50.854185 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9135b74b-7eda-495f-882d-1084a54b840c tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:50.855069 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9135b74b-7eda-495f-882d-1084a54b840c tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:50.856010 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9135b74b-7eda-495f-882d-1084a54b840c tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:50.913266 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9135b74b-7eda-495f-882d-1084a54b840c tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: c3e40a19-4a8a-4fd7-833f-87a0a4359824] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:39:51.055272 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9135b74b-7eda-495f-882d-1084a54b840c tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: c3e40a19-4a8a-4fd7-833f-87a0a4359824] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:39:51.059225 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9135b74b-7eda-495f-882d-1084a54b840c tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:51.064162 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9135b74b-7eda-495f-882d-1084a54b840c tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:51.064864 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-9135b74b-7eda-495f-882d-1084a54b840c tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: c3e40a19-4a8a-4fd7-833f-87a0a4359824] instance's host None is down, deleting from database Jun 05 08:39:51.074016 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-9135b74b-7eda-495f-882d-1084a54b840c tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: c3e40a19-4a8a-4fd7-833f-87a0a4359824] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:39:51.177982 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-9135b74b-7eda-495f-882d-1084a54b840c tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: c3e40a19-4a8a-4fd7-833f-87a0a4359824] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:39:51.185485 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-9135b74b-7eda-495f-882d-1084a54b840c tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: c3e40a19-4a8a-4fd7-833f-87a0a4359824] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:39:51.415544 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9135b74b-7eda-495f-882d-1084a54b840c tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c3e40a19-4a8a-4fd7-833f-87a0a4359824" status: 204 len: 0 microversion: 2.1 time: 0.584032 Jun 05 08:39:51.420193 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1487/3054] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:39:50 2022] DELETE /compute/v2.1/servers/c3e40a19-4a8a-4fd7-833f-87a0a4359824 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:39:51.424871 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7b780c3f-e5a8-47a5-bc2c-17f7fa8272d9 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:51.425490 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7b780c3f-e5a8-47a5-bc2c-17f7fa8272d9 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: c3e40a19-4a8a-4fd7-833f-87a0a4359824] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:51.427373 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:DELETE=4 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:39:51.436604 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7b780c3f-e5a8-47a5-bc2c-17f7fa8272d9 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:51.440394 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7b780c3f-e5a8-47a5-bc2c-17f7fa8272d9 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:51.441305 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7b780c3f-e5a8-47a5-bc2c-17f7fa8272d9 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:51.441761 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7b780c3f-e5a8-47a5-bc2c-17f7fa8272d9 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:51.477487 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-7b780c3f-e5a8-47a5-bc2c-17f7fa8272d9 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] HTTP exception thrown: Instance c3e40a19-4a8a-4fd7-833f-87a0a4359824 could not be found. Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7b780c3f-e5a8-47a5-bc2c-17f7fa8272d9 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Request method failure captured: Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/c3e40a19-4a8a-4fd7-833f-87a0a4359824 HTTP/1.1 Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGu1vFCwWen85d3HsPe2yp3Ue0qTRVzpHRvnDC2K9Zq7dXy-upJpVvCiFKsXFfl02PIgLY8X82xPfb_LVHLyaFDpNYpAMesTIyWh9bIwUEf7Ktz2z92xAdpstdBaCJfFxBdlDjs-RRoYJtmtUKpjlscLHodDrvmqbYQWg0V1EvcLdS8 Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: e0a74e63775d49dbafd25b2c7257f817 Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ServersTestJSON-1445963553 Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e0a74e63775d49dbafd25b2c7257f817"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0a74e63775d49dbafd25b2c7257f817"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e0a74e63775d49dbafd25b2c7257f817", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0a74e63775d49dbafd25b2c7257f817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ServersTestJSON-1445963553 Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: e0a74e63775d49dbafd25b2c7257f817 Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ServersTestJSON-1445963553 Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ServersTestJSON-1445963553-project Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 65a3e3ac4a994d55a3c87e51b3be024c Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ServersTestJSON-1445963553-project Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance c3e40a19-4a8a-4fd7-833f-87a0a4359824 could not be found. Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'c3e40a19-4a8a-4fd7-833f-87a0a4359824'} Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3e40a19-4a8a-4fd7-833f-87a0a4359824 could not be found. Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3e40a19-4a8a-4fd7-833f-87a0a4359824 could not be found. Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:51.480115 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:51.485214 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:51.485214 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:51.485214 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:39:51.485214 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:39:51.485214 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3e40a19-4a8a-4fd7-833f-87a0a4359824 could not be found. Jun 05 08:39:51.485214 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:51.486596 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7b780c3f-e5a8-47a5-bc2c-17f7fa8272d9 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Returning 404 to user: Instance c3e40a19-4a8a-4fd7-833f-87a0a4359824 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:39:51.487655 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7b780c3f-e5a8-47a5-bc2c-17f7fa8272d9 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "GET /compute/v2.1/servers/c3e40a19-4a8a-4fd7-833f-87a0a4359824" status: 404 len: 111 microversion: 2.1 time: 0.066727 Jun 05 08:39:51.488803 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1568/3055] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:51 2022] GET /compute/v2.1/servers/c3e40a19-4a8a-4fd7-833f-87a0a4359824 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 05 08:39:51.500831 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c26834ca-15e9-4e1d-be2e-71beedaa0d45 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:51.501486 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c26834ca-15e9-4e1d-be2e-71beedaa0d45 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: e57b1da6-59e4-408e-b2df-1161fe5a062c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:51.510339 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c26834ca-15e9-4e1d-be2e-71beedaa0d45 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:51.511310 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c26834ca-15e9-4e1d-be2e-71beedaa0d45 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:51.512365 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c26834ca-15e9-4e1d-be2e-71beedaa0d45 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:51.513604 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c26834ca-15e9-4e1d-be2e-71beedaa0d45 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:51.538328 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-c26834ca-15e9-4e1d-be2e-71beedaa0d45 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] HTTP exception thrown: Instance e57b1da6-59e4-408e-b2df-1161fe5a062c could not be found. Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c26834ca-15e9-4e1d-be2e-71beedaa0d45 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Request method failure captured: Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: request: DELETE /compute/v2.1/servers/e57b1da6-59e4-408e-b2df-1161fe5a062c HTTP/1.1 Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGu1vFCwWen85d3HsPe2yp3Ue0qTRVzpHRvnDC2K9Zq7dXy-upJpVvCiFKsXFfl02PIgLY8X82xPfb_LVHLyaFDpNYpAMesTIyWh9bIwUEf7Ktz2z92xAdpstdBaCJfFxBdlDjs-RRoYJtmtUKpjlscLHodDrvmqbYQWg0V1EvcLdS8 Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: e0a74e63775d49dbafd25b2c7257f817 Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ServersTestJSON-1445963553 Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e0a74e63775d49dbafd25b2c7257f817"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0a74e63775d49dbafd25b2c7257f817"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e0a74e63775d49dbafd25b2c7257f817", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0a74e63775d49dbafd25b2c7257f817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ServersTestJSON-1445963553 Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: e0a74e63775d49dbafd25b2c7257f817 Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ServersTestJSON-1445963553 Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ServersTestJSON-1445963553-project Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 65a3e3ac4a994d55a3c87e51b3be024c Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ServersTestJSON-1445963553-project Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance e57b1da6-59e4-408e-b2df-1161fe5a062c could not be found. Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'e57b1da6-59e4-408e-b2df-1161fe5a062c'} Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e57b1da6-59e4-408e-b2df-1161fe5a062c could not be found. Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:39:51.540962 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e57b1da6-59e4-408e-b2df-1161fe5a062c could not be found. Jun 05 08:39:51.546132 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:51.546132 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:51.546132 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:51.546132 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:51.546132 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:51.546132 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:51.546132 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:39:51.546132 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:39:51.546132 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e57b1da6-59e4-408e-b2df-1161fe5a062c could not be found. Jun 05 08:39:51.546132 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:39:51.548074 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c26834ca-15e9-4e1d-be2e-71beedaa0d45 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Returning 404 to user: Instance e57b1da6-59e4-408e-b2df-1161fe5a062c could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:39:51.549998 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c26834ca-15e9-4e1d-be2e-71beedaa0d45 tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e57b1da6-59e4-408e-b2df-1161fe5a062c" status: 404 len: 111 microversion: 2.1 time: 0.052341 Jun 05 08:39:51.551330 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1488/3056] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:39:51 2022] DELETE /compute/v2.1/servers/e57b1da6-59e4-408e-b2df-1161fe5a062c => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:39:51.559293 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6789045f-e13e-4452-bc02-49625397d76b tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:51.560021 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6789045f-e13e-4452-bc02-49625397d76b tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] [instance: e57b1da6-59e4-408e-b2df-1161fe5a062c] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:51.567446 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6789045f-e13e-4452-bc02-49625397d76b tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:51.570463 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6789045f-e13e-4452-bc02-49625397d76b tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:51.572281 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6789045f-e13e-4452-bc02-49625397d76b tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:51.573147 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6789045f-e13e-4452-bc02-49625397d76b tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:51.595702 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-6789045f-e13e-4452-bc02-49625397d76b tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] HTTP exception thrown: Instance e57b1da6-59e4-408e-b2df-1161fe5a062c could not be found. Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6789045f-e13e-4452-bc02-49625397d76b tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Request method failure captured: Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/e57b1da6-59e4-408e-b2df-1161fe5a062c HTTP/1.1 Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGu1vFCwWen85d3HsPe2yp3Ue0qTRVzpHRvnDC2K9Zq7dXy-upJpVvCiFKsXFfl02PIgLY8X82xPfb_LVHLyaFDpNYpAMesTIyWh9bIwUEf7Ktz2z92xAdpstdBaCJfFxBdlDjs-RRoYJtmtUKpjlscLHodDrvmqbYQWg0V1EvcLdS8 Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: e0a74e63775d49dbafd25b2c7257f817 Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ServersTestJSON-1445963553 Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e0a74e63775d49dbafd25b2c7257f817"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0a74e63775d49dbafd25b2c7257f817"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e0a74e63775d49dbafd25b2c7257f817", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0a74e63775d49dbafd25b2c7257f817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ServersTestJSON-1445963553 Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: e0a74e63775d49dbafd25b2c7257f817 Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ServersTestJSON-1445963553 Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ServersTestJSON-1445963553-project Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 65a3e3ac4a994d55a3c87e51b3be024c Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ServersTestJSON-1445963553-project Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance e57b1da6-59e4-408e-b2df-1161fe5a062c could not be found. Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'e57b1da6-59e4-408e-b2df-1161fe5a062c'} Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e57b1da6-59e4-408e-b2df-1161fe5a062c could not be found. Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e57b1da6-59e4-408e-b2df-1161fe5a062c could not be found. Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:51.597237 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:51.605032 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:51.605032 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:51.605032 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:39:51.605032 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:39:51.605032 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e57b1da6-59e4-408e-b2df-1161fe5a062c could not be found. Jun 05 08:39:51.605032 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:51.605032 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6789045f-e13e-4452-bc02-49625397d76b tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] Returning 404 to user: Instance e57b1da6-59e4-408e-b2df-1161fe5a062c could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:39:51.605032 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6789045f-e13e-4452-bc02-49625397d76b tempest-ServersTestJSON-1445963553 tempest-ServersTestJSON-1445963553-project] 10.222.0.33 "GET /compute/v2.1/servers/e57b1da6-59e4-408e-b2df-1161fe5a062c" status: 404 len: 111 microversion: 2.1 time: 0.043508 Jun 05 08:39:51.605032 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1569/3057] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:51 2022] GET /compute/v2.1/servers/e57b1da6-59e4-408e-b2df-1161fe5a062c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:39:55.043866 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0f6dc94e-7bdb-4b8a-9b99-f0e7d83af43b tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] Action: 'create', calling method: .version_select at 0x7f2432d60af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-800275751", "metadata": {"Type": "work"}}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:39:55.915930 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0f6dc94e-7bdb-4b8a-9b99-f0e7d83af43b tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.268595 Jun 05 08:39:55.918168 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1489/3058] 10.222.0.33 () {60 vars in 1155 bytes} [Sun Jun 5 08:39:54 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1273 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 05 08:39:55.930743 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-95c947ec-05c2-4525-b363-46a23232b713 tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] Calling method '.version_select at 0x7f24339dce50>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:56.091553 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-95c947ec-05c2-4525-b363-46a23232b713 tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a05e7a9b-3ad7-4a8d-ac20-f91dd627064a" status: 200 len: 352 microversion: 2.1 time: 0.167466 Jun 05 08:39:56.092541 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1570/3059] 10.222.0.33 () {58 vars in 1244 bytes} [Sun Jun 5 08:39:55 2022] GET /compute/v2.1/os-volumes/a05e7a9b-3ad7-4a8d-ac20-f91dd627064a => generated 352 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:56.285975 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=6 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:39:56.768080 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-68271792-2a3f-4b5e-9f59-9e027c7f2acc tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1463339575", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "4dd72484-88c2-4160-b375-18996aef7a80"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:39:57.111442 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-48db1a6d-d6d1-41e8-a9c5-004eb67450d6 tempest-VolumesNegativeTest-767783987 tempest-VolumesNegativeTest-767783987-project] Action: 'create', calling method: .version_select at 0x7f24337ca5e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1459578965", "metadata": {"Type": "work"}}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-48db1a6d-d6d1-41e8-a9c5-004eb67450d6 tempest-VolumesNegativeTest-767783987 tempest-VolumesNegativeTest-767783987-project] Request method failure captured: Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 122 Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGvcBhG4UGYVAZ1Und13tGxtuvVrZBGARXf6C7o2piqI1q1I7-tQEVHAP-FQ2qOK520Qu6I3UgrP_FdagodGA787ztNu5PJ40n4iid2YDO5d2noqRQX8UmLOVv9NN-XhjeTHRAXIefM3u_RWVEexnGHkf-T9DiiBONfySwpzSI87wh4 Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: a40b81834c72478eb9fbf1ea47fc0637 Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-VolumesNegativeTest-767783987 Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a40b81834c72478eb9fbf1ea47fc0637"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a40b81834c72478eb9fbf1ea47fc0637"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a40b81834c72478eb9fbf1ea47fc0637", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a40b81834c72478eb9fbf1ea47fc0637"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-VolumesNegativeTest-767783987 Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: a40b81834c72478eb9fbf1ea47fc0637 Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-VolumesNegativeTest-767783987 Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-VolumesNegativeTest-767783987-project Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 13069bc5b3154a8bb5ed0c2d85c47553 Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-VolumesNegativeTest-767783987-project Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1459578965", "metadata": {"Type": "work"}}} Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1459578965', 'metadata': {'Type': 'work'}}}} Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise error Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi '#$%' Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 05 08:39:57.119069 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 05 08:39:57.124617 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 05 08:39:57.124617 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.124617 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:57.124617 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.124617 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:57.124617 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:57.124617 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:57.124617 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 05 08:39:57.124617 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 05 08:39:57.124617 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 05 08:39:57.124617 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.126931 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-48db1a6d-d6d1-41e8-a9c5-004eb67450d6 tempest-VolumesNegativeTest-767783987 tempest-VolumesNegativeTest-767783987-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:39:57.131828 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-48db1a6d-d6d1-41e8-a9c5-004eb67450d6 tempest-VolumesNegativeTest-767783987 tempest-VolumesNegativeTest-767783987-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.298422 Jun 05 08:39:57.132952 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1571/3060] 10.222.0.33 () {60 vars in 1155 bytes} [Sun Jun 5 08:39:56 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 304 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 05 08:39:57.142308 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ee562637-a2db-46f7-abd6-08a92cf7b55d tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] Calling method '.version_select at 0x7f243375cf70>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:57.287324 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ee562637-a2db-46f7-abd6-08a92cf7b55d tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a05e7a9b-3ad7-4a8d-ac20-f91dd627064a" status: 200 len: 352 microversion: 2.1 time: 0.152744 Jun 05 08:39:57.287988 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1572/3061] 10.222.0.33 () {58 vars in 1244 bytes} [Sun Jun 5 08:39:57 2022] GET /compute/v2.1/os-volumes/a05e7a9b-3ad7-4a8d-ac20-f91dd627064a => generated 352 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:57.295071 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d17c2875-ce6b-47b5-850f-dbc58b6265e1 tempest-VolumesNegativeTest-767783987 tempest-VolumesNegativeTest-767783987-project] Action: 'create', calling method: .version_select at 0x7f24339a9ca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-256655278", "metadata": {"Type": "work"}}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d17c2875-ce6b-47b5-850f-dbc58b6265e1 tempest-VolumesNegativeTest-767783987 tempest-VolumesNegativeTest-767783987-project] Request method failure captured: Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 119 Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGvcBhG4UGYVAZ1Und13tGxtuvVrZBGARXf6C7o2piqI1q1I7-tQEVHAP-FQ2qOK520Qu6I3UgrP_FdagodGA787ztNu5PJ40n4iid2YDO5d2noqRQX8UmLOVv9NN-XhjeTHRAXIefM3u_RWVEexnGHkf-T9DiiBONfySwpzSI87wh4 Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: a40b81834c72478eb9fbf1ea47fc0637 Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-VolumesNegativeTest-767783987 Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a40b81834c72478eb9fbf1ea47fc0637"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a40b81834c72478eb9fbf1ea47fc0637"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a40b81834c72478eb9fbf1ea47fc0637", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a40b81834c72478eb9fbf1ea47fc0637"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-VolumesNegativeTest-767783987 Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: a40b81834c72478eb9fbf1ea47fc0637 Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-VolumesNegativeTest-767783987 Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-VolumesNegativeTest-767783987-project Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 13069bc5b3154a8bb5ed0c2d85c47553 Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-VolumesNegativeTest-767783987-project Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-256655278", "metadata": {"Type": "work"}}} Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-256655278', 'metadata': {'Type': 'work'}}}} Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise error Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi '0' Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 05 08:39:57.306359 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 05 08:39:57.311093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 05 08:39:57.311093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.311093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:57.311093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.311093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:57.311093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:57.311093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:57.311093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 05 08:39:57.311093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 05 08:39:57.311093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 05 08:39:57.311093 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.311093 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d17c2875-ce6b-47b5-850f-dbc58b6265e1 tempest-VolumesNegativeTest-767783987 tempest-VolumesNegativeTest-767783987-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:39:57.315441 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d17c2875-ce6b-47b5-850f-dbc58b6265e1 tempest-VolumesNegativeTest-767783987 tempest-VolumesNegativeTest-767783987-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.024302 Jun 05 08:39:57.320551 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1573/3062] 10.222.0.33 () {60 vars in 1155 bytes} [Sun Jun 5 08:39:57 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 05 08:39:57.338365 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e1e5fef2-03d2-4454-902f-55ca0bfba5ff tempest-VolumesNegativeTest-767783987 tempest-VolumesNegativeTest-767783987-project] Action: 'create', calling method: .version_select at 0x7f2433699820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-669229461", "metadata": {"Type": "work"}}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e1e5fef2-03d2-4454-902f-55ca0bfba5ff tempest-VolumesNegativeTest-767783987 tempest-VolumesNegativeTest-767783987-project] Request method failure captured: Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 118 Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGvcBhG4UGYVAZ1Und13tGxtuvVrZBGARXf6C7o2piqI1q1I7-tQEVHAP-FQ2qOK520Qu6I3UgrP_FdagodGA787ztNu5PJ40n4iid2YDO5d2noqRQX8UmLOVv9NN-XhjeTHRAXIefM3u_RWVEexnGHkf-T9DiiBONfySwpzSI87wh4 Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: a40b81834c72478eb9fbf1ea47fc0637 Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-VolumesNegativeTest-767783987 Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a40b81834c72478eb9fbf1ea47fc0637"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a40b81834c72478eb9fbf1ea47fc0637"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a40b81834c72478eb9fbf1ea47fc0637", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a40b81834c72478eb9fbf1ea47fc0637"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-VolumesNegativeTest-767783987 Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: a40b81834c72478eb9fbf1ea47fc0637 Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-VolumesNegativeTest-767783987 Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-VolumesNegativeTest-767783987-project Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 13069bc5b3154a8bb5ed0c2d85c47553 Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-VolumesNegativeTest-767783987-project Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-669229461", "metadata": {"Type": "work"}}} Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-669229461', 'metadata': {'Type': 'work'}}}} Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise error Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi '' Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 05 08:39:57.351542 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 05 08:39:57.356148 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 05 08:39:57.356148 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.356148 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:57.356148 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.356148 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:57.356148 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:57.356148 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:57.356148 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 05 08:39:57.356148 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 05 08:39:57.356148 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 05 08:39:57.356148 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.356148 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e1e5fef2-03d2-4454-902f-55ca0bfba5ff tempest-VolumesNegativeTest-767783987 tempest-VolumesNegativeTest-767783987-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:39:57.357892 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e1e5fef2-03d2-4454-902f-55ca0bfba5ff tempest-VolumesNegativeTest-767783987 tempest-VolumesNegativeTest-767783987-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.033995 Jun 05 08:39:57.360906 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1574/3063] 10.222.0.33 () {60 vars in 1155 bytes} [Sun Jun 5 08:39:57 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 05 08:39:57.380740 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2237d7cc-b527-46d2-9e89-1e786f29e206 tempest-VolumesNegativeTest-767783987 tempest-VolumesNegativeTest-767783987-project] Calling method '.version_select at 0x7f243396dca0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:57.468953 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-2237d7cc-b527-46d2-9e89-1e786f29e206 tempest-VolumesNegativeTest-767783987 tempest-VolumesNegativeTest-767783987-project] HTTP exception thrown: Volume tempest-invalid-251263703 could not be found. Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2237d7cc-b527-46d2-9e89-1e786f29e206 tempest-VolumesNegativeTest-767783987 tempest-VolumesNegativeTest-767783987-project] Request method failure captured: Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-251263703 HTTP/1.1 Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGvcBhG4UGYVAZ1Und13tGxtuvVrZBGARXf6C7o2piqI1q1I7-tQEVHAP-FQ2qOK520Qu6I3UgrP_FdagodGA787ztNu5PJ40n4iid2YDO5d2noqRQX8UmLOVv9NN-XhjeTHRAXIefM3u_RWVEexnGHkf-T9DiiBONfySwpzSI87wh4 Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: a40b81834c72478eb9fbf1ea47fc0637 Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-VolumesNegativeTest-767783987 Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a40b81834c72478eb9fbf1ea47fc0637"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a40b81834c72478eb9fbf1ea47fc0637"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a40b81834c72478eb9fbf1ea47fc0637", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a40b81834c72478eb9fbf1ea47fc0637"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-VolumesNegativeTest-767783987 Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: a40b81834c72478eb9fbf1ea47fc0637 Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-VolumesNegativeTest-767783987 Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-VolumesNegativeTest-767783987-project Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 13069bc5b3154a8bb5ed0c2d85c47553 Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-VolumesNegativeTest-767783987-project Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: exception: Volume tempest-invalid-251263703 could not be found. Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'tempest-invalid-251263703'} Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-251263703 could not be found. (HTTP 404) (Request-ID: req-1d4e14d1-9961-4338-9523-9419fadd79f8) Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 05 08:39:57.472008 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-251263703 could not be found. Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-251263703 could not be found. Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-251263703 could not be found. Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2237d7cc-b527-46d2-9e89-1e786f29e206 tempest-VolumesNegativeTest-767783987 tempest-VolumesNegativeTest-767783987-project] Returning 404 to user: Volume tempest-invalid-251263703 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:39:57.477131 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2237d7cc-b527-46d2-9e89-1e786f29e206 tempest-VolumesNegativeTest-767783987 tempest-VolumesNegativeTest-767783987-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-251263703" status: 404 len: 98 microversion: 2.1 time: 0.106675 Jun 05 08:39:57.485679 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1575/3064] 10.222.0.33 () {58 vars in 1214 bytes} [Sun Jun 5 08:39:57 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-251263703 => generated 98 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 05 08:39:57.488306 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a7ff3c58-f76b-4c01-9115-c86abedcc2c5 tempest-VolumesNegativeTest-767783987 tempest-VolumesNegativeTest-767783987-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007564 Jun 05 08:39:57.496324 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1576/3065] 10.222.0.33 () {58 vars in 1139 bytes} [Sun Jun 5 08:39:57 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 05 08:39:57.526303 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c173f386-a189-4a55-96a3-0dd65148b25a tempest-VolumesNegativeTest-767783987 tempest-VolumesNegativeTest-767783987-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.019914 Jun 05 08:39:57.526969 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-68271792-2a3f-4b5e-9f59-9e027c7f2acc tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] validate_networks() for [('4dd72484-88c2-4160-b375-18996aef7a80', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:39:57.533003 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1577/3066] 10.222.0.33 () {58 vars in 1136 bytes} [Sun Jun 5 08:39:57 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 05 08:39:57.540236 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8dc36d60-f896-464f-912e-6f1768749c43 tempest-VolumesNegativeTest-767783987 tempest-VolumesNegativeTest-767783987-project] Calling method '.version_select at 0x7f2433699790>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:57.594318 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-8dc36d60-f896-464f-912e-6f1768749c43 tempest-VolumesNegativeTest-767783987 tempest-VolumesNegativeTest-767783987-project] HTTP exception thrown: Volume 90a54d27-dffe-4da4-ad12-4dfa79e60b5b could not be found. Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8dc36d60-f896-464f-912e-6f1768749c43 tempest-VolumesNegativeTest-767783987 tempest-VolumesNegativeTest-767783987-project] Request method failure captured: Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: request: DELETE /compute/v2.1/os-volumes/90a54d27-dffe-4da4-ad12-4dfa79e60b5b HTTP/1.1 Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGvcBhG4UGYVAZ1Und13tGxtuvVrZBGARXf6C7o2piqI1q1I7-tQEVHAP-FQ2qOK520Qu6I3UgrP_FdagodGA787ztNu5PJ40n4iid2YDO5d2noqRQX8UmLOVv9NN-XhjeTHRAXIefM3u_RWVEexnGHkf-T9DiiBONfySwpzSI87wh4 Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: a40b81834c72478eb9fbf1ea47fc0637 Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-VolumesNegativeTest-767783987 Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a40b81834c72478eb9fbf1ea47fc0637"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a40b81834c72478eb9fbf1ea47fc0637"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a40b81834c72478eb9fbf1ea47fc0637", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a40b81834c72478eb9fbf1ea47fc0637"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-VolumesNegativeTest-767783987 Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: a40b81834c72478eb9fbf1ea47fc0637 Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-VolumesNegativeTest-767783987 Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-VolumesNegativeTest-767783987-project Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 13069bc5b3154a8bb5ed0c2d85c47553 Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-VolumesNegativeTest-767783987-project Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: exception: Volume 90a54d27-dffe-4da4-ad12-4dfa79e60b5b could not be found. Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '90a54d27-dffe-4da4-ad12-4dfa79e60b5b'} Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 90a54d27-dffe-4da4-ad12-4dfa79e60b5b could not be found. (HTTP 404) (Request-ID: req-227fda54-7ab6-481b-a36b-a0e45c36efc1) Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 05 08:39:57.596931 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 90a54d27-dffe-4da4-ad12-4dfa79e60b5b could not be found. Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 90a54d27-dffe-4da4-ad12-4dfa79e60b5b could not be found. Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 90a54d27-dffe-4da4-ad12-4dfa79e60b5b could not be found. Jun 05 08:39:57.603463 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.609087 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8dc36d60-f896-464f-912e-6f1768749c43 tempest-VolumesNegativeTest-767783987 tempest-VolumesNegativeTest-767783987-project] Returning 404 to user: Volume 90a54d27-dffe-4da4-ad12-4dfa79e60b5b could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:39:57.609890 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8dc36d60-f896-464f-912e-6f1768749c43 tempest-VolumesNegativeTest-767783987 tempest-VolumesNegativeTest-767783987-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/90a54d27-dffe-4da4-ad12-4dfa79e60b5b" status: 404 len: 109 microversion: 2.1 time: 0.075337 Jun 05 08:39:57.616225 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1578/3067] 10.222.0.33 () {58 vars in 1247 bytes} [Sun Jun 5 08:39:57 2022] DELETE /compute/v2.1/os-volumes/90a54d27-dffe-4da4-ad12-4dfa79e60b5b => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:39:57.622264 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f24e1896-fdf9-429e-b206-3baaab5c9cdd tempest-VolumesNegativeTest-767783987 tempest-VolumesNegativeTest-767783987-project] Calling method '.version_select at 0x7f2433873e50>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:57.663990 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-f24e1896-fdf9-429e-b206-3baaab5c9cdd tempest-VolumesNegativeTest-767783987 tempest-VolumesNegativeTest-767783987-project] HTTP exception thrown: Volume 49cac370-b91d-4e4c-ac5a-cde917fe1c93 could not be found. Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f24e1896-fdf9-429e-b206-3baaab5c9cdd tempest-VolumesNegativeTest-767783987 tempest-VolumesNegativeTest-767783987-project] Request method failure captured: Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-volumes/49cac370-b91d-4e4c-ac5a-cde917fe1c93 HTTP/1.1 Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGvcBhG4UGYVAZ1Und13tGxtuvVrZBGARXf6C7o2piqI1q1I7-tQEVHAP-FQ2qOK520Qu6I3UgrP_FdagodGA787ztNu5PJ40n4iid2YDO5d2noqRQX8UmLOVv9NN-XhjeTHRAXIefM3u_RWVEexnGHkf-T9DiiBONfySwpzSI87wh4 Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: a40b81834c72478eb9fbf1ea47fc0637 Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-VolumesNegativeTest-767783987 Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a40b81834c72478eb9fbf1ea47fc0637"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a40b81834c72478eb9fbf1ea47fc0637"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a40b81834c72478eb9fbf1ea47fc0637", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a40b81834c72478eb9fbf1ea47fc0637"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-VolumesNegativeTest-767783987 Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: a40b81834c72478eb9fbf1ea47fc0637 Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-VolumesNegativeTest-767783987 Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-VolumesNegativeTest-767783987-project Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 13069bc5b3154a8bb5ed0c2d85c47553 Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-VolumesNegativeTest-767783987-project Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: exception: Volume 49cac370-b91d-4e4c-ac5a-cde917fe1c93 could not be found. Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '49cac370-b91d-4e4c-ac5a-cde917fe1c93'} Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 49cac370-b91d-4e4c-ac5a-cde917fe1c93 could not be found. (HTTP 404) (Request-ID: req-5b3611bd-3c1a-4291-bd63-245facee19a5) Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 05 08:39:57.669484 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 49cac370-b91d-4e4c-ac5a-cde917fe1c93 could not be found. Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 49cac370-b91d-4e4c-ac5a-cde917fe1c93 could not be found. Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 49cac370-b91d-4e4c-ac5a-cde917fe1c93 could not be found. Jun 05 08:39:57.675423 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:39:57.681765 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f24e1896-fdf9-429e-b206-3baaab5c9cdd tempest-VolumesNegativeTest-767783987 tempest-VolumesNegativeTest-767783987-project] Returning 404 to user: Volume 49cac370-b91d-4e4c-ac5a-cde917fe1c93 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:39:57.681765 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f24e1896-fdf9-429e-b206-3baaab5c9cdd tempest-VolumesNegativeTest-767783987 tempest-VolumesNegativeTest-767783987-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/49cac370-b91d-4e4c-ac5a-cde917fe1c93" status: 404 len: 109 microversion: 2.1 time: 0.064209 Jun 05 08:39:57.690339 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1579/3068] 10.222.0.33 () {58 vars in 1244 bytes} [Sun Jun 5 08:39:57 2022] GET /compute/v2.1/os-volumes/49cac370-b91d-4e4c-ac5a-cde917fe1c93 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:39:58.300196 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f07ba117-0a04-41fb-80cb-f3c8122ef9f9 tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] Calling method '.version_select at 0x7f24339dc8b0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:58.429292 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f07ba117-0a04-41fb-80cb-f3c8122ef9f9 tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a05e7a9b-3ad7-4a8d-ac20-f91dd627064a" status: 200 len: 352 microversion: 2.1 time: 0.133705 Jun 05 08:39:58.430970 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1580/3069] 10.222.0.33 () {58 vars in 1244 bytes} [Sun Jun 5 08:39:58 2022] GET /compute/v2.1/os-volumes/a05e7a9b-3ad7-4a8d-ac20-f91dd627064a => generated 352 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:39:58.750263 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-68271792-2a3f-4b5e-9f59-9e027c7f2acc tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:39:58.750834 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-68271792-2a3f-4b5e-9f59-9e027c7f2acc tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:39:58.751524 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-68271792-2a3f-4b5e-9f59-9e027c7f2acc tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:39:58.752207 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-68271792-2a3f-4b5e-9f59-9e027c7f2acc tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:39:58.752980 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-68271792-2a3f-4b5e-9f59-9e027c7f2acc tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:39:58.767804 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-68271792-2a3f-4b5e-9f59-9e027c7f2acc tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:58.772539 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-68271792-2a3f-4b5e-9f59-9e027c7f2acc tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:58.773768 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-68271792-2a3f-4b5e-9f59-9e027c7f2acc tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:39:58.774624 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-68271792-2a3f-4b5e-9f59-9e027c7f2acc tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:39:58.824419 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-68271792-2a3f-4b5e-9f59-9e027c7f2acc tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Getting quotas for project 32041deb887a4e61986ca40263b87f95. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:39:58.843325 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-68271792-2a3f-4b5e-9f59-9e027c7f2acc tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Getting quotas for user 88a10688ac4243d6aa10b13ef77dc890 and project 32041deb887a4e61986ca40263b87f95. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:39:58.871755 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-68271792-2a3f-4b5e-9f59-9e027c7f2acc tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:39:58.877848 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-68271792-2a3f-4b5e-9f59-9e027c7f2acc tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] [instance: 8a0d1601-ec33-4cd2-945d-143ef2f7800b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:39:58.991556 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-68271792-2a3f-4b5e-9f59-9e027c7f2acc tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.710130 Jun 05 08:39:58.992548 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1490/3070] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:39:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:39:59.005873 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-45edf5e5-8f49-4a40-926d-615bd6b340d0 tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:59.006690 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-45edf5e5-8f49-4a40-926d-615bd6b340d0 tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] [instance: 8a0d1601-ec33-4cd2-945d-143ef2f7800b] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:39:59.191907 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:39:59.227609 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-45edf5e5-8f49-4a40-926d-615bd6b340d0 tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a10688ac4243d6aa10b13ef77dc890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32041deb887a4e61986ca40263b87f95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:39:59.241205 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-45edf5e5-8f49-4a40-926d-615bd6b340d0 tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] 10.222.0.33 "GET /compute/v2.1/servers/8a0d1601-ec33-4cd2-945d-143ef2f7800b" status: 200 len: 1228 microversion: 2.1 time: 0.241079 Jun 05 08:39:59.243534 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1581/3071] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:39:58 2022] GET /compute/v2.1/servers/8a0d1601-ec33-4cd2-945d-143ef2f7800b => generated 1228 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:39:59.445814 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-49b9b710-6d42-4fb0-bc87-2e920302a26d tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] Calling method '.version_select at 0x7f2432d60790>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:59.537704 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-49b9b710-6d42-4fb0-bc87-2e920302a26d tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a05e7a9b-3ad7-4a8d-ac20-f91dd627064a" status: 200 len: 353 microversion: 2.1 time: 0.096418 Jun 05 08:39:59.544214 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1491/3072] 10.222.0.33 () {58 vars in 1244 bytes} [Sun Jun 5 08:39:59 2022] GET /compute/v2.1/os-volumes/a05e7a9b-3ad7-4a8d-ac20-f91dd627064a => generated 353 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:59.550792 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9a2fa48b-889e-4461-9d8a-37f439ba2c05 tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] Calling method '.version_select at 0x7f2433716790>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:59.644790 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9a2fa48b-889e-4461-9d8a-37f439ba2c05 tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a05e7a9b-3ad7-4a8d-ac20-f91dd627064a" status: 200 len: 353 microversion: 2.1 time: 0.098941 Jun 05 08:39:59.647170 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1582/3073] 10.222.0.33 () {58 vars in 1244 bytes} [Sun Jun 5 08:39:59 2022] GET /compute/v2.1/os-volumes/a05e7a9b-3ad7-4a8d-ac20-f91dd627064a => generated 353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:39:59.668515 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8457dfc6-901d-46ff-8d75-7d966b1cd424 tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] Calling method '.version_select at 0x7f2432d608b0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:59.844761 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8457dfc6-901d-46ff-8d75-7d966b1cd424 tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/a05e7a9b-3ad7-4a8d-ac20-f91dd627064a" status: 202 len: 0 microversion: 2.1 time: 0.189159 Jun 05 08:39:59.845994 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1492/3074] 10.222.0.33 () {58 vars in 1247 bytes} [Sun Jun 5 08:39:59 2022] DELETE /compute/v2.1/os-volumes/a05e7a9b-3ad7-4a8d-ac20-f91dd627064a => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:39:59.855562 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7d6a3c9c-74d2-4746-9eea-b3a25e48a181 tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] Calling method '.version_select at 0x7f2433aeb280>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:39:59.962815 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7d6a3c9c-74d2-4746-9eea-b3a25e48a181 tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a05e7a9b-3ad7-4a8d-ac20-f91dd627064a" status: 200 len: 352 microversion: 2.1 time: 0.111964 Jun 05 08:39:59.968542 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1583/3075] 10.222.0.33 () {58 vars in 1244 bytes} [Sun Jun 5 08:39:59 2022] GET /compute/v2.1/os-volumes/a05e7a9b-3ad7-4a8d-ac20-f91dd627064a => generated 352 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:40:00.260402 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4da9a93b-6526-404e-b6ba-8c0d795f9045 tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:40:00.261319 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4da9a93b-6526-404e-b6ba-8c0d795f9045 tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] [instance: 8a0d1601-ec33-4cd2-945d-143ef2f7800b] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:40:00.275114 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4da9a93b-6526-404e-b6ba-8c0d795f9045 tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:40:00.276499 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4da9a93b-6526-404e-b6ba-8c0d795f9045 tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:40:00.278468 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4da9a93b-6526-404e-b6ba-8c0d795f9045 tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:40:00.279398 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4da9a93b-6526-404e-b6ba-8c0d795f9045 tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:40:00.354845 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4da9a93b-6526-404e-b6ba-8c0d795f9045 tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:40:00.355207 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4da9a93b-6526-404e-b6ba-8c0d795f9045 tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:40:00.366337 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-4da9a93b-6526-404e-b6ba-8c0d795f9045 tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Lazy-loading 'fault' on Instance uuid 8a0d1601-ec33-4cd2-945d-143ef2f7800b {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:40:00.370412 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:DELETE=6,nova_cell0:SELECT=60,nova_cell0:UPDATE=30,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:40:00.458975 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4da9a93b-6526-404e-b6ba-8c0d795f9045 tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a10688ac4243d6aa10b13ef77dc890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32041deb887a4e61986ca40263b87f95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:40:00.472458 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4da9a93b-6526-404e-b6ba-8c0d795f9045 tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] 10.222.0.33 "GET /compute/v2.1/servers/8a0d1601-ec33-4cd2-945d-143ef2f7800b" status: 200 len: 1301 microversion: 2.1 time: 0.217479 Jun 05 08:40:00.473667 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1493/3076] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:40:00 2022] GET /compute/v2.1/servers/8a0d1601-ec33-4cd2-945d-143ef2f7800b => generated 1301 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:40:00.490951 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-68f5eaa7-b526-4993-8f94-7f27520325c6 tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:40:00.492172 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-68f5eaa7-b526-4993-8f94-7f27520325c6 tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] [instance: 8a0d1601-ec33-4cd2-945d-143ef2f7800b] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:40:00.503025 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-68f5eaa7-b526-4993-8f94-7f27520325c6 tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:40:00.505780 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-68f5eaa7-b526-4993-8f94-7f27520325c6 tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:40:00.509139 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-68f5eaa7-b526-4993-8f94-7f27520325c6 tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:40:00.509833 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-68f5eaa7-b526-4993-8f94-7f27520325c6 tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:40:00.586542 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-68f5eaa7-b526-4993-8f94-7f27520325c6 tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] [instance: 8a0d1601-ec33-4cd2-945d-143ef2f7800b] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:40:00.725718 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-68f5eaa7-b526-4993-8f94-7f27520325c6 tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] [instance: 8a0d1601-ec33-4cd2-945d-143ef2f7800b] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:40:00.727030 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-68f5eaa7-b526-4993-8f94-7f27520325c6 tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:40:00.729095 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-68f5eaa7-b526-4993-8f94-7f27520325c6 tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:40:00.729829 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-68f5eaa7-b526-4993-8f94-7f27520325c6 tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] [instance: 8a0d1601-ec33-4cd2-945d-143ef2f7800b] instance's host None is down, deleting from database Jun 05 08:40:00.738418 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-68f5eaa7-b526-4993-8f94-7f27520325c6 tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] [instance: 8a0d1601-ec33-4cd2-945d-143ef2f7800b] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:40:00.834250 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-68f5eaa7-b526-4993-8f94-7f27520325c6 tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] [instance: 8a0d1601-ec33-4cd2-945d-143ef2f7800b] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:40:00.844577 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-68f5eaa7-b526-4993-8f94-7f27520325c6 tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] [instance: 8a0d1601-ec33-4cd2-945d-143ef2f7800b] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:40:00.979445 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5e62a81f-2cbc-40b8-9232-9d2dd96afc08 tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] Calling method '.version_select at 0x7f2432e7b550>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:40:01.076648 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5e62a81f-2cbc-40b8-9232-9d2dd96afc08 tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a05e7a9b-3ad7-4a8d-ac20-f91dd627064a" status: 200 len: 352 microversion: 2.1 time: 0.104024 Jun 05 08:40:01.082887 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1494/3077] 10.222.0.33 () {58 vars in 1244 bytes} [Sun Jun 5 08:40:00 2022] GET /compute/v2.1/os-volumes/a05e7a9b-3ad7-4a8d-ac20-f91dd627064a => generated 352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 08:40:01.166865 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-68f5eaa7-b526-4993-8f94-7f27520325c6 tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8a0d1601-ec33-4cd2-945d-143ef2f7800b" status: 204 len: 0 microversion: 2.1 time: 0.680808 Jun 05 08:40:01.169343 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1584/3078] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:40:00 2022] DELETE /compute/v2.1/servers/8a0d1601-ec33-4cd2-945d-143ef2f7800b => generated 0 bytes in 684 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:40:01.178435 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4ce1f425-acba-46b2-866d-7236a42644bd tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:40:01.179592 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4ce1f425-acba-46b2-866d-7236a42644bd tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] [instance: 8a0d1601-ec33-4cd2-945d-143ef2f7800b] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:40:01.194824 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4ce1f425-acba-46b2-866d-7236a42644bd tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:40:01.195559 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4ce1f425-acba-46b2-866d-7236a42644bd tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:40:01.197767 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4ce1f425-acba-46b2-866d-7236a42644bd tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:40:01.200285 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4ce1f425-acba-46b2-866d-7236a42644bd tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:40:01.226258 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-4ce1f425-acba-46b2-866d-7236a42644bd tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] HTTP exception thrown: Instance 8a0d1601-ec33-4cd2-945d-143ef2f7800b could not be found. Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4ce1f425-acba-46b2-866d-7236a42644bd tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Request method failure captured: Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/8a0d1601-ec33-4cd2-945d-143ef2f7800b HTTP/1.1 Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGvXrAZzJifLYVFMGVNx2obQfFVeVeQ77sU1kJa8gMBUvGAtMdqbFjO_bjDFdDkNN3x5jPMuHPxBIS2-Bj0LRwBTM43gnQIORcQe1wriPZxrEd2QhmcCzTOQwsJr3t6PrTOj6VKhQ2LiFKzEdlqvXjMQZpFIleGiX5Q2qc_oe81dbHI Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 32041deb887a4e61986ca40263b87f95 Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1743097698 Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/32041deb887a4e61986ca40263b87f95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/32041deb887a4e61986ca40263b87f95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_32041deb887a4e61986ca40263b87f95", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/32041deb887a4e61986ca40263b87f95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1743097698 Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 32041deb887a4e61986ca40263b87f95 Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1743097698 Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1743097698-project Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 88a10688ac4243d6aa10b13ef77dc890 Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1743097698-project Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 8a0d1601-ec33-4cd2-945d-143ef2f7800b could not be found. Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '8a0d1601-ec33-4cd2-945d-143ef2f7800b'} Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a0d1601-ec33-4cd2-945d-143ef2f7800b could not be found. Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a0d1601-ec33-4cd2-945d-143ef2f7800b could not be found. Jun 05 08:40:01.228280 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:40:01.233291 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:40:01.233291 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:40:01.233291 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:40:01.233291 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:40:01.233291 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:40:01.233291 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:40:01.233291 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:40:01.233291 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a0d1601-ec33-4cd2-945d-143ef2f7800b could not be found. Jun 05 08:40:01.233291 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:40:01.235176 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4ce1f425-acba-46b2-866d-7236a42644bd tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] Returning 404 to user: Instance 8a0d1601-ec33-4cd2-945d-143ef2f7800b could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:40:01.237580 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4ce1f425-acba-46b2-866d-7236a42644bd tempest-ServersNegativeTestMultiTenantJSON-1743097698 tempest-ServersNegativeTestMultiTenantJSON-1743097698-project] 10.222.0.33 "GET /compute/v2.1/servers/8a0d1601-ec33-4cd2-945d-143ef2f7800b" status: 404 len: 111 microversion: 2.1 time: 0.063246 Jun 05 08:40:01.238695 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1495/3079] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:40:01 2022] GET /compute/v2.1/servers/8a0d1601-ec33-4cd2-945d-143ef2f7800b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 05 08:40:02.090352 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b0cd6543-7269-4509-a77c-fb0e0e51c46e tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] Calling method '.version_select at 0x7f2433a22820>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:40:02.203971 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b0cd6543-7269-4509-a77c-fb0e0e51c46e tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a05e7a9b-3ad7-4a8d-ac20-f91dd627064a" status: 200 len: 352 microversion: 2.1 time: 0.117353 Jun 05 08:40:02.205607 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1585/3080] 10.222.0.33 () {58 vars in 1244 bytes} [Sun Jun 5 08:40:02 2022] GET /compute/v2.1/os-volumes/a05e7a9b-3ad7-4a8d-ac20-f91dd627064a => generated 352 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:40:03.222490 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-22efc63d-40ec-430e-a3b6-a73f0692f530 tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] Calling method '.version_select at 0x7f2432e7b3a0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:40:03.362788 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-22efc63d-40ec-430e-a3b6-a73f0692f530 tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a05e7a9b-3ad7-4a8d-ac20-f91dd627064a" status: 200 len: 352 microversion: 2.1 time: 0.146888 Jun 05 08:40:03.363894 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1496/3081] 10.222.0.33 () {58 vars in 1244 bytes} [Sun Jun 5 08:40:03 2022] GET /compute/v2.1/os-volumes/a05e7a9b-3ad7-4a8d-ac20-f91dd627064a => generated 352 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:40:04.387778 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-38961e3d-23e4-4e2a-ade4-9db00f11cbbd tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] Calling method '.version_select at 0x7f2432e99940>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:40:04.618752 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-38961e3d-23e4-4e2a-ade4-9db00f11cbbd tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a05e7a9b-3ad7-4a8d-ac20-f91dd627064a" status: 200 len: 352 microversion: 2.1 time: 0.247428 Jun 05 08:40:04.638451 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1586/3082] 10.222.0.33 () {58 vars in 1244 bytes} [Sun Jun 5 08:40:04 2022] GET /compute/v2.1/os-volumes/a05e7a9b-3ad7-4a8d-ac20-f91dd627064a => generated 352 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:40:05.648495 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-41389332-1348-41cb-9c93-d7bd4953d246 tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] Calling method '.version_select at 0x7f2432ebef70>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:40:05.825484 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-41389332-1348-41cb-9c93-d7bd4953d246 tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a05e7a9b-3ad7-4a8d-ac20-f91dd627064a" status: 200 len: 352 microversion: 2.1 time: 0.181952 Jun 05 08:40:05.826548 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1497/3083] 10.222.0.33 () {58 vars in 1244 bytes} [Sun Jun 5 08:40:05 2022] GET /compute/v2.1/os-volumes/a05e7a9b-3ad7-4a8d-ac20-f91dd627064a => generated 352 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:40:06.842537 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-211e9160-fce9-4094-9def-ccd74a770d3f tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] Calling method '.version_select at 0x7f24337caf70>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:40:06.913288 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-211e9160-fce9-4094-9def-ccd74a770d3f tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] HTTP exception thrown: Volume a05e7a9b-3ad7-4a8d-ac20-f91dd627064a could not be found. Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-211e9160-fce9-4094-9def-ccd74a770d3f tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] Request method failure captured: Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/os-volumes/a05e7a9b-3ad7-4a8d-ac20-f91dd627064a HTTP/1.1 Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGva7Iz6Ne67M1AKM3yqUwu58nWqJIsJggJrc2i2wdOLYWAoP1f_ceIupLWUNq1Z-kUnEgTUoiQYVW4WvkIKdO3yVIe0dmsX7v1decjjvphELkc4qHzq0WyWZnDtRkRMKUFtW6TDTzsJWmvMW51vlL75B7np3JxdAM2ibUCVRI8KRtc Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 69a25487b67a40a8bfb6062dd1393483 Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-VolumesGetTestJSON-572284130 Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/69a25487b67a40a8bfb6062dd1393483"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/69a25487b67a40a8bfb6062dd1393483"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_69a25487b67a40a8bfb6062dd1393483", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/69a25487b67a40a8bfb6062dd1393483"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-VolumesGetTestJSON-572284130 Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 69a25487b67a40a8bfb6062dd1393483 Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-VolumesGetTestJSON-572284130 Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-VolumesGetTestJSON-572284130-project Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: aa33f1d859ca40de8f610dd4b80f09b5 Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-VolumesGetTestJSON-572284130-project Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: method: Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: exception: Volume a05e7a9b-3ad7-4a8d-ac20-f91dd627064a could not be found. Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'a05e7a9b-3ad7-4a8d-ac20-f91dd627064a'} Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a05e7a9b-3ad7-4a8d-ac20-f91dd627064a could not be found. (HTTP 404) (Request-ID: req-091fd838-402d-4384-9f90-b52a44a286bb) Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 05 08:40:06.919924 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a05e7a9b-3ad7-4a8d-ac20-f91dd627064a could not be found. Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a05e7a9b-3ad7-4a8d-ac20-f91dd627064a could not be found. Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a05e7a9b-3ad7-4a8d-ac20-f91dd627064a could not be found. Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-211e9160-fce9-4094-9def-ccd74a770d3f tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] Returning 404 to user: Volume a05e7a9b-3ad7-4a8d-ac20-f91dd627064a could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-211e9160-fce9-4094-9def-ccd74a770d3f tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a05e7a9b-3ad7-4a8d-ac20-f91dd627064a" status: 404 len: 109 microversion: 2.1 time: 0.087504 Jun 05 08:40:06.928494 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1587/3084] 10.222.0.33 () {58 vars in 1244 bytes} [Sun Jun 5 08:40:06 2022] GET /compute/v2.1/os-volumes/a05e7a9b-3ad7-4a8d-ac20-f91dd627064a => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:40:16.808011 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-41389332-1348-41cb-9c93-d7bd4953d246 tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:40:16.809189 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-41389332-1348-41cb-9c93-d7bd4953d246 tempest-VolumesGetTestJSON-572284130 tempest-VolumesGetTestJSON-572284130-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001566 Jun 05 08:40:16.815721 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1498/3085] 10.222.0.33 () {56 vars in 885 bytes} [Sun Jun 5 08:40:16 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 05 08:40:53.068087 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=10 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:40:53.068908 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:40:53.071669 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=35,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:40:53.408399 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-29daedab-ebaf-44f5-9092-89f3aecc665b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1145144191 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1145144191-project-admin] Calling method '.version_select at 0x7f244029ee50>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:40:53.412371 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:40:53.412371 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:40:53.414995 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-29daedab-ebaf-44f5-9092-89f3aecc665b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1145144191 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1145144191-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:40:53.415815 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-29daedab-ebaf-44f5-9092-89f3aecc665b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1145144191 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1145144191-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:40:53.464178 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-29daedab-ebaf-44f5-9092-89f3aecc665b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1145144191 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1145144191-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:40:53.465010 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-29daedab-ebaf-44f5-9092-89f3aecc665b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1145144191 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1145144191-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:40:53.495182 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-29daedab-ebaf-44f5-9092-89f3aecc665b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1145144191 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1145144191-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:40:53.498315 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-29daedab-ebaf-44f5-9092-89f3aecc665b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1145144191 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1145144191-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:40:53.518756 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-29daedab-ebaf-44f5-9092-89f3aecc665b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1145144191 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1145144191-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.460295 Jun 05 08:40:53.521654 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1588/3086] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:40:53 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:41:50.650968 n-d-844739-1 devstack@n-api.service[119049]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72a16dc1-a618-40fe-bc5c-8f61b915d107] AMQP server on 10.222.0.33:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 05 08:41:50.662188 n-d-844739-1 devstack@n-api.service[119049]: ERROR oslo.messaging._drivers.impl_rabbit [-] [411e268b-965d-4f7a-8b7c-c8ab976cc9eb] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 05 08:41:50.668123 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:41:50.670631 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=7 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:41:50.681164 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=9,nova_api:UPDATE=3 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:41:50.682811 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=4 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:41:50.976762 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a9d2b88d-893b-4a80-9892-4c561d18d125 tempest-PortsAdminExtendedAttrsTestJSON-1644499585 tempest-PortsAdminExtendedAttrsTestJSON-1644499585-project-admin] Calling method '.version_select at 0x7f2432e97790>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:41:50.977708 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:41:50.977708 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:41:50.980909 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a9d2b88d-893b-4a80-9892-4c561d18d125 tempest-PortsAdminExtendedAttrsTestJSON-1644499585 tempest-PortsAdminExtendedAttrsTestJSON-1644499585-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:41:50.981404 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a9d2b88d-893b-4a80-9892-4c561d18d125 tempest-PortsAdminExtendedAttrsTestJSON-1644499585 tempest-PortsAdminExtendedAttrsTestJSON-1644499585-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:41:51.024703 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a9d2b88d-893b-4a80-9892-4c561d18d125 tempest-PortsAdminExtendedAttrsTestJSON-1644499585 tempest-PortsAdminExtendedAttrsTestJSON-1644499585-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:41:51.030462 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a9d2b88d-893b-4a80-9892-4c561d18d125 tempest-PortsAdminExtendedAttrsTestJSON-1644499585 tempest-PortsAdminExtendedAttrsTestJSON-1644499585-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:41:51.074714 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a9d2b88d-893b-4a80-9892-4c561d18d125 tempest-PortsAdminExtendedAttrsTestJSON-1644499585 tempest-PortsAdminExtendedAttrsTestJSON-1644499585-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:41:51.080828 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a9d2b88d-893b-4a80-9892-4c561d18d125 tempest-PortsAdminExtendedAttrsTestJSON-1644499585 tempest-PortsAdminExtendedAttrsTestJSON-1644499585-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:41:51.102402 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a9d2b88d-893b-4a80-9892-4c561d18d125 tempest-PortsAdminExtendedAttrsTestJSON-1644499585 tempest-PortsAdminExtendedAttrsTestJSON-1644499585-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.449256 Jun 05 08:41:51.108295 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1499/3087] 10.222.0.33 () {58 vars in 1145 bytes} [Sun Jun 5 08:41:50 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:42:03.729757 n-d-844739-1 devstack@n-api.service[119050]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 08:42:03.730237 n-d-844739-1 devstack@n-api.service[119050]: Sun Jun 5 08:42:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 08:43:17.406710 n-d-844739-1 devstack@n-api.service[119049]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 08:43:17.409105 n-d-844739-1 devstack@n-api.service[119049]: Sun Jun 5 08:43:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 08:43:17.989831 n-d-844739-1 devstack@n-api.service[119050]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 08:43:17.990459 n-d-844739-1 devstack@n-api.service[119050]: Sun Jun 5 08:43:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 08:43:37.767190 n-d-844739-1 devstack@n-api.service[119049]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 08:43:37.767941 n-d-844739-1 devstack@n-api.service[119049]: Sun Jun 5 08:43:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 08:44:08.209359 n-d-844739-1 devstack@n-api.service[119050]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7e679682-2a57-43a8-8a9d-11590e5228db] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 05 08:44:08.210424 n-d-844739-1 devstack@n-api.service[119050]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3479185a-57d3-411e-b5f9-4f515ddebedd] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 05 08:44:08.210928 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=4 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:44:08.212099 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=6 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:44:08.220823 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a91be26e-30b3-4b86-a28d-24ad798fbf73 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Action: 'create', calling method: .version_select at 0x7f24339dcd30>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1160261205", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9OTlry2D7odpq9D3vJ63W4Ugg9a2P1CdARMXzNgRGGTocmjQLgY91OFp4oL0zFvkZHLqZKaxNI4ZEwNLAGxs7XwppJezR/Vhx8LSV5vM8vXvm1cNrbVh42aH53hWAnPg=="}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:44:08.280481 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-a91be26e-30b3-4b86-a28d-24ad798fbf73 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Getting quotas for project b518f9e635514a49b86bf961db515826. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:44:08.296460 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-a91be26e-30b3-4b86-a28d-24ad798fbf73 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Getting quotas for user 732bbed9298346c8b27cb0ef281ac415 and project b518f9e635514a49b86bf961db515826. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:44:08.423562 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a91be26e-30b3-4b86-a28d-24ad798fbf73 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.217126 Jun 05 08:44:08.426466 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1589/3088] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:44:08 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:44:19.341803 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=4 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:44:19.343006 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=6 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:44:19.348432 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-592c4728-9ee7-4248-9ae1-42080677b0c9 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1204370997", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "7ee91158-e22d-4ae9-92d3-0574fe59e236"}], "key_name": "tempest-TestNetworkBasicOps-1160261205", "security_groups": [{"name": "tempest-secgroup-smoke-1755520609"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:44:19.371624 n-d-844739-1 devstack@n-api.service[119049]: INFO oslo.messaging._drivers.impl_rabbit [-] [72a16dc1-a618-40fe-bc5c-8f61b915d107] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 39512. Jun 05 08:44:19.386548 n-d-844739-1 devstack@n-api.service[119049]: INFO oslo.messaging._drivers.impl_rabbit [-] [411e268b-965d-4f7a-8b7c-c8ab976cc9eb] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 39514. Jun 05 08:44:20.406477 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-592c4728-9ee7-4248-9ae1-42080677b0c9 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] validate_networks() for [('7ee91158-e22d-4ae9-92d3-0574fe59e236', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:44:22.422651 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-592c4728-9ee7-4248-9ae1-42080677b0c9 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:44:22.423897 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-592c4728-9ee7-4248-9ae1-42080677b0c9 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:44:22.424444 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-592c4728-9ee7-4248-9ae1-42080677b0c9 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:44:22.424913 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-592c4728-9ee7-4248-9ae1-42080677b0c9 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:44:22.426589 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-592c4728-9ee7-4248-9ae1-42080677b0c9 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:44:22.450958 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-592c4728-9ee7-4248-9ae1-42080677b0c9 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:44:22.451578 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-592c4728-9ee7-4248-9ae1-42080677b0c9 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:44:22.453068 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-592c4728-9ee7-4248-9ae1-42080677b0c9 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:44:22.453737 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-592c4728-9ee7-4248-9ae1-42080677b0c9 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:44:22.490706 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-592c4728-9ee7-4248-9ae1-42080677b0c9 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Getting quotas for project b518f9e635514a49b86bf961db515826. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:44:22.498223 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-592c4728-9ee7-4248-9ae1-42080677b0c9 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Getting quotas for user 732bbed9298346c8b27cb0ef281ac415 and project b518f9e635514a49b86bf961db515826. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:44:22.519904 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-592c4728-9ee7-4248-9ae1-42080677b0c9 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:44:22.524006 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-592c4728-9ee7-4248-9ae1-42080677b0c9 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] [instance: cc79f812-1ac2-4b52-aab5-de204b852ca2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:44:22.645201 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-592c4728-9ee7-4248-9ae1-42080677b0c9 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.308397 Jun 05 08:44:22.647847 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1500/3089] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:44:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 3314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:44:22.661009 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-381fa895-dd58-4a1b-8ff2-3e84d8094745 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:44:22.663824 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-381fa895-dd58-4a1b-8ff2-3e84d8094745 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] [instance: cc79f812-1ac2-4b52-aab5-de204b852ca2] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:44:22.678555 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=4 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:44:22.681004 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:44:22.770012 n-d-844739-1 devstack@n-api.service[119050]: INFO oslo.messaging._drivers.impl_rabbit [-] [7e679682-2a57-43a8-8a9d-11590e5228db] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 39592. Jun 05 08:44:22.778692 n-d-844739-1 devstack@n-api.service[119050]: INFO oslo.messaging._drivers.impl_rabbit [-] [3479185a-57d3-411e-b5f9-4f515ddebedd] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 39594. Jun 05 08:44:23.684746 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-381fa895-dd58-4a1b-8ff2-3e84d8094745 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732bbed9298346c8b27cb0ef281ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b518f9e635514a49b86bf961db515826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:44:23.698305 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-381fa895-dd58-4a1b-8ff2-3e84d8094745 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] 10.222.0.33 "GET /compute/v2.1/servers/cc79f812-1ac2-4b52-aab5-de204b852ca2" status: 200 len: 1249 microversion: 2.1 time: 1.042684 Jun 05 08:44:23.701179 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1590/3090] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:44:22 2022] GET /compute/v2.1/servers/cc79f812-1ac2-4b52-aab5-de204b852ca2 => generated 1249 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:44:24.718955 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-558a8f8b-3df5-4dca-80ad-fc1c14238daa tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:44:24.720164 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-558a8f8b-3df5-4dca-80ad-fc1c14238daa tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] [instance: cc79f812-1ac2-4b52-aab5-de204b852ca2] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:44:24.741053 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-558a8f8b-3df5-4dca-80ad-fc1c14238daa tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:44:24.741794 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-558a8f8b-3df5-4dca-80ad-fc1c14238daa tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:44:24.742865 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-558a8f8b-3df5-4dca-80ad-fc1c14238daa tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:44:24.743579 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-558a8f8b-3df5-4dca-80ad-fc1c14238daa tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:44:24.810653 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-558a8f8b-3df5-4dca-80ad-fc1c14238daa tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:44:24.811304 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-558a8f8b-3df5-4dca-80ad-fc1c14238daa tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:44:24.811887 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-558a8f8b-3df5-4dca-80ad-fc1c14238daa tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lazy-loading 'fault' on Instance uuid cc79f812-1ac2-4b52-aab5-de204b852ca2 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:44:25.066062 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-558a8f8b-3df5-4dca-80ad-fc1c14238daa tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732bbed9298346c8b27cb0ef281ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b518f9e635514a49b86bf961db515826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:44:25.075943 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-558a8f8b-3df5-4dca-80ad-fc1c14238daa tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] 10.222.0.33 "GET /compute/v2.1/servers/cc79f812-1ac2-4b52-aab5-de204b852ca2" status: 200 len: 1322 microversion: 2.1 time: 0.362845 Jun 05 08:44:25.081133 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1501/3091] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:44:24 2022] GET /compute/v2.1/servers/cc79f812-1ac2-4b52-aab5-de204b852ca2 => generated 1322 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:44:25.103777 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-084a9c4b-ae9a-4365-916e-5ef03304a066 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:44:25.106136 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-084a9c4b-ae9a-4365-916e-5ef03304a066 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] [instance: cc79f812-1ac2-4b52-aab5-de204b852ca2] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:44:25.128700 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-084a9c4b-ae9a-4365-916e-5ef03304a066 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:44:25.130493 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-084a9c4b-ae9a-4365-916e-5ef03304a066 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:44:25.132552 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-084a9c4b-ae9a-4365-916e-5ef03304a066 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:44:25.133714 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-084a9c4b-ae9a-4365-916e-5ef03304a066 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:44:25.204110 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-084a9c4b-ae9a-4365-916e-5ef03304a066 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] [instance: cc79f812-1ac2-4b52-aab5-de204b852ca2] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:44:25.327840 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-084a9c4b-ae9a-4365-916e-5ef03304a066 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] [instance: cc79f812-1ac2-4b52-aab5-de204b852ca2] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:44:25.328848 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-084a9c4b-ae9a-4365-916e-5ef03304a066 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:44:25.329482 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-084a9c4b-ae9a-4365-916e-5ef03304a066 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:44:25.330099 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-084a9c4b-ae9a-4365-916e-5ef03304a066 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] [instance: cc79f812-1ac2-4b52-aab5-de204b852ca2] instance's host None is down, deleting from database Jun 05 08:44:25.358488 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-084a9c4b-ae9a-4365-916e-5ef03304a066 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] [instance: cc79f812-1ac2-4b52-aab5-de204b852ca2] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:44:25.921427 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-084a9c4b-ae9a-4365-916e-5ef03304a066 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] [instance: cc79f812-1ac2-4b52-aab5-de204b852ca2] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:44:25.939356 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-084a9c4b-ae9a-4365-916e-5ef03304a066 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] [instance: cc79f812-1ac2-4b52-aab5-de204b852ca2] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:44:26.858699 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-084a9c4b-ae9a-4365-916e-5ef03304a066 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cc79f812-1ac2-4b52-aab5-de204b852ca2" status: 204 len: 0 microversion: 2.1 time: 1.765900 Jun 05 08:44:26.871155 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-922b4979-d6d4-422a-8023-bc829fcd4310 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:44:26.871939 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-922b4979-d6d4-422a-8023-bc829fcd4310 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] [instance: cc79f812-1ac2-4b52-aab5-de204b852ca2] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:44:26.876144 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1591/3092] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:44:25 2022] DELETE /compute/v2.1/servers/cc79f812-1ac2-4b52-aab5-de204b852ca2 => generated 0 bytes in 1771 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:44:26.887277 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-922b4979-d6d4-422a-8023-bc829fcd4310 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:44:26.887826 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-922b4979-d6d4-422a-8023-bc829fcd4310 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:44:26.888735 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-922b4979-d6d4-422a-8023-bc829fcd4310 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:44:26.890745 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-922b4979-d6d4-422a-8023-bc829fcd4310 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:44:26.922774 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-922b4979-d6d4-422a-8023-bc829fcd4310 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] HTTP exception thrown: Instance cc79f812-1ac2-4b52-aab5-de204b852ca2 could not be found. Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-922b4979-d6d4-422a-8023-bc829fcd4310 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Request method failure captured: Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/cc79f812-1ac2-4b52-aab5-de204b852ca2 HTTP/1.1 Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinGy-oTz2trvOMefgvQUpqNWhdvGHppQfhmxE6-gNOdKUEVYLKE31xbHGjCsVQ6hWUKS8q_lmlpvr-Lf7w4vbjnO3NhpYhkJ27dvhQJ6Dr8_pVhmGDLQL97emidUr1V7mG9lgAYS7520_B3TVpWPJjCK-LdLhD8ZPvux7PlTDTpe4C0w Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: b518f9e635514a49b86bf961db515826 Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-TestNetworkBasicOps-17247121 Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b518f9e635514a49b86bf961db515826"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b518f9e635514a49b86bf961db515826"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b518f9e635514a49b86bf961db515826", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b518f9e635514a49b86bf961db515826"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-TestNetworkBasicOps-17247121 Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: b518f9e635514a49b86bf961db515826 Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-TestNetworkBasicOps-17247121 Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-TestNetworkBasicOps-17247121-project Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 732bbed9298346c8b27cb0ef281ac415 Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-TestNetworkBasicOps-17247121-project Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance cc79f812-1ac2-4b52-aab5-de204b852ca2 could not be found. Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'cc79f812-1ac2-4b52-aab5-de204b852ca2'} Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc79f812-1ac2-4b52-aab5-de204b852ca2 could not be found. Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc79f812-1ac2-4b52-aab5-de204b852ca2 could not be found. Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:44:26.935758 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:44:26.940308 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:44:26.940308 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:44:26.940308 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:44:26.940308 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:44:26.940308 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:44:26.940308 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc79f812-1ac2-4b52-aab5-de204b852ca2 could not be found. Jun 05 08:44:26.940308 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:44:26.943488 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-922b4979-d6d4-422a-8023-bc829fcd4310 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Returning 404 to user: Instance cc79f812-1ac2-4b52-aab5-de204b852ca2 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:44:26.947198 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-922b4979-d6d4-422a-8023-bc829fcd4310 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] 10.222.0.33 "GET /compute/v2.1/servers/cc79f812-1ac2-4b52-aab5-de204b852ca2" status: 404 len: 111 microversion: 2.1 time: 0.080647 Jun 05 08:44:26.952253 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1502/3093] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:44:26 2022] GET /compute/v2.1/servers/cc79f812-1ac2-4b52-aab5-de204b852ca2 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:44:27.818749 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-caf3ced8-d7f6-4b61-9e98-6f970c4b4186 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Calling method '.version_select at 0x7f2433ad6dc0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:44:27.875254 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-caf3ced8-d7f6-4b61-9e98-6f970c4b4186 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1160261205" status: 202 len: 0 microversion: 2.1 time: 0.061694 Jun 05 08:44:27.876668 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1592/3094] 10.222.0.33 () {58 vars in 1256 bytes} [Sun Jun 5 08:44:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1160261205 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:44:57.413945 n-d-844739-1 devstack@n-api.service[119049]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 08:44:57.414659 n-d-844739-1 devstack@n-api.service[119049]: Sun Jun 5 08:44:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 08:44:58.050710 n-d-844739-1 devstack@n-api.service[119050]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 08:44:58.051349 n-d-844739-1 devstack@n-api.service[119050]: Sun Jun 5 08:44:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 08:45:10.015496 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-181176e2-a0c5-4831-9a3a-6a822358df42 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Action: 'create', calling method: .version_select at 0x7f2432ee2550>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1051572934", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZVvAORX970d7Fubplunlb47/03PEbGCid0hew82xKvcq7YeqJeFmqAFV3Bpp5uDeNySmGybvwn+h8zXL82lHltoweAZP0Hb3+b2Jjsh24n91AxlDcc/QMsxWO8dG+DfA=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:45:10.034781 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:45:10.039462 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=6 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:45:10.046701 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:45:10.058294 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=12 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:45:10.106733 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-181176e2-a0c5-4831-9a3a-6a822358df42 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Getting quotas for project b518f9e635514a49b86bf961db515826. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:45:10.124693 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-181176e2-a0c5-4831-9a3a-6a822358df42 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Getting quotas for user 732bbed9298346c8b27cb0ef281ac415 and project b518f9e635514a49b86bf961db515826. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:45:10.197927 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-181176e2-a0c5-4831-9a3a-6a822358df42 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.186104 Jun 05 08:45:10.199118 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1503/3095] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:45:10 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:45:16.359073 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:45:16.366152 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:45:16.367366 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:45:16.381956 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a6ad6bdd-affd-45ae-8d95-462ab722f9d2 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1346089931", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "651f68c1-56a4-4382-9ecf-92454f6cca84"}], "key_name": "tempest-TestNetworkBasicOps-1051572934", "security_groups": [{"name": "tempest-secgroup-smoke-980098893"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:45:16.978304 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-a6ad6bdd-affd-45ae-8d95-462ab722f9d2 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] validate_networks() for [('651f68c1-56a4-4382-9ecf-92454f6cca84', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:45:18.842665 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-a6ad6bdd-affd-45ae-8d95-462ab722f9d2 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:45:18.843226 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-a6ad6bdd-affd-45ae-8d95-462ab722f9d2 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:45:18.843564 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-a6ad6bdd-affd-45ae-8d95-462ab722f9d2 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:45:18.843974 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-a6ad6bdd-affd-45ae-8d95-462ab722f9d2 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:45:18.845292 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-a6ad6bdd-affd-45ae-8d95-462ab722f9d2 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:45:18.874303 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a6ad6bdd-affd-45ae-8d95-462ab722f9d2 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:45:18.878654 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a6ad6bdd-affd-45ae-8d95-462ab722f9d2 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:45:18.879532 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a6ad6bdd-affd-45ae-8d95-462ab722f9d2 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:45:18.879986 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a6ad6bdd-affd-45ae-8d95-462ab722f9d2 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:45:18.939109 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-a6ad6bdd-affd-45ae-8d95-462ab722f9d2 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Getting quotas for project b518f9e635514a49b86bf961db515826. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:45:18.948849 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-a6ad6bdd-affd-45ae-8d95-462ab722f9d2 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Getting quotas for user 732bbed9298346c8b27cb0ef281ac415 and project b518f9e635514a49b86bf961db515826. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:45:18.967055 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a6ad6bdd-affd-45ae-8d95-462ab722f9d2 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:45:18.971263 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a6ad6bdd-affd-45ae-8d95-462ab722f9d2 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] [instance: 092e554b-36d0-40a7-9ff5-4445553b3453] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:45:19.072225 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a6ad6bdd-affd-45ae-8d95-462ab722f9d2 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.713790 Jun 05 08:45:19.085362 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1593/3096] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:45:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 2728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:45:19.096300 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c17decf5-e7b8-43a3-86f5-6b466531dd81 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:45:19.097634 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c17decf5-e7b8-43a3-86f5-6b466531dd81 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] [instance: 092e554b-36d0-40a7-9ff5-4445553b3453] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:45:19.307040 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c17decf5-e7b8-43a3-86f5-6b466531dd81 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732bbed9298346c8b27cb0ef281ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b518f9e635514a49b86bf961db515826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:45:19.329125 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c17decf5-e7b8-43a3-86f5-6b466531dd81 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] 10.222.0.33 "GET /compute/v2.1/servers/092e554b-36d0-40a7-9ff5-4445553b3453" status: 200 len: 1249 microversion: 2.1 time: 0.238122 Jun 05 08:45:19.329706 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1504/3097] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:45:19 2022] GET /compute/v2.1/servers/092e554b-36d0-40a7-9ff5-4445553b3453 => generated 1249 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:45:20.349223 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-94f937ed-c35d-4701-acd7-e31e0885dc44 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:45:20.349851 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-94f937ed-c35d-4701-acd7-e31e0885dc44 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] [instance: 092e554b-36d0-40a7-9ff5-4445553b3453] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:45:20.366864 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-94f937ed-c35d-4701-acd7-e31e0885dc44 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:45:20.367331 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-94f937ed-c35d-4701-acd7-e31e0885dc44 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:45:20.382126 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-94f937ed-c35d-4701-acd7-e31e0885dc44 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:45:20.382539 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-94f937ed-c35d-4701-acd7-e31e0885dc44 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:45:20.512329 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-94f937ed-c35d-4701-acd7-e31e0885dc44 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:45:20.516299 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-94f937ed-c35d-4701-acd7-e31e0885dc44 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:45:20.518485 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-94f937ed-c35d-4701-acd7-e31e0885dc44 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lazy-loading 'fault' on Instance uuid 092e554b-36d0-40a7-9ff5-4445553b3453 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:45:20.790478 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-94f937ed-c35d-4701-acd7-e31e0885dc44 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '732bbed9298346c8b27cb0ef281ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b518f9e635514a49b86bf961db515826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:45:20.809888 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-94f937ed-c35d-4701-acd7-e31e0885dc44 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] 10.222.0.33 "GET /compute/v2.1/servers/092e554b-36d0-40a7-9ff5-4445553b3453" status: 200 len: 1322 microversion: 2.1 time: 0.465907 Jun 05 08:45:20.810477 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1594/3098] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:45:20 2022] GET /compute/v2.1/servers/092e554b-36d0-40a7-9ff5-4445553b3453 => generated 1322 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:45:20.831654 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-164fa7e4-549e-42bc-bcaf-0f697bcf0743 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:45:20.832368 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-164fa7e4-549e-42bc-bcaf-0f697bcf0743 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] [instance: 092e554b-36d0-40a7-9ff5-4445553b3453] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:45:20.850860 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-164fa7e4-549e-42bc-bcaf-0f697bcf0743 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:45:20.858260 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-164fa7e4-549e-42bc-bcaf-0f697bcf0743 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:45:20.861177 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-164fa7e4-549e-42bc-bcaf-0f697bcf0743 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:45:20.863779 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-164fa7e4-549e-42bc-bcaf-0f697bcf0743 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:45:20.938159 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-164fa7e4-549e-42bc-bcaf-0f697bcf0743 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] [instance: 092e554b-36d0-40a7-9ff5-4445553b3453] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:45:21.147893 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-164fa7e4-549e-42bc-bcaf-0f697bcf0743 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] [instance: 092e554b-36d0-40a7-9ff5-4445553b3453] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:45:21.161941 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-164fa7e4-549e-42bc-bcaf-0f697bcf0743 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:45:21.167825 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-164fa7e4-549e-42bc-bcaf-0f697bcf0743 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:45:21.172147 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-164fa7e4-549e-42bc-bcaf-0f697bcf0743 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] [instance: 092e554b-36d0-40a7-9ff5-4445553b3453] instance's host None is down, deleting from database Jun 05 08:45:21.191610 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-164fa7e4-549e-42bc-bcaf-0f697bcf0743 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] [instance: 092e554b-36d0-40a7-9ff5-4445553b3453] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:45:21.507784 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-164fa7e4-549e-42bc-bcaf-0f697bcf0743 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] [instance: 092e554b-36d0-40a7-9ff5-4445553b3453] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:45:21.523307 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-164fa7e4-549e-42bc-bcaf-0f697bcf0743 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] [instance: 092e554b-36d0-40a7-9ff5-4445553b3453] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:45:22.080202 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-164fa7e4-549e-42bc-bcaf-0f697bcf0743 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] 10.222.0.33 "DELETE /compute/v2.1/servers/092e554b-36d0-40a7-9ff5-4445553b3453" status: 204 len: 0 microversion: 2.1 time: 1.256935 Jun 05 08:45:22.084715 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1505/3099] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:45:20 2022] DELETE /compute/v2.1/servers/092e554b-36d0-40a7-9ff5-4445553b3453 => generated 0 bytes in 1260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:45:22.090174 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1132fcb7-91c6-4e1b-a7d8-9e635e9aa55c tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:45:22.090812 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1132fcb7-91c6-4e1b-a7d8-9e635e9aa55c tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] [instance: 092e554b-36d0-40a7-9ff5-4445553b3453] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:45:22.107670 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1132fcb7-91c6-4e1b-a7d8-9e635e9aa55c tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:45:22.108162 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1132fcb7-91c6-4e1b-a7d8-9e635e9aa55c tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:45:22.108956 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1132fcb7-91c6-4e1b-a7d8-9e635e9aa55c tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:45:22.109399 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1132fcb7-91c6-4e1b-a7d8-9e635e9aa55c tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:45:22.144356 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-1132fcb7-91c6-4e1b-a7d8-9e635e9aa55c tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] HTTP exception thrown: Instance 092e554b-36d0-40a7-9ff5-4445553b3453 could not be found. Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1132fcb7-91c6-4e1b-a7d8-9e635e9aa55c tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Request method failure captured: Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/092e554b-36d0-40a7-9ff5-4445553b3453 HTTP/1.1 Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGy-oTz2trvOMefgvQUpqNWhdvGHppQfhmxE6-gNOdKUEVYLKE31xbHGjCsVQ6hWUKS8q_lmlpvr-Lf7w4vbjnO3NhpYhkJ27dvhQJ6Dr8_pVhmGDLQL97emidUr1V7mG9lgAYS7520_B3TVpWPJjCK-LdLhD8ZPvux7PlTDTpe4C0w Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: b518f9e635514a49b86bf961db515826 Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-TestNetworkBasicOps-17247121 Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b518f9e635514a49b86bf961db515826"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b518f9e635514a49b86bf961db515826"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b518f9e635514a49b86bf961db515826", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b518f9e635514a49b86bf961db515826"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-TestNetworkBasicOps-17247121 Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: b518f9e635514a49b86bf961db515826 Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-TestNetworkBasicOps-17247121 Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-TestNetworkBasicOps-17247121-project Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 732bbed9298346c8b27cb0ef281ac415 Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-TestNetworkBasicOps-17247121-project Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 092e554b-36d0-40a7-9ff5-4445553b3453 could not be found. Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '092e554b-36d0-40a7-9ff5-4445553b3453'} Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 092e554b-36d0-40a7-9ff5-4445553b3453 could not be found. Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 092e554b-36d0-40a7-9ff5-4445553b3453 could not be found. Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:45:22.146175 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:45:22.150802 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:45:22.150802 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:45:22.150802 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:45:22.150802 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:45:22.150802 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:45:22.150802 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 092e554b-36d0-40a7-9ff5-4445553b3453 could not be found. Jun 05 08:45:22.150802 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:45:22.152194 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1132fcb7-91c6-4e1b-a7d8-9e635e9aa55c tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Returning 404 to user: Instance 092e554b-36d0-40a7-9ff5-4445553b3453 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:45:22.153230 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1132fcb7-91c6-4e1b-a7d8-9e635e9aa55c tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] 10.222.0.33 "GET /compute/v2.1/servers/092e554b-36d0-40a7-9ff5-4445553b3453" status: 404 len: 111 microversion: 2.1 time: 0.067820 Jun 05 08:45:22.154275 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1595/3100] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:45:22 2022] GET /compute/v2.1/servers/092e554b-36d0-40a7-9ff5-4445553b3453 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 05 08:45:23.208648 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-76e0d715-57fb-4904-9631-1d4a7a33b885 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] Calling method '.version_select at 0x7f2432dde670>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:45:23.267405 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-76e0d715-57fb-4904-9631-1d4a7a33b885 tempest-TestNetworkBasicOps-17247121 tempest-TestNetworkBasicOps-17247121-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1051572934" status: 202 len: 0 microversion: 2.1 time: 0.063151 Jun 05 08:45:23.269044 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1506/3101] 10.222.0.33 () {58 vars in 1256 bytes} [Sun Jun 5 08:45:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1051572934 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:45:23.740495 n-d-844739-1 devstack@n-api.service[119050]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 08:45:23.741045 n-d-844739-1 devstack@n-api.service[119050]: Sun Jun 5 08:45:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 08:46:57.776922 n-d-844739-1 devstack@n-api.service[119049]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 08:46:57.777491 n-d-844739-1 devstack@n-api.service[119049]: Sun Jun 5 08:46:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 08:48:17.426185 n-d-844739-1 devstack@n-api.service[119049]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 08:48:17.427247 n-d-844739-1 devstack@n-api.service[119049]: Sun Jun 5 08:48:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 08:48:18.065018 n-d-844739-1 devstack@n-api.service[119050]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 08:48:18.066734 n-d-844739-1 devstack@n-api.service[119050]: Sun Jun 5 08:48:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 08:48:24.287958 n-d-844739-1 devstack@n-api.service[119050]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3479185a-57d3-411e-b5f9-4f515ddebedd] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 05 08:48:24.293188 n-d-844739-1 devstack@n-api.service[119050]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7e679682-2a57-43a8-8a9d-11590e5228db] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 05 08:48:24.301565 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-28e155bf-a83c-4fb0-b4b1-008d0f179658 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1495223975", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "9383d93a-ef34-4f4c-999a-8f7b9eecce84"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:48:24.366912 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:48:24.382152 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=6 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:48:24.384450 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:48:24.401073 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=12 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:48:24.526429 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-28e155bf-a83c-4fb0-b4b1-008d0f179658 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] validate_networks() for [('9383d93a-ef34-4f4c-999a-8f7b9eecce84', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:48:25.320243 n-d-844739-1 devstack@n-api.service[119050]: INFO oslo.messaging._drivers.impl_rabbit [-] [3479185a-57d3-411e-b5f9-4f515ddebedd] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 46486. Jun 05 08:48:25.322847 n-d-844739-1 devstack@n-api.service[119050]: INFO oslo.messaging._drivers.impl_rabbit [-] [7e679682-2a57-43a8-8a9d-11590e5228db] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 46488. Jun 05 08:48:27.491308 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-28e155bf-a83c-4fb0-b4b1-008d0f179658 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:48:27.492698 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-28e155bf-a83c-4fb0-b4b1-008d0f179658 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:48:27.493425 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-28e155bf-a83c-4fb0-b4b1-008d0f179658 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:48:27.494223 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-28e155bf-a83c-4fb0-b4b1-008d0f179658 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:48:27.496680 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-28e155bf-a83c-4fb0-b4b1-008d0f179658 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:48:27.518332 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-28e155bf-a83c-4fb0-b4b1-008d0f179658 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:48:27.520546 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-28e155bf-a83c-4fb0-b4b1-008d0f179658 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:48:27.538779 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-28e155bf-a83c-4fb0-b4b1-008d0f179658 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:48:27.540833 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-28e155bf-a83c-4fb0-b4b1-008d0f179658 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:48:27.600585 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-28e155bf-a83c-4fb0-b4b1-008d0f179658 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Getting quotas for project 7e82275dda11406d970ade8e6b8cfda0. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:48:27.613641 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-28e155bf-a83c-4fb0-b4b1-008d0f179658 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Getting quotas for user 9b097739f2964499ac31a390a0965696 and project 7e82275dda11406d970ade8e6b8cfda0. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:48:27.729303 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-28e155bf-a83c-4fb0-b4b1-008d0f179658 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:48:27.735008 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-28e155bf-a83c-4fb0-b4b1-008d0f179658 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] [instance: 44aa44c3-7c59-42e8-abdb-52b7c2faaa90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:48:27.947587 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-28e155bf-a83c-4fb0-b4b1-008d0f179658 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.666888 Jun 05 08:48:27.952589 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1596/3102] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:48:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:48:27.961419 n-d-844739-1 devstack@n-api.service[119049]: ERROR oslo.messaging._drivers.impl_rabbit [-] [411e268b-965d-4f7a-8b7c-c8ab976cc9eb] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 05 08:48:27.962292 n-d-844739-1 devstack@n-api.service[119049]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72a16dc1-a618-40fe-bc5c-8f61b915d107] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 05 08:48:27.962840 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=6 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:48:27.963941 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:48:27.964823 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:48:27.980139 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8064526e-f6e5-453f-88eb-90996ecf9f30 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:48:27.984916 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8064526e-f6e5-453f-88eb-90996ecf9f30 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] [instance: 44aa44c3-7c59-42e8-abdb-52b7c2faaa90] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:48:28.294153 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-8064526e-f6e5-453f-88eb-90996ecf9f30 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b097739f2964499ac31a390a0965696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e82275dda11406d970ade8e6b8cfda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:48:28.306806 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8064526e-f6e5-453f-88eb-90996ecf9f30 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] 10.222.0.33 "GET /compute/v2.1/servers/44aa44c3-7c59-42e8-abdb-52b7c2faaa90" status: 200 len: 1214 microversion: 2.1 time: 0.345058 Jun 05 08:48:28.318207 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1507/3103] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:48:27 2022] GET /compute/v2.1/servers/44aa44c3-7c59-42e8-abdb-52b7c2faaa90 => generated 1214 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:48:29.324712 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-dde2c878-28f1-4a51-8714-91b828f56118 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:48:29.325347 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-dde2c878-28f1-4a51-8714-91b828f56118 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] [instance: 44aa44c3-7c59-42e8-abdb-52b7c2faaa90] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:48:29.355521 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dde2c878-28f1-4a51-8714-91b828f56118 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:48:29.359565 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dde2c878-28f1-4a51-8714-91b828f56118 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:48:29.361325 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dde2c878-28f1-4a51-8714-91b828f56118 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:48:29.364150 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dde2c878-28f1-4a51-8714-91b828f56118 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:48:29.467203 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dde2c878-28f1-4a51-8714-91b828f56118 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:48:29.467674 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-dde2c878-28f1-4a51-8714-91b828f56118 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:48:29.468827 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-dde2c878-28f1-4a51-8714-91b828f56118 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lazy-loading 'fault' on Instance uuid 44aa44c3-7c59-42e8-abdb-52b7c2faaa90 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:48:29.805118 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-dde2c878-28f1-4a51-8714-91b828f56118 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b097739f2964499ac31a390a0965696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e82275dda11406d970ade8e6b8cfda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:48:29.819966 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-dde2c878-28f1-4a51-8714-91b828f56118 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] 10.222.0.33 "GET /compute/v2.1/servers/44aa44c3-7c59-42e8-abdb-52b7c2faaa90" status: 200 len: 1287 microversion: 2.1 time: 0.497216 Jun 05 08:48:29.824148 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1597/3104] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:48:29 2022] GET /compute/v2.1/servers/44aa44c3-7c59-42e8-abdb-52b7c2faaa90 => generated 1287 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:48:29.847000 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0e053b67-9ad0-4f35-81f3-cd76144633e2 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:48:29.848229 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0e053b67-9ad0-4f35-81f3-cd76144633e2 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] [instance: 44aa44c3-7c59-42e8-abdb-52b7c2faaa90] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:48:29.872897 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0e053b67-9ad0-4f35-81f3-cd76144633e2 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:48:29.872897 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0e053b67-9ad0-4f35-81f3-cd76144633e2 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:48:29.875165 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0e053b67-9ad0-4f35-81f3-cd76144633e2 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:48:29.876115 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0e053b67-9ad0-4f35-81f3-cd76144633e2 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:48:29.944520 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0e053b67-9ad0-4f35-81f3-cd76144633e2 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] [instance: 44aa44c3-7c59-42e8-abdb-52b7c2faaa90] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:48:30.024162 n-d-844739-1 devstack@n-api.service[119049]: INFO oslo.messaging._drivers.impl_rabbit [-] [72a16dc1-a618-40fe-bc5c-8f61b915d107] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 46668. Jun 05 08:48:30.027090 n-d-844739-1 devstack@n-api.service[119049]: INFO oslo.messaging._drivers.impl_rabbit [-] [411e268b-965d-4f7a-8b7c-c8ab976cc9eb] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 46666. Jun 05 08:48:30.042668 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0e053b67-9ad0-4f35-81f3-cd76144633e2 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] [instance: 44aa44c3-7c59-42e8-abdb-52b7c2faaa90] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:48:30.044885 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0e053b67-9ad0-4f35-81f3-cd76144633e2 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:48:30.045705 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-0e053b67-9ad0-4f35-81f3-cd76144633e2 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:48:30.047416 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-0e053b67-9ad0-4f35-81f3-cd76144633e2 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] [instance: 44aa44c3-7c59-42e8-abdb-52b7c2faaa90] instance's host None is down, deleting from database Jun 05 08:48:30.086146 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-0e053b67-9ad0-4f35-81f3-cd76144633e2 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] [instance: 44aa44c3-7c59-42e8-abdb-52b7c2faaa90] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:48:30.219372 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-0e053b67-9ad0-4f35-81f3-cd76144633e2 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] [instance: 44aa44c3-7c59-42e8-abdb-52b7c2faaa90] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:48:30.228214 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-0e053b67-9ad0-4f35-81f3-cd76144633e2 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] [instance: 44aa44c3-7c59-42e8-abdb-52b7c2faaa90] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:48:30.695499 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0e053b67-9ad0-4f35-81f3-cd76144633e2 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] 10.222.0.33 "DELETE /compute/v2.1/servers/44aa44c3-7c59-42e8-abdb-52b7c2faaa90" status: 204 len: 0 microversion: 2.1 time: 0.855318 Jun 05 08:48:30.696094 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1508/3105] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:48:29 2022] DELETE /compute/v2.1/servers/44aa44c3-7c59-42e8-abdb-52b7c2faaa90 => generated 0 bytes in 857 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:48:30.710822 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-aa301349-dd14-4566-bdb7-b9c9b6d2bd80 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:48:30.711452 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-aa301349-dd14-4566-bdb7-b9c9b6d2bd80 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] [instance: 44aa44c3-7c59-42e8-abdb-52b7c2faaa90] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:48:30.725753 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-aa301349-dd14-4566-bdb7-b9c9b6d2bd80 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:48:30.726208 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-aa301349-dd14-4566-bdb7-b9c9b6d2bd80 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:48:30.729315 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-aa301349-dd14-4566-bdb7-b9c9b6d2bd80 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:48:30.729944 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-aa301349-dd14-4566-bdb7-b9c9b6d2bd80 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:48:30.776325 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-aa301349-dd14-4566-bdb7-b9c9b6d2bd80 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] HTTP exception thrown: Instance 44aa44c3-7c59-42e8-abdb-52b7c2faaa90 could not be found. Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-aa301349-dd14-4566-bdb7-b9c9b6d2bd80 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Request method failure captured: Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/44aa44c3-7c59-42e8-abdb-52b7c2faaa90 HTTP/1.1 Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinG3RBFaGMVpQ7dS0vTyLo4eJpwln2Kmyh1nDdPsgyxDn5m2ZsawusMRIRTZkdZ3RmHZwG5oGmd091U4cBYENbragK8M3LuNGYa--kfj8OHsQKWOEZeAvEeSTHutOXMRkF6rwpMOR4O5jQmaib1dG8Xgm9Scp5fhvCR9aJ6_63nq0zyA Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 7e82275dda11406d970ade8e6b8cfda0 Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-VolumesActionsTest-852086613 Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7e82275dda11406d970ade8e6b8cfda0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e82275dda11406d970ade8e6b8cfda0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7e82275dda11406d970ade8e6b8cfda0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e82275dda11406d970ade8e6b8cfda0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-VolumesActionsTest-852086613 Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 7e82275dda11406d970ade8e6b8cfda0 Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-VolumesActionsTest-852086613 Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-VolumesActionsTest-852086613-project Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 9b097739f2964499ac31a390a0965696 Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-VolumesActionsTest-852086613-project Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 44aa44c3-7c59-42e8-abdb-52b7c2faaa90 could not be found. Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '44aa44c3-7c59-42e8-abdb-52b7c2faaa90'} Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44aa44c3-7c59-42e8-abdb-52b7c2faaa90 could not be found. Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44aa44c3-7c59-42e8-abdb-52b7c2faaa90 could not be found. Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:48:30.780370 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:48:30.785155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:48:30.785155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:48:30.785155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:48:30.785155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:48:30.785155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:48:30.785155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44aa44c3-7c59-42e8-abdb-52b7c2faaa90 could not be found. Jun 05 08:48:30.785155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:48:30.793153 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-aa301349-dd14-4566-bdb7-b9c9b6d2bd80 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Returning 404 to user: Instance 44aa44c3-7c59-42e8-abdb-52b7c2faaa90 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:48:30.794290 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-aa301349-dd14-4566-bdb7-b9c9b6d2bd80 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] 10.222.0.33 "GET /compute/v2.1/servers/44aa44c3-7c59-42e8-abdb-52b7c2faaa90" status: 404 len: 111 microversion: 2.1 time: 0.087345 Jun 05 08:48:30.795028 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1598/3106] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:48:30 2022] GET /compute/v2.1/servers/44aa44c3-7c59-42e8-abdb-52b7c2faaa90 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:48:31.081344 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d17eb07e-b882-47d9-9e44-33be24d64a15 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-143776706", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "9383d93a-ef34-4f4c-999a-8f7b9eecce84"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:48:31.218530 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-d17eb07e-b882-47d9-9e44-33be24d64a15 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] validate_networks() for [('9383d93a-ef34-4f4c-999a-8f7b9eecce84', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:48:33.475105 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-d17eb07e-b882-47d9-9e44-33be24d64a15 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:48:33.475687 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-d17eb07e-b882-47d9-9e44-33be24d64a15 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:48:33.475988 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-d17eb07e-b882-47d9-9e44-33be24d64a15 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:48:33.476434 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-d17eb07e-b882-47d9-9e44-33be24d64a15 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:48:33.476843 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-d17eb07e-b882-47d9-9e44-33be24d64a15 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:48:33.502076 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d17eb07e-b882-47d9-9e44-33be24d64a15 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:48:33.502548 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d17eb07e-b882-47d9-9e44-33be24d64a15 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:48:33.503354 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d17eb07e-b882-47d9-9e44-33be24d64a15 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:48:33.503790 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d17eb07e-b882-47d9-9e44-33be24d64a15 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:48:33.567219 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-d17eb07e-b882-47d9-9e44-33be24d64a15 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Getting quotas for project 7e82275dda11406d970ade8e6b8cfda0. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:48:33.583613 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-d17eb07e-b882-47d9-9e44-33be24d64a15 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Getting quotas for user 9b097739f2964499ac31a390a0965696 and project 7e82275dda11406d970ade8e6b8cfda0. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:48:33.621627 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d17eb07e-b882-47d9-9e44-33be24d64a15 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:48:33.623798 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d17eb07e-b882-47d9-9e44-33be24d64a15 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] [instance: ec2138e8-e6d1-47aa-aa41-54d4fa7e4552] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:48:33.730041 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d17eb07e-b882-47d9-9e44-33be24d64a15 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.654434 Jun 05 08:48:33.734722 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1509/3107] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:48:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:48:33.744888 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2690f336-9458-4c21-b623-38ae511ee746 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:48:33.746253 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2690f336-9458-4c21-b623-38ae511ee746 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] [instance: ec2138e8-e6d1-47aa-aa41-54d4fa7e4552] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:48:34.020133 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2690f336-9458-4c21-b623-38ae511ee746 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b097739f2964499ac31a390a0965696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e82275dda11406d970ade8e6b8cfda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:48:34.030042 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2690f336-9458-4c21-b623-38ae511ee746 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] 10.222.0.33 "GET /compute/v2.1/servers/ec2138e8-e6d1-47aa-aa41-54d4fa7e4552" status: 200 len: 1213 microversion: 2.1 time: 0.289280 Jun 05 08:48:34.035489 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1599/3108] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:48:33 2022] GET /compute/v2.1/servers/ec2138e8-e6d1-47aa-aa41-54d4fa7e4552 => generated 1213 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:48:35.046628 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6d8ee953-f443-4664-b82b-4f978fa1c7d9 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:48:35.047239 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6d8ee953-f443-4664-b82b-4f978fa1c7d9 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] [instance: ec2138e8-e6d1-47aa-aa41-54d4fa7e4552] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:48:35.058970 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6d8ee953-f443-4664-b82b-4f978fa1c7d9 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:48:35.059992 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6d8ee953-f443-4664-b82b-4f978fa1c7d9 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:48:35.061409 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6d8ee953-f443-4664-b82b-4f978fa1c7d9 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:48:35.062741 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6d8ee953-f443-4664-b82b-4f978fa1c7d9 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:48:35.135908 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6d8ee953-f443-4664-b82b-4f978fa1c7d9 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:48:35.136396 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6d8ee953-f443-4664-b82b-4f978fa1c7d9 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:48:35.140440 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-6d8ee953-f443-4664-b82b-4f978fa1c7d9 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lazy-loading 'fault' on Instance uuid ec2138e8-e6d1-47aa-aa41-54d4fa7e4552 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:48:35.262129 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-6d8ee953-f443-4664-b82b-4f978fa1c7d9 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b097739f2964499ac31a390a0965696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e82275dda11406d970ade8e6b8cfda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:48:35.272524 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6d8ee953-f443-4664-b82b-4f978fa1c7d9 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] 10.222.0.33 "GET /compute/v2.1/servers/ec2138e8-e6d1-47aa-aa41-54d4fa7e4552" status: 200 len: 1286 microversion: 2.1 time: 0.229629 Jun 05 08:48:35.275647 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1510/3109] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:48:35 2022] GET /compute/v2.1/servers/ec2138e8-e6d1-47aa-aa41-54d4fa7e4552 => generated 1286 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:48:35.301637 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b1c944bf-f2ae-4ec1-be60-95e8bd2c83bc tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:48:35.302705 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b1c944bf-f2ae-4ec1-be60-95e8bd2c83bc tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] [instance: ec2138e8-e6d1-47aa-aa41-54d4fa7e4552] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:48:35.322606 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b1c944bf-f2ae-4ec1-be60-95e8bd2c83bc tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:48:35.323360 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b1c944bf-f2ae-4ec1-be60-95e8bd2c83bc tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:48:35.324377 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b1c944bf-f2ae-4ec1-be60-95e8bd2c83bc tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:48:35.325177 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b1c944bf-f2ae-4ec1-be60-95e8bd2c83bc tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:48:35.393246 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b1c944bf-f2ae-4ec1-be60-95e8bd2c83bc tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] [instance: ec2138e8-e6d1-47aa-aa41-54d4fa7e4552] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:48:35.523489 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b1c944bf-f2ae-4ec1-be60-95e8bd2c83bc tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] [instance: ec2138e8-e6d1-47aa-aa41-54d4fa7e4552] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:48:35.525816 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b1c944bf-f2ae-4ec1-be60-95e8bd2c83bc tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:48:35.526284 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b1c944bf-f2ae-4ec1-be60-95e8bd2c83bc tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:48:35.526747 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-b1c944bf-f2ae-4ec1-be60-95e8bd2c83bc tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] [instance: ec2138e8-e6d1-47aa-aa41-54d4fa7e4552] instance's host None is down, deleting from database Jun 05 08:48:35.541840 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-b1c944bf-f2ae-4ec1-be60-95e8bd2c83bc tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] [instance: ec2138e8-e6d1-47aa-aa41-54d4fa7e4552] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:48:35.611270 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-b1c944bf-f2ae-4ec1-be60-95e8bd2c83bc tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] [instance: ec2138e8-e6d1-47aa-aa41-54d4fa7e4552] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:48:35.638216 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-b1c944bf-f2ae-4ec1-be60-95e8bd2c83bc tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] [instance: ec2138e8-e6d1-47aa-aa41-54d4fa7e4552] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:48:36.146701 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b1c944bf-f2ae-4ec1-be60-95e8bd2c83bc tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ec2138e8-e6d1-47aa-aa41-54d4fa7e4552" status: 204 len: 0 microversion: 2.1 time: 0.848392 Jun 05 08:48:36.146701 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1600/3110] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:48:35 2022] DELETE /compute/v2.1/servers/ec2138e8-e6d1-47aa-aa41-54d4fa7e4552 => generated 0 bytes in 851 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:48:36.151535 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4f4dcff0-f826-4547-8c7d-87e3054f0813 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:48:36.152192 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4f4dcff0-f826-4547-8c7d-87e3054f0813 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] [instance: ec2138e8-e6d1-47aa-aa41-54d4fa7e4552] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:48:36.167472 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4f4dcff0-f826-4547-8c7d-87e3054f0813 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:48:36.167924 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4f4dcff0-f826-4547-8c7d-87e3054f0813 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:48:36.175844 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4f4dcff0-f826-4547-8c7d-87e3054f0813 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:48:36.176451 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4f4dcff0-f826-4547-8c7d-87e3054f0813 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:48:36.227270 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-4f4dcff0-f826-4547-8c7d-87e3054f0813 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] HTTP exception thrown: Instance ec2138e8-e6d1-47aa-aa41-54d4fa7e4552 could not be found. Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4f4dcff0-f826-4547-8c7d-87e3054f0813 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Request method failure captured: Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/ec2138e8-e6d1-47aa-aa41-54d4fa7e4552 HTTP/1.1 Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinG3RBFaGMVpQ7dS0vTyLo4eJpwln2Kmyh1nDdPsgyxDn5m2ZsawusMRIRTZkdZ3RmHZwG5oGmd091U4cBYENbragK8M3LuNGYa--kfj8OHsQKWOEZeAvEeSTHutOXMRkF6rwpMOR4O5jQmaib1dG8Xgm9Scp5fhvCR9aJ6_63nq0zyA Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 7e82275dda11406d970ade8e6b8cfda0 Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-VolumesActionsTest-852086613 Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7e82275dda11406d970ade8e6b8cfda0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e82275dda11406d970ade8e6b8cfda0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7e82275dda11406d970ade8e6b8cfda0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e82275dda11406d970ade8e6b8cfda0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-VolumesActionsTest-852086613 Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 7e82275dda11406d970ade8e6b8cfda0 Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-VolumesActionsTest-852086613 Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-VolumesActionsTest-852086613-project Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 9b097739f2964499ac31a390a0965696 Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-VolumesActionsTest-852086613-project Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance ec2138e8-e6d1-47aa-aa41-54d4fa7e4552 could not be found. Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'ec2138e8-e6d1-47aa-aa41-54d4fa7e4552'} Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec2138e8-e6d1-47aa-aa41-54d4fa7e4552 could not be found. Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec2138e8-e6d1-47aa-aa41-54d4fa7e4552 could not be found. Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:48:36.228899 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:48:36.233816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:48:36.233816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:48:36.233816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:48:36.233816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:48:36.233816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:48:36.233816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec2138e8-e6d1-47aa-aa41-54d4fa7e4552 could not be found. Jun 05 08:48:36.233816 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:48:36.233816 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4f4dcff0-f826-4547-8c7d-87e3054f0813 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] Returning 404 to user: Instance ec2138e8-e6d1-47aa-aa41-54d4fa7e4552 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:48:36.233816 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4f4dcff0-f826-4547-8c7d-87e3054f0813 tempest-VolumesActionsTest-852086613 tempest-VolumesActionsTest-852086613-project] 10.222.0.33 "GET /compute/v2.1/servers/ec2138e8-e6d1-47aa-aa41-54d4fa7e4552" status: 404 len: 111 microversion: 2.1 time: 0.086304 Jun 05 08:48:36.235205 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1511/3111] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:48:36 2022] GET /compute/v2.1/servers/ec2138e8-e6d1-47aa-aa41-54d4fa7e4552 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:48:43.751515 n-d-844739-1 devstack@n-api.service[119050]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 08:48:43.752258 n-d-844739-1 devstack@n-api.service[119050]: Sun Jun 5 08:48:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 08:49:53.031812 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:49:53.033491 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=8 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:49:53.034370 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:49:53.035136 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=36,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:49:53.301288 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6536933c-119a-47a6-b9e0-25f9c38ec1ae tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-196676413", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "56519aa3-021f-4a8b-88de-a74ea00a4f13"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:49:53.763034 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-6536933c-119a-47a6-b9e0-25f9c38ec1ae tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] validate_networks() for [('56519aa3-021f-4a8b-88de-a74ea00a4f13', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:49:54.358466 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-6536933c-119a-47a6-b9e0-25f9c38ec1ae tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:49:54.359046 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-6536933c-119a-47a6-b9e0-25f9c38ec1ae tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:49:54.359363 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-6536933c-119a-47a6-b9e0-25f9c38ec1ae tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:49:54.359776 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-6536933c-119a-47a6-b9e0-25f9c38ec1ae tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:49:54.360833 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-6536933c-119a-47a6-b9e0-25f9c38ec1ae tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:49:54.379434 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6536933c-119a-47a6-b9e0-25f9c38ec1ae tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:49:54.379882 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6536933c-119a-47a6-b9e0-25f9c38ec1ae tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:49:54.380716 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6536933c-119a-47a6-b9e0-25f9c38ec1ae tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:49:54.381149 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6536933c-119a-47a6-b9e0-25f9c38ec1ae tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:49:54.426744 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-6536933c-119a-47a6-b9e0-25f9c38ec1ae tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Getting quotas for project a60e5e0307df4212a6b55a4f8be0dc09. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:49:54.433541 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-6536933c-119a-47a6-b9e0-25f9c38ec1ae tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Getting quotas for user 91c3f9e144f344d6a5b7786d54a91c15 and project a60e5e0307df4212a6b55a4f8be0dc09. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:49:54.463880 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6536933c-119a-47a6-b9e0-25f9c38ec1ae tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:49:54.467035 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6536933c-119a-47a6-b9e0-25f9c38ec1ae tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] [instance: 87180d1a-58e3-42ae-8e08-cf00f6675985] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:49:54.557012 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6536933c-119a-47a6-b9e0-25f9c38ec1ae tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.526906 Jun 05 08:49:54.558170 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1601/3112] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:49:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:49:54.566068 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:49:54.567942 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=8 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:49:54.569039 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:49:54.569844 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=36,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:49:54.574530 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b7440b18-f382-410f-bd7c-96bbdad55742 tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:49:54.576999 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b7440b18-f382-410f-bd7c-96bbdad55742 tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] [instance: 87180d1a-58e3-42ae-8e08-cf00f6675985] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:49:55.028155 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b7440b18-f382-410f-bd7c-96bbdad55742 tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c3f9e144f344d6a5b7786d54a91c15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60e5e0307df4212a6b55a4f8be0dc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:49:55.046562 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b7440b18-f382-410f-bd7c-96bbdad55742 tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] 10.222.0.33 "GET /compute/v2.1/servers/87180d1a-58e3-42ae-8e08-cf00f6675985" status: 200 len: 1213 microversion: 2.1 time: 0.482316 Jun 05 08:49:55.049198 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1512/3113] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:49:54 2022] GET /compute/v2.1/servers/87180d1a-58e3-42ae-8e08-cf00f6675985 => generated 1213 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:49:56.073187 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4f24e60e-d36e-4fb7-aa00-a3b6e1bb8996 tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:49:56.075794 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4f24e60e-d36e-4fb7-aa00-a3b6e1bb8996 tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] [instance: 87180d1a-58e3-42ae-8e08-cf00f6675985] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:49:56.101567 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4f24e60e-d36e-4fb7-aa00-a3b6e1bb8996 tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:49:56.104407 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4f24e60e-d36e-4fb7-aa00-a3b6e1bb8996 tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:49:56.107541 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4f24e60e-d36e-4fb7-aa00-a3b6e1bb8996 tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:49:56.108371 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4f24e60e-d36e-4fb7-aa00-a3b6e1bb8996 tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:49:56.204877 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4f24e60e-d36e-4fb7-aa00-a3b6e1bb8996 tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:49:56.204877 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4f24e60e-d36e-4fb7-aa00-a3b6e1bb8996 tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:49:56.204877 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-4f24e60e-d36e-4fb7-aa00-a3b6e1bb8996 tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Lazy-loading 'fault' on Instance uuid 87180d1a-58e3-42ae-8e08-cf00f6675985 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:49:56.273744 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-4f24e60e-d36e-4fb7-aa00-a3b6e1bb8996 tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c3f9e144f344d6a5b7786d54a91c15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a60e5e0307df4212a6b55a4f8be0dc09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:49:56.286094 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4f24e60e-d36e-4fb7-aa00-a3b6e1bb8996 tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] 10.222.0.33 "GET /compute/v2.1/servers/87180d1a-58e3-42ae-8e08-cf00f6675985" status: 200 len: 1286 microversion: 2.1 time: 0.222838 Jun 05 08:49:56.287379 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1602/3114] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:49:56 2022] GET /compute/v2.1/servers/87180d1a-58e3-42ae-8e08-cf00f6675985 => generated 1286 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:49:56.311885 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7a0a8b5f-cef5-4e69-ac11-a6b738a1c08a tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:49:56.314019 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7a0a8b5f-cef5-4e69-ac11-a6b738a1c08a tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] [instance: 87180d1a-58e3-42ae-8e08-cf00f6675985] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:49:56.331493 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7a0a8b5f-cef5-4e69-ac11-a6b738a1c08a tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:49:56.337032 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7a0a8b5f-cef5-4e69-ac11-a6b738a1c08a tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:49:56.346148 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7a0a8b5f-cef5-4e69-ac11-a6b738a1c08a tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:49:56.350030 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7a0a8b5f-cef5-4e69-ac11-a6b738a1c08a tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:49:56.412387 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7a0a8b5f-cef5-4e69-ac11-a6b738a1c08a tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] [instance: 87180d1a-58e3-42ae-8e08-cf00f6675985] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:49:56.474306 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7a0a8b5f-cef5-4e69-ac11-a6b738a1c08a tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] [instance: 87180d1a-58e3-42ae-8e08-cf00f6675985] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:49:56.475166 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7a0a8b5f-cef5-4e69-ac11-a6b738a1c08a tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:49:56.475613 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7a0a8b5f-cef5-4e69-ac11-a6b738a1c08a tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:49:56.476136 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-7a0a8b5f-cef5-4e69-ac11-a6b738a1c08a tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] [instance: 87180d1a-58e3-42ae-8e08-cf00f6675985] instance's host None is down, deleting from database Jun 05 08:49:56.480692 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-7a0a8b5f-cef5-4e69-ac11-a6b738a1c08a tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] [instance: 87180d1a-58e3-42ae-8e08-cf00f6675985] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:49:56.529866 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-7a0a8b5f-cef5-4e69-ac11-a6b738a1c08a tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] [instance: 87180d1a-58e3-42ae-8e08-cf00f6675985] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:49:56.536857 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-7a0a8b5f-cef5-4e69-ac11-a6b738a1c08a tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] [instance: 87180d1a-58e3-42ae-8e08-cf00f6675985] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:49:56.759719 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7a0a8b5f-cef5-4e69-ac11-a6b738a1c08a tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] 10.222.0.33 "DELETE /compute/v2.1/servers/87180d1a-58e3-42ae-8e08-cf00f6675985" status: 204 len: 0 microversion: 2.1 time: 0.453485 Jun 05 08:49:56.761294 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1513/3115] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:49:56 2022] DELETE /compute/v2.1/servers/87180d1a-58e3-42ae-8e08-cf00f6675985 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:49:56.777966 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2f5b36d2-9402-4dc2-bed8-1798bdbf7c33 tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:49:56.781442 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2f5b36d2-9402-4dc2-bed8-1798bdbf7c33 tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] [instance: 87180d1a-58e3-42ae-8e08-cf00f6675985] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:49:56.789874 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2f5b36d2-9402-4dc2-bed8-1798bdbf7c33 tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:49:56.790733 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2f5b36d2-9402-4dc2-bed8-1798bdbf7c33 tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:49:56.793323 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2f5b36d2-9402-4dc2-bed8-1798bdbf7c33 tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:49:56.794019 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2f5b36d2-9402-4dc2-bed8-1798bdbf7c33 tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:49:56.820885 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-2f5b36d2-9402-4dc2-bed8-1798bdbf7c33 tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] HTTP exception thrown: Instance 87180d1a-58e3-42ae-8e08-cf00f6675985 could not be found. Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2f5b36d2-9402-4dc2-bed8-1798bdbf7c33 tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Request method failure captured: Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/87180d1a-58e3-42ae-8e08-cf00f6675985 HTTP/1.1 Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinG4tKHDTyGMEKdUk0FYvsMEQtGLKtSlOOEUMLelIjAMd8g_28oK6nIFXbcPNK8Ahra7gpPoBdNZhp12R2uRfTGnfajgD0vTtr0n21-77f7C0VF7MQixF3d2LtqiMaKflrnUwVMWyWmfjTCagiWqlU4MpCM9-arRtofk6s4qEcWU2FR4 Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: a60e5e0307df4212a6b55a4f8be0dc09 Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-VolumesActionsTest-1220383423 Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a60e5e0307df4212a6b55a4f8be0dc09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a60e5e0307df4212a6b55a4f8be0dc09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a60e5e0307df4212a6b55a4f8be0dc09", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a60e5e0307df4212a6b55a4f8be0dc09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-VolumesActionsTest-1220383423 Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: a60e5e0307df4212a6b55a4f8be0dc09 Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-VolumesActionsTest-1220383423 Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-VolumesActionsTest-1220383423-project Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 91c3f9e144f344d6a5b7786d54a91c15 Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-VolumesActionsTest-1220383423-project Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 87180d1a-58e3-42ae-8e08-cf00f6675985 could not be found. Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '87180d1a-58e3-42ae-8e08-cf00f6675985'} Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87180d1a-58e3-42ae-8e08-cf00f6675985 could not be found. Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87180d1a-58e3-42ae-8e08-cf00f6675985 could not be found. Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:49:56.826928 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:49:56.832671 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:49:56.832671 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:49:56.832671 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:49:56.832671 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:49:56.832671 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:49:56.832671 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87180d1a-58e3-42ae-8e08-cf00f6675985 could not be found. Jun 05 08:49:56.832671 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:49:56.832671 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2f5b36d2-9402-4dc2-bed8-1798bdbf7c33 tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] Returning 404 to user: Instance 87180d1a-58e3-42ae-8e08-cf00f6675985 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:49:56.839990 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2f5b36d2-9402-4dc2-bed8-1798bdbf7c33 tempest-VolumesActionsTest-1220383423 tempest-VolumesActionsTest-1220383423-project] 10.222.0.33 "GET /compute/v2.1/servers/87180d1a-58e3-42ae-8e08-cf00f6675985" status: 404 len: 111 microversion: 2.1 time: 0.067944 Jun 05 08:49:56.840795 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1603/3116] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:49:56 2022] GET /compute/v2.1/servers/87180d1a-58e3-42ae-8e08-cf00f6675985 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:50:17.786176 n-d-844739-1 devstack@n-api.service[119049]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 08:50:17.786871 n-d-844739-1 devstack@n-api.service[119049]: Sun Jun 5 08:50:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 08:50:20.741812 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:50:20.743693 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:50:20.744674 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:50:20.753040 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8e7d4f48-e3c3-43ab-9168-faaba81074cf tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-287204048", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:50:20.867773 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-8e7d4f48-e3c3-43ab-9168-faaba81074cf tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] validate_networks() for None {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:50:21.369783 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-8e7d4f48-e3c3-43ab-9168-faaba81074cf tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:50:21.370595 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-8e7d4f48-e3c3-43ab-9168-faaba81074cf tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:50:21.371911 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-8e7d4f48-e3c3-43ab-9168-faaba81074cf tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:50:21.372804 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-8e7d4f48-e3c3-43ab-9168-faaba81074cf tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:50:21.373480 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-8e7d4f48-e3c3-43ab-9168-faaba81074cf tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:50:21.407908 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8e7d4f48-e3c3-43ab-9168-faaba81074cf tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:50:21.408427 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8e7d4f48-e3c3-43ab-9168-faaba81074cf tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:50:21.409241 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8e7d4f48-e3c3-43ab-9168-faaba81074cf tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:50:21.409808 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8e7d4f48-e3c3-43ab-9168-faaba81074cf tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:50:21.456332 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-8e7d4f48-e3c3-43ab-9168-faaba81074cf tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Getting quotas for project 80acbbbdb39e43bca5c2daa0cd2e540e. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:50:21.486362 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-8e7d4f48-e3c3-43ab-9168-faaba81074cf tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Getting quotas for user eae443c144424f46971ccecc0cf7e611 and project 80acbbbdb39e43bca5c2daa0cd2e540e. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:50:21.512789 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8e7d4f48-e3c3-43ab-9168-faaba81074cf tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:50:21.514961 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8e7d4f48-e3c3-43ab-9168-faaba81074cf tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] [instance: d51b2bd9-2bca-408c-951c-7fce4e51fdb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:50:21.656912 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8e7d4f48-e3c3-43ab-9168-faaba81074cf tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.916766 Jun 05 08:50:21.658484 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1514/3117] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:50:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:50:21.668908 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c619075f-03fa-40e6-b08c-18da11682293 tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:50:21.670419 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c619075f-03fa-40e6-b08c-18da11682293 tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] [instance: d51b2bd9-2bca-408c-951c-7fce4e51fdb1] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:50:21.674901 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:50:21.681345 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=6 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:50:21.683830 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:50:21.685271 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=12 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:50:21.818872 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-c619075f-03fa-40e6-b08c-18da11682293 tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae443c144424f46971ccecc0cf7e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80acbbbdb39e43bca5c2daa0cd2e540e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:50:21.827826 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c619075f-03fa-40e6-b08c-18da11682293 tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] 10.222.0.33 "GET /compute/v2.1/servers/d51b2bd9-2bca-408c-951c-7fce4e51fdb1" status: 200 len: 1213 microversion: 2.1 time: 0.163467 Jun 05 08:50:21.833637 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1604/3118] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:50:21 2022] GET /compute/v2.1/servers/d51b2bd9-2bca-408c-951c-7fce4e51fdb1 => generated 1213 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:50:22.859029 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ffb89622-3b43-4122-9226-415959008433 tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:50:22.859674 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ffb89622-3b43-4122-9226-415959008433 tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] [instance: d51b2bd9-2bca-408c-951c-7fce4e51fdb1] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:50:22.890789 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ffb89622-3b43-4122-9226-415959008433 tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:50:22.891255 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ffb89622-3b43-4122-9226-415959008433 tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:50:22.892146 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ffb89622-3b43-4122-9226-415959008433 tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:50:22.892531 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ffb89622-3b43-4122-9226-415959008433 tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:50:23.022052 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ffb89622-3b43-4122-9226-415959008433 tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:50:23.024872 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ffb89622-3b43-4122-9226-415959008433 tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:50:23.032514 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-ffb89622-3b43-4122-9226-415959008433 tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Lazy-loading 'fault' on Instance uuid d51b2bd9-2bca-408c-951c-7fce4e51fdb1 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:50:23.104324 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ffb89622-3b43-4122-9226-415959008433 tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae443c144424f46971ccecc0cf7e611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80acbbbdb39e43bca5c2daa0cd2e540e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:50:23.113293 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ffb89622-3b43-4122-9226-415959008433 tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] 10.222.0.33 "GET /compute/v2.1/servers/d51b2bd9-2bca-408c-951c-7fce4e51fdb1" status: 200 len: 1286 microversion: 2.1 time: 0.265681 Jun 05 08:50:23.116201 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1515/3119] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:50:22 2022] GET /compute/v2.1/servers/d51b2bd9-2bca-408c-951c-7fce4e51fdb1 => generated 1286 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:50:23.131766 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c4295c2e-d62e-4133-8df7-f7590606c1ba tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:50:23.132977 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c4295c2e-d62e-4133-8df7-f7590606c1ba tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] [instance: d51b2bd9-2bca-408c-951c-7fce4e51fdb1] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:50:23.147539 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c4295c2e-d62e-4133-8df7-f7590606c1ba tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:50:23.148310 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c4295c2e-d62e-4133-8df7-f7590606c1ba tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:50:23.152124 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c4295c2e-d62e-4133-8df7-f7590606c1ba tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:50:23.153386 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c4295c2e-d62e-4133-8df7-f7590606c1ba tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:50:23.210043 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c4295c2e-d62e-4133-8df7-f7590606c1ba tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] [instance: d51b2bd9-2bca-408c-951c-7fce4e51fdb1] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:50:23.330602 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c4295c2e-d62e-4133-8df7-f7590606c1ba tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] [instance: d51b2bd9-2bca-408c-951c-7fce4e51fdb1] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:50:23.331654 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c4295c2e-d62e-4133-8df7-f7590606c1ba tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:50:23.332144 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c4295c2e-d62e-4133-8df7-f7590606c1ba tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:50:23.332915 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-c4295c2e-d62e-4133-8df7-f7590606c1ba tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] [instance: d51b2bd9-2bca-408c-951c-7fce4e51fdb1] instance's host None is down, deleting from database Jun 05 08:50:23.344550 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-c4295c2e-d62e-4133-8df7-f7590606c1ba tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] [instance: d51b2bd9-2bca-408c-951c-7fce4e51fdb1] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:50:23.396497 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-c4295c2e-d62e-4133-8df7-f7590606c1ba tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] [instance: d51b2bd9-2bca-408c-951c-7fce4e51fdb1] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:50:23.412553 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-c4295c2e-d62e-4133-8df7-f7590606c1ba tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] [instance: d51b2bd9-2bca-408c-951c-7fce4e51fdb1] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:50:24.037166 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c4295c2e-d62e-4133-8df7-f7590606c1ba tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d51b2bd9-2bca-408c-951c-7fce4e51fdb1" status: 204 len: 0 microversion: 2.1 time: 0.909547 Jun 05 08:50:24.041356 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1605/3120] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:50:23 2022] DELETE /compute/v2.1/servers/d51b2bd9-2bca-408c-951c-7fce4e51fdb1 => generated 0 bytes in 914 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:50:24.049786 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2eedbf1e-adf6-4afe-9e13-febcbc489ab8 tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:50:24.050409 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2eedbf1e-adf6-4afe-9e13-febcbc489ab8 tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] [instance: d51b2bd9-2bca-408c-951c-7fce4e51fdb1] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:50:24.058401 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2eedbf1e-adf6-4afe-9e13-febcbc489ab8 tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:50:24.059395 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2eedbf1e-adf6-4afe-9e13-febcbc489ab8 tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:50:24.090500 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2eedbf1e-adf6-4afe-9e13-febcbc489ab8 tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:50:24.091096 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2eedbf1e-adf6-4afe-9e13-febcbc489ab8 tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:50:24.142356 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-2eedbf1e-adf6-4afe-9e13-febcbc489ab8 tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] HTTP exception thrown: Instance d51b2bd9-2bca-408c-951c-7fce4e51fdb1 could not be found. Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2eedbf1e-adf6-4afe-9e13-febcbc489ab8 tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Request method failure captured: Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/d51b2bd9-2bca-408c-951c-7fce4e51fdb1 HTTP/1.1 Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinG5HJdtZgzRw4ryBleTfAq7GUabxEAXuIL3ShiI_nsn3M9hCjF-LxvPyZ5jQy3D5_cPnwNs_dZI0khTI-YnqMF_-9tYGsG1UPoeVtPtKTfOIQHkXKG1DmdpbYn4oMi6k68-DdA9Z4uqPUwEj8-30T_GIIfQQsVwPK_gOE-MxkJXHO6s Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 80acbbbdb39e43bca5c2daa0cd2e540e Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-VolumesBackupsTest-1784904236 Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/80acbbbdb39e43bca5c2daa0cd2e540e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/80acbbbdb39e43bca5c2daa0cd2e540e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_80acbbbdb39e43bca5c2daa0cd2e540e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/80acbbbdb39e43bca5c2daa0cd2e540e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-VolumesBackupsTest-1784904236 Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 80acbbbdb39e43bca5c2daa0cd2e540e Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-VolumesBackupsTest-1784904236 Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-VolumesBackupsTest-1784904236-project Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: eae443c144424f46971ccecc0cf7e611 Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-VolumesBackupsTest-1784904236-project Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance d51b2bd9-2bca-408c-951c-7fce4e51fdb1 could not be found. Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'd51b2bd9-2bca-408c-951c-7fce4e51fdb1'} Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d51b2bd9-2bca-408c-951c-7fce4e51fdb1 could not be found. Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d51b2bd9-2bca-408c-951c-7fce4e51fdb1 could not be found. Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:50:24.146993 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:50:24.151592 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:50:24.151592 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:50:24.151592 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:50:24.151592 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:50:24.151592 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:50:24.151592 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d51b2bd9-2bca-408c-951c-7fce4e51fdb1 could not be found. Jun 05 08:50:24.151592 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:50:24.157107 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2eedbf1e-adf6-4afe-9e13-febcbc489ab8 tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] Returning 404 to user: Instance d51b2bd9-2bca-408c-951c-7fce4e51fdb1 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:50:24.164508 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2eedbf1e-adf6-4afe-9e13-febcbc489ab8 tempest-VolumesBackupsTest-1784904236 tempest-VolumesBackupsTest-1784904236-project] 10.222.0.33 "GET /compute/v2.1/servers/d51b2bd9-2bca-408c-951c-7fce4e51fdb1" status: 404 len: 111 microversion: 2.1 time: 0.118574 Jun 05 08:50:24.165379 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1516/3121] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:50:24 2022] GET /compute/v2.1/servers/d51b2bd9-2bca-408c-951c-7fce4e51fdb1 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:50:48.177208 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-baa5c50d-8d09-4e50-b275-f72ca7ee24ab tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-510598175", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:50:48.196364 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:50:48.203970 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:50:48.206819 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:50:48.324718 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-baa5c50d-8d09-4e50-b275-f72ca7ee24ab tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] validate_networks() for None {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:50:48.881967 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-baa5c50d-8d09-4e50-b275-f72ca7ee24ab tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:50:48.882327 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-baa5c50d-8d09-4e50-b275-f72ca7ee24ab tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:50:48.882869 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-baa5c50d-8d09-4e50-b275-f72ca7ee24ab tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:50:48.883484 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-baa5c50d-8d09-4e50-b275-f72ca7ee24ab tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:50:48.883912 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-baa5c50d-8d09-4e50-b275-f72ca7ee24ab tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:50:48.923554 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-baa5c50d-8d09-4e50-b275-f72ca7ee24ab tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:50:48.924018 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-baa5c50d-8d09-4e50-b275-f72ca7ee24ab tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:50:48.926699 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-baa5c50d-8d09-4e50-b275-f72ca7ee24ab tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:50:48.927147 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-baa5c50d-8d09-4e50-b275-f72ca7ee24ab tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:50:48.991739 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-baa5c50d-8d09-4e50-b275-f72ca7ee24ab tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Getting quotas for project 31224ba050364bd08e621c94265bc6ca. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:50:49.006788 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-baa5c50d-8d09-4e50-b275-f72ca7ee24ab tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Getting quotas for user 83a51fc46d9d4d4e9b54bf6e0ea303fe and project 31224ba050364bd08e621c94265bc6ca. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:50:49.039546 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-baa5c50d-8d09-4e50-b275-f72ca7ee24ab tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:50:49.042581 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-baa5c50d-8d09-4e50-b275-f72ca7ee24ab tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] [instance: 7313602e-359e-435c-9a7b-3dd92a216800] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:50:49.196149 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-baa5c50d-8d09-4e50-b275-f72ca7ee24ab tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.024612 Jun 05 08:50:49.211082 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1606/3122] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:50:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:50:49.217917 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d1a28d48-8a29-4b25-b74a-1047887588ee tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:50:49.218556 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d1a28d48-8a29-4b25-b74a-1047887588ee tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] [instance: 7313602e-359e-435c-9a7b-3dd92a216800] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:50:49.232943 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:50:49.241797 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=6 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:50:49.243965 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:50:49.246177 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=12 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:50:49.485953 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-d1a28d48-8a29-4b25-b74a-1047887588ee tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a51fc46d9d4d4e9b54bf6e0ea303fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31224ba050364bd08e621c94265bc6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:50:49.494093 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d1a28d48-8a29-4b25-b74a-1047887588ee tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] 10.222.0.33 "GET /compute/v2.1/servers/7313602e-359e-435c-9a7b-3dd92a216800" status: 200 len: 1214 microversion: 2.1 time: 0.282506 Jun 05 08:50:49.503152 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1517/3123] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:50:49 2022] GET /compute/v2.1/servers/7313602e-359e-435c-9a7b-3dd92a216800 => generated 1214 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:50:50.520872 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-13868db8-74a9-42f4-80b0-f25981cedea0 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:50:50.523250 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-13868db8-74a9-42f4-80b0-f25981cedea0 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] [instance: 7313602e-359e-435c-9a7b-3dd92a216800] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:50:50.539642 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-13868db8-74a9-42f4-80b0-f25981cedea0 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:50:50.545339 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-13868db8-74a9-42f4-80b0-f25981cedea0 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:50:50.546915 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-13868db8-74a9-42f4-80b0-f25981cedea0 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:50:50.550335 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-13868db8-74a9-42f4-80b0-f25981cedea0 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:50:50.656022 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-13868db8-74a9-42f4-80b0-f25981cedea0 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:50:50.656885 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-13868db8-74a9-42f4-80b0-f25981cedea0 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:50:50.658152 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-13868db8-74a9-42f4-80b0-f25981cedea0 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Lazy-loading 'fault' on Instance uuid 7313602e-359e-435c-9a7b-3dd92a216800 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:50:50.810499 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-13868db8-74a9-42f4-80b0-f25981cedea0 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a51fc46d9d4d4e9b54bf6e0ea303fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31224ba050364bd08e621c94265bc6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:50:50.843189 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-13868db8-74a9-42f4-80b0-f25981cedea0 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] 10.222.0.33 "GET /compute/v2.1/servers/7313602e-359e-435c-9a7b-3dd92a216800" status: 200 len: 1287 microversion: 2.1 time: 0.325739 Jun 05 08:50:50.849625 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1607/3124] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:50:50 2022] GET /compute/v2.1/servers/7313602e-359e-435c-9a7b-3dd92a216800 => generated 1287 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:50:50.863863 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a9532a1e-505e-4895-b0f5-bec2eec53863 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:50:50.864567 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a9532a1e-505e-4895-b0f5-bec2eec53863 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] [instance: 7313602e-359e-435c-9a7b-3dd92a216800] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:50:50.892594 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a9532a1e-505e-4895-b0f5-bec2eec53863 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:50:50.895012 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a9532a1e-505e-4895-b0f5-bec2eec53863 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:50:50.897081 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a9532a1e-505e-4895-b0f5-bec2eec53863 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:50:50.905279 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a9532a1e-505e-4895-b0f5-bec2eec53863 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:50:50.978104 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a9532a1e-505e-4895-b0f5-bec2eec53863 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] [instance: 7313602e-359e-435c-9a7b-3dd92a216800] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:50:51.135196 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a9532a1e-505e-4895-b0f5-bec2eec53863 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] [instance: 7313602e-359e-435c-9a7b-3dd92a216800] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:50:51.136227 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a9532a1e-505e-4895-b0f5-bec2eec53863 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:50:51.136688 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a9532a1e-505e-4895-b0f5-bec2eec53863 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:50:51.137162 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-a9532a1e-505e-4895-b0f5-bec2eec53863 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] [instance: 7313602e-359e-435c-9a7b-3dd92a216800] instance's host None is down, deleting from database Jun 05 08:50:51.151880 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-a9532a1e-505e-4895-b0f5-bec2eec53863 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] [instance: 7313602e-359e-435c-9a7b-3dd92a216800] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:50:51.246521 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-a9532a1e-505e-4895-b0f5-bec2eec53863 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] [instance: 7313602e-359e-435c-9a7b-3dd92a216800] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:50:51.256143 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-a9532a1e-505e-4895-b0f5-bec2eec53863 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] [instance: 7313602e-359e-435c-9a7b-3dd92a216800] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:50:51.987054 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a9532a1e-505e-4895-b0f5-bec2eec53863 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7313602e-359e-435c-9a7b-3dd92a216800" status: 204 len: 0 microversion: 2.1 time: 1.126987 Jun 05 08:50:51.999598 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1518/3125] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:50:50 2022] DELETE /compute/v2.1/servers/7313602e-359e-435c-9a7b-3dd92a216800 => generated 0 bytes in 1128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:50:51.999704 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-73e9b3bc-af25-4f07-9b6b-b72c04d4ec80 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:50:51.999704 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-73e9b3bc-af25-4f07-9b6b-b72c04d4ec80 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] [instance: 7313602e-359e-435c-9a7b-3dd92a216800] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:50:52.015235 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-73e9b3bc-af25-4f07-9b6b-b72c04d4ec80 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:50:52.017230 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-73e9b3bc-af25-4f07-9b6b-b72c04d4ec80 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:50:52.019653 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-73e9b3bc-af25-4f07-9b6b-b72c04d4ec80 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:50:52.022722 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-73e9b3bc-af25-4f07-9b6b-b72c04d4ec80 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:50:52.077716 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-73e9b3bc-af25-4f07-9b6b-b72c04d4ec80 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] HTTP exception thrown: Instance 7313602e-359e-435c-9a7b-3dd92a216800 could not be found. Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-73e9b3bc-af25-4f07-9b6b-b72c04d4ec80 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Request method failure captured: Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/7313602e-359e-435c-9a7b-3dd92a216800 HTTP/1.1 Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinG5inYbCVZqJnT7-bXxSsHPr_cQPeNAgUPxXBJXiW1ssf4wJd7dwTZnVg6uPDcDTXnj9LhAdTpiHL8VQYI3WX_m7OeOlkydOhe0eYLDrymOSlE4ogVLcFLO8fstUIOZva01nOTBY94KvxLTA2Byn_WFz60hTKgqYJvUJC-JNz8mi6SM Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 31224ba050364bd08e621c94265bc6ca Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-VolumesNegativeTest-1393387630 Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/31224ba050364bd08e621c94265bc6ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31224ba050364bd08e621c94265bc6ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_31224ba050364bd08e621c94265bc6ca", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/31224ba050364bd08e621c94265bc6ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-VolumesNegativeTest-1393387630 Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 31224ba050364bd08e621c94265bc6ca Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-VolumesNegativeTest-1393387630 Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-VolumesNegativeTest-1393387630-project Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 83a51fc46d9d4d4e9b54bf6e0ea303fe Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-VolumesNegativeTest-1393387630-project Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 7313602e-359e-435c-9a7b-3dd92a216800 could not be found. Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '7313602e-359e-435c-9a7b-3dd92a216800'} Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7313602e-359e-435c-9a7b-3dd92a216800 could not be found. Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7313602e-359e-435c-9a7b-3dd92a216800 could not be found. Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:50:52.079741 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:50:52.084614 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:50:52.084614 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:50:52.084614 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:50:52.084614 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:50:52.084614 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:50:52.084614 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7313602e-359e-435c-9a7b-3dd92a216800 could not be found. Jun 05 08:50:52.084614 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:50:52.084614 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-73e9b3bc-af25-4f07-9b6b-b72c04d4ec80 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] Returning 404 to user: Instance 7313602e-359e-435c-9a7b-3dd92a216800 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:50:52.084614 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-73e9b3bc-af25-4f07-9b6b-b72c04d4ec80 tempest-VolumesNegativeTest-1393387630 tempest-VolumesNegativeTest-1393387630-project] 10.222.0.33 "GET /compute/v2.1/servers/7313602e-359e-435c-9a7b-3dd92a216800" status: 404 len: 111 microversion: 2.1 time: 0.089486 Jun 05 08:50:52.087133 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1608/3126] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:50:51 2022] GET /compute/v2.1/servers/7313602e-359e-435c-9a7b-3dd92a216800 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:51:17.085129 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fd9124c1-1f57-448f-9e26-bedbd4300925 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Action: 'create', calling method: .version_select at 0x7f2432f111f0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1672451343", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESjR/x5C2MkIWcSRaDW8TRkloWtOkDFyDRQ3fw+b5HaiMA5pMzbbkzB3chyAUpjEK+0+E4CwV48ihZ78HShU2bRMWYtiwZykKi34fg0np7JLsTpEitl6/i6yAZdEGL1DQ=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:51:17.090570 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:51:17.114055 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:51:17.114903 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:51:17.190686 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-fd9124c1-1f57-448f-9e26-bedbd4300925 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Getting quotas for project 16cd268d827946e998770378355e8dbc. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:51:17.215987 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-fd9124c1-1f57-448f-9e26-bedbd4300925 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Getting quotas for user 1d30256cb2384c91ae6bd7b587f318ff and project 16cd268d827946e998770378355e8dbc. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:51:17.328497 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fd9124c1-1f57-448f-9e26-bedbd4300925 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.247339 Jun 05 08:51:17.334027 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1519/3127] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:51:17 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:51:26.706520 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-41fcaeb8-84d4-4c28-aea5-4d2dddb47cc1 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-902330192", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "6690f1c0-ae80-4c42-8dd2-a2dc3db1727a", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1672451343", "security_groups": [{"name": "tempest-secgroup-smoke-1656450292"}], "networks": [{"uuid": "f8526050-effe-4004-8694-169b93297418"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:51:26.748653 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:51:26.762248 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=6 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:51:26.767004 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:51:26.784696 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=12 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:51:27.321509 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-41fcaeb8-84d4-4c28-aea5-4d2dddb47cc1 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] validate_networks() for [('f8526050-effe-4004-8694-169b93297418', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:51:30.289593 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-41fcaeb8-84d4-4c28-aea5-4d2dddb47cc1 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:51:30.291157 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-41fcaeb8-84d4-4c28-aea5-4d2dddb47cc1 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:51:30.291654 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-41fcaeb8-84d4-4c28-aea5-4d2dddb47cc1 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:51:30.292089 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-41fcaeb8-84d4-4c28-aea5-4d2dddb47cc1 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:51:30.293167 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-41fcaeb8-84d4-4c28-aea5-4d2dddb47cc1 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:51:30.318951 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-41fcaeb8-84d4-4c28-aea5-4d2dddb47cc1 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:30.319609 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-41fcaeb8-84d4-4c28-aea5-4d2dddb47cc1 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:30.322659 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-41fcaeb8-84d4-4c28-aea5-4d2dddb47cc1 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:30.323114 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-41fcaeb8-84d4-4c28-aea5-4d2dddb47cc1 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:30.409388 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-41fcaeb8-84d4-4c28-aea5-4d2dddb47cc1 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Getting quotas for project 16cd268d827946e998770378355e8dbc. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:51:30.427196 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-41fcaeb8-84d4-4c28-aea5-4d2dddb47cc1 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Getting quotas for user 1d30256cb2384c91ae6bd7b587f318ff and project 16cd268d827946e998770378355e8dbc. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:51:30.640743 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-41fcaeb8-84d4-4c28-aea5-4d2dddb47cc1 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:51:30.643387 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-41fcaeb8-84d4-4c28-aea5-4d2dddb47cc1 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] [instance: 4187ef37-5c25-4455-b079-f7143e822776] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6690f1c0-ae80-4c42-8dd2-a2dc3db1727a',volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:51:31.055283 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-41fcaeb8-84d4-4c28-aea5-4d2dddb47cc1 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.352844 Jun 05 08:51:31.059225 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1609/3128] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:51:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 4357 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:51:31.070665 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-36ce5306-ddab-4c31-b023-29ede11ef5f7 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:51:31.071355 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-36ce5306-ddab-4c31-b023-29ede11ef5f7 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] [instance: 4187ef37-5c25-4455-b079-f7143e822776] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:51:31.075968 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=4 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:51:31.082119 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:51:31.370523 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-36ce5306-ddab-4c31-b023-29ede11ef5f7 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30256cb2384c91ae6bd7b587f318ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd268d827946e998770378355e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:51:31.385963 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-36ce5306-ddab-4c31-b023-29ede11ef5f7 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] 10.222.0.33 "GET /compute/v2.1/servers/4187ef37-5c25-4455-b079-f7143e822776" status: 200 len: 1098 microversion: 2.1 time: 0.319587 Jun 05 08:51:31.390654 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1520/3129] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:51:31 2022] GET /compute/v2.1/servers/4187ef37-5c25-4455-b079-f7143e822776 => generated 1098 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:51:32.406497 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-13b5cd63-7554-499b-83c4-1a0589f36f45 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:51:32.407453 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-13b5cd63-7554-499b-83c4-1a0589f36f45 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] [instance: 4187ef37-5c25-4455-b079-f7143e822776] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:51:32.433593 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-13b5cd63-7554-499b-83c4-1a0589f36f45 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:32.438242 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-13b5cd63-7554-499b-83c4-1a0589f36f45 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:32.439133 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-13b5cd63-7554-499b-83c4-1a0589f36f45 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:32.443951 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-13b5cd63-7554-499b-83c4-1a0589f36f45 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:32.582748 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-13b5cd63-7554-499b-83c4-1a0589f36f45 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:32.583211 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-13b5cd63-7554-499b-83c4-1a0589f36f45 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:32.587007 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-13b5cd63-7554-499b-83c4-1a0589f36f45 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Lazy-loading 'fault' on Instance uuid 4187ef37-5c25-4455-b079-f7143e822776 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:51:33.121295 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-13b5cd63-7554-499b-83c4-1a0589f36f45 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d30256cb2384c91ae6bd7b587f318ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd268d827946e998770378355e8dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:51:33.134591 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-13b5cd63-7554-499b-83c4-1a0589f36f45 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] 10.222.0.33 "GET /compute/v2.1/servers/4187ef37-5c25-4455-b079-f7143e822776" status: 200 len: 1217 microversion: 2.1 time: 0.733225 Jun 05 08:51:33.136434 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1610/3130] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:51:32 2022] GET /compute/v2.1/servers/4187ef37-5c25-4455-b079-f7143e822776 => generated 1217 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:51:33.152490 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a1dabed6-947e-482f-a606-2efc64aa44e2 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:51:33.152846 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a1dabed6-947e-482f-a606-2efc64aa44e2 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] [instance: 4187ef37-5c25-4455-b079-f7143e822776] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:51:33.169649 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a1dabed6-947e-482f-a606-2efc64aa44e2 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:33.172076 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a1dabed6-947e-482f-a606-2efc64aa44e2 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:33.173473 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a1dabed6-947e-482f-a606-2efc64aa44e2 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:33.174990 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a1dabed6-947e-482f-a606-2efc64aa44e2 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:33.244049 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a1dabed6-947e-482f-a606-2efc64aa44e2 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] [instance: 4187ef37-5c25-4455-b079-f7143e822776] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:51:33.355651 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a1dabed6-947e-482f-a606-2efc64aa44e2 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] [instance: 4187ef37-5c25-4455-b079-f7143e822776] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:51:33.356733 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a1dabed6-947e-482f-a606-2efc64aa44e2 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:33.357361 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a1dabed6-947e-482f-a606-2efc64aa44e2 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:33.357960 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-a1dabed6-947e-482f-a606-2efc64aa44e2 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] [instance: 4187ef37-5c25-4455-b079-f7143e822776] instance's host None is down, deleting from database Jun 05 08:51:33.364081 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-a1dabed6-947e-482f-a606-2efc64aa44e2 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] [instance: 4187ef37-5c25-4455-b079-f7143e822776] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:51:33.500139 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-a1dabed6-947e-482f-a606-2efc64aa44e2 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] [instance: 4187ef37-5c25-4455-b079-f7143e822776] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:51:33.506027 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-a1dabed6-947e-482f-a606-2efc64aa44e2 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] [instance: 4187ef37-5c25-4455-b079-f7143e822776] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:51:34.093982 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a1dabed6-947e-482f-a606-2efc64aa44e2 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4187ef37-5c25-4455-b079-f7143e822776" status: 204 len: 0 microversion: 2.1 time: 0.946677 Jun 05 08:51:34.095185 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1521/3131] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:51:33 2022] DELETE /compute/v2.1/servers/4187ef37-5c25-4455-b079-f7143e822776 => generated 0 bytes in 949 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:51:34.104584 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2b290bef-aa5e-43e1-9aa5-220b903f8d88 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:51:34.106431 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2b290bef-aa5e-43e1-9aa5-220b903f8d88 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] [instance: 4187ef37-5c25-4455-b079-f7143e822776] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:51:34.133244 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2b290bef-aa5e-43e1-9aa5-220b903f8d88 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:34.135895 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2b290bef-aa5e-43e1-9aa5-220b903f8d88 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:34.140207 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2b290bef-aa5e-43e1-9aa5-220b903f8d88 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:34.140691 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2b290bef-aa5e-43e1-9aa5-220b903f8d88 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:34.209513 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-2b290bef-aa5e-43e1-9aa5-220b903f8d88 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] HTTP exception thrown: Instance 4187ef37-5c25-4455-b079-f7143e822776 could not be found. Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2b290bef-aa5e-43e1-9aa5-220b903f8d88 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Request method failure captured: Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/4187ef37-5c25-4455-b079-f7143e822776 HTTP/1.1 Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinGzYXhEECEV-t5XvgF5LMp30LLFJVbQe29XkNtu-x6mbKH33wuNb0sx64IsUcYvwnqNVaMJ7lQTBXdrsnD7Yl-qotcVPSaWqd5fCJReXHFLmakJlZ_xVUd8NchoPw7QGdBq4fv7UUnlKfE38xgNK0THc3cljhHT0ags3m5KGGXFptio Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 16cd268d827946e998770378355e8dbc Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-TestVolumeBackupRestore-695620475 Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/16cd268d827946e998770378355e8dbc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16cd268d827946e998770378355e8dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_16cd268d827946e998770378355e8dbc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/16cd268d827946e998770378355e8dbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-TestVolumeBackupRestore-695620475 Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 16cd268d827946e998770378355e8dbc Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-TestVolumeBackupRestore-695620475 Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-TestVolumeBackupRestore-695620475-project Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 1d30256cb2384c91ae6bd7b587f318ff Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-TestVolumeBackupRestore-695620475-project Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 4187ef37-5c25-4455-b079-f7143e822776 could not be found. Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '4187ef37-5c25-4455-b079-f7143e822776'} Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4187ef37-5c25-4455-b079-f7143e822776 could not be found. Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4187ef37-5c25-4455-b079-f7143e822776 could not be found. Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:51:34.211113 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:51:34.214378 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:51:34.214378 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:51:34.214378 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:51:34.214378 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:51:34.214378 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:51:34.214378 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4187ef37-5c25-4455-b079-f7143e822776 could not be found. Jun 05 08:51:34.214378 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:51:34.214378 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2b290bef-aa5e-43e1-9aa5-220b903f8d88 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Returning 404 to user: Instance 4187ef37-5c25-4455-b079-f7143e822776 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:51:34.219062 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2b290bef-aa5e-43e1-9aa5-220b903f8d88 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] 10.222.0.33 "GET /compute/v2.1/servers/4187ef37-5c25-4455-b079-f7143e822776" status: 404 len: 111 microversion: 2.1 time: 0.119323 Jun 05 08:51:34.230105 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1611/3132] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:51:34 2022] GET /compute/v2.1/servers/4187ef37-5c25-4455-b079-f7143e822776 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:51:35.749617 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b01587ec-d915-40e9-8b6c-1cc716a024d0 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] Calling method '.version_select at 0x7f2432f7b8b0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:51:35.801807 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b01587ec-d915-40e9-8b6c-1cc716a024d0 tempest-TestVolumeBackupRestore-695620475 tempest-TestVolumeBackupRestore-695620475-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1672451343" status: 202 len: 0 microversion: 2.1 time: 0.057359 Jun 05 08:51:35.803167 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1522/3133] 10.222.0.33 () {58 vars in 1268 bytes} [Sun Jun 5 08:51:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1672451343 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:51:40.688705 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:51:40.689564 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=6 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:51:41.404564 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-08df3c96-477b-400c-a8e3-21aeb0590872 tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Action: 'create', calling method: .version_select at 0x7f243386c430>, body: {"keypair": {"name": "tempest-TestServerBasicOps-102931071", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgzPLW9ivUb9TU8Shr2x9Z0QIGbvommrVyUd7Ud6R4K6N38yVxkPxrV498QnNUr8B+ngQIddIrdeC5AbJbmDbsVtQb08tKvLC7u/i/1z1H1ENgVeEy6UC++x8eMnk5nJg=="}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:51:41.520033 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-08df3c96-477b-400c-a8e3-21aeb0590872 tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Getting quotas for project a5568b8e340e4e709e57e03ada6cc227. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:51:41.576570 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-08df3c96-477b-400c-a8e3-21aeb0590872 tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Getting quotas for user 3a685a380d3a4a5384ec5ff16c9cdde0 and project a5568b8e340e4e709e57e03ada6cc227. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:51:41.643549 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-08df3c96-477b-400c-a8e3-21aeb0590872 tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.961513 Jun 05 08:51:41.645030 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1612/3134] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:51:40 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:51:45.847539 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:51:45.849235 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:51:45.850344 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:51:45.855575 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4de4bd03-b14f-4239-bdde-fc58f7c95a9d tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-933908582", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-102931071", "security_groups": [{"name": "tempest-secgroup-smoke-973417024"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "285cb973-34ad-4880-b9a0-902cc5e4142b"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:51:46.147327 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-4de4bd03-b14f-4239-bdde-fc58f7c95a9d tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] validate_networks() for [('285cb973-34ad-4880-b9a0-902cc5e4142b', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:51:47.534158 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-4de4bd03-b14f-4239-bdde-fc58f7c95a9d tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Getting quotas for project a5568b8e340e4e709e57e03ada6cc227. Resources: dict_keys(['metadata_items']) {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:51:47.546875 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-4de4bd03-b14f-4239-bdde-fc58f7c95a9d tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Getting quotas for user 3a685a380d3a4a5384ec5ff16c9cdde0 and project a5568b8e340e4e709e57e03ada6cc227. Resources: dict_keys(['metadata_items']) {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:51:47.581528 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-4de4bd03-b14f-4239-bdde-fc58f7c95a9d tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:51:47.583868 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-4de4bd03-b14f-4239-bdde-fc58f7c95a9d tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:51:47.584642 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-4de4bd03-b14f-4239-bdde-fc58f7c95a9d tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:51:47.585192 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-4de4bd03-b14f-4239-bdde-fc58f7c95a9d tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:51:47.585904 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-4de4bd03-b14f-4239-bdde-fc58f7c95a9d tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:51:47.614700 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4de4bd03-b14f-4239-bdde-fc58f7c95a9d tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:47.617172 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4de4bd03-b14f-4239-bdde-fc58f7c95a9d tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:47.619527 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4de4bd03-b14f-4239-bdde-fc58f7c95a9d tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:47.621469 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4de4bd03-b14f-4239-bdde-fc58f7c95a9d tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:47.662931 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-4de4bd03-b14f-4239-bdde-fc58f7c95a9d tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Getting quotas for project a5568b8e340e4e709e57e03ada6cc227. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:51:47.675420 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-4de4bd03-b14f-4239-bdde-fc58f7c95a9d tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Getting quotas for user 3a685a380d3a4a5384ec5ff16c9cdde0 and project a5568b8e340e4e709e57e03ada6cc227. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:51:47.707672 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4de4bd03-b14f-4239-bdde-fc58f7c95a9d tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:51:47.710222 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4de4bd03-b14f-4239-bdde-fc58f7c95a9d tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] [instance: 9ee990b0-598b-4b3a-b23f-e8865142136e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:51:47.854164 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4de4bd03-b14f-4239-bdde-fc58f7c95a9d tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.005515 Jun 05 08:51:47.856604 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1523/3135] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:51:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 2011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:51:47.875057 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=12 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:51:47.930928 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-32762876-0746-4fff-882a-5bde8b098c2c tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:51:47.931898 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-32762876-0746-4fff-882a-5bde8b098c2c tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] [instance: 9ee990b0-598b-4b3a-b23f-e8865142136e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:51:48.138447 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-53e5798b-af30-4699-899d-2c436a97253d tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:51:48.139483 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:51:48.139483 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:51:48.140881 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-53e5798b-af30-4699-899d-2c436a97253d tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:48.141541 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-53e5798b-af30-4699-899d-2c436a97253d tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:48.142522 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-53e5798b-af30-4699-899d-2c436a97253d tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:48.143262 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-53e5798b-af30-4699-899d-2c436a97253d tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:48.195050 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-32762876-0746-4fff-882a-5bde8b098c2c tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a685a380d3a4a5384ec5ff16c9cdde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5568b8e340e4e709e57e03ada6cc227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:51:48.203845 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-32762876-0746-4fff-882a-5bde8b098c2c tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] 10.222.0.33 "GET /compute/v2.1/servers/9ee990b0-598b-4b3a-b23f-e8865142136e" status: 200 len: 1301 microversion: 2.1 time: 0.299268 Jun 05 08:51:48.213327 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1524/3136] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:51:47 2022] GET /compute/v2.1/servers/9ee990b0-598b-4b3a-b23f-e8865142136e => generated 1301 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:51:48.254381 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-53e5798b-af30-4699-899d-2c436a97253d tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] 10.222.0.33 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.384916 Jun 05 08:51:48.255346 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1613/3137] 10.222.0.33 () {58 vars in 1184 bytes} [Sun Jun 5 08:51:47 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:51:48.523327 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-8ebc9a21-f152-4f83-9aee-0fc5c3cfeda5 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1154404124", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "availability_zone": "nova:n-h2-844739-1", "networks": [{"uuid": "09ca849f-b75a-43fc-9642-4b95954bf89a"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:51:48.711150 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-8ebc9a21-f152-4f83-9aee-0fc5c3cfeda5 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] validate_networks() for [('09ca849f-b75a-43fc-9642-4b95954bf89a', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:51:49.232556 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-26b20ae4-01f5-49bf-a98a-031e2f9e103b tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:51:49.233208 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-26b20ae4-01f5-49bf-a98a-031e2f9e103b tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] [instance: 9ee990b0-598b-4b3a-b23f-e8865142136e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:51:49.249901 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-26b20ae4-01f5-49bf-a98a-031e2f9e103b tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:49.250369 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-26b20ae4-01f5-49bf-a98a-031e2f9e103b tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:49.251177 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-26b20ae4-01f5-49bf-a98a-031e2f9e103b tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:49.254277 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-26b20ae4-01f5-49bf-a98a-031e2f9e103b tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:49.402373 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-26b20ae4-01f5-49bf-a98a-031e2f9e103b tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:49.411890 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-26b20ae4-01f5-49bf-a98a-031e2f9e103b tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:49.412609 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-26b20ae4-01f5-49bf-a98a-031e2f9e103b tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Lazy-loading 'fault' on Instance uuid 9ee990b0-598b-4b3a-b23f-e8865142136e {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:51:49.569442 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-26b20ae4-01f5-49bf-a98a-031e2f9e103b tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a685a380d3a4a5384ec5ff16c9cdde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5568b8e340e4e709e57e03ada6cc227', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:51:49.590960 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-26b20ae4-01f5-49bf-a98a-031e2f9e103b tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] 10.222.0.33 "GET /compute/v2.1/servers/9ee990b0-598b-4b3a-b23f-e8865142136e" status: 200 len: 1374 microversion: 2.1 time: 0.365641 Jun 05 08:51:49.591923 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1614/3138] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:51:49 2022] GET /compute/v2.1/servers/9ee990b0-598b-4b3a-b23f-e8865142136e => generated 1374 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:51:49.614029 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d8aef354-76bd-451a-b4a4-61c8a93c38ad tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:51:49.617988 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d8aef354-76bd-451a-b4a4-61c8a93c38ad tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] [instance: 9ee990b0-598b-4b3a-b23f-e8865142136e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:51:49.636235 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d8aef354-76bd-451a-b4a4-61c8a93c38ad tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:49.637052 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d8aef354-76bd-451a-b4a4-61c8a93c38ad tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:49.641436 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d8aef354-76bd-451a-b4a4-61c8a93c38ad tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:49.642143 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d8aef354-76bd-451a-b4a4-61c8a93c38ad tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:49.685266 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d8aef354-76bd-451a-b4a4-61c8a93c38ad tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] [instance: 9ee990b0-598b-4b3a-b23f-e8865142136e] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:51:49.755996 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-8ebc9a21-f152-4f83-9aee-0fc5c3cfeda5 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:51:49.757123 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-8ebc9a21-f152-4f83-9aee-0fc5c3cfeda5 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:51:49.758001 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-8ebc9a21-f152-4f83-9aee-0fc5c3cfeda5 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:51:49.759647 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-8ebc9a21-f152-4f83-9aee-0fc5c3cfeda5 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:51:49.762829 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-8ebc9a21-f152-4f83-9aee-0fc5c3cfeda5 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:51:49.780402 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8ebc9a21-f152-4f83-9aee-0fc5c3cfeda5 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:49.781096 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8ebc9a21-f152-4f83-9aee-0fc5c3cfeda5 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:49.782535 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8ebc9a21-f152-4f83-9aee-0fc5c3cfeda5 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:49.783130 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-8ebc9a21-f152-4f83-9aee-0fc5c3cfeda5 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:49.795226 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d8aef354-76bd-451a-b4a4-61c8a93c38ad tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] [instance: 9ee990b0-598b-4b3a-b23f-e8865142136e] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:51:49.796275 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d8aef354-76bd-451a-b4a4-61c8a93c38ad tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:49.798721 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d8aef354-76bd-451a-b4a4-61c8a93c38ad tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:49.799311 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-d8aef354-76bd-451a-b4a4-61c8a93c38ad tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] [instance: 9ee990b0-598b-4b3a-b23f-e8865142136e] instance's host None is down, deleting from database Jun 05 08:51:49.809362 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-d8aef354-76bd-451a-b4a4-61c8a93c38ad tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] [instance: 9ee990b0-598b-4b3a-b23f-e8865142136e] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:51:49.810088 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-8ebc9a21-f152-4f83-9aee-0fc5c3cfeda5 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Getting quotas for project 2305627537424751b6dfc00f15e32090. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:51:49.816982 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-8ebc9a21-f152-4f83-9aee-0fc5c3cfeda5 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Getting quotas for user f96f998946844ba7b0abe675d73fd58b and project 2305627537424751b6dfc00f15e32090. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:51:49.869279 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8ebc9a21-f152-4f83-9aee-0fc5c3cfeda5 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:51:49.871733 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-8ebc9a21-f152-4f83-9aee-0fc5c3cfeda5 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] [instance: 2b6c9900-1fc7-4106-a85a-7eaa5b234b86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:51:49.880198 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-d8aef354-76bd-451a-b4a4-61c8a93c38ad tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] [instance: 9ee990b0-598b-4b3a-b23f-e8865142136e] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:51:49.890631 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-d8aef354-76bd-451a-b4a4-61c8a93c38ad tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] [instance: 9ee990b0-598b-4b3a-b23f-e8865142136e] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:51:49.977385 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-8ebc9a21-f152-4f83-9aee-0fc5c3cfeda5 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.457379 Jun 05 08:51:49.993938 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1525/3139] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:51:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:51:50.006000 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-87a56dfb-b47a-4a15-b897-755c205dadd1 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:51:50.007503 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-87a56dfb-b47a-4a15-b897-755c205dadd1 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] [instance: 2b6c9900-1fc7-4106-a85a-7eaa5b234b86] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:51:50.170706 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-87a56dfb-b47a-4a15-b897-755c205dadd1 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/2b6c9900-1fc7-4106-a85a-7eaa5b234b86" status: 200 len: 1329 microversion: 2.1 time: 0.174183 Jun 05 08:51:50.181451 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1526/3140] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:51:49 2022] GET /compute/v2.1/servers/2b6c9900-1fc7-4106-a85a-7eaa5b234b86 => generated 1329 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:51:50.257179 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d8aef354-76bd-451a-b4a4-61c8a93c38ad tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9ee990b0-598b-4b3a-b23f-e8865142136e" status: 204 len: 0 microversion: 2.1 time: 0.649129 Jun 05 08:51:50.260905 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1615/3141] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:51:49 2022] DELETE /compute/v2.1/servers/9ee990b0-598b-4b3a-b23f-e8865142136e => generated 0 bytes in 653 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:51:50.268836 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e22f5f74-c96f-4f55-a115-9583031ee526 tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:51:50.269551 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e22f5f74-c96f-4f55-a115-9583031ee526 tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] [instance: 9ee990b0-598b-4b3a-b23f-e8865142136e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:51:50.285092 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e22f5f74-c96f-4f55-a115-9583031ee526 tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:50.285960 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e22f5f74-c96f-4f55-a115-9583031ee526 tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:50.287061 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e22f5f74-c96f-4f55-a115-9583031ee526 tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:50.287638 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e22f5f74-c96f-4f55-a115-9583031ee526 tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:50.355387 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-e22f5f74-c96f-4f55-a115-9583031ee526 tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] HTTP exception thrown: Instance 9ee990b0-598b-4b3a-b23f-e8865142136e could not be found. Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e22f5f74-c96f-4f55-a115-9583031ee526 tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Request method failure captured: Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/9ee990b0-598b-4b3a-b23f-e8865142136e HTTP/1.1 Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinG6LK0XXbXi4DiAfQ8NhXuHwMMBF-k0h1MDZlFTgkRerM7WBU6V1FqsW6RwOiqqMONm3syAMH4q9O6ds8ihtkeWHVtq9dC3Yt7GXpV58yTtcd3XhtGpZdV55PSQd8nSG56l5CQQa59I9SsA9hiwQS45ORedxNglwYUNmaL5XFQMCwuM Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: a5568b8e340e4e709e57e03ada6cc227 Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-TestServerBasicOps-1055752831 Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a5568b8e340e4e709e57e03ada6cc227"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a5568b8e340e4e709e57e03ada6cc227"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a5568b8e340e4e709e57e03ada6cc227", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a5568b8e340e4e709e57e03ada6cc227"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-TestServerBasicOps-1055752831 Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: a5568b8e340e4e709e57e03ada6cc227 Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-TestServerBasicOps-1055752831 Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-TestServerBasicOps-1055752831-project Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 3a685a380d3a4a5384ec5ff16c9cdde0 Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-TestServerBasicOps-1055752831-project Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 9ee990b0-598b-4b3a-b23f-e8865142136e could not be found. Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '9ee990b0-598b-4b3a-b23f-e8865142136e'} Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ee990b0-598b-4b3a-b23f-e8865142136e could not be found. Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ee990b0-598b-4b3a-b23f-e8865142136e could not be found. Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:51:50.361928 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:51:50.366444 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:51:50.366444 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:51:50.366444 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:51:50.366444 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:51:50.366444 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:51:50.366444 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ee990b0-598b-4b3a-b23f-e8865142136e could not be found. Jun 05 08:51:50.366444 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:51:50.370715 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e22f5f74-c96f-4f55-a115-9583031ee526 tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Returning 404 to user: Instance 9ee990b0-598b-4b3a-b23f-e8865142136e could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:51:50.372136 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e22f5f74-c96f-4f55-a115-9583031ee526 tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] 10.222.0.33 "GET /compute/v2.1/servers/9ee990b0-598b-4b3a-b23f-e8865142136e" status: 404 len: 111 microversion: 2.1 time: 0.107264 Jun 05 08:51:50.377220 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1527/3142] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:51:50 2022] GET /compute/v2.1/servers/9ee990b0-598b-4b3a-b23f-e8865142136e => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:51:50.857458 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ea38b916-5a80-4246-9330-fbe82b0d0ca4 tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] Calling method '.version_select at 0x7f2433624d30>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:51:50.936802 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ea38b916-5a80-4246-9330-fbe82b0d0ca4 tempest-TestServerBasicOps-1055752831 tempest-TestServerBasicOps-1055752831-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-102931071" status: 202 len: 0 microversion: 2.1 time: 0.080314 Jun 05 08:51:50.938791 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1616/3143] 10.222.0.33 () {58 vars in 1250 bytes} [Sun Jun 5 08:51:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-102931071 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:51:51.191535 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6f32e9ac-6924-4a54-9908-33bf148a313e tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:51:51.196502 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6f32e9ac-6924-4a54-9908-33bf148a313e tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] [instance: 2b6c9900-1fc7-4106-a85a-7eaa5b234b86] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:51:51.235821 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6f32e9ac-6924-4a54-9908-33bf148a313e tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:51.239173 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6f32e9ac-6924-4a54-9908-33bf148a313e tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:51.250661 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6f32e9ac-6924-4a54-9908-33bf148a313e tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:51.250661 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6f32e9ac-6924-4a54-9908-33bf148a313e tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:51.648714 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6f32e9ac-6924-4a54-9908-33bf148a313e tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:51.650007 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6f32e9ac-6924-4a54-9908-33bf148a313e tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:51.651179 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-6f32e9ac-6924-4a54-9908-33bf148a313e tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Lazy-loading 'fault' on Instance uuid 2b6c9900-1fc7-4106-a85a-7eaa5b234b86 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:51:51.860445 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6f32e9ac-6924-4a54-9908-33bf148a313e tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/2b6c9900-1fc7-4106-a85a-7eaa5b234b86" status: 200 len: 3128 microversion: 2.1 time: 0.674895 Jun 05 08:51:51.861051 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1528/3144] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:51:51 2022] GET /compute/v2.1/servers/2b6c9900-1fc7-4106-a85a-7eaa5b234b86 => generated 3128 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:51:51.879032 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ba4d2ffe-0dfc-4703-ac91-f38081cbadb7 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:51:51.880106 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ba4d2ffe-0dfc-4703-ac91-f38081cbadb7 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] [instance: 2b6c9900-1fc7-4106-a85a-7eaa5b234b86] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:51:51.918671 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=4 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:51:51.922109 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ba4d2ffe-0dfc-4703-ac91-f38081cbadb7 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:51.922839 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ba4d2ffe-0dfc-4703-ac91-f38081cbadb7 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:51.924186 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ba4d2ffe-0dfc-4703-ac91-f38081cbadb7 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:51.924786 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ba4d2ffe-0dfc-4703-ac91-f38081cbadb7 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:52.225623 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ba4d2ffe-0dfc-4703-ac91-f38081cbadb7 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] [instance: 2b6c9900-1fc7-4106-a85a-7eaa5b234b86] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:51:52.526883 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ba4d2ffe-0dfc-4703-ac91-f38081cbadb7 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] [instance: 2b6c9900-1fc7-4106-a85a-7eaa5b234b86] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:51:52.527982 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ba4d2ffe-0dfc-4703-ac91-f38081cbadb7 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:52.528662 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ba4d2ffe-0dfc-4703-ac91-f38081cbadb7 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:52.534983 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-ba4d2ffe-0dfc-4703-ac91-f38081cbadb7 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] [instance: 2b6c9900-1fc7-4106-a85a-7eaa5b234b86] instance's host None is down, deleting from database Jun 05 08:51:52.547420 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-ba4d2ffe-0dfc-4703-ac91-f38081cbadb7 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] [instance: 2b6c9900-1fc7-4106-a85a-7eaa5b234b86] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:51:53.415294 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-ba4d2ffe-0dfc-4703-ac91-f38081cbadb7 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] [instance: 2b6c9900-1fc7-4106-a85a-7eaa5b234b86] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:51:53.425431 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-ba4d2ffe-0dfc-4703-ac91-f38081cbadb7 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] [instance: 2b6c9900-1fc7-4106-a85a-7eaa5b234b86] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:51:53.873191 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ba4d2ffe-0dfc-4703-ac91-f38081cbadb7 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] 10.222.0.33 "DELETE /compute/v2.1/servers/2b6c9900-1fc7-4106-a85a-7eaa5b234b86" status: 204 len: 0 microversion: 2.1 time: 1.999577 Jun 05 08:51:53.878692 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1617/3145] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:51:51 2022] DELETE /compute/v2.1/servers/2b6c9900-1fc7-4106-a85a-7eaa5b234b86 => generated 0 bytes in 2005 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:51:53.897959 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c85458c5-103b-4da4-b6ef-372079fc32f4 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:51:53.901819 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c85458c5-103b-4da4-b6ef-372079fc32f4 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] [instance: 2b6c9900-1fc7-4106-a85a-7eaa5b234b86] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:51:53.943155 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c85458c5-103b-4da4-b6ef-372079fc32f4 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:53.944489 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c85458c5-103b-4da4-b6ef-372079fc32f4 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:53.948673 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c85458c5-103b-4da4-b6ef-372079fc32f4 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:51:53.949311 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c85458c5-103b-4da4-b6ef-372079fc32f4 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:51:53.995080 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-c85458c5-103b-4da4-b6ef-372079fc32f4 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] HTTP exception thrown: Instance 2b6c9900-1fc7-4106-a85a-7eaa5b234b86 could not be found. Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c85458c5-103b-4da4-b6ef-372079fc32f4 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Request method failure captured: Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/2b6c9900-1fc7-4106-a85a-7eaa5b234b86 HTTP/1.1 Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinG6jpgPlRxo6zcbNg240mfqyIHYjw07Z3gQql5MlAfGGgaVeHgI4d4dGbRwnla4PUzvjbTHjqWr_T_q7ZB7d0px9abxfZQZlKc2Et-MjvH1yC85KC3gzbd1xql4mY3K0-T2dW1Y2nuaw0gBUYbKXWAfI6gcs5ZkFq0ECSGeMwZl1JYc Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 2305627537424751b6dfc00f15e32090 Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-TestServerMultinode-2003855470 Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: X-Role: admin,reader,member Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: admin,reader,member Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2305627537424751b6dfc00f15e32090"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2305627537424751b6dfc00f15e32090"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2305627537424751b6dfc00f15e32090", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2305627537424751b6dfc00f15e32090"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-TestServerMultinode-2003855470 Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 2305627537424751b6dfc00f15e32090 Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-TestServerMultinode-2003855470 Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-TestServerMultinode-2003855470-project-admin Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: f96f998946844ba7b0abe675d73fd58b Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-TestServerMultinode-2003855470-project-admin Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 2b6c9900-1fc7-4106-a85a-7eaa5b234b86 could not be found. Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '2b6c9900-1fc7-4106-a85a-7eaa5b234b86'} Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b6c9900-1fc7-4106-a85a-7eaa5b234b86 could not be found. Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b6c9900-1fc7-4106-a85a-7eaa5b234b86 could not be found. Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:51:54.010044 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:51:54.014350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:51:54.014350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:51:54.014350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:51:54.014350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:51:54.014350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:51:54.014350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b6c9900-1fc7-4106-a85a-7eaa5b234b86 could not be found. Jun 05 08:51:54.014350 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:51:54.018626 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c85458c5-103b-4da4-b6ef-372079fc32f4 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] Returning 404 to user: Instance 2b6c9900-1fc7-4106-a85a-7eaa5b234b86 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:51:54.025944 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c85458c5-103b-4da4-b6ef-372079fc32f4 tempest-TestServerMultinode-2003855470 tempest-TestServerMultinode-2003855470-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/2b6c9900-1fc7-4106-a85a-7eaa5b234b86" status: 404 len: 111 microversion: 2.1 time: 0.140702 Jun 05 08:51:54.028663 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1529/3146] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:51:53 2022] GET /compute/v2.1/servers/2b6c9900-1fc7-4106-a85a-7eaa5b234b86 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:52:03.791609 n-d-844739-1 devstack@n-api.service[119050]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 08:52:03.792163 n-d-844739-1 devstack@n-api.service[119050]: Sun Jun 5 08:52:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 08:52:46.375274 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:52:46.377841 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:52:46.379254 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=58,nova_cell0:UPDATE=30,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=4 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:52:46.605501 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-68d89878-285f-48a7-b0ef-e60c281a1587 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-565236669", "availability_zone": "foo_zone"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:52:46.635577 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:52:46.635577 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:52:46.637643 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.aggregate [None req-68d89878-285f-48a7-b0ef-e60c281a1587 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] Generated uuid 19abf1be-61ef-42b9-9b77-4cc6bd40f612 for aggregate {{(pid=119050) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 05 08:52:46.696160 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-68d89878-285f-48a7-b0ef-e60c281a1587 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.328982 Jun 05 08:52:46.697401 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1618/3147] 10.222.0.33 () {60 vars in 1163 bytes} [Sun Jun 5 08:52:46 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:52:46.704695 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=4 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:52:46.706097 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=20 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:52:46.707950 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:52:46.709283 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=16 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:52:46.713866 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2ff34e30-2079-42ec-be2f-7c04a1e086d3 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:52:46.716777 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:52:46.716777 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:52:46.763910 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2ff34e30-2079-42ec-be2f-7c04a1e086d3 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.060419 Jun 05 08:52:46.775834 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-504d8c62-ba46-4f2f-9d69-bbafb39c87b4 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:52:46.777136 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:52:46.777136 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:52:46.778851 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-504d8c62-ba46-4f2f-9d69-bbafb39c87b4 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:52:46.779467 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-504d8c62-ba46-4f2f-9d69-bbafb39c87b4 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:52:46.780543 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-504d8c62-ba46-4f2f-9d69-bbafb39c87b4 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:52:46.780989 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-504d8c62-ba46-4f2f-9d69-bbafb39c87b4 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:52:46.783323 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1530/3148] 10.222.0.33 () {60 vars in 1193 bytes} [Sun Jun 5 08:52:46 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:52:46.837228 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-504d8c62-ba46-4f2f-9d69-bbafb39c87b4 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.065292 Jun 05 08:52:46.838498 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1619/3149] 10.222.0.33 () {58 vars in 1175 bytes} [Sun Jun 5 08:52:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:52:46.851833 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b518901d-5284-4e2e-8106-a33d19e1f1f0 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:52:46.852676 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:52:46.852676 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:52:46.864019 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b518901d-5284-4e2e-8106-a33d19e1f1f0 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.017094 Jun 05 08:52:46.864640 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1531/3150] 10.222.0.33 () {58 vars in 1142 bytes} [Sun Jun 5 08:52:46 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:52:46.880398 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fa01468c-932c-48da-b0a2-752f71ce4fc0 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-844739-1"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:52:46.882180 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:52:46.882180 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:52:46.896075 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fa01468c-932c-48da-b0a2-752f71ce4fc0 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:52:46.897047 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fa01468c-932c-48da-b0a2-752f71ce4fc0 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:52:47.269574 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fa01468c-932c-48da-b0a2-752f71ce4fc0 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.396783 Jun 05 08:52:47.275739 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1620/3151] 10.222.0.33 () {60 vars in 1193 bytes} [Sun Jun 5 08:52:46 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:52:47.281001 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c1f87f75-d647-4df9-b292-6b3e85f531f1 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:52:47.282148 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:52:47.282148 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:52:47.291405 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c1f87f75-d647-4df9-b292-6b3e85f531f1 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.014028 Jun 05 08:52:47.291983 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1532/3152] 10.222.0.33 () {58 vars in 1151 bytes} [Sun Jun 5 08:52:47 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:52:47.306873 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fbe42120-4588-4e92-81bb-4574957aa496 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-2133178024", "availability_zone": "foo_zone"}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:52:47.391704 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:52:47.391704 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:52:47.484292 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fbe42120-4588-4e92-81bb-4574957aa496 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.184392 Jun 05 08:52:47.486034 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1621/3153] 10.222.0.33 () {60 vars in 1172 bytes} [Sun Jun 5 08:52:47 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:52:47.495557 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b43ade09-5a89-4320-8c61-9feddfba3860 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:52:47.496913 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:52:47.496913 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:52:47.528273 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b43ade09-5a89-4320-8c61-9feddfba3860 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.035867 Jun 05 08:52:47.542065 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0224c3e0-a3ed-4b6e-8ac3-e89a7008fd15 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:52:47.543111 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:52:47.543111 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:52:47.547057 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1533/3154] 10.222.0.33 () {60 vars in 1193 bytes} [Sun Jun 5 08:52:47 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:52:47.554067 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0224c3e0-a3ed-4b6e-8ac3-e89a7008fd15 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.017381 Jun 05 08:52:47.554804 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1622/3155] 10.222.0.33 () {58 vars in 1151 bytes} [Sun Jun 5 08:52:47 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:52:47.566579 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ce73174e-4244-40da-974b-0d20898b8f19 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-844739-1"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:52:47.567842 n-d-844739-1 devstack@n-api.service[119049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:52:47.567842 n-d-844739-1 devstack@n-api.service[119049]: warnings.warn(msg) Jun 05 08:52:47.577937 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ce73174e-4244-40da-974b-0d20898b8f19 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:52:47.578395 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ce73174e-4244-40da-974b-0d20898b8f19 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:52:47.847855 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ce73174e-4244-40da-974b-0d20898b8f19 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.286041 Jun 05 08:52:47.852199 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1534/3156] 10.222.0.33 () {60 vars in 1193 bytes} [Sun Jun 5 08:52:47 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:52:47.862239 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-96829d49-988a-4e5c-bac4-d9db5ab8d169 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:52:47.863024 n-d-844739-1 devstack@n-api.service[119050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 05 08:52:47.863024 n-d-844739-1 devstack@n-api.service[119050]: warnings.warn(msg) Jun 05 08:52:47.888953 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-96829d49-988a-4e5c-bac4-d9db5ab8d169 tempest-TestAggregatesBasicOps-1593742682 tempest-TestAggregatesBasicOps-1593742682-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.030730 Jun 05 08:52:47.889809 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1623/3157] 10.222.0.33 () {58 vars in 1154 bytes} [Sun Jun 5 08:52:47 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 05 08:53:04.291092 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=4 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:53:04.291994 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:53:04.462702 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c6f09750-61fd-42b3-a8c6-7fb5dfe77a9c tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Action: 'create', calling method: .version_select at 0x7f2432dde040>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1140306974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfaAYcC0hnj7gVwhrduxqlzZFAq/MSjlBpEopatvcGXfV4V8WVVJpJSJ6PpGSjE2fz/xfRHECwHFKkfxbA3dQ3PN/r+iS4YCliJm8ZBD+tZZBN3sQNWNHFAOxUEZ2e+7Q=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:53:04.477573 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-c6f09750-61fd-42b3-a8c6-7fb5dfe77a9c tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Getting quotas for project 3e72b2e3d6884f9db111dea6b517d747. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:53:04.484347 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-c6f09750-61fd-42b3-a8c6-7fb5dfe77a9c tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Getting quotas for user 226896aaa10a4a2db326fda289c33dc4 and project 3e72b2e3d6884f9db111dea6b517d747. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:53:04.515512 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c6f09750-61fd-42b3-a8c6-7fb5dfe77a9c tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.226173 Jun 05 08:53:04.516608 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1535/3158] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:53:04 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:53:11.581654 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:53:11.583437 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=6 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:53:11.584932 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:53:11.625976 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-09816ae6-7746-4b10-8957-b1c9aa515b80 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-238976517-access_point-1926023872", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "92ae75d3-be5b-45b7-85f6-94cec4bd45b0"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1140306974", "security_groups": [{"name": "tempest-secgroup_access--2068855391"}, {"name": "tempest-secgroup_general--1893119387"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:53:11.936972 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-09816ae6-7746-4b10-8957-b1c9aa515b80 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] validate_networks() for [('92ae75d3-be5b-45b7-85f6-94cec4bd45b0', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:53:12.498947 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-09816ae6-7746-4b10-8957-b1c9aa515b80 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:53:12.499401 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-09816ae6-7746-4b10-8957-b1c9aa515b80 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:53:12.499883 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-09816ae6-7746-4b10-8957-b1c9aa515b80 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:53:12.500336 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-09816ae6-7746-4b10-8957-b1c9aa515b80 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:53:12.500776 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-09816ae6-7746-4b10-8957-b1c9aa515b80 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:53:12.510867 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-09816ae6-7746-4b10-8957-b1c9aa515b80 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:53:12.511332 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-09816ae6-7746-4b10-8957-b1c9aa515b80 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:53:12.512167 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-09816ae6-7746-4b10-8957-b1c9aa515b80 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:53:12.512612 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-09816ae6-7746-4b10-8957-b1c9aa515b80 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:53:12.534238 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-09816ae6-7746-4b10-8957-b1c9aa515b80 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Getting quotas for project 3e72b2e3d6884f9db111dea6b517d747. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:53:12.549682 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-09816ae6-7746-4b10-8957-b1c9aa515b80 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Getting quotas for user 226896aaa10a4a2db326fda289c33dc4 and project 3e72b2e3d6884f9db111dea6b517d747. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:53:12.578716 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-09816ae6-7746-4b10-8957-b1c9aa515b80 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:53:12.580669 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.utils [None req-09816ae6-7746-4b10-8957-b1c9aa515b80 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-238976517-access_point-1926023872 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-238976517-acc Jun 05 08:53:12.581657 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-09816ae6-7746-4b10-8957-b1c9aa515b80 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] [instance: a13bd1c9-4ba0-4599-87d7-ca5099a8037b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:53:12.690515 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-09816ae6-7746-4b10-8957-b1c9aa515b80 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 1.110025 Jun 05 08:53:12.698312 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1624/3159] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:53:11 2022] POST /compute/v2.1/servers => generated 458 bytes in 1119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:53:12.703479 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3748bf24-4040-4a90-aa69-58954d87c330 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:53:12.712490 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-3748bf24-4040-4a90-aa69-58954d87c330 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] [instance: a13bd1c9-4ba0-4599-87d7-ca5099a8037b] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:53:12.810032 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-3748bf24-4040-4a90-aa69-58954d87c330 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226896aaa10a4a2db326fda289c33dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e72b2e3d6884f9db111dea6b517d747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:53:12.818523 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3748bf24-4040-4a90-aa69-58954d87c330 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] 10.222.0.33 "GET /compute/v2.1/servers/a13bd1c9-4ba0-4599-87d7-ca5099a8037b" status: 200 len: 1294 microversion: 2.1 time: 0.121182 Jun 05 08:53:12.820558 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1536/3160] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:53:12 2022] GET /compute/v2.1/servers/a13bd1c9-4ba0-4599-87d7-ca5099a8037b => generated 1294 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 08:53:13.843632 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ac0ff9e1-f727-40a6-a9ca-28ad837a4c12 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:53:13.847916 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ac0ff9e1-f727-40a6-a9ca-28ad837a4c12 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] [instance: a13bd1c9-4ba0-4599-87d7-ca5099a8037b] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:53:13.862766 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ac0ff9e1-f727-40a6-a9ca-28ad837a4c12 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:53:13.863290 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ac0ff9e1-f727-40a6-a9ca-28ad837a4c12 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:53:13.865342 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ac0ff9e1-f727-40a6-a9ca-28ad837a4c12 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:53:13.866287 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ac0ff9e1-f727-40a6-a9ca-28ad837a4c12 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:53:13.934127 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ac0ff9e1-f727-40a6-a9ca-28ad837a4c12 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:53:13.934127 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ac0ff9e1-f727-40a6-a9ca-28ad837a4c12 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:53:13.934127 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-ac0ff9e1-f727-40a6-a9ca-28ad837a4c12 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Lazy-loading 'fault' on Instance uuid a13bd1c9-4ba0-4599-87d7-ca5099a8037b {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:53:14.013441 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ac0ff9e1-f727-40a6-a9ca-28ad837a4c12 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226896aaa10a4a2db326fda289c33dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e72b2e3d6884f9db111dea6b517d747', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:53:14.027553 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ac0ff9e1-f727-40a6-a9ca-28ad837a4c12 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] 10.222.0.33 "GET /compute/v2.1/servers/a13bd1c9-4ba0-4599-87d7-ca5099a8037b" status: 200 len: 1367 microversion: 2.1 time: 0.193799 Jun 05 08:53:14.038190 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1625/3161] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:53:13 2022] GET /compute/v2.1/servers/a13bd1c9-4ba0-4599-87d7-ca5099a8037b => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:53:14.044439 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6262f1e9-2ffa-4c8a-9ea9-9832f1cf1088 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:53:14.045501 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6262f1e9-2ffa-4c8a-9ea9-9832f1cf1088 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] [instance: a13bd1c9-4ba0-4599-87d7-ca5099a8037b] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:53:14.056249 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6262f1e9-2ffa-4c8a-9ea9-9832f1cf1088 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:53:14.057063 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6262f1e9-2ffa-4c8a-9ea9-9832f1cf1088 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:53:14.058085 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6262f1e9-2ffa-4c8a-9ea9-9832f1cf1088 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:53:14.058736 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6262f1e9-2ffa-4c8a-9ea9-9832f1cf1088 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:53:14.086842 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6262f1e9-2ffa-4c8a-9ea9-9832f1cf1088 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] [instance: a13bd1c9-4ba0-4599-87d7-ca5099a8037b] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:53:14.146367 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6262f1e9-2ffa-4c8a-9ea9-9832f1cf1088 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] [instance: a13bd1c9-4ba0-4599-87d7-ca5099a8037b] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:53:14.148326 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6262f1e9-2ffa-4c8a-9ea9-9832f1cf1088 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:53:14.149084 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6262f1e9-2ffa-4c8a-9ea9-9832f1cf1088 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:53:14.149739 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-6262f1e9-2ffa-4c8a-9ea9-9832f1cf1088 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] [instance: a13bd1c9-4ba0-4599-87d7-ca5099a8037b] instance's host None is down, deleting from database Jun 05 08:53:14.156715 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-6262f1e9-2ffa-4c8a-9ea9-9832f1cf1088 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] [instance: a13bd1c9-4ba0-4599-87d7-ca5099a8037b] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:53:14.199574 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-6262f1e9-2ffa-4c8a-9ea9-9832f1cf1088 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] [instance: a13bd1c9-4ba0-4599-87d7-ca5099a8037b] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:53:14.206746 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-6262f1e9-2ffa-4c8a-9ea9-9832f1cf1088 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] [instance: a13bd1c9-4ba0-4599-87d7-ca5099a8037b] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:53:14.452497 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6262f1e9-2ffa-4c8a-9ea9-9832f1cf1088 tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a13bd1c9-4ba0-4599-87d7-ca5099a8037b" status: 204 len: 0 microversion: 2.1 time: 0.411772 Jun 05 08:53:14.453435 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1537/3162] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:53:14 2022] DELETE /compute/v2.1/servers/a13bd1c9-4ba0-4599-87d7-ca5099a8037b => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:53:14.461793 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7a69ecd5-f447-4657-b744-3224cd3b003c tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:53:14.462421 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7a69ecd5-f447-4657-b744-3224cd3b003c tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] [instance: a13bd1c9-4ba0-4599-87d7-ca5099a8037b] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:53:14.471975 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7a69ecd5-f447-4657-b744-3224cd3b003c tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:53:14.472682 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7a69ecd5-f447-4657-b744-3224cd3b003c tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:53:14.474402 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7a69ecd5-f447-4657-b744-3224cd3b003c tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:53:14.475009 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7a69ecd5-f447-4657-b744-3224cd3b003c tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:53:14.495202 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-7a69ecd5-f447-4657-b744-3224cd3b003c tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] HTTP exception thrown: Instance a13bd1c9-4ba0-4599-87d7-ca5099a8037b could not be found. Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7a69ecd5-f447-4657-b744-3224cd3b003c tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Request method failure captured: Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/a13bd1c9-4ba0-4599-87d7-ca5099a8037b HTTP/1.1 Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinG7v9py3lGs_zLwRR1QSo7-MZ144h0l8WQa7hhiBz9AhMaGsqaZ3GLHdmA_K8Lqm82WNgC2np945HU6BeJktj16e2pt2af9JVvoOu7f0Mu35_r7kRSGFNtaUvqFaWDTENCtDh8xvZgjT4m8v7IRuxP0iKOvSaGmRY7KQH0etGDlV8m0 Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 3e72b2e3d6884f9db111dea6b517d747 Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-238976517 Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3e72b2e3d6884f9db111dea6b517d747"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3e72b2e3d6884f9db111dea6b517d747"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3e72b2e3d6884f9db111dea6b517d747", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3e72b2e3d6884f9db111dea6b517d747"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-TestSecurityGroupsBasicOps-238976517 Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 3e72b2e3d6884f9db111dea6b517d747 Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-238976517 Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-TestSecurityGroupsBasicOps-238976517-project Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 226896aaa10a4a2db326fda289c33dc4 Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-TestSecurityGroupsBasicOps-238976517-project Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance a13bd1c9-4ba0-4599-87d7-ca5099a8037b could not be found. Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'a13bd1c9-4ba0-4599-87d7-ca5099a8037b'} Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a13bd1c9-4ba0-4599-87d7-ca5099a8037b could not be found. Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a13bd1c9-4ba0-4599-87d7-ca5099a8037b could not be found. Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:53:14.497155 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:53:14.500616 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:53:14.500616 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:53:14.500616 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:53:14.500616 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:53:14.500616 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:53:14.500616 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a13bd1c9-4ba0-4599-87d7-ca5099a8037b could not be found. Jun 05 08:53:14.500616 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:53:14.500616 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7a69ecd5-f447-4657-b744-3224cd3b003c tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Returning 404 to user: Instance a13bd1c9-4ba0-4599-87d7-ca5099a8037b could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:53:14.500616 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7a69ecd5-f447-4657-b744-3224cd3b003c tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] 10.222.0.33 "GET /compute/v2.1/servers/a13bd1c9-4ba0-4599-87d7-ca5099a8037b" status: 404 len: 111 microversion: 2.1 time: 0.041206 Jun 05 08:53:14.503090 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1626/3163] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:53:14 2022] GET /compute/v2.1/servers/a13bd1c9-4ba0-4599-87d7-ca5099a8037b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:53:20.918001 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-15c466eb-c3b6-480f-9873-fae0d9a2574d tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] Calling method '.version_select at 0x7f2432f113a0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:53:20.956154 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-15c466eb-c3b6-480f-9873-fae0d9a2574d tempest-TestSecurityGroupsBasicOps-238976517 tempest-TestSecurityGroupsBasicOps-238976517-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1140306974" status: 202 len: 0 microversion: 2.1 time: 0.042191 Jun 05 08:53:20.958510 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1538/3164] 10.222.0.33 () {58 vars in 1277 bytes} [Sun Jun 5 08:53:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1140306974 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:53:33.269089 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-69baad34-c8fc-41aa-9671-8ae0e47a2036 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1558120309", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "4abc43f1-abe0-4d49-b906-43997c020f92", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4efba431-52b7-48d5-9703-aa9668c7ab96"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:53:33.280435 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:53:33.281545 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=6 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:53:33.282257 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:53:33.283431 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=12 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:53:33.356970 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-69baad34-c8fc-41aa-9671-8ae0e47a2036 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] validate_networks() for [('4efba431-52b7-48d5-9703-aa9668c7ab96', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:53:33.897215 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-69baad34-c8fc-41aa-9671-8ae0e47a2036 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:53:33.898012 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-69baad34-c8fc-41aa-9671-8ae0e47a2036 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:53:33.898638 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-69baad34-c8fc-41aa-9671-8ae0e47a2036 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:53:33.899245 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-69baad34-c8fc-41aa-9671-8ae0e47a2036 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:53:33.900299 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-69baad34-c8fc-41aa-9671-8ae0e47a2036 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:53:33.915841 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-69baad34-c8fc-41aa-9671-8ae0e47a2036 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:53:33.916326 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-69baad34-c8fc-41aa-9671-8ae0e47a2036 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:53:33.917126 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-69baad34-c8fc-41aa-9671-8ae0e47a2036 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:53:33.917562 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-69baad34-c8fc-41aa-9671-8ae0e47a2036 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:53:33.937058 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-69baad34-c8fc-41aa-9671-8ae0e47a2036 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Getting quotas for project 5d27147659194eddaf26e972e5be75b0. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:53:33.943508 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-69baad34-c8fc-41aa-9671-8ae0e47a2036 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Getting quotas for user 002d53b0f0974a8ba68ff9d0e5d81df3 and project 5d27147659194eddaf26e972e5be75b0. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:53:34.013578 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-69baad34-c8fc-41aa-9671-8ae0e47a2036 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:53:34.015495 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-69baad34-c8fc-41aa-9671-8ae0e47a2036 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 20e8c51e-4fdf-4a31-8308-2e0dc9681c50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4abc43f1-abe0-4d49-b906-43997c020f92',volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:53:34.211720 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-69baad34-c8fc-41aa-9671-8ae0e47a2036 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.949389 Jun 05 08:53:34.212922 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1627/3165] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:53:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:53:34.221386 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=6 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:53:34.229108 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:53:34.230076 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:53:34.234773 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b3a1a2b1-ebed-4fc5-96f6-73cf4cd13a8f tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:53:34.235414 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b3a1a2b1-ebed-4fc5-96f6-73cf4cd13a8f tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 20e8c51e-4fdf-4a31-8308-2e0dc9681c50] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:53:34.303802 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-b3a1a2b1-ebed-4fc5-96f6-73cf4cd13a8f tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002d53b0f0974a8ba68ff9d0e5d81df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d27147659194eddaf26e972e5be75b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:53:34.315039 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b3a1a2b1-ebed-4fc5-96f6-73cf4cd13a8f tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] 10.222.0.33 "GET /compute/v2.1/servers/20e8c51e-4fdf-4a31-8308-2e0dc9681c50" status: 200 len: 1057 microversion: 2.1 time: 0.095217 Jun 05 08:53:34.316648 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1539/3166] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:53:34 2022] GET /compute/v2.1/servers/20e8c51e-4fdf-4a31-8308-2e0dc9681c50 => generated 1057 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:53:35.334403 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-76002b38-43a8-4dea-b407-e0e1a7c4f996 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:53:35.335022 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-76002b38-43a8-4dea-b407-e0e1a7c4f996 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 20e8c51e-4fdf-4a31-8308-2e0dc9681c50] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:53:35.342159 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-76002b38-43a8-4dea-b407-e0e1a7c4f996 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:53:35.342610 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-76002b38-43a8-4dea-b407-e0e1a7c4f996 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:53:35.343369 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-76002b38-43a8-4dea-b407-e0e1a7c4f996 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:53:35.343804 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-76002b38-43a8-4dea-b407-e0e1a7c4f996 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:53:35.373289 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-76002b38-43a8-4dea-b407-e0e1a7c4f996 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:53:35.373736 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-76002b38-43a8-4dea-b407-e0e1a7c4f996 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:53:35.374182 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-76002b38-43a8-4dea-b407-e0e1a7c4f996 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lazy-loading 'fault' on Instance uuid 20e8c51e-4fdf-4a31-8308-2e0dc9681c50 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:53:35.419540 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-76002b38-43a8-4dea-b407-e0e1a7c4f996 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002d53b0f0974a8ba68ff9d0e5d81df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d27147659194eddaf26e972e5be75b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:53:35.428239 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-76002b38-43a8-4dea-b407-e0e1a7c4f996 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] 10.222.0.33 "GET /compute/v2.1/servers/20e8c51e-4fdf-4a31-8308-2e0dc9681c50" status: 200 len: 1176 microversion: 2.1 time: 0.098476 Jun 05 08:53:35.428813 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1628/3167] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:53:35 2022] GET /compute/v2.1/servers/20e8c51e-4fdf-4a31-8308-2e0dc9681c50 => generated 1176 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:53:35.444316 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-35092296-8440-42ca-8a7e-9a499b541e49 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:53:35.444813 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-35092296-8440-42ca-8a7e-9a499b541e49 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 20e8c51e-4fdf-4a31-8308-2e0dc9681c50] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:53:35.452651 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-35092296-8440-42ca-8a7e-9a499b541e49 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:53:35.453112 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-35092296-8440-42ca-8a7e-9a499b541e49 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:53:35.453888 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-35092296-8440-42ca-8a7e-9a499b541e49 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:53:35.454326 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-35092296-8440-42ca-8a7e-9a499b541e49 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:53:35.480081 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-35092296-8440-42ca-8a7e-9a499b541e49 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 20e8c51e-4fdf-4a31-8308-2e0dc9681c50] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:53:35.527927 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-35092296-8440-42ca-8a7e-9a499b541e49 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 20e8c51e-4fdf-4a31-8308-2e0dc9681c50] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:53:35.528771 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-35092296-8440-42ca-8a7e-9a499b541e49 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:53:35.529214 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-35092296-8440-42ca-8a7e-9a499b541e49 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:53:35.529651 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-35092296-8440-42ca-8a7e-9a499b541e49 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 20e8c51e-4fdf-4a31-8308-2e0dc9681c50] instance's host None is down, deleting from database Jun 05 08:53:35.534238 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-35092296-8440-42ca-8a7e-9a499b541e49 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 20e8c51e-4fdf-4a31-8308-2e0dc9681c50] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:53:35.570803 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-35092296-8440-42ca-8a7e-9a499b541e49 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 20e8c51e-4fdf-4a31-8308-2e0dc9681c50] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:53:35.576699 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-35092296-8440-42ca-8a7e-9a499b541e49 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 20e8c51e-4fdf-4a31-8308-2e0dc9681c50] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:53:35.790473 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-35092296-8440-42ca-8a7e-9a499b541e49 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] 10.222.0.33 "DELETE /compute/v2.1/servers/20e8c51e-4fdf-4a31-8308-2e0dc9681c50" status: 204 len: 0 microversion: 2.1 time: 0.349833 Jun 05 08:53:35.791732 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1540/3168] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:53:35 2022] DELETE /compute/v2.1/servers/20e8c51e-4fdf-4a31-8308-2e0dc9681c50 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:53:35.799723 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-41e7b9b8-cd58-4c78-82d9-1e34e5610012 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:53:35.800408 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-41e7b9b8-cd58-4c78-82d9-1e34e5610012 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 20e8c51e-4fdf-4a31-8308-2e0dc9681c50] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:53:35.807326 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-41e7b9b8-cd58-4c78-82d9-1e34e5610012 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:53:35.807797 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-41e7b9b8-cd58-4c78-82d9-1e34e5610012 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:53:35.808598 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-41e7b9b8-cd58-4c78-82d9-1e34e5610012 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:53:35.809042 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-41e7b9b8-cd58-4c78-82d9-1e34e5610012 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:53:35.823406 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-41e7b9b8-cd58-4c78-82d9-1e34e5610012 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] HTTP exception thrown: Instance 20e8c51e-4fdf-4a31-8308-2e0dc9681c50 could not be found. Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-41e7b9b8-cd58-4c78-82d9-1e34e5610012 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Request method failure captured: Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/20e8c51e-4fdf-4a31-8308-2e0dc9681c50 HTTP/1.1 Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinG8DkI5tj2tCqcPrcBIBBxzbFEeup92hxsS0mDHdshCJPEz6GeY9QAD0hu23-NZuqFctxvQ7wKbxz49sH6odvzACuzZacXMQTZHNCva3xgecmVgM8LwgCbgy2_faZfQLhYi563x1GMxzuyfNivwrmYOjfj7iy6Vnd9ZL8e9Wl_I_pyM Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 5d27147659194eddaf26e972e5be75b0 Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-TestVolumeBootPattern-1726159269 Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5d27147659194eddaf26e972e5be75b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5d27147659194eddaf26e972e5be75b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5d27147659194eddaf26e972e5be75b0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5d27147659194eddaf26e972e5be75b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-TestVolumeBootPattern-1726159269 Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 5d27147659194eddaf26e972e5be75b0 Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-TestVolumeBootPattern-1726159269 Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-TestVolumeBootPattern-1726159269-project Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 002d53b0f0974a8ba68ff9d0e5d81df3 Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-TestVolumeBootPattern-1726159269-project Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 20e8c51e-4fdf-4a31-8308-2e0dc9681c50 could not be found. Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '20e8c51e-4fdf-4a31-8308-2e0dc9681c50'} Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20e8c51e-4fdf-4a31-8308-2e0dc9681c50 could not be found. Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20e8c51e-4fdf-4a31-8308-2e0dc9681c50 could not be found. Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:53:35.825172 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:53:35.830315 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:53:35.830315 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:53:35.830315 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:53:35.830315 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:53:35.830315 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:53:35.830315 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20e8c51e-4fdf-4a31-8308-2e0dc9681c50 could not be found. Jun 05 08:53:35.830315 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:53:35.830315 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-41e7b9b8-cd58-4c78-82d9-1e34e5610012 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Returning 404 to user: Instance 20e8c51e-4fdf-4a31-8308-2e0dc9681c50 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:53:35.830315 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-41e7b9b8-cd58-4c78-82d9-1e34e5610012 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] 10.222.0.33 "GET /compute/v2.1/servers/20e8c51e-4fdf-4a31-8308-2e0dc9681c50" status: 404 len: 111 microversion: 2.1 time: 0.030843 Jun 05 08:53:35.830315 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1629/3169] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:53:35 2022] GET /compute/v2.1/servers/20e8c51e-4fdf-4a31-8308-2e0dc9681c50 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 05 08:53:37.795517 n-d-844739-1 devstack@n-api.service[119049]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 08:53:37.796306 n-d-844739-1 devstack@n-api.service[119049]: Sun Jun 5 08:53:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 08:54:04.374074 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a45193d7-8fae-436a-aff6-4b192ce2b598 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-646692649", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f36e60c7-d93a-4a34-89c3-30632246259a", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "4efba431-52b7-48d5-9703-aa9668c7ab96"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:54:04.382227 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:54:04.384566 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:54:04.385357 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:54:04.471741 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-a45193d7-8fae-436a-aff6-4b192ce2b598 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] validate_networks() for [('4efba431-52b7-48d5-9703-aa9668c7ab96', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:54:04.856630 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-a45193d7-8fae-436a-aff6-4b192ce2b598 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:54:04.857063 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-a45193d7-8fae-436a-aff6-4b192ce2b598 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:54:04.857548 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-a45193d7-8fae-436a-aff6-4b192ce2b598 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:54:04.857964 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-a45193d7-8fae-436a-aff6-4b192ce2b598 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:54:04.858382 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-a45193d7-8fae-436a-aff6-4b192ce2b598 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:54:04.867635 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a45193d7-8fae-436a-aff6-4b192ce2b598 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:54:04.868107 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a45193d7-8fae-436a-aff6-4b192ce2b598 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:54:04.868900 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a45193d7-8fae-436a-aff6-4b192ce2b598 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:54:04.869336 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a45193d7-8fae-436a-aff6-4b192ce2b598 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:54:04.886388 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-a45193d7-8fae-436a-aff6-4b192ce2b598 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Getting quotas for project 5d27147659194eddaf26e972e5be75b0. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:54:04.891260 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-a45193d7-8fae-436a-aff6-4b192ce2b598 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Getting quotas for user 002d53b0f0974a8ba68ff9d0e5d81df3 and project 5d27147659194eddaf26e972e5be75b0. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:54:04.904146 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a45193d7-8fae-436a-aff6-4b192ce2b598 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:54:04.906244 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a45193d7-8fae-436a-aff6-4b192ce2b598 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 990865eb-21f7-4bb3-943b-2bfaabcb2b72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='f36e60c7-d93a-4a34-89c3-30632246259a',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:54:04.982426 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a45193d7-8fae-436a-aff6-4b192ce2b598 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612352 Jun 05 08:54:04.983606 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1541/3170] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:54:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:54:04.993466 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-050a6afb-10bb-450d-9c8d-c150f068ccfe tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:54:04.994348 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-050a6afb-10bb-450d-9c8d-c150f068ccfe tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 990865eb-21f7-4bb3-943b-2bfaabcb2b72] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:54:04.997505 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:54:04.998254 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=6 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:54:04.999015 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:54:04.999623 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=12 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:54:05.059521 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-050a6afb-10bb-450d-9c8d-c150f068ccfe tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002d53b0f0974a8ba68ff9d0e5d81df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d27147659194eddaf26e972e5be75b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:54:05.070894 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-050a6afb-10bb-450d-9c8d-c150f068ccfe tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] 10.222.0.33 "GET /compute/v2.1/servers/990865eb-21f7-4bb3-943b-2bfaabcb2b72" status: 200 len: 1056 microversion: 2.1 time: 0.079816 Jun 05 08:54:05.071564 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1630/3171] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:54:04 2022] GET /compute/v2.1/servers/990865eb-21f7-4bb3-943b-2bfaabcb2b72 => generated 1056 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:54:06.088337 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9189af90-d0b0-47c1-9385-5a16bdc78781 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:54:06.088954 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9189af90-d0b0-47c1-9385-5a16bdc78781 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 990865eb-21f7-4bb3-943b-2bfaabcb2b72] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:54:06.095780 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9189af90-d0b0-47c1-9385-5a16bdc78781 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:54:06.096815 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9189af90-d0b0-47c1-9385-5a16bdc78781 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:54:06.097789 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9189af90-d0b0-47c1-9385-5a16bdc78781 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:54:06.098236 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9189af90-d0b0-47c1-9385-5a16bdc78781 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:54:06.128659 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9189af90-d0b0-47c1-9385-5a16bdc78781 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:54:06.129112 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9189af90-d0b0-47c1-9385-5a16bdc78781 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:54:06.129652 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-9189af90-d0b0-47c1-9385-5a16bdc78781 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lazy-loading 'fault' on Instance uuid 990865eb-21f7-4bb3-943b-2bfaabcb2b72 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:54:06.173799 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-9189af90-d0b0-47c1-9385-5a16bdc78781 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002d53b0f0974a8ba68ff9d0e5d81df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d27147659194eddaf26e972e5be75b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:54:06.181488 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9189af90-d0b0-47c1-9385-5a16bdc78781 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] 10.222.0.33 "GET /compute/v2.1/servers/990865eb-21f7-4bb3-943b-2bfaabcb2b72" status: 200 len: 1129 microversion: 2.1 time: 0.098133 Jun 05 08:54:06.182056 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1542/3172] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:54:06 2022] GET /compute/v2.1/servers/990865eb-21f7-4bb3-943b-2bfaabcb2b72 => generated 1129 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:54:06.197665 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-e23c395c-b7ba-434b-b71f-99a90e236951 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:54:06.198249 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e23c395c-b7ba-434b-b71f-99a90e236951 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 990865eb-21f7-4bb3-943b-2bfaabcb2b72] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:54:06.207955 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e23c395c-b7ba-434b-b71f-99a90e236951 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:54:06.208715 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e23c395c-b7ba-434b-b71f-99a90e236951 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:54:06.209505 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e23c395c-b7ba-434b-b71f-99a90e236951 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:54:06.209967 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e23c395c-b7ba-434b-b71f-99a90e236951 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:54:06.235062 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e23c395c-b7ba-434b-b71f-99a90e236951 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 990865eb-21f7-4bb3-943b-2bfaabcb2b72] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:54:06.284588 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e23c395c-b7ba-434b-b71f-99a90e236951 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 990865eb-21f7-4bb3-943b-2bfaabcb2b72] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:54:06.285434 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e23c395c-b7ba-434b-b71f-99a90e236951 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:54:06.285960 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-e23c395c-b7ba-434b-b71f-99a90e236951 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:54:06.286544 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-e23c395c-b7ba-434b-b71f-99a90e236951 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 990865eb-21f7-4bb3-943b-2bfaabcb2b72] instance's host None is down, deleting from database Jun 05 08:54:06.293548 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-e23c395c-b7ba-434b-b71f-99a90e236951 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 990865eb-21f7-4bb3-943b-2bfaabcb2b72] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:54:06.334671 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-e23c395c-b7ba-434b-b71f-99a90e236951 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 990865eb-21f7-4bb3-943b-2bfaabcb2b72] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:54:06.341204 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-e23c395c-b7ba-434b-b71f-99a90e236951 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 990865eb-21f7-4bb3-943b-2bfaabcb2b72] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:54:06.350111 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-e23c395c-b7ba-434b-b71f-99a90e236951 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 990865eb-21f7-4bb3-943b-2bfaabcb2b72] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=119050) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2553}} Jun 05 08:54:06.376829 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-e23c395c-b7ba-434b-b71f-99a90e236951 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 990865eb-21f7-4bb3-943b-2bfaabcb2b72] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Jun 05 08:54:06.527041 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-e23c395c-b7ba-434b-b71f-99a90e236951 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] 10.222.0.33 "DELETE /compute/v2.1/servers/990865eb-21f7-4bb3-943b-2bfaabcb2b72" status: 204 len: 0 microversion: 2.1 time: 0.333180 Jun 05 08:54:06.527638 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1631/3173] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:54:06 2022] DELETE /compute/v2.1/servers/990865eb-21f7-4bb3-943b-2bfaabcb2b72 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:54:06.536198 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-73bee08d-33b3-44eb-9dd7-1ec8df3f6dd3 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:54:06.536821 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-73bee08d-33b3-44eb-9dd7-1ec8df3f6dd3 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 990865eb-21f7-4bb3-943b-2bfaabcb2b72] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:54:06.542946 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-73bee08d-33b3-44eb-9dd7-1ec8df3f6dd3 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:54:06.543405 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-73bee08d-33b3-44eb-9dd7-1ec8df3f6dd3 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:54:06.544209 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-73bee08d-33b3-44eb-9dd7-1ec8df3f6dd3 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:54:06.544651 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-73bee08d-33b3-44eb-9dd7-1ec8df3f6dd3 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:54:06.558529 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-73bee08d-33b3-44eb-9dd7-1ec8df3f6dd3 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] HTTP exception thrown: Instance 990865eb-21f7-4bb3-943b-2bfaabcb2b72 could not be found. Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-73bee08d-33b3-44eb-9dd7-1ec8df3f6dd3 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Request method failure captured: Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/990865eb-21f7-4bb3-943b-2bfaabcb2b72 HTTP/1.1 Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinG8DkI5tj2tCqcPrcBIBBxzbFEeup92hxsS0mDHdshCJPEz6GeY9QAD0hu23-NZuqFctxvQ7wKbxz49sH6odvzACuzZacXMQTZHNCva3xgecmVgM8LwgCbgy2_faZfQLhYi563x1GMxzuyfNivwrmYOjfj7iy6Vnd9ZL8e9Wl_I_pyM Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 5d27147659194eddaf26e972e5be75b0 Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-TestVolumeBootPattern-1726159269 Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5d27147659194eddaf26e972e5be75b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5d27147659194eddaf26e972e5be75b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5d27147659194eddaf26e972e5be75b0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5d27147659194eddaf26e972e5be75b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-TestVolumeBootPattern-1726159269 Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 5d27147659194eddaf26e972e5be75b0 Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-TestVolumeBootPattern-1726159269 Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-TestVolumeBootPattern-1726159269-project Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 002d53b0f0974a8ba68ff9d0e5d81df3 Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-TestVolumeBootPattern-1726159269-project Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 990865eb-21f7-4bb3-943b-2bfaabcb2b72 could not be found. Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '990865eb-21f7-4bb3-943b-2bfaabcb2b72'} Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 990865eb-21f7-4bb3-943b-2bfaabcb2b72 could not be found. Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 990865eb-21f7-4bb3-943b-2bfaabcb2b72 could not be found. Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:54:06.560138 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:54:06.564378 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:54:06.564378 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:54:06.564378 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:54:06.564378 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:54:06.564378 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:54:06.564378 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 990865eb-21f7-4bb3-943b-2bfaabcb2b72 could not be found. Jun 05 08:54:06.564378 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 08:54:06.564378 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-73bee08d-33b3-44eb-9dd7-1ec8df3f6dd3 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Returning 404 to user: Instance 990865eb-21f7-4bb3-943b-2bfaabcb2b72 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:54:06.564378 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-73bee08d-33b3-44eb-9dd7-1ec8df3f6dd3 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] 10.222.0.33 "GET /compute/v2.1/servers/990865eb-21f7-4bb3-943b-2bfaabcb2b72" status: 404 len: 111 microversion: 2.1 time: 0.029355 Jun 05 08:54:06.566313 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1543/3174] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:54:06 2022] GET /compute/v2.1/servers/990865eb-21f7-4bb3-943b-2bfaabcb2b72 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:54:35.869600 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:54:35.870423 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:54:35.871106 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:54:35.875495 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fa0b52da-46db-4b38-85f0-30df51c15eeb tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1507738013", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "465070d4-9860-4521-9951-35c9a5a80aa8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "4efba431-52b7-48d5-9703-aa9668c7ab96"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:54:35.943152 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-fa0b52da-46db-4b38-85f0-30df51c15eeb tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] validate_networks() for [('4efba431-52b7-48d5-9703-aa9668c7ab96', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:54:36.301835 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-fa0b52da-46db-4b38-85f0-30df51c15eeb tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:54:36.302291 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-fa0b52da-46db-4b38-85f0-30df51c15eeb tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:54:36.302771 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-fa0b52da-46db-4b38-85f0-30df51c15eeb tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:54:36.303185 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-fa0b52da-46db-4b38-85f0-30df51c15eeb tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:54:36.303635 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-fa0b52da-46db-4b38-85f0-30df51c15eeb tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:54:36.312664 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fa0b52da-46db-4b38-85f0-30df51c15eeb tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:54:36.313121 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fa0b52da-46db-4b38-85f0-30df51c15eeb tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:54:36.314006 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fa0b52da-46db-4b38-85f0-30df51c15eeb tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:54:36.314449 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fa0b52da-46db-4b38-85f0-30df51c15eeb tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:54:36.333317 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-fa0b52da-46db-4b38-85f0-30df51c15eeb tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Getting quotas for project 5d27147659194eddaf26e972e5be75b0. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:54:36.338902 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-fa0b52da-46db-4b38-85f0-30df51c15eeb tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Getting quotas for user 002d53b0f0974a8ba68ff9d0e5d81df3 and project 5d27147659194eddaf26e972e5be75b0. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:54:36.401461 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-fa0b52da-46db-4b38-85f0-30df51c15eeb tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:54:36.403577 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-fa0b52da-46db-4b38-85f0-30df51c15eeb tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 93186ba6-8cbb-4a56-9abb-794812e7fd9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='465070d4-9860-4521-9951-35c9a5a80aa8',volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:54:36.542827 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fa0b52da-46db-4b38-85f0-30df51c15eeb tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674812 Jun 05 08:54:36.543486 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1632/3175] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:54:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 08:54:36.554794 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e0e27bce-d643-406e-b41f-503baeb58a12 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:54:36.555416 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e0e27bce-d643-406e-b41f-503baeb58a12 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 93186ba6-8cbb-4a56-9abb-794812e7fd9d] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:54:36.557637 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:54:36.558729 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=6 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:54:36.559740 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:54:36.560415 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=12 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:54:36.624291 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-e0e27bce-d643-406e-b41f-503baeb58a12 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002d53b0f0974a8ba68ff9d0e5d81df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d27147659194eddaf26e972e5be75b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:54:36.631848 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e0e27bce-d643-406e-b41f-503baeb58a12 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] 10.222.0.33 "GET /compute/v2.1/servers/93186ba6-8cbb-4a56-9abb-794812e7fd9d" status: 200 len: 1071 microversion: 2.1 time: 0.081280 Jun 05 08:54:36.632457 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1544/3176] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:54:36 2022] GET /compute/v2.1/servers/93186ba6-8cbb-4a56-9abb-794812e7fd9d => generated 1071 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:54:37.649778 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-d6f8b636-b88f-47a9-87a4-79f0ac1e2540 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:54:37.650397 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-d6f8b636-b88f-47a9-87a4-79f0ac1e2540 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 93186ba6-8cbb-4a56-9abb-794812e7fd9d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:54:37.656873 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d6f8b636-b88f-47a9-87a4-79f0ac1e2540 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:54:37.657329 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d6f8b636-b88f-47a9-87a4-79f0ac1e2540 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:54:37.658222 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d6f8b636-b88f-47a9-87a4-79f0ac1e2540 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:54:37.658669 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d6f8b636-b88f-47a9-87a4-79f0ac1e2540 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:54:37.694752 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d6f8b636-b88f-47a9-87a4-79f0ac1e2540 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:54:37.695216 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-d6f8b636-b88f-47a9-87a4-79f0ac1e2540 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:54:37.695681 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-d6f8b636-b88f-47a9-87a4-79f0ac1e2540 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lazy-loading 'fault' on Instance uuid 93186ba6-8cbb-4a56-9abb-794812e7fd9d {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:54:37.736555 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-d6f8b636-b88f-47a9-87a4-79f0ac1e2540 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002d53b0f0974a8ba68ff9d0e5d81df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d27147659194eddaf26e972e5be75b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:54:37.744721 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-d6f8b636-b88f-47a9-87a4-79f0ac1e2540 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] 10.222.0.33 "GET /compute/v2.1/servers/93186ba6-8cbb-4a56-9abb-794812e7fd9d" status: 200 len: 1190 microversion: 2.1 time: 0.099765 Jun 05 08:54:37.745300 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1633/3177] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:54:37 2022] GET /compute/v2.1/servers/93186ba6-8cbb-4a56-9abb-794812e7fd9d => generated 1190 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:54:37.761943 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a44e9980-fea1-41d8-bbf5-ddef5984803a tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:54:37.762456 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a44e9980-fea1-41d8-bbf5-ddef5984803a tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 93186ba6-8cbb-4a56-9abb-794812e7fd9d] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:54:37.770524 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a44e9980-fea1-41d8-bbf5-ddef5984803a tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:54:37.770986 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a44e9980-fea1-41d8-bbf5-ddef5984803a tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:54:37.771769 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a44e9980-fea1-41d8-bbf5-ddef5984803a tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:54:37.772246 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a44e9980-fea1-41d8-bbf5-ddef5984803a tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:54:37.796586 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a44e9980-fea1-41d8-bbf5-ddef5984803a tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 93186ba6-8cbb-4a56-9abb-794812e7fd9d] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:54:37.842198 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a44e9980-fea1-41d8-bbf5-ddef5984803a tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 93186ba6-8cbb-4a56-9abb-794812e7fd9d] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:54:37.842993 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a44e9980-fea1-41d8-bbf5-ddef5984803a tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:54:37.843438 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a44e9980-fea1-41d8-bbf5-ddef5984803a tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:54:37.843875 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-a44e9980-fea1-41d8-bbf5-ddef5984803a tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 93186ba6-8cbb-4a56-9abb-794812e7fd9d] instance's host None is down, deleting from database Jun 05 08:54:37.848158 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-a44e9980-fea1-41d8-bbf5-ddef5984803a tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 93186ba6-8cbb-4a56-9abb-794812e7fd9d] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:54:37.882129 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-a44e9980-fea1-41d8-bbf5-ddef5984803a tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 93186ba6-8cbb-4a56-9abb-794812e7fd9d] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:54:37.888209 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-a44e9980-fea1-41d8-bbf5-ddef5984803a tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 93186ba6-8cbb-4a56-9abb-794812e7fd9d] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:54:38.197354 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a44e9980-fea1-41d8-bbf5-ddef5984803a tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] 10.222.0.33 "DELETE /compute/v2.1/servers/93186ba6-8cbb-4a56-9abb-794812e7fd9d" status: 204 len: 0 microversion: 2.1 time: 0.439658 Jun 05 08:54:38.198112 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1545/3178] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:54:37 2022] DELETE /compute/v2.1/servers/93186ba6-8cbb-4a56-9abb-794812e7fd9d => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:54:38.206628 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-81b0bfa0-3509-4ff3-a62b-5af290d2db42 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:54:38.207258 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-81b0bfa0-3509-4ff3-a62b-5af290d2db42 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: 93186ba6-8cbb-4a56-9abb-794812e7fd9d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:54:38.214068 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-81b0bfa0-3509-4ff3-a62b-5af290d2db42 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:54:38.214531 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-81b0bfa0-3509-4ff3-a62b-5af290d2db42 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:54:38.215310 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-81b0bfa0-3509-4ff3-a62b-5af290d2db42 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:54:38.215936 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-81b0bfa0-3509-4ff3-a62b-5af290d2db42 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:54:38.230428 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-81b0bfa0-3509-4ff3-a62b-5af290d2db42 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] HTTP exception thrown: Instance 93186ba6-8cbb-4a56-9abb-794812e7fd9d could not be found. Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-81b0bfa0-3509-4ff3-a62b-5af290d2db42 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Request method failure captured: Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/93186ba6-8cbb-4a56-9abb-794812e7fd9d HTTP/1.1 Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinG8DkI5tj2tCqcPrcBIBBxzbFEeup92hxsS0mDHdshCJPEz6GeY9QAD0hu23-NZuqFctxvQ7wKbxz49sH6odvzACuzZacXMQTZHNCva3xgecmVgM8LwgCbgy2_faZfQLhYi563x1GMxzuyfNivwrmYOjfj7iy6Vnd9ZL8e9Wl_I_pyM Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 5d27147659194eddaf26e972e5be75b0 Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-TestVolumeBootPattern-1726159269 Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5d27147659194eddaf26e972e5be75b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5d27147659194eddaf26e972e5be75b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5d27147659194eddaf26e972e5be75b0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5d27147659194eddaf26e972e5be75b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-TestVolumeBootPattern-1726159269 Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 5d27147659194eddaf26e972e5be75b0 Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-TestVolumeBootPattern-1726159269 Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-TestVolumeBootPattern-1726159269-project Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 002d53b0f0974a8ba68ff9d0e5d81df3 Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-TestVolumeBootPattern-1726159269-project Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 93186ba6-8cbb-4a56-9abb-794812e7fd9d could not be found. Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '93186ba6-8cbb-4a56-9abb-794812e7fd9d'} Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93186ba6-8cbb-4a56-9abb-794812e7fd9d could not be found. Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93186ba6-8cbb-4a56-9abb-794812e7fd9d could not be found. Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:54:38.232220 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:54:38.236890 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:54:38.236890 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:54:38.236890 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:54:38.236890 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:54:38.236890 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:54:38.236890 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93186ba6-8cbb-4a56-9abb-794812e7fd9d could not be found. Jun 05 08:54:38.236890 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:54:38.236890 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-81b0bfa0-3509-4ff3-a62b-5af290d2db42 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Returning 404 to user: Instance 93186ba6-8cbb-4a56-9abb-794812e7fd9d could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:54:38.236890 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-81b0bfa0-3509-4ff3-a62b-5af290d2db42 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] 10.222.0.33 "GET /compute/v2.1/servers/93186ba6-8cbb-4a56-9abb-794812e7fd9d" status: 404 len: 111 microversion: 2.1 time: 0.031496 Jun 05 08:54:38.236890 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1634/3179] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:54:38 2022] GET /compute/v2.1/servers/93186ba6-8cbb-4a56-9abb-794812e7fd9d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 05 08:54:42.566714 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-45ee30b9-300e-495f-9861-6fea6864e57e tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Action: 'create', calling method: .version_select at 0x7f2432f36b80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-327686168", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDInxV8Nmx2/Zpa6LLc+brCjAEShtroHwU3z60IOoVJvVXx9dAPcRtX+fMOvt8bJkPcVMNAmyXbqbIHFwc3kYWB+bf2D4sQkPOr6VUvmFWQXjMHlPuBknShPfTySvJzXNA=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:54:42.584154 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-45ee30b9-300e-495f-9861-6fea6864e57e tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Getting quotas for project 5d27147659194eddaf26e972e5be75b0. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:54:42.589312 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-45ee30b9-300e-495f-9861-6fea6864e57e tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Getting quotas for user 002d53b0f0974a8ba68ff9d0e5d81df3 and project 5d27147659194eddaf26e972e5be75b0. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:54:42.616578 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-45ee30b9-300e-495f-9861-6fea6864e57e tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.055041 Jun 05 08:54:42.617277 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1546/3180] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 08:54:42 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 08:55:05.596325 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7f755278-4a22-401d-966f-07819d8f0d78 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1191933236", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-327686168", "security_groups": [{"name": "tempest-secgroup-smoke-567300437"}], "block_device_mapping_v2": [{"uuid": "0ea31a26-8a2c-4f5b-99e8-8b5e234ff093", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4efba431-52b7-48d5-9703-aa9668c7ab96"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 08:55:05.604442 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:55:05.605117 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=6 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:55:05.605814 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:55:05.606477 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=12 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:55:05.885600 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-7f755278-4a22-401d-966f-07819d8f0d78 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] validate_networks() for [('4efba431-52b7-48d5-9703-aa9668c7ab96', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 08:55:06.265827 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-7f755278-4a22-401d-966f-07819d8f0d78 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 08:55:06.266262 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-7f755278-4a22-401d-966f-07819d8f0d78 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 08:55:06.266752 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-7f755278-4a22-401d-966f-07819d8f0d78 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 08:55:06.267202 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-7f755278-4a22-401d-966f-07819d8f0d78 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 08:55:06.267895 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-7f755278-4a22-401d-966f-07819d8f0d78 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 08:55:06.283226 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7f755278-4a22-401d-966f-07819d8f0d78 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:55:06.283838 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7f755278-4a22-401d-966f-07819d8f0d78 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:55:06.284694 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7f755278-4a22-401d-966f-07819d8f0d78 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:55:06.285141 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7f755278-4a22-401d-966f-07819d8f0d78 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:55:06.302403 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-7f755278-4a22-401d-966f-07819d8f0d78 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Getting quotas for project 5d27147659194eddaf26e972e5be75b0. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 08:55:06.307402 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-7f755278-4a22-401d-966f-07819d8f0d78 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Getting quotas for user 002d53b0f0974a8ba68ff9d0e5d81df3 and project 5d27147659194eddaf26e972e5be75b0. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 08:55:06.372881 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7f755278-4a22-401d-966f-07819d8f0d78 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 08:55:06.375107 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7f755278-4a22-401d-966f-07819d8f0d78 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: f10e7663-b94b-493b-b601-cd43bd8cb47f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0ea31a26-8a2c-4f5b-99e8-8b5e234ff093',volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 08:55:06.506035 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7f755278-4a22-401d-966f-07819d8f0d78 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.913855 Jun 05 08:55:06.506928 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1635/3181] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 08:55:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 05 08:55:06.517385 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1c2a87ab-d3d5-4351-9d23-8c18ad453532 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:55:06.518813 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1c2a87ab-d3d5-4351-9d23-8c18ad453532 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: f10e7663-b94b-493b-b601-cd43bd8cb47f] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:55:06.522123 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:55:06.523242 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=6 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:55:06.523687 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 08:55:06.694302 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-1c2a87ab-d3d5-4351-9d23-8c18ad453532 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002d53b0f0974a8ba68ff9d0e5d81df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d27147659194eddaf26e972e5be75b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:55:06.709616 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1c2a87ab-d3d5-4351-9d23-8c18ad453532 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] 10.222.0.33 "GET /compute/v2.1/servers/f10e7663-b94b-493b-b601-cd43bd8cb47f" status: 200 len: 1094 microversion: 2.1 time: 0.196613 Jun 05 08:55:06.710400 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1547/3182] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:55:06 2022] GET /compute/v2.1/servers/f10e7663-b94b-493b-b601-cd43bd8cb47f => generated 1094 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:55:07.727666 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-02948f93-d835-408c-97dc-c302ae64f744 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:55:07.728311 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-02948f93-d835-408c-97dc-c302ae64f744 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: f10e7663-b94b-493b-b601-cd43bd8cb47f] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:55:07.735791 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-02948f93-d835-408c-97dc-c302ae64f744 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:55:07.736257 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-02948f93-d835-408c-97dc-c302ae64f744 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:55:07.737026 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-02948f93-d835-408c-97dc-c302ae64f744 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:55:07.737465 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-02948f93-d835-408c-97dc-c302ae64f744 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:55:07.767610 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-02948f93-d835-408c-97dc-c302ae64f744 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:55:07.768100 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-02948f93-d835-408c-97dc-c302ae64f744 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:55:07.768560 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-02948f93-d835-408c-97dc-c302ae64f744 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lazy-loading 'fault' on Instance uuid f10e7663-b94b-493b-b601-cd43bd8cb47f {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 08:55:07.810247 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-02948f93-d835-408c-97dc-c302ae64f744 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '002d53b0f0974a8ba68ff9d0e5d81df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d27147659194eddaf26e972e5be75b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 08:55:07.817739 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-02948f93-d835-408c-97dc-c302ae64f744 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] 10.222.0.33 "GET /compute/v2.1/servers/f10e7663-b94b-493b-b601-cd43bd8cb47f" status: 200 len: 1213 microversion: 2.1 time: 0.094878 Jun 05 08:55:07.818294 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1636/3183] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:55:07 2022] GET /compute/v2.1/servers/f10e7663-b94b-493b-b601-cd43bd8cb47f => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 08:55:07.833826 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4036ff60-ab8e-4e96-ae12-3e27b596c58b tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:55:07.834269 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4036ff60-ab8e-4e96-ae12-3e27b596c58b tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: f10e7663-b94b-493b-b601-cd43bd8cb47f] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:55:07.844089 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4036ff60-ab8e-4e96-ae12-3e27b596c58b tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:55:07.844558 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4036ff60-ab8e-4e96-ae12-3e27b596c58b tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:55:07.845403 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4036ff60-ab8e-4e96-ae12-3e27b596c58b tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:55:07.845838 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4036ff60-ab8e-4e96-ae12-3e27b596c58b tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:55:07.870685 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4036ff60-ab8e-4e96-ae12-3e27b596c58b tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: f10e7663-b94b-493b-b601-cd43bd8cb47f] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 08:55:07.920163 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4036ff60-ab8e-4e96-ae12-3e27b596c58b tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: f10e7663-b94b-493b-b601-cd43bd8cb47f] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 08:55:07.920951 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4036ff60-ab8e-4e96-ae12-3e27b596c58b tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:55:07.922004 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4036ff60-ab8e-4e96-ae12-3e27b596c58b tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:55:07.922493 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-4036ff60-ab8e-4e96-ae12-3e27b596c58b tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: f10e7663-b94b-493b-b601-cd43bd8cb47f] instance's host None is down, deleting from database Jun 05 08:55:07.926941 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-4036ff60-ab8e-4e96-ae12-3e27b596c58b tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: f10e7663-b94b-493b-b601-cd43bd8cb47f] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 08:55:07.966683 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-4036ff60-ab8e-4e96-ae12-3e27b596c58b tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: f10e7663-b94b-493b-b601-cd43bd8cb47f] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 08:55:07.973280 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-4036ff60-ab8e-4e96-ae12-3e27b596c58b tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: f10e7663-b94b-493b-b601-cd43bd8cb47f] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 08:55:08.216629 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4036ff60-ab8e-4e96-ae12-3e27b596c58b tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f10e7663-b94b-493b-b601-cd43bd8cb47f" status: 204 len: 0 microversion: 2.1 time: 0.386712 Jun 05 08:55:08.217222 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1548/3184] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 08:55:07 2022] DELETE /compute/v2.1/servers/f10e7663-b94b-493b-b601-cd43bd8cb47f => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 08:55:08.226222 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8cb2be93-3201-45d8-ad72-c76be4c158c8 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:55:08.226840 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8cb2be93-3201-45d8-ad72-c76be4c158c8 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] [instance: f10e7663-b94b-493b-b601-cd43bd8cb47f] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 08:55:08.232957 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8cb2be93-3201-45d8-ad72-c76be4c158c8 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:55:08.233402 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8cb2be93-3201-45d8-ad72-c76be4c158c8 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:55:08.234162 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8cb2be93-3201-45d8-ad72-c76be4c158c8 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 08:55:08.234927 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8cb2be93-3201-45d8-ad72-c76be4c158c8 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 08:55:08.248218 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-8cb2be93-3201-45d8-ad72-c76be4c158c8 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] HTTP exception thrown: Instance f10e7663-b94b-493b-b601-cd43bd8cb47f could not be found. Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8cb2be93-3201-45d8-ad72-c76be4c158c8 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Request method failure captured: Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/f10e7663-b94b-493b-b601-cd43bd8cb47f HTTP/1.1 Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinG8DkI5tj2tCqcPrcBIBBxzbFEeup92hxsS0mDHdshCJPEz6GeY9QAD0hu23-NZuqFctxvQ7wKbxz49sH6odvzACuzZacXMQTZHNCva3xgecmVgM8LwgCbgy2_faZfQLhYi563x1GMxzuyfNivwrmYOjfj7iy6Vnd9ZL8e9Wl_I_pyM Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 5d27147659194eddaf26e972e5be75b0 Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-TestVolumeBootPattern-1726159269 Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5d27147659194eddaf26e972e5be75b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5d27147659194eddaf26e972e5be75b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5d27147659194eddaf26e972e5be75b0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5d27147659194eddaf26e972e5be75b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-TestVolumeBootPattern-1726159269 Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 5d27147659194eddaf26e972e5be75b0 Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-TestVolumeBootPattern-1726159269 Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-TestVolumeBootPattern-1726159269-project Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 002d53b0f0974a8ba68ff9d0e5d81df3 Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-TestVolumeBootPattern-1726159269-project Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance f10e7663-b94b-493b-b601-cd43bd8cb47f could not be found. Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'f10e7663-b94b-493b-b601-cd43bd8cb47f'} Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f10e7663-b94b-493b-b601-cd43bd8cb47f could not be found. Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f10e7663-b94b-493b-b601-cd43bd8cb47f could not be found. Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 08:55:08.250404 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:55:08.258468 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 08:55:08.258468 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 08:55:08.258468 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 08:55:08.258468 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 08:55:08.258468 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 08:55:08.258468 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f10e7663-b94b-493b-b601-cd43bd8cb47f could not be found. Jun 05 08:55:08.258468 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 08:55:08.258468 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8cb2be93-3201-45d8-ad72-c76be4c158c8 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Returning 404 to user: Instance f10e7663-b94b-493b-b601-cd43bd8cb47f could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 08:55:08.258468 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8cb2be93-3201-45d8-ad72-c76be4c158c8 tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] 10.222.0.33 "GET /compute/v2.1/servers/f10e7663-b94b-493b-b601-cd43bd8cb47f" status: 404 len: 111 microversion: 2.1 time: 0.029531 Jun 05 08:55:08.258468 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1637/3185] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 08:55:08 2022] GET /compute/v2.1/servers/f10e7663-b94b-493b-b601-cd43bd8cb47f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 08:55:12.770962 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-12aaf396-9277-4721-93be-5d9bf49a757e tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] Calling method '.version_select at 0x7f2432e46f70>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 08:55:12.798507 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-12aaf396-9277-4721-93be-5d9bf49a757e tempest-TestVolumeBootPattern-1726159269 tempest-TestVolumeBootPattern-1726159269-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-327686168" status: 202 len: 0 microversion: 2.1 time: 0.050009 Jun 05 08:55:12.802543 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1549/3186] 10.222.0.33 () {58 vars in 1259 bytes} [Sun Jun 5 08:55:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-327686168 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 08:55:23.806355 n-d-844739-1 devstack@n-api.service[119050]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 08:55:23.806866 n-d-844739-1 devstack@n-api.service[119050]: Sun Jun 5 08:55:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 08:56:37.437030 n-d-844739-1 devstack@n-api.service[119049]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 08:56:37.437594 n-d-844739-1 devstack@n-api.service[119049]: Sun Jun 5 08:56:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 08:56:38.014578 n-d-844739-1 devstack@n-api.service[119050]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 08:56:38.015152 n-d-844739-1 devstack@n-api.service[119050]: Sun Jun 5 08:56:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 08:56:57.813583 n-d-844739-1 devstack@n-api.service[119049]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 08:56:57.814184 n-d-844739-1 devstack@n-api.service[119049]: Sun Jun 5 08:56:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 08:58:17.455217 n-d-844739-1 devstack@n-api.service[119049]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 08:58:17.455884 n-d-844739-1 devstack@n-api.service[119049]: Sun Jun 5 08:58:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 08:58:18.084537 n-d-844739-1 devstack@n-api.service[119050]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 08:58:18.085105 n-d-844739-1 devstack@n-api.service[119050]: Sun Jun 5 08:58:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 08:58:43.815194 n-d-844739-1 devstack@n-api.service[119050]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 08:58:43.815891 n-d-844739-1 devstack@n-api.service[119050]: Sun Jun 5 08:58:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 08:59:57.446098 n-d-844739-1 devstack@n-api.service[119049]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 08:59:57.446623 n-d-844739-1 devstack@n-api.service[119049]: Sun Jun 5 08:59:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 08:59:58.024114 n-d-844739-1 devstack@n-api.service[119050]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 08:59:58.024670 n-d-844739-1 devstack@n-api.service[119050]: Sun Jun 5 08:59:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 09:00:17.823275 n-d-844739-1 devstack@n-api.service[119049]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 09:00:17.823879 n-d-844739-1 devstack@n-api.service[119049]: Sun Jun 5 09:00:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 09:00:25.738182 n-d-844739-1 devstack@n-api.service[119050]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7e679682-2a57-43a8-8a9d-11590e5228db] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 05 09:00:25.739075 n-d-844739-1 devstack@n-api.service[119050]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3479185a-57d3-411e-b5f9-4f515ddebedd] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 05 09:00:25.739471 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:00:25.740284 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=6 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:00:25.742386 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:00:25.743474 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=12 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:00:25.748236 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-cbe33436-a5bb-4a1f-88a7-883431e07a06 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1303508046", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "efdfcc78-e6e9-4440-b2be-f52e538a7a1c"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:00:26.006965 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-cbe33436-a5bb-4a1f-88a7-883431e07a06 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] validate_networks() for [('efdfcc78-e6e9-4440-b2be-f52e538a7a1c', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 09:00:26.427816 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-cbe33436-a5bb-4a1f-88a7-883431e07a06 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 09:00:26.428948 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-cbe33436-a5bb-4a1f-88a7-883431e07a06 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 09:00:26.429605 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-cbe33436-a5bb-4a1f-88a7-883431e07a06 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 09:00:26.430026 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-cbe33436-a5bb-4a1f-88a7-883431e07a06 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 09:00:26.430984 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-cbe33436-a5bb-4a1f-88a7-883431e07a06 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 09:00:26.439898 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cbe33436-a5bb-4a1f-88a7-883431e07a06 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:00:26.440387 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cbe33436-a5bb-4a1f-88a7-883431e07a06 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:00:26.441203 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cbe33436-a5bb-4a1f-88a7-883431e07a06 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:00:26.441652 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-cbe33436-a5bb-4a1f-88a7-883431e07a06 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:00:26.459666 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-cbe33436-a5bb-4a1f-88a7-883431e07a06 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Getting quotas for project 85ec8eb4fe3c488890134386116a708f. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:00:26.465567 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-cbe33436-a5bb-4a1f-88a7-883431e07a06 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Getting quotas for user 257cff650e124f899981c0581092ee17 and project 85ec8eb4fe3c488890134386116a708f. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:00:26.477915 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-cbe33436-a5bb-4a1f-88a7-883431e07a06 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 09:00:26.480098 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-cbe33436-a5bb-4a1f-88a7-883431e07a06 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] [instance: 4aa594dd-f10e-40f3-9129-65bafc1cda5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 09:00:26.538136 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-cbe33436-a5bb-4a1f-88a7-883431e07a06 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.801803 Jun 05 09:00:26.544267 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1638/3187] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 09:00:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 09:00:26.548195 n-d-844739-1 devstack@n-api.service[119049]: ERROR oslo.messaging._drivers.impl_rabbit [-] [411e268b-965d-4f7a-8b7c-c8ab976cc9eb] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 05 09:00:26.549717 n-d-844739-1 devstack@n-api.service[119049]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72a16dc1-a618-40fe-bc5c-8f61b915d107] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 05 09:00:26.550150 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:00:26.552491 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:00:26.555930 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:00:26.566737 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0ae190ca-0b2c-4ae0-84ba-4881a4835d87 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:00:26.570433 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-0ae190ca-0b2c-4ae0-84ba-4881a4835d87 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] [instance: 4aa594dd-f10e-40f3-9129-65bafc1cda5c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:00:26.700929 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-0ae190ca-0b2c-4ae0-84ba-4881a4835d87 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257cff650e124f899981c0581092ee17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ec8eb4fe3c488890134386116a708f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:00:26.708694 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0ae190ca-0b2c-4ae0-84ba-4881a4835d87 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] 10.222.0.33 "GET /compute/v2.1/servers/4aa594dd-f10e-40f3-9129-65bafc1cda5c" status: 200 len: 1219 microversion: 2.1 time: 0.162803 Jun 05 09:00:26.709261 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1550/3188] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:00:26 2022] GET /compute/v2.1/servers/4aa594dd-f10e-40f3-9129-65bafc1cda5c => generated 1219 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:00:27.729274 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-70ed39c5-e96c-4eea-a7eb-1d1c3821c55d tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:00:27.730039 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-70ed39c5-e96c-4eea-a7eb-1d1c3821c55d tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] [instance: 4aa594dd-f10e-40f3-9129-65bafc1cda5c] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:00:27.739968 n-d-844739-1 devstack@n-api.service[119050]: INFO oslo.messaging._drivers.impl_rabbit [-] [7e679682-2a57-43a8-8a9d-11590e5228db] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 60024. Jun 05 09:00:27.743557 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-70ed39c5-e96c-4eea-a7eb-1d1c3821c55d tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:00:27.744014 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-70ed39c5-e96c-4eea-a7eb-1d1c3821c55d tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:00:27.744817 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-70ed39c5-e96c-4eea-a7eb-1d1c3821c55d tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:00:27.745284 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-70ed39c5-e96c-4eea-a7eb-1d1c3821c55d tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:00:27.749985 n-d-844739-1 devstack@n-api.service[119050]: INFO oslo.messaging._drivers.impl_rabbit [-] [3479185a-57d3-411e-b5f9-4f515ddebedd] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 60026. Jun 05 09:00:27.778198 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-70ed39c5-e96c-4eea-a7eb-1d1c3821c55d tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:00:27.778902 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-70ed39c5-e96c-4eea-a7eb-1d1c3821c55d tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:00:27.779384 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-70ed39c5-e96c-4eea-a7eb-1d1c3821c55d tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lazy-loading 'fault' on Instance uuid 4aa594dd-f10e-40f3-9129-65bafc1cda5c {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 09:00:27.820618 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-70ed39c5-e96c-4eea-a7eb-1d1c3821c55d tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257cff650e124f899981c0581092ee17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ec8eb4fe3c488890134386116a708f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:00:27.828006 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-70ed39c5-e96c-4eea-a7eb-1d1c3821c55d tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] 10.222.0.33 "GET /compute/v2.1/servers/4aa594dd-f10e-40f3-9129-65bafc1cda5c" status: 200 len: 1292 microversion: 2.1 time: 0.106941 Jun 05 09:00:27.828589 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1639/3189] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:00:27 2022] GET /compute/v2.1/servers/4aa594dd-f10e-40f3-9129-65bafc1cda5c => generated 1292 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:00:27.844012 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-db3ebf77-d6a7-4c6a-9e7c-9a4c402dcf4e tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:00:27.844585 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-db3ebf77-d6a7-4c6a-9e7c-9a4c402dcf4e tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] [instance: 4aa594dd-f10e-40f3-9129-65bafc1cda5c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:00:27.860473 n-d-844739-1 devstack@n-api.service[119049]: INFO oslo.messaging._drivers.impl_rabbit [-] [72a16dc1-a618-40fe-bc5c-8f61b915d107] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 60032. Jun 05 09:00:27.861918 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-db3ebf77-d6a7-4c6a-9e7c-9a4c402dcf4e tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:00:27.862378 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-db3ebf77-d6a7-4c6a-9e7c-9a4c402dcf4e tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:00:27.863214 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-db3ebf77-d6a7-4c6a-9e7c-9a4c402dcf4e tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:00:27.863669 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-db3ebf77-d6a7-4c6a-9e7c-9a4c402dcf4e tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:00:27.870303 n-d-844739-1 devstack@n-api.service[119049]: INFO oslo.messaging._drivers.impl_rabbit [-] [411e268b-965d-4f7a-8b7c-c8ab976cc9eb] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 60030. Jun 05 09:00:27.892640 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-db3ebf77-d6a7-4c6a-9e7c-9a4c402dcf4e tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] [instance: 4aa594dd-f10e-40f3-9129-65bafc1cda5c] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 09:00:27.942635 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-db3ebf77-d6a7-4c6a-9e7c-9a4c402dcf4e tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] [instance: 4aa594dd-f10e-40f3-9129-65bafc1cda5c] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 09:00:27.943377 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-db3ebf77-d6a7-4c6a-9e7c-9a4c402dcf4e tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:00:27.943859 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-db3ebf77-d6a7-4c6a-9e7c-9a4c402dcf4e tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:00:27.944498 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-db3ebf77-d6a7-4c6a-9e7c-9a4c402dcf4e tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] [instance: 4aa594dd-f10e-40f3-9129-65bafc1cda5c] instance's host None is down, deleting from database Jun 05 09:00:27.952233 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-db3ebf77-d6a7-4c6a-9e7c-9a4c402dcf4e tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] [instance: 4aa594dd-f10e-40f3-9129-65bafc1cda5c] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 09:00:27.992142 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-db3ebf77-d6a7-4c6a-9e7c-9a4c402dcf4e tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] [instance: 4aa594dd-f10e-40f3-9129-65bafc1cda5c] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 09:00:27.998278 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-db3ebf77-d6a7-4c6a-9e7c-9a4c402dcf4e tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] [instance: 4aa594dd-f10e-40f3-9129-65bafc1cda5c] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 09:00:28.205580 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-db3ebf77-d6a7-4c6a-9e7c-9a4c402dcf4e tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4aa594dd-f10e-40f3-9129-65bafc1cda5c" status: 204 len: 0 microversion: 2.1 time: 0.365398 Jun 05 09:00:28.206199 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1551/3190] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 09:00:27 2022] DELETE /compute/v2.1/servers/4aa594dd-f10e-40f3-9129-65bafc1cda5c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 09:00:28.215103 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-03b6115a-f93a-4dd0-8900-975d52a79420 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:00:28.215723 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-03b6115a-f93a-4dd0-8900-975d52a79420 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] [instance: 4aa594dd-f10e-40f3-9129-65bafc1cda5c] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:00:28.221750 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-03b6115a-f93a-4dd0-8900-975d52a79420 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:00:28.222223 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-03b6115a-f93a-4dd0-8900-975d52a79420 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:00:28.222971 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-03b6115a-f93a-4dd0-8900-975d52a79420 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:00:28.223416 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-03b6115a-f93a-4dd0-8900-975d52a79420 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:00:28.237764 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-03b6115a-f93a-4dd0-8900-975d52a79420 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] HTTP exception thrown: Instance 4aa594dd-f10e-40f3-9129-65bafc1cda5c could not be found. Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-03b6115a-f93a-4dd0-8900-975d52a79420 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Request method failure captured: Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/4aa594dd-f10e-40f3-9129-65bafc1cda5c HTTP/1.1 Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinHBi_AdTpF3dXUR59gm_BwXCR3UDotHtWwQckZYr91pwOBytXBFBJpaEghFUhoxViJ_bGa1l1rwRl-Vy9IJAVQ_lhMvhgREj-l4WTX5AJPAtc2ucM_8DAyBzC4OfSIIpznNmV2o347f-Uu9ITKxS_yl13mF5-scBztNNoVTHOz3ZUsM Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 85ec8eb4fe3c488890134386116a708f Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-VolumesSnapshotTestJSON-829828933 Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/85ec8eb4fe3c488890134386116a708f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/85ec8eb4fe3c488890134386116a708f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_85ec8eb4fe3c488890134386116a708f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/85ec8eb4fe3c488890134386116a708f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-VolumesSnapshotTestJSON-829828933 Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 85ec8eb4fe3c488890134386116a708f Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-829828933 Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-VolumesSnapshotTestJSON-829828933-project Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 257cff650e124f899981c0581092ee17 Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-VolumesSnapshotTestJSON-829828933-project Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 4aa594dd-f10e-40f3-9129-65bafc1cda5c could not be found. Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '4aa594dd-f10e-40f3-9129-65bafc1cda5c'} Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aa594dd-f10e-40f3-9129-65bafc1cda5c could not be found. Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aa594dd-f10e-40f3-9129-65bafc1cda5c could not be found. Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:00:28.239325 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:00:28.246603 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:00:28.246603 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:00:28.246603 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:00:28.246603 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 09:00:28.246603 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 09:00:28.246603 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aa594dd-f10e-40f3-9129-65bafc1cda5c could not be found. Jun 05 09:00:28.246603 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:00:28.246603 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-03b6115a-f93a-4dd0-8900-975d52a79420 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Returning 404 to user: Instance 4aa594dd-f10e-40f3-9129-65bafc1cda5c could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 09:00:28.246603 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-03b6115a-f93a-4dd0-8900-975d52a79420 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] 10.222.0.33 "GET /compute/v2.1/servers/4aa594dd-f10e-40f3-9129-65bafc1cda5c" status: 404 len: 111 microversion: 2.1 time: 0.030161 Jun 05 09:00:28.246603 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1640/3191] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:00:28 2022] GET /compute/v2.1/servers/4aa594dd-f10e-40f3-9129-65bafc1cda5c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 05 09:00:38.059810 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:00:38.063920 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4758656e-4215-4f86-b012-ed25566c0957 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-353028996", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "efdfcc78-e6e9-4440-b2be-f52e538a7a1c"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:00:38.115183 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-4758656e-4215-4f86-b012-ed25566c0957 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] validate_networks() for [('efdfcc78-e6e9-4440-b2be-f52e538a7a1c', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 09:00:38.195862 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:00:38.539384 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-4758656e-4215-4f86-b012-ed25566c0957 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 09:00:38.539834 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-4758656e-4215-4f86-b012-ed25566c0957 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 09:00:38.540433 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-4758656e-4215-4f86-b012-ed25566c0957 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 09:00:38.540852 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-4758656e-4215-4f86-b012-ed25566c0957 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 09:00:38.541264 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-4758656e-4215-4f86-b012-ed25566c0957 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 09:00:38.549961 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4758656e-4215-4f86-b012-ed25566c0957 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:00:38.550410 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4758656e-4215-4f86-b012-ed25566c0957 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:00:38.551208 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4758656e-4215-4f86-b012-ed25566c0957 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:00:38.551678 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4758656e-4215-4f86-b012-ed25566c0957 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:00:38.571353 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-4758656e-4215-4f86-b012-ed25566c0957 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Getting quotas for project 85ec8eb4fe3c488890134386116a708f. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:00:38.576382 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-4758656e-4215-4f86-b012-ed25566c0957 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Getting quotas for user 257cff650e124f899981c0581092ee17 and project 85ec8eb4fe3c488890134386116a708f. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:00:38.588986 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4758656e-4215-4f86-b012-ed25566c0957 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 09:00:38.591135 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4758656e-4215-4f86-b012-ed25566c0957 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] [instance: 883c58df-f0f0-40ef-9910-6b3e6d9293a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 09:00:38.638143 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4758656e-4215-4f86-b012-ed25566c0957 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.579865 Jun 05 09:00:38.643754 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1552/3192] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 09:00:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 09:00:38.649423 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f9e04ffb-d31c-4e9f-aec2-0022c38f6491 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:00:38.650067 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f9e04ffb-d31c-4e9f-aec2-0022c38f6491 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] [instance: 883c58df-f0f0-40ef-9910-6b3e6d9293a1] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:00:38.652778 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:00:38.653739 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=6 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:00:38.654383 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:00:38.655024 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=12 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:00:38.715015 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-f9e04ffb-d31c-4e9f-aec2-0022c38f6491 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257cff650e124f899981c0581092ee17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ec8eb4fe3c488890134386116a708f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:00:38.721966 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f9e04ffb-d31c-4e9f-aec2-0022c38f6491 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] 10.222.0.33 "GET /compute/v2.1/servers/883c58df-f0f0-40ef-9910-6b3e6d9293a1" status: 200 len: 1218 microversion: 2.1 time: 0.077020 Jun 05 09:00:38.722581 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1641/3193] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:00:38 2022] GET /compute/v2.1/servers/883c58df-f0f0-40ef-9910-6b3e6d9293a1 => generated 1218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 09:00:39.740514 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-74c2f8bb-2bfb-42cf-b085-710bf4f0f1f1 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:00:39.741127 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-74c2f8bb-2bfb-42cf-b085-710bf4f0f1f1 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] [instance: 883c58df-f0f0-40ef-9910-6b3e6d9293a1] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:00:39.748090 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-74c2f8bb-2bfb-42cf-b085-710bf4f0f1f1 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:00:39.748535 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-74c2f8bb-2bfb-42cf-b085-710bf4f0f1f1 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:00:39.749289 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-74c2f8bb-2bfb-42cf-b085-710bf4f0f1f1 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:00:39.749725 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-74c2f8bb-2bfb-42cf-b085-710bf4f0f1f1 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:00:39.780666 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-74c2f8bb-2bfb-42cf-b085-710bf4f0f1f1 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:00:39.781128 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-74c2f8bb-2bfb-42cf-b085-710bf4f0f1f1 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:00:39.781597 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-74c2f8bb-2bfb-42cf-b085-710bf4f0f1f1 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lazy-loading 'fault' on Instance uuid 883c58df-f0f0-40ef-9910-6b3e6d9293a1 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 09:00:39.824428 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-74c2f8bb-2bfb-42cf-b085-710bf4f0f1f1 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257cff650e124f899981c0581092ee17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ec8eb4fe3c488890134386116a708f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:00:39.831816 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-74c2f8bb-2bfb-42cf-b085-710bf4f0f1f1 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] 10.222.0.33 "GET /compute/v2.1/servers/883c58df-f0f0-40ef-9910-6b3e6d9293a1" status: 200 len: 1291 microversion: 2.1 time: 0.096133 Jun 05 09:00:39.832422 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1553/3194] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:00:39 2022] GET /compute/v2.1/servers/883c58df-f0f0-40ef-9910-6b3e6d9293a1 => generated 1291 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:00:39.848217 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3ae80547-086e-436c-be53-8f4dd92a54f8 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:00:39.848726 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3ae80547-086e-436c-be53-8f4dd92a54f8 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] [instance: 883c58df-f0f0-40ef-9910-6b3e6d9293a1] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:00:39.855770 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3ae80547-086e-436c-be53-8f4dd92a54f8 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:00:39.856274 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3ae80547-086e-436c-be53-8f4dd92a54f8 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:00:39.857051 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3ae80547-086e-436c-be53-8f4dd92a54f8 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:00:39.857499 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3ae80547-086e-436c-be53-8f4dd92a54f8 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:00:39.881969 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3ae80547-086e-436c-be53-8f4dd92a54f8 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] [instance: 883c58df-f0f0-40ef-9910-6b3e6d9293a1] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 09:00:39.931376 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3ae80547-086e-436c-be53-8f4dd92a54f8 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] [instance: 883c58df-f0f0-40ef-9910-6b3e6d9293a1] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 09:00:39.932221 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3ae80547-086e-436c-be53-8f4dd92a54f8 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:00:39.932676 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3ae80547-086e-436c-be53-8f4dd92a54f8 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:00:39.933119 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-3ae80547-086e-436c-be53-8f4dd92a54f8 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] [instance: 883c58df-f0f0-40ef-9910-6b3e6d9293a1] instance's host None is down, deleting from database Jun 05 09:00:39.940627 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-3ae80547-086e-436c-be53-8f4dd92a54f8 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] [instance: 883c58df-f0f0-40ef-9910-6b3e6d9293a1] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 09:00:39.974082 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-3ae80547-086e-436c-be53-8f4dd92a54f8 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] [instance: 883c58df-f0f0-40ef-9910-6b3e6d9293a1] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 09:00:39.979903 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-3ae80547-086e-436c-be53-8f4dd92a54f8 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] [instance: 883c58df-f0f0-40ef-9910-6b3e6d9293a1] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 09:00:40.182299 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3ae80547-086e-436c-be53-8f4dd92a54f8 tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] 10.222.0.33 "DELETE /compute/v2.1/servers/883c58df-f0f0-40ef-9910-6b3e6d9293a1" status: 204 len: 0 microversion: 2.1 time: 0.337884 Jun 05 09:00:40.182889 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1642/3195] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 09:00:39 2022] DELETE /compute/v2.1/servers/883c58df-f0f0-40ef-9910-6b3e6d9293a1 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 09:00:40.191243 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-554a10a5-eac9-480b-bc9c-fc5a5359209f tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:00:40.191833 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-554a10a5-eac9-480b-bc9c-fc5a5359209f tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] [instance: 883c58df-f0f0-40ef-9910-6b3e6d9293a1] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:00:40.198581 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-554a10a5-eac9-480b-bc9c-fc5a5359209f tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:00:40.199035 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-554a10a5-eac9-480b-bc9c-fc5a5359209f tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:00:40.199802 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-554a10a5-eac9-480b-bc9c-fc5a5359209f tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:00:40.200407 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-554a10a5-eac9-480b-bc9c-fc5a5359209f tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:00:40.214171 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-554a10a5-eac9-480b-bc9c-fc5a5359209f tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] HTTP exception thrown: Instance 883c58df-f0f0-40ef-9910-6b3e6d9293a1 could not be found. Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-554a10a5-eac9-480b-bc9c-fc5a5359209f tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Request method failure captured: Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/883c58df-f0f0-40ef-9910-6b3e6d9293a1 HTTP/1.1 Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinHBi_AdTpF3dXUR59gm_BwXCR3UDotHtWwQckZYr91pwOBytXBFBJpaEghFUhoxViJ_bGa1l1rwRl-Vy9IJAVQ_lhMvhgREj-l4WTX5AJPAtc2ucM_8DAyBzC4OfSIIpznNmV2o347f-Uu9ITKxS_yl13mF5-scBztNNoVTHOz3ZUsM Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 85ec8eb4fe3c488890134386116a708f Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-VolumesSnapshotTestJSON-829828933 Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/85ec8eb4fe3c488890134386116a708f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/85ec8eb4fe3c488890134386116a708f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_85ec8eb4fe3c488890134386116a708f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/85ec8eb4fe3c488890134386116a708f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-VolumesSnapshotTestJSON-829828933 Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 85ec8eb4fe3c488890134386116a708f Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-829828933 Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-VolumesSnapshotTestJSON-829828933-project Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 257cff650e124f899981c0581092ee17 Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-VolumesSnapshotTestJSON-829828933-project Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 883c58df-f0f0-40ef-9910-6b3e6d9293a1 could not be found. Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '883c58df-f0f0-40ef-9910-6b3e6d9293a1'} Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 883c58df-f0f0-40ef-9910-6b3e6d9293a1 could not be found. Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 883c58df-f0f0-40ef-9910-6b3e6d9293a1 could not be found. Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:00:40.215697 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:00:40.220281 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:00:40.220281 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:00:40.220281 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:00:40.220281 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 09:00:40.220281 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 09:00:40.220281 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 883c58df-f0f0-40ef-9910-6b3e6d9293a1 could not be found. Jun 05 09:00:40.220281 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:00:40.220281 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-554a10a5-eac9-480b-bc9c-fc5a5359209f tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] Returning 404 to user: Instance 883c58df-f0f0-40ef-9910-6b3e6d9293a1 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 09:00:40.220281 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-554a10a5-eac9-480b-bc9c-fc5a5359209f tempest-VolumesSnapshotTestJSON-829828933 tempest-VolumesSnapshotTestJSON-829828933-project] 10.222.0.33 "GET /compute/v2.1/servers/883c58df-f0f0-40ef-9910-6b3e6d9293a1" status: 404 len: 111 microversion: 2.1 time: 0.029888 Jun 05 09:00:40.220281 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1554/3196] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:00:40 2022] GET /compute/v2.1/servers/883c58df-f0f0-40ef-9910-6b3e6d9293a1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 09:01:49.410615 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:01:49.411421 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:01:49.412119 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:01:49.585400 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-21eb58ee-23aa-432d-982b-07221fe0568b tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Action: 'create', calling method: .version_select at 0x7f2440245670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-258341763", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWtyRIcbNjXKzD6LrCKYPMO/lltGJq+g2GqrXJ9Zx/1s8LAKLtJV0V9THjlVXpFDkbc0tKaM66KGuMzgtdxF8I1OqadvWZjPAWz2sBEYuu3JHEV9i37FRgCT9TeoGohmQ=="}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:01:49.600544 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-21eb58ee-23aa-432d-982b-07221fe0568b tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Getting quotas for project 3fbbb7bcc587445ab43f295f8e7a2ab1. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:01:49.605598 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-21eb58ee-23aa-432d-982b-07221fe0568b tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Getting quotas for user 4daf08714b6f48d7949b5be64a367794 and project 3fbbb7bcc587445ab43f295f8e7a2ab1. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:01:49.630332 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-21eb58ee-23aa-432d-982b-07221fe0568b tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.221370 Jun 05 09:01:49.630932 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1643/3197] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 09:01:49 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 09:01:55.566078 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:01:55.567333 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=6 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:01:55.568417 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:01:55.569224 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=12 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:01:55.574887 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c99890b8-f00f-4bed-8975-7efb907aa327 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1592908592", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "2ab26867-3d92-43e4-a74b-f987f37c1446"}], "key_name": "tempest-TestNetworkAdvancedServerOps-258341763", "security_groups": [{"name": "tempest-secgroup-smoke-2065378191"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:01:55.690265 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-c99890b8-f00f-4bed-8975-7efb907aa327 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] validate_networks() for [('2ab26867-3d92-43e4-a74b-f987f37c1446', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 09:01:56.125522 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-c99890b8-f00f-4bed-8975-7efb907aa327 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 09:01:56.126604 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-c99890b8-f00f-4bed-8975-7efb907aa327 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 09:01:56.126927 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-c99890b8-f00f-4bed-8975-7efb907aa327 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 09:01:56.127725 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-c99890b8-f00f-4bed-8975-7efb907aa327 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 09:01:56.128500 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-c99890b8-f00f-4bed-8975-7efb907aa327 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 09:01:56.139912 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c99890b8-f00f-4bed-8975-7efb907aa327 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:01:56.140702 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c99890b8-f00f-4bed-8975-7efb907aa327 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:01:56.141703 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c99890b8-f00f-4bed-8975-7efb907aa327 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:01:56.142339 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c99890b8-f00f-4bed-8975-7efb907aa327 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:01:56.166755 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-c99890b8-f00f-4bed-8975-7efb907aa327 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Getting quotas for project 3fbbb7bcc587445ab43f295f8e7a2ab1. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:01:56.172622 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-c99890b8-f00f-4bed-8975-7efb907aa327 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Getting quotas for user 4daf08714b6f48d7949b5be64a367794 and project 3fbbb7bcc587445ab43f295f8e7a2ab1. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:01:56.187493 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c99890b8-f00f-4bed-8975-7efb907aa327 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 09:01:56.189757 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c99890b8-f00f-4bed-8975-7efb907aa327 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 57932801-42d1-4989-a8c8-44bd48233633] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 09:01:56.241562 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c99890b8-f00f-4bed-8975-7efb907aa327 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.676626 Jun 05 09:01:56.247097 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1555/3198] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 09:01:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 05 09:01:56.252709 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-372bc628-b13f-4159-8200-da18ccabed03 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:01:56.253347 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-372bc628-b13f-4159-8200-da18ccabed03 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 57932801-42d1-4989-a8c8-44bd48233633] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:01:56.333761 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-372bc628-b13f-4159-8200-da18ccabed03 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daf08714b6f48d7949b5be64a367794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbbb7bcc587445ab43f295f8e7a2ab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:01:56.344181 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-372bc628-b13f-4159-8200-da18ccabed03 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] 10.222.0.33 "GET /compute/v2.1/servers/57932801-42d1-4989-a8c8-44bd48233633" status: 200 len: 1266 microversion: 2.1 time: 0.094704 Jun 05 09:01:56.344181 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1644/3199] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:01:56 2022] GET /compute/v2.1/servers/57932801-42d1-4989-a8c8-44bd48233633 => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:01:57.359388 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c003a308-77a1-4d31-a0d7-44c34ebff439 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:01:57.360226 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c003a308-77a1-4d31-a0d7-44c34ebff439 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 57932801-42d1-4989-a8c8-44bd48233633] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:01:57.369879 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c003a308-77a1-4d31-a0d7-44c34ebff439 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:01:57.370416 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c003a308-77a1-4d31-a0d7-44c34ebff439 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:01:57.371445 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c003a308-77a1-4d31-a0d7-44c34ebff439 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:01:57.372260 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c003a308-77a1-4d31-a0d7-44c34ebff439 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:01:57.407180 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c003a308-77a1-4d31-a0d7-44c34ebff439 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:01:57.407749 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c003a308-77a1-4d31-a0d7-44c34ebff439 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:01:57.408456 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-c003a308-77a1-4d31-a0d7-44c34ebff439 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lazy-loading 'fault' on Instance uuid 57932801-42d1-4989-a8c8-44bd48233633 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 09:01:57.456341 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-c003a308-77a1-4d31-a0d7-44c34ebff439 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daf08714b6f48d7949b5be64a367794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbbb7bcc587445ab43f295f8e7a2ab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:01:57.464759 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c003a308-77a1-4d31-a0d7-44c34ebff439 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] 10.222.0.33 "GET /compute/v2.1/servers/57932801-42d1-4989-a8c8-44bd48233633" status: 200 len: 1339 microversion: 2.1 time: 0.109317 Jun 05 09:01:57.465337 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1556/3200] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:01:57 2022] GET /compute/v2.1/servers/57932801-42d1-4989-a8c8-44bd48233633 => generated 1339 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:01:57.481562 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fca1135b-9772-434e-bb6b-2b2a9479b5e2 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:01:57.482090 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-fca1135b-9772-434e-bb6b-2b2a9479b5e2 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 57932801-42d1-4989-a8c8-44bd48233633] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:01:57.490216 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fca1135b-9772-434e-bb6b-2b2a9479b5e2 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:01:57.490676 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fca1135b-9772-434e-bb6b-2b2a9479b5e2 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:01:57.491541 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fca1135b-9772-434e-bb6b-2b2a9479b5e2 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:01:57.492078 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fca1135b-9772-434e-bb6b-2b2a9479b5e2 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:01:57.518952 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-fca1135b-9772-434e-bb6b-2b2a9479b5e2 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 57932801-42d1-4989-a8c8-44bd48233633] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 09:01:57.571790 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-fca1135b-9772-434e-bb6b-2b2a9479b5e2 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 57932801-42d1-4989-a8c8-44bd48233633] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 09:01:57.572681 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fca1135b-9772-434e-bb6b-2b2a9479b5e2 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:01:57.573122 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fca1135b-9772-434e-bb6b-2b2a9479b5e2 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:01:57.573723 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-fca1135b-9772-434e-bb6b-2b2a9479b5e2 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 57932801-42d1-4989-a8c8-44bd48233633] instance's host None is down, deleting from database Jun 05 09:01:57.589849 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-fca1135b-9772-434e-bb6b-2b2a9479b5e2 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 57932801-42d1-4989-a8c8-44bd48233633] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 09:01:57.638395 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-fca1135b-9772-434e-bb6b-2b2a9479b5e2 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 57932801-42d1-4989-a8c8-44bd48233633] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 09:01:57.644653 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-fca1135b-9772-434e-bb6b-2b2a9479b5e2 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 57932801-42d1-4989-a8c8-44bd48233633] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 09:01:57.806840 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fca1135b-9772-434e-bb6b-2b2a9479b5e2 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] 10.222.0.33 "DELETE /compute/v2.1/servers/57932801-42d1-4989-a8c8-44bd48233633" status: 204 len: 0 microversion: 2.1 time: 0.329591 Jun 05 09:01:57.807537 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1645/3201] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 09:01:57 2022] DELETE /compute/v2.1/servers/57932801-42d1-4989-a8c8-44bd48233633 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 09:01:57.815722 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-aba13f17-946f-4c0e-9e17-5279996dcc3e tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:01:57.816391 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-aba13f17-946f-4c0e-9e17-5279996dcc3e tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 57932801-42d1-4989-a8c8-44bd48233633] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:01:57.823548 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aba13f17-946f-4c0e-9e17-5279996dcc3e tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:01:57.824370 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aba13f17-946f-4c0e-9e17-5279996dcc3e tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:01:57.825040 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aba13f17-946f-4c0e-9e17-5279996dcc3e tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:01:57.825486 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-aba13f17-946f-4c0e-9e17-5279996dcc3e tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:01:57.840589 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-aba13f17-946f-4c0e-9e17-5279996dcc3e tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] HTTP exception thrown: Instance 57932801-42d1-4989-a8c8-44bd48233633 could not be found. Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-aba13f17-946f-4c0e-9e17-5279996dcc3e tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Request method failure captured: Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/57932801-42d1-4989-a8c8-44bd48233633 HTTP/1.1 Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinHD8ojtBC-3BdSL_T7lnGGtbcYjdf-4Gu77kTFW02x3qvVfT6jOFWP1nZSlQoQEDfJGJ9eR28NB3W5Zckt93_z9HmxyhyHAuibMkH0DlLkWK-zgdYG1exbYLrrBE4Fu0ue7TyzwPNnlvssuWAClvbYYEOEleuEUy-Kah3ec_WiJGnFw Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 3fbbb7bcc587445ab43f295f8e7a2ab1 Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1349413407 Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3fbbb7bcc587445ab43f295f8e7a2ab1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3fbbb7bcc587445ab43f295f8e7a2ab1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3fbbb7bcc587445ab43f295f8e7a2ab1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3fbbb7bcc587445ab43f295f8e7a2ab1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1349413407 Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 3fbbb7bcc587445ab43f295f8e7a2ab1 Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1349413407 Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-TestNetworkAdvancedServerOps-1349413407-project Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 4daf08714b6f48d7949b5be64a367794 Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1349413407-project Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 57932801-42d1-4989-a8c8-44bd48233633 could not be found. Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '57932801-42d1-4989-a8c8-44bd48233633'} Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57932801-42d1-4989-a8c8-44bd48233633 could not be found. Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57932801-42d1-4989-a8c8-44bd48233633 could not be found. Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:01:57.842197 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:01:57.846793 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:01:57.846793 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:01:57.846793 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:01:57.846793 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:01:57.846793 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 09:01:57.846793 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 09:01:57.846793 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57932801-42d1-4989-a8c8-44bd48233633 could not be found. Jun 05 09:01:57.846793 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:01:57.846793 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-aba13f17-946f-4c0e-9e17-5279996dcc3e tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Returning 404 to user: Instance 57932801-42d1-4989-a8c8-44bd48233633 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 09:01:57.846793 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-aba13f17-946f-4c0e-9e17-5279996dcc3e tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] 10.222.0.33 "GET /compute/v2.1/servers/57932801-42d1-4989-a8c8-44bd48233633" status: 404 len: 111 microversion: 2.1 time: 0.031863 Jun 05 09:01:57.846793 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1557/3202] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:01:57 2022] GET /compute/v2.1/servers/57932801-42d1-4989-a8c8-44bd48233633 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 09:02:01.444945 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2a5832bd-9c8a-4b76-a2a0-5396df8b0e9d tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Calling method '.version_select at 0x7f243386c280>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:02:01.474315 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2a5832bd-9c8a-4b76-a2a0-5396df8b0e9d tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-258341763" status: 202 len: 0 microversion: 2.1 time: 0.034178 Jun 05 09:02:01.474901 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1646/3203] 10.222.0.33 () {58 vars in 1280 bytes} [Sun Jun 5 09:02:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-258341763 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 09:02:01.490698 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a1658a5f-1685-4f9f-9fea-725a00317a94 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Action: 'create', calling method: .version_select at 0x7f243379dee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1071813361", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNWaCjvaq8lUV0qilo3RTLw4E/aKLS5+hegUsLBXHQtJISQQWYhrEcLSuTR2mJ+zMhgiFoN9He8jT40bT/R6xzBZN5o/UJM8loHCU3iA8E40BqTIgMjvS3T9v/dZb6olQ=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:02:01.505199 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-a1658a5f-1685-4f9f-9fea-725a00317a94 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Getting quotas for project 3fbbb7bcc587445ab43f295f8e7a2ab1. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:02:01.510232 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-a1658a5f-1685-4f9f-9fea-725a00317a94 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Getting quotas for user 4daf08714b6f48d7949b5be64a367794 and project 3fbbb7bcc587445ab43f295f8e7a2ab1. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:02:01.534360 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a1658a5f-1685-4f9f-9fea-725a00317a94 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.047862 Jun 05 09:02:01.534949 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1558/3204] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 09:02:01 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 09:02:03.824280 n-d-844739-1 devstack@n-api.service[119050]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 09:02:03.824828 n-d-844739-1 devstack@n-api.service[119050]: Sun Jun 5 09:02:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 09:02:06.876875 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-4a4339e5-15ba-4ed9-8394-e2e93c348adc tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-581462333", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "b71e820c-bc50-4c1a-9035-eb698b13c2b0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1071813361", "security_groups": [{"name": "tempest-secgroup-smoke-205451075"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:02:06.890019 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=6 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:02:07.028236 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-4a4339e5-15ba-4ed9-8394-e2e93c348adc tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] validate_networks() for [('b71e820c-bc50-4c1a-9035-eb698b13c2b0', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 09:02:07.451413 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-4a4339e5-15ba-4ed9-8394-e2e93c348adc tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 09:02:07.451844 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-4a4339e5-15ba-4ed9-8394-e2e93c348adc tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 09:02:07.452532 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-4a4339e5-15ba-4ed9-8394-e2e93c348adc tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 09:02:07.452952 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-4a4339e5-15ba-4ed9-8394-e2e93c348adc tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 09:02:07.453557 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-4a4339e5-15ba-4ed9-8394-e2e93c348adc tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 09:02:07.463831 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4a4339e5-15ba-4ed9-8394-e2e93c348adc tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:07.464612 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4a4339e5-15ba-4ed9-8394-e2e93c348adc tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:07.465835 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4a4339e5-15ba-4ed9-8394-e2e93c348adc tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:07.466336 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-4a4339e5-15ba-4ed9-8394-e2e93c348adc tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:07.489724 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-4a4339e5-15ba-4ed9-8394-e2e93c348adc tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Getting quotas for project 3fbbb7bcc587445ab43f295f8e7a2ab1. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:02:07.495991 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-4a4339e5-15ba-4ed9-8394-e2e93c348adc tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Getting quotas for user 4daf08714b6f48d7949b5be64a367794 and project 3fbbb7bcc587445ab43f295f8e7a2ab1. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:02:07.508809 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4a4339e5-15ba-4ed9-8394-e2e93c348adc tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 09:02:07.510948 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-4a4339e5-15ba-4ed9-8394-e2e93c348adc tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: c59c8953-8a42-405a-9232-509aef63edf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 09:02:07.560607 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-4a4339e5-15ba-4ed9-8394-e2e93c348adc tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.687357 Jun 05 09:02:07.561271 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1647/3205] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 09:02:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 09:02:07.571702 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-22d648af-4734-4644-a5e2-d403d0611f64 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:02:07.572305 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-22d648af-4734-4644-a5e2-d403d0611f64 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: c59c8953-8a42-405a-9232-509aef63edf9] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:02:07.575280 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:02:07.639134 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-22d648af-4734-4644-a5e2-d403d0611f64 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daf08714b6f48d7949b5be64a367794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbbb7bcc587445ab43f295f8e7a2ab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:02:07.646503 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-22d648af-4734-4644-a5e2-d403d0611f64 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] 10.222.0.33 "GET /compute/v2.1/servers/c59c8953-8a42-405a-9232-509aef63edf9" status: 200 len: 1266 microversion: 2.1 time: 0.079117 Jun 05 09:02:07.647087 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1559/3206] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:02:07 2022] GET /compute/v2.1/servers/c59c8953-8a42-405a-9232-509aef63edf9 => generated 1266 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:02:08.663382 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-75a59a6c-f85e-4101-8333-a69d81302c72 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:02:08.665208 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-75a59a6c-f85e-4101-8333-a69d81302c72 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: c59c8953-8a42-405a-9232-509aef63edf9] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:02:08.672799 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-75a59a6c-f85e-4101-8333-a69d81302c72 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:08.673507 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-75a59a6c-f85e-4101-8333-a69d81302c72 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:08.674286 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-75a59a6c-f85e-4101-8333-a69d81302c72 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:08.674720 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-75a59a6c-f85e-4101-8333-a69d81302c72 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:08.712397 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-75a59a6c-f85e-4101-8333-a69d81302c72 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:08.713106 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-75a59a6c-f85e-4101-8333-a69d81302c72 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:08.713672 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-75a59a6c-f85e-4101-8333-a69d81302c72 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lazy-loading 'fault' on Instance uuid c59c8953-8a42-405a-9232-509aef63edf9 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 09:02:09.051110 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-75a59a6c-f85e-4101-8333-a69d81302c72 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daf08714b6f48d7949b5be64a367794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbbb7bcc587445ab43f295f8e7a2ab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:02:09.059137 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-75a59a6c-f85e-4101-8333-a69d81302c72 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] 10.222.0.33 "GET /compute/v2.1/servers/c59c8953-8a42-405a-9232-509aef63edf9" status: 200 len: 1339 microversion: 2.1 time: 0.399711 Jun 05 09:02:09.059816 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1648/3207] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:02:08 2022] GET /compute/v2.1/servers/c59c8953-8a42-405a-9232-509aef63edf9 => generated 1339 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:02:09.075544 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-08703c9b-01df-415a-a06b-9bd9556f1c2b tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:02:09.076726 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-08703c9b-01df-415a-a06b-9bd9556f1c2b tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: c59c8953-8a42-405a-9232-509aef63edf9] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:02:09.078754 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=12 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:02:09.084914 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-08703c9b-01df-415a-a06b-9bd9556f1c2b tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:09.085459 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-08703c9b-01df-415a-a06b-9bd9556f1c2b tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:09.087095 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-08703c9b-01df-415a-a06b-9bd9556f1c2b tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:09.087608 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-08703c9b-01df-415a-a06b-9bd9556f1c2b tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:09.115142 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-08703c9b-01df-415a-a06b-9bd9556f1c2b tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: c59c8953-8a42-405a-9232-509aef63edf9] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 09:02:09.162801 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-08703c9b-01df-415a-a06b-9bd9556f1c2b tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: c59c8953-8a42-405a-9232-509aef63edf9] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 09:02:09.163607 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-08703c9b-01df-415a-a06b-9bd9556f1c2b tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:09.164873 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-08703c9b-01df-415a-a06b-9bd9556f1c2b tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:09.165318 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-08703c9b-01df-415a-a06b-9bd9556f1c2b tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: c59c8953-8a42-405a-9232-509aef63edf9] instance's host None is down, deleting from database Jun 05 09:02:09.170054 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-08703c9b-01df-415a-a06b-9bd9556f1c2b tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: c59c8953-8a42-405a-9232-509aef63edf9] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 09:02:09.204702 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-08703c9b-01df-415a-a06b-9bd9556f1c2b tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: c59c8953-8a42-405a-9232-509aef63edf9] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 09:02:09.213228 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-08703c9b-01df-415a-a06b-9bd9556f1c2b tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: c59c8953-8a42-405a-9232-509aef63edf9] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 09:02:09.430898 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-08703c9b-01df-415a-a06b-9bd9556f1c2b tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c59c8953-8a42-405a-9232-509aef63edf9" status: 204 len: 0 microversion: 2.1 time: 0.359428 Jun 05 09:02:09.434697 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1560/3208] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 09:02:09 2022] DELETE /compute/v2.1/servers/c59c8953-8a42-405a-9232-509aef63edf9 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 05 09:02:09.439747 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c106a5b3-6569-426d-a61b-b815c8e1ccc5 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:02:09.440405 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c106a5b3-6569-426d-a61b-b815c8e1ccc5 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: c59c8953-8a42-405a-9232-509aef63edf9] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:02:09.447310 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c106a5b3-6569-426d-a61b-b815c8e1ccc5 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:09.447772 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c106a5b3-6569-426d-a61b-b815c8e1ccc5 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:09.448790 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c106a5b3-6569-426d-a61b-b815c8e1ccc5 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:09.449499 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c106a5b3-6569-426d-a61b-b815c8e1ccc5 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:09.467843 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-c106a5b3-6569-426d-a61b-b815c8e1ccc5 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] HTTP exception thrown: Instance c59c8953-8a42-405a-9232-509aef63edf9 could not be found. Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c106a5b3-6569-426d-a61b-b815c8e1ccc5 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Request method failure captured: Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/c59c8953-8a42-405a-9232-509aef63edf9 HTTP/1.1 Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinHD8ojtBC-3BdSL_T7lnGGtbcYjdf-4Gu77kTFW02x3qvVfT6jOFWP1nZSlQoQEDfJGJ9eR28NB3W5Zckt93_z9HmxyhyHAuibMkH0DlLkWK-zgdYG1exbYLrrBE4Fu0ue7TyzwPNnlvssuWAClvbYYEOEleuEUy-Kah3ec_WiJGnFw Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 3fbbb7bcc587445ab43f295f8e7a2ab1 Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1349413407 Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3fbbb7bcc587445ab43f295f8e7a2ab1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3fbbb7bcc587445ab43f295f8e7a2ab1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3fbbb7bcc587445ab43f295f8e7a2ab1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3fbbb7bcc587445ab43f295f8e7a2ab1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1349413407 Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 3fbbb7bcc587445ab43f295f8e7a2ab1 Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1349413407 Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-TestNetworkAdvancedServerOps-1349413407-project Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 4daf08714b6f48d7949b5be64a367794 Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1349413407-project Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance c59c8953-8a42-405a-9232-509aef63edf9 could not be found. Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'c59c8953-8a42-405a-9232-509aef63edf9'} Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c59c8953-8a42-405a-9232-509aef63edf9 could not be found. Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c59c8953-8a42-405a-9232-509aef63edf9 could not be found. Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:02:09.470282 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:02:09.474964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:02:09.474964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:02:09.474964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:02:09.474964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:02:09.474964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 09:02:09.474964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 09:02:09.474964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c59c8953-8a42-405a-9232-509aef63edf9 could not be found. Jun 05 09:02:09.474964 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:02:09.477175 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c106a5b3-6569-426d-a61b-b815c8e1ccc5 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Returning 404 to user: Instance c59c8953-8a42-405a-9232-509aef63edf9 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 09:02:09.478330 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c106a5b3-6569-426d-a61b-b815c8e1ccc5 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] 10.222.0.33 "GET /compute/v2.1/servers/c59c8953-8a42-405a-9232-509aef63edf9" status: 404 len: 111 microversion: 2.1 time: 0.042528 Jun 05 09:02:09.479083 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1649/3209] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:02:09 2022] GET /compute/v2.1/servers/c59c8953-8a42-405a-9232-509aef63edf9 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 09:02:12.942729 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a5711e32-c4ed-4d0f-8245-0addb8ffc804 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Calling method '.version_select at 0x7f2445538550>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:02:12.963599 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a5711e32-c4ed-4d0f-8245-0addb8ffc804 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1071813361" status: 202 len: 0 microversion: 2.1 time: 0.024676 Jun 05 09:02:12.964210 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1561/3210] 10.222.0.33 () {58 vars in 1283 bytes} [Sun Jun 5 09:02:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1071813361 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 05 09:02:12.976682 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8a3ab0e7-8b9d-4faa-99a5-0ab5d7618fe6 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Action: 'create', calling method: .version_select at 0x7f2433a95040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1223009267", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUCi3oz4b9U4HEQkomSJRKr9kz7z7RqBjpGrqoGq1VYn1Lawme1jbTuPxpNKjeDpYIbm4gymLovA1tK07ZlPL6aTpl8XLaL0hnsBLKTIWFAqTpdxqWXs9LJFAylrnu/hA=="}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:02:12.992977 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-8a3ab0e7-8b9d-4faa-99a5-0ab5d7618fe6 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Getting quotas for project 3fbbb7bcc587445ab43f295f8e7a2ab1. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:02:12.998080 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-8a3ab0e7-8b9d-4faa-99a5-0ab5d7618fe6 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Getting quotas for user 4daf08714b6f48d7949b5be64a367794 and project 3fbbb7bcc587445ab43f295f8e7a2ab1. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:02:13.030711 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8a3ab0e7-8b9d-4faa-99a5-0ab5d7618fe6 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.057904 Jun 05 09:02:13.031717 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1650/3211] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 09:02:12 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 09:02:18.544297 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=12 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:02:18.549314 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1379d1e7-c9ee-4fba-b66a-04e44a041dcb tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1816966321", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "6170f4d0-d5d9-4172-a4be-95be719e3421"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1223009267", "security_groups": [{"name": "tempest-secgroup-smoke-435724753"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:02:18.676871 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-1379d1e7-c9ee-4fba-b66a-04e44a041dcb tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] validate_networks() for [('6170f4d0-d5d9-4172-a4be-95be719e3421', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 09:02:19.115524 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-1379d1e7-c9ee-4fba-b66a-04e44a041dcb tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 09:02:19.116080 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-1379d1e7-c9ee-4fba-b66a-04e44a041dcb tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 09:02:19.117196 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-1379d1e7-c9ee-4fba-b66a-04e44a041dcb tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 09:02:19.117713 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-1379d1e7-c9ee-4fba-b66a-04e44a041dcb tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 09:02:19.118242 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-1379d1e7-c9ee-4fba-b66a-04e44a041dcb tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 09:02:19.127807 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1379d1e7-c9ee-4fba-b66a-04e44a041dcb tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:19.128295 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1379d1e7-c9ee-4fba-b66a-04e44a041dcb tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:19.129108 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1379d1e7-c9ee-4fba-b66a-04e44a041dcb tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:19.129581 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1379d1e7-c9ee-4fba-b66a-04e44a041dcb tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:19.157078 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-1379d1e7-c9ee-4fba-b66a-04e44a041dcb tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Getting quotas for project 3fbbb7bcc587445ab43f295f8e7a2ab1. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:02:19.165346 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-1379d1e7-c9ee-4fba-b66a-04e44a041dcb tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Getting quotas for user 4daf08714b6f48d7949b5be64a367794 and project 3fbbb7bcc587445ab43f295f8e7a2ab1. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:02:19.182548 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1379d1e7-c9ee-4fba-b66a-04e44a041dcb tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 09:02:19.184787 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1379d1e7-c9ee-4fba-b66a-04e44a041dcb tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 70990d6d-5c6d-4da2-8cd7-64fbb988f3ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 09:02:19.276913 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1379d1e7-c9ee-4fba-b66a-04e44a041dcb tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.734112 Jun 05 09:02:19.278446 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1562/3212] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 09:02:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 09:02:19.288081 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0dc87d9d-b145-4425-a96c-26b414c68175 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:02:19.290278 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0dc87d9d-b145-4425-a96c-26b414c68175 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 70990d6d-5c6d-4da2-8cd7-64fbb988f3ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:02:19.296876 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:02:19.383865 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0dc87d9d-b145-4425-a96c-26b414c68175 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daf08714b6f48d7949b5be64a367794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbbb7bcc587445ab43f295f8e7a2ab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:02:19.391117 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0dc87d9d-b145-4425-a96c-26b414c68175 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] 10.222.0.33 "GET /compute/v2.1/servers/70990d6d-5c6d-4da2-8cd7-64fbb988f3ca" status: 200 len: 1267 microversion: 2.1 time: 0.106856 Jun 05 09:02:19.400786 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1651/3213] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:02:19 2022] GET /compute/v2.1/servers/70990d6d-5c6d-4da2-8cd7-64fbb988f3ca => generated 1267 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:02:20.409465 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2ec46c64-36f3-4d38-8d1a-54c8e0218cac tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:02:20.410587 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2ec46c64-36f3-4d38-8d1a-54c8e0218cac tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 70990d6d-5c6d-4da2-8cd7-64fbb988f3ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:02:20.417139 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2ec46c64-36f3-4d38-8d1a-54c8e0218cac tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:20.417714 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2ec46c64-36f3-4d38-8d1a-54c8e0218cac tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:20.418494 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2ec46c64-36f3-4d38-8d1a-54c8e0218cac tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:20.418933 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2ec46c64-36f3-4d38-8d1a-54c8e0218cac tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:20.451331 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2ec46c64-36f3-4d38-8d1a-54c8e0218cac tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:20.451778 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2ec46c64-36f3-4d38-8d1a-54c8e0218cac tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:20.452256 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-2ec46c64-36f3-4d38-8d1a-54c8e0218cac tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lazy-loading 'fault' on Instance uuid 70990d6d-5c6d-4da2-8cd7-64fbb988f3ca {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 09:02:20.496191 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2ec46c64-36f3-4d38-8d1a-54c8e0218cac tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daf08714b6f48d7949b5be64a367794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbbb7bcc587445ab43f295f8e7a2ab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:02:20.504796 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2ec46c64-36f3-4d38-8d1a-54c8e0218cac tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] 10.222.0.33 "GET /compute/v2.1/servers/70990d6d-5c6d-4da2-8cd7-64fbb988f3ca" status: 200 len: 1340 microversion: 2.1 time: 0.100320 Jun 05 09:02:20.506412 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1563/3214] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:02:20 2022] GET /compute/v2.1/servers/70990d6d-5c6d-4da2-8cd7-64fbb988f3ca => generated 1340 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:02:20.523815 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c65cf948-1685-4862-acfa-176a4b002d31 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:02:20.523815 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c65cf948-1685-4862-acfa-176a4b002d31 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 70990d6d-5c6d-4da2-8cd7-64fbb988f3ca] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:02:20.525510 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=36,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:02:20.529426 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:02:20.539217 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c65cf948-1685-4862-acfa-176a4b002d31 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:20.539749 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c65cf948-1685-4862-acfa-176a4b002d31 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:20.540781 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c65cf948-1685-4862-acfa-176a4b002d31 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:20.541400 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c65cf948-1685-4862-acfa-176a4b002d31 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:20.574495 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c65cf948-1685-4862-acfa-176a4b002d31 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 70990d6d-5c6d-4da2-8cd7-64fbb988f3ca] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 09:02:20.632876 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c65cf948-1685-4862-acfa-176a4b002d31 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 70990d6d-5c6d-4da2-8cd7-64fbb988f3ca] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 09:02:20.635065 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c65cf948-1685-4862-acfa-176a4b002d31 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:20.635519 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c65cf948-1685-4862-acfa-176a4b002d31 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:20.635965 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-c65cf948-1685-4862-acfa-176a4b002d31 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 70990d6d-5c6d-4da2-8cd7-64fbb988f3ca] instance's host None is down, deleting from database Jun 05 09:02:20.640957 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-c65cf948-1685-4862-acfa-176a4b002d31 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 70990d6d-5c6d-4da2-8cd7-64fbb988f3ca] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 09:02:20.678569 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-c65cf948-1685-4862-acfa-176a4b002d31 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 70990d6d-5c6d-4da2-8cd7-64fbb988f3ca] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 09:02:20.685868 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-c65cf948-1685-4862-acfa-176a4b002d31 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 70990d6d-5c6d-4da2-8cd7-64fbb988f3ca] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 09:02:20.883183 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c65cf948-1685-4862-acfa-176a4b002d31 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] 10.222.0.33 "DELETE /compute/v2.1/servers/70990d6d-5c6d-4da2-8cd7-64fbb988f3ca" status: 204 len: 0 microversion: 2.1 time: 0.363833 Jun 05 09:02:20.888551 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1652/3215] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 09:02:20 2022] DELETE /compute/v2.1/servers/70990d6d-5c6d-4da2-8cd7-64fbb988f3ca => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 09:02:20.894753 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d94b1be1-99b9-4f22-a648-fb3611623ef8 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:02:20.895523 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d94b1be1-99b9-4f22-a648-fb3611623ef8 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 70990d6d-5c6d-4da2-8cd7-64fbb988f3ca] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:02:20.909132 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d94b1be1-99b9-4f22-a648-fb3611623ef8 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:20.909662 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d94b1be1-99b9-4f22-a648-fb3611623ef8 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:20.910497 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d94b1be1-99b9-4f22-a648-fb3611623ef8 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:20.910935 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d94b1be1-99b9-4f22-a648-fb3611623ef8 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:20.939137 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-d94b1be1-99b9-4f22-a648-fb3611623ef8 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] HTTP exception thrown: Instance 70990d6d-5c6d-4da2-8cd7-64fbb988f3ca could not be found. Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d94b1be1-99b9-4f22-a648-fb3611623ef8 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Request method failure captured: Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/70990d6d-5c6d-4da2-8cd7-64fbb988f3ca HTTP/1.1 Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinHD8ojtBC-3BdSL_T7lnGGtbcYjdf-4Gu77kTFW02x3qvVfT6jOFWP1nZSlQoQEDfJGJ9eR28NB3W5Zckt93_z9HmxyhyHAuibMkH0DlLkWK-zgdYG1exbYLrrBE4Fu0ue7TyzwPNnlvssuWAClvbYYEOEleuEUy-Kah3ec_WiJGnFw Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 3fbbb7bcc587445ab43f295f8e7a2ab1 Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1349413407 Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3fbbb7bcc587445ab43f295f8e7a2ab1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3fbbb7bcc587445ab43f295f8e7a2ab1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3fbbb7bcc587445ab43f295f8e7a2ab1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3fbbb7bcc587445ab43f295f8e7a2ab1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1349413407 Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 3fbbb7bcc587445ab43f295f8e7a2ab1 Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1349413407 Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-TestNetworkAdvancedServerOps-1349413407-project Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 4daf08714b6f48d7949b5be64a367794 Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1349413407-project Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 70990d6d-5c6d-4da2-8cd7-64fbb988f3ca could not be found. Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '70990d6d-5c6d-4da2-8cd7-64fbb988f3ca'} Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70990d6d-5c6d-4da2-8cd7-64fbb988f3ca could not be found. Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70990d6d-5c6d-4da2-8cd7-64fbb988f3ca could not be found. Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:02:20.941007 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:02:20.945701 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:02:20.945701 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:02:20.945701 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:02:20.945701 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:02:20.945701 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 09:02:20.945701 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 09:02:20.945701 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70990d6d-5c6d-4da2-8cd7-64fbb988f3ca could not be found. Jun 05 09:02:20.945701 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:02:20.947940 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d94b1be1-99b9-4f22-a648-fb3611623ef8 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Returning 404 to user: Instance 70990d6d-5c6d-4da2-8cd7-64fbb988f3ca could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 09:02:20.949014 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d94b1be1-99b9-4f22-a648-fb3611623ef8 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] 10.222.0.33 "GET /compute/v2.1/servers/70990d6d-5c6d-4da2-8cd7-64fbb988f3ca" status: 404 len: 111 microversion: 2.1 time: 0.059178 Jun 05 09:02:20.950135 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1564/3216] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:02:20 2022] GET /compute/v2.1/servers/70990d6d-5c6d-4da2-8cd7-64fbb988f3ca => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 09:02:24.370087 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-65945522-00dc-4e27-bbdf-9b0da78c0ed0 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Calling method '.version_select at 0x7f24454861f0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:02:24.393551 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-65945522-00dc-4e27-bbdf-9b0da78c0ed0 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1223009267" status: 202 len: 0 microversion: 2.1 time: 0.027831 Jun 05 09:02:24.406603 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1653/3217] 10.222.0.33 () {58 vars in 1283 bytes} [Sun Jun 5 09:02:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1223009267 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 09:02:24.411941 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-afdc1c94-4057-4908-9541-85d0276654c7 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Action: 'create', calling method: .version_select at 0x7f2432f7b8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-815431504", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKonK+Wl0FrldYVYhDKqNtSqP52IWhsOsJjq99NgY64CIlgcrAKChIQfalIm4udzdU2g609Re4dxcd8m0nK4JpU3aRwP0qzAfH+pGTml97FyHbXnljZ1suj1pUuXGxoSxw=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:02:24.433888 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-afdc1c94-4057-4908-9541-85d0276654c7 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Getting quotas for project 3fbbb7bcc587445ab43f295f8e7a2ab1. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:02:24.440010 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-afdc1c94-4057-4908-9541-85d0276654c7 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Getting quotas for user 4daf08714b6f48d7949b5be64a367794 and project 3fbbb7bcc587445ab43f295f8e7a2ab1. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:02:24.463641 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-afdc1c94-4057-4908-9541-85d0276654c7 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.056139 Jun 05 09:02:24.464278 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1565/3218] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 09:02:24 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 09:02:30.275021 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=12 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:02:30.279973 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-958a4ba5-76b8-4d0a-81d2-b1ac14c8d665 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1276344479", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "09cdd8b0-ddc9-4f89-aa4e-b7e6e2388d98"}], "key_name": "tempest-TestNetworkAdvancedServerOps-815431504", "security_groups": [{"name": "tempest-secgroup-smoke-212543190"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:02:30.433178 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-958a4ba5-76b8-4d0a-81d2-b1ac14c8d665 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] validate_networks() for [('09cdd8b0-ddc9-4f89-aa4e-b7e6e2388d98', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 09:02:30.872302 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:02:30.891617 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-958a4ba5-76b8-4d0a-81d2-b1ac14c8d665 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 09:02:30.892079 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-958a4ba5-76b8-4d0a-81d2-b1ac14c8d665 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 09:02:30.892551 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-958a4ba5-76b8-4d0a-81d2-b1ac14c8d665 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 09:02:30.893139 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-958a4ba5-76b8-4d0a-81d2-b1ac14c8d665 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 09:02:30.893571 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-958a4ba5-76b8-4d0a-81d2-b1ac14c8d665 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 09:02:30.904771 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-958a4ba5-76b8-4d0a-81d2-b1ac14c8d665 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:30.905227 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-958a4ba5-76b8-4d0a-81d2-b1ac14c8d665 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:30.906236 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-958a4ba5-76b8-4d0a-81d2-b1ac14c8d665 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:30.906680 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-958a4ba5-76b8-4d0a-81d2-b1ac14c8d665 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:30.929565 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-958a4ba5-76b8-4d0a-81d2-b1ac14c8d665 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Getting quotas for project 3fbbb7bcc587445ab43f295f8e7a2ab1. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:02:30.935076 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-958a4ba5-76b8-4d0a-81d2-b1ac14c8d665 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Getting quotas for user 4daf08714b6f48d7949b5be64a367794 and project 3fbbb7bcc587445ab43f295f8e7a2ab1. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:02:30.947792 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-958a4ba5-76b8-4d0a-81d2-b1ac14c8d665 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 09:02:30.950061 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-958a4ba5-76b8-4d0a-81d2-b1ac14c8d665 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 3b1a6616-c237-4c54-88f8-2e9ae32b5197] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 09:02:31.001063 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-958a4ba5-76b8-4d0a-81d2-b1ac14c8d665 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.728337 Jun 05 09:02:31.002148 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1654/3219] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 09:02:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 09:02:31.010221 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:02:31.011728 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=36,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:02:31.016364 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-680df7e3-5ee8-4655-a784-1eeb0d4850b6 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:02:31.017792 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-680df7e3-5ee8-4655-a784-1eeb0d4850b6 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 3b1a6616-c237-4c54-88f8-2e9ae32b5197] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:02:31.021861 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=8,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:02:31.104872 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-680df7e3-5ee8-4655-a784-1eeb0d4850b6 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daf08714b6f48d7949b5be64a367794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbbb7bcc587445ab43f295f8e7a2ab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:02:31.111063 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-680df7e3-5ee8-4655-a784-1eeb0d4850b6 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a6616-c237-4c54-88f8-2e9ae32b5197" status: 200 len: 1266 microversion: 2.1 time: 0.102662 Jun 05 09:02:31.120943 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1566/3220] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:02:31 2022] GET /compute/v2.1/servers/3b1a6616-c237-4c54-88f8-2e9ae32b5197 => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:02:32.128921 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b6f8772e-2600-42b9-967d-ae471c2f34b2 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:02:32.129477 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b6f8772e-2600-42b9-967d-ae471c2f34b2 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 3b1a6616-c237-4c54-88f8-2e9ae32b5197] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:02:32.137057 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b6f8772e-2600-42b9-967d-ae471c2f34b2 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:32.137507 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b6f8772e-2600-42b9-967d-ae471c2f34b2 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:32.138275 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b6f8772e-2600-42b9-967d-ae471c2f34b2 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:32.138710 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b6f8772e-2600-42b9-967d-ae471c2f34b2 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:32.171249 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b6f8772e-2600-42b9-967d-ae471c2f34b2 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:32.171638 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b6f8772e-2600-42b9-967d-ae471c2f34b2 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:32.172608 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-b6f8772e-2600-42b9-967d-ae471c2f34b2 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lazy-loading 'fault' on Instance uuid 3b1a6616-c237-4c54-88f8-2e9ae32b5197 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 09:02:32.214319 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b6f8772e-2600-42b9-967d-ae471c2f34b2 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4daf08714b6f48d7949b5be64a367794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbbb7bcc587445ab43f295f8e7a2ab1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:02:32.221951 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b6f8772e-2600-42b9-967d-ae471c2f34b2 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a6616-c237-4c54-88f8-2e9ae32b5197" status: 200 len: 1339 microversion: 2.1 time: 0.097119 Jun 05 09:02:32.222701 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1655/3221] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:02:32 2022] GET /compute/v2.1/servers/3b1a6616-c237-4c54-88f8-2e9ae32b5197 => generated 1339 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 09:02:32.238440 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-5c0dca75-234c-4a4a-9eab-ca2101188282 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:02:32.239071 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5c0dca75-234c-4a4a-9eab-ca2101188282 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 3b1a6616-c237-4c54-88f8-2e9ae32b5197] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:02:32.247699 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5c0dca75-234c-4a4a-9eab-ca2101188282 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:32.248193 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5c0dca75-234c-4a4a-9eab-ca2101188282 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:32.248975 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5c0dca75-234c-4a4a-9eab-ca2101188282 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:32.249456 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5c0dca75-234c-4a4a-9eab-ca2101188282 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:32.274248 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5c0dca75-234c-4a4a-9eab-ca2101188282 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 3b1a6616-c237-4c54-88f8-2e9ae32b5197] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 09:02:32.326462 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-5c0dca75-234c-4a4a-9eab-ca2101188282 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 3b1a6616-c237-4c54-88f8-2e9ae32b5197] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 09:02:32.327277 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5c0dca75-234c-4a4a-9eab-ca2101188282 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:32.328064 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-5c0dca75-234c-4a4a-9eab-ca2101188282 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:32.328195 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-5c0dca75-234c-4a4a-9eab-ca2101188282 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 3b1a6616-c237-4c54-88f8-2e9ae32b5197] instance's host None is down, deleting from database Jun 05 09:02:32.331980 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-5c0dca75-234c-4a4a-9eab-ca2101188282 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 3b1a6616-c237-4c54-88f8-2e9ae32b5197] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 09:02:32.370049 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-5c0dca75-234c-4a4a-9eab-ca2101188282 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 3b1a6616-c237-4c54-88f8-2e9ae32b5197] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 09:02:32.376745 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-5c0dca75-234c-4a4a-9eab-ca2101188282 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 3b1a6616-c237-4c54-88f8-2e9ae32b5197] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 09:02:32.567785 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-5c0dca75-234c-4a4a-9eab-ca2101188282 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3b1a6616-c237-4c54-88f8-2e9ae32b5197" status: 204 len: 0 microversion: 2.1 time: 0.333387 Jun 05 09:02:32.568419 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1567/3222] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 09:02:32 2022] DELETE /compute/v2.1/servers/3b1a6616-c237-4c54-88f8-2e9ae32b5197 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 09:02:32.577423 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c70e4147-9b49-4f7a-8792-0a43afc2dd59 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:02:32.578138 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-c70e4147-9b49-4f7a-8792-0a43afc2dd59 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] [instance: 3b1a6616-c237-4c54-88f8-2e9ae32b5197] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:02:32.584559 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c70e4147-9b49-4f7a-8792-0a43afc2dd59 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:32.585671 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c70e4147-9b49-4f7a-8792-0a43afc2dd59 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:32.586487 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c70e4147-9b49-4f7a-8792-0a43afc2dd59 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:32.586937 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-c70e4147-9b49-4f7a-8792-0a43afc2dd59 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:32.601451 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-c70e4147-9b49-4f7a-8792-0a43afc2dd59 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] HTTP exception thrown: Instance 3b1a6616-c237-4c54-88f8-2e9ae32b5197 could not be found. Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c70e4147-9b49-4f7a-8792-0a43afc2dd59 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Request method failure captured: Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/3b1a6616-c237-4c54-88f8-2e9ae32b5197 HTTP/1.1 Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinHD8ojtBC-3BdSL_T7lnGGtbcYjdf-4Gu77kTFW02x3qvVfT6jOFWP1nZSlQoQEDfJGJ9eR28NB3W5Zckt93_z9HmxyhyHAuibMkH0DlLkWK-zgdYG1exbYLrrBE4Fu0ue7TyzwPNnlvssuWAClvbYYEOEleuEUy-Kah3ec_WiJGnFw Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 3fbbb7bcc587445ab43f295f8e7a2ab1 Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1349413407 Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3fbbb7bcc587445ab43f295f8e7a2ab1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3fbbb7bcc587445ab43f295f8e7a2ab1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3fbbb7bcc587445ab43f295f8e7a2ab1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3fbbb7bcc587445ab43f295f8e7a2ab1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1349413407 Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 3fbbb7bcc587445ab43f295f8e7a2ab1 Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1349413407 Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-TestNetworkAdvancedServerOps-1349413407-project Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 4daf08714b6f48d7949b5be64a367794 Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1349413407-project Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 3b1a6616-c237-4c54-88f8-2e9ae32b5197 could not be found. Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '3b1a6616-c237-4c54-88f8-2e9ae32b5197'} Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b1a6616-c237-4c54-88f8-2e9ae32b5197 could not be found. Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b1a6616-c237-4c54-88f8-2e9ae32b5197 could not be found. Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:02:32.603211 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:02:32.611470 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:02:32.611470 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:02:32.611470 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:02:32.611470 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:02:32.611470 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 09:02:32.611470 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 09:02:32.611470 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b1a6616-c237-4c54-88f8-2e9ae32b5197 could not be found. Jun 05 09:02:32.611470 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:02:32.611470 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-c70e4147-9b49-4f7a-8792-0a43afc2dd59 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Returning 404 to user: Instance 3b1a6616-c237-4c54-88f8-2e9ae32b5197 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 09:02:32.611470 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-c70e4147-9b49-4f7a-8792-0a43afc2dd59 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a6616-c237-4c54-88f8-2e9ae32b5197" status: 404 len: 111 microversion: 2.1 time: 0.031223 Jun 05 09:02:32.611470 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1656/3223] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:02:32 2022] GET /compute/v2.1/servers/3b1a6616-c237-4c54-88f8-2e9ae32b5197 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 09:02:35.739830 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-248f1159-3cbe-45db-911d-7a5591123662 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] Calling method '.version_select at 0x7f2432f7bca0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:02:35.768230 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-248f1159-3cbe-45db-911d-7a5591123662 tempest-TestNetworkAdvancedServerOps-1349413407 tempest-TestNetworkAdvancedServerOps-1349413407-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-815431504" status: 202 len: 0 microversion: 2.1 time: 0.032433 Jun 05 09:02:35.772655 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1568/3224] 10.222.0.33 () {58 vars in 1280 bytes} [Sun Jun 5 09:02:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-815431504 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 09:02:39.758953 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7519a5e1-1a1f-48e4-89bf-f136190e9fe3 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-649345844", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "fc34747e-11de-46df-a902-0bef0202ca39"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:02:39.809326 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-7519a5e1-1a1f-48e4-89bf-f136190e9fe3 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] validate_networks() for [('fc34747e-11de-46df-a902-0bef0202ca39', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 09:02:40.162568 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-7519a5e1-1a1f-48e4-89bf-f136190e9fe3 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 09:02:40.162998 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-7519a5e1-1a1f-48e4-89bf-f136190e9fe3 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 09:02:40.163479 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-7519a5e1-1a1f-48e4-89bf-f136190e9fe3 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 09:02:40.163896 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-7519a5e1-1a1f-48e4-89bf-f136190e9fe3 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 09:02:40.164337 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-7519a5e1-1a1f-48e4-89bf-f136190e9fe3 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 09:02:40.172999 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7519a5e1-1a1f-48e4-89bf-f136190e9fe3 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:40.173451 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7519a5e1-1a1f-48e4-89bf-f136190e9fe3 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:40.174247 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7519a5e1-1a1f-48e4-89bf-f136190e9fe3 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:40.174685 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7519a5e1-1a1f-48e4-89bf-f136190e9fe3 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:40.190800 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-7519a5e1-1a1f-48e4-89bf-f136190e9fe3 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Getting quotas for project f3d78a2fd6ac47598338fcc451631e7a. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:02:40.196370 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-7519a5e1-1a1f-48e4-89bf-f136190e9fe3 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Getting quotas for user acf97070af494cf285414351986af6ea and project f3d78a2fd6ac47598338fcc451631e7a. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:02:40.208151 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7519a5e1-1a1f-48e4-89bf-f136190e9fe3 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 09:02:40.210844 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7519a5e1-1a1f-48e4-89bf-f136190e9fe3 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] [instance: 5627b3fb-ef08-42e4-bb2a-bb3b5cd78bc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 09:02:40.253862 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7519a5e1-1a1f-48e4-89bf-f136190e9fe3 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.611592 Jun 05 09:02:40.254517 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1657/3225] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 09:02:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 09:02:40.265747 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-eb7a654c-c9cc-4185-be19-b9b64d683346 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:02:40.266368 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-eb7a654c-c9cc-4185-be19-b9b64d683346 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] [instance: 5627b3fb-ef08-42e4-bb2a-bb3b5cd78bc7] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:02:40.321149 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-eb7a654c-c9cc-4185-be19-b9b64d683346 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf97070af494cf285414351986af6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d78a2fd6ac47598338fcc451631e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:02:40.328548 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-eb7a654c-c9cc-4185-be19-b9b64d683346 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] 10.222.0.33 "GET /compute/v2.1/servers/5627b3fb-ef08-42e4-bb2a-bb3b5cd78bc7" status: 200 len: 1214 microversion: 2.1 time: 0.067362 Jun 05 09:02:40.329112 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1569/3226] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:02:40 2022] GET /compute/v2.1/servers/5627b3fb-ef08-42e4-bb2a-bb3b5cd78bc7 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:02:41.346066 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2a727cbc-762f-47cc-8b9d-e20a11016b58 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:02:41.346685 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-2a727cbc-762f-47cc-8b9d-e20a11016b58 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] [instance: 5627b3fb-ef08-42e4-bb2a-bb3b5cd78bc7] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:02:41.355080 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2a727cbc-762f-47cc-8b9d-e20a11016b58 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:41.355537 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2a727cbc-762f-47cc-8b9d-e20a11016b58 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:41.356332 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2a727cbc-762f-47cc-8b9d-e20a11016b58 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:41.356777 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2a727cbc-762f-47cc-8b9d-e20a11016b58 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:41.385942 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2a727cbc-762f-47cc-8b9d-e20a11016b58 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:41.386393 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-2a727cbc-762f-47cc-8b9d-e20a11016b58 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:41.386846 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-2a727cbc-762f-47cc-8b9d-e20a11016b58 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Lazy-loading 'fault' on Instance uuid 5627b3fb-ef08-42e4-bb2a-bb3b5cd78bc7 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 09:02:41.432383 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-2a727cbc-762f-47cc-8b9d-e20a11016b58 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf97070af494cf285414351986af6ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d78a2fd6ac47598338fcc451631e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:02:41.439775 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2a727cbc-762f-47cc-8b9d-e20a11016b58 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] 10.222.0.33 "GET /compute/v2.1/servers/5627b3fb-ef08-42e4-bb2a-bb3b5cd78bc7" status: 200 len: 1287 microversion: 2.1 time: 0.097704 Jun 05 09:02:41.440372 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1658/3227] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:02:41 2022] GET /compute/v2.1/servers/5627b3fb-ef08-42e4-bb2a-bb3b5cd78bc7 => generated 1287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:02:41.456244 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-76c37dd9-d169-4f4c-bf9a-2742a578e17b tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:02:41.456771 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-76c37dd9-d169-4f4c-bf9a-2742a578e17b tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] [instance: 5627b3fb-ef08-42e4-bb2a-bb3b5cd78bc7] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:02:41.465554 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-76c37dd9-d169-4f4c-bf9a-2742a578e17b tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:41.466010 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-76c37dd9-d169-4f4c-bf9a-2742a578e17b tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:41.466782 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-76c37dd9-d169-4f4c-bf9a-2742a578e17b tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:41.467223 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-76c37dd9-d169-4f4c-bf9a-2742a578e17b tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:41.491852 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-76c37dd9-d169-4f4c-bf9a-2742a578e17b tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] [instance: 5627b3fb-ef08-42e4-bb2a-bb3b5cd78bc7] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 09:02:41.544801 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-76c37dd9-d169-4f4c-bf9a-2742a578e17b tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] [instance: 5627b3fb-ef08-42e4-bb2a-bb3b5cd78bc7] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 09:02:41.545965 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-76c37dd9-d169-4f4c-bf9a-2742a578e17b tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:41.546633 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-76c37dd9-d169-4f4c-bf9a-2742a578e17b tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:41.547296 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-76c37dd9-d169-4f4c-bf9a-2742a578e17b tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] [instance: 5627b3fb-ef08-42e4-bb2a-bb3b5cd78bc7] instance's host None is down, deleting from database Jun 05 09:02:41.551983 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-76c37dd9-d169-4f4c-bf9a-2742a578e17b tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] [instance: 5627b3fb-ef08-42e4-bb2a-bb3b5cd78bc7] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 09:02:41.586733 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-76c37dd9-d169-4f4c-bf9a-2742a578e17b tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] [instance: 5627b3fb-ef08-42e4-bb2a-bb3b5cd78bc7] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 09:02:41.592731 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-76c37dd9-d169-4f4c-bf9a-2742a578e17b tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] [instance: 5627b3fb-ef08-42e4-bb2a-bb3b5cd78bc7] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 09:02:41.735652 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-76c37dd9-d169-4f4c-bf9a-2742a578e17b tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5627b3fb-ef08-42e4-bb2a-bb3b5cd78bc7" status: 204 len: 0 microversion: 2.1 time: 0.283325 Jun 05 09:02:41.736277 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1570/3228] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 09:02:41 2022] DELETE /compute/v2.1/servers/5627b3fb-ef08-42e4-bb2a-bb3b5cd78bc7 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 09:02:41.744610 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5ceecad9-c333-4164-b2c4-e645f733cb87 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:02:41.745198 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5ceecad9-c333-4164-b2c4-e645f733cb87 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] [instance: 5627b3fb-ef08-42e4-bb2a-bb3b5cd78bc7] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:02:41.751432 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5ceecad9-c333-4164-b2c4-e645f733cb87 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:41.751893 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5ceecad9-c333-4164-b2c4-e645f733cb87 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:41.752834 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5ceecad9-c333-4164-b2c4-e645f733cb87 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:41.753285 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5ceecad9-c333-4164-b2c4-e645f733cb87 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:41.767060 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-5ceecad9-c333-4164-b2c4-e645f733cb87 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] HTTP exception thrown: Instance 5627b3fb-ef08-42e4-bb2a-bb3b5cd78bc7 could not be found. Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5ceecad9-c333-4164-b2c4-e645f733cb87 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Request method failure captured: Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/5627b3fb-ef08-42e4-bb2a-bb3b5cd78bc7 HTTP/1.1 Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinHEu2CkGJr_BYy07d-0rRvdIK0ARws64v3iw1oIRT-M0vHNDHdBz2wucYKxwClO2GhSoX04DN4NtieOVdc8CVPVxfyL79Y-EOENa6u1GB-0eihAHqmxRtleDZeFeizh_5IOfFKMAOeH43w2QgpnnLmI4jw6BifPNIlhJjg_McI4p6VI Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: f3d78a2fd6ac47598338fcc451631e7a Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-TestServerAdvancedOps-376905953 Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f3d78a2fd6ac47598338fcc451631e7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f3d78a2fd6ac47598338fcc451631e7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f3d78a2fd6ac47598338fcc451631e7a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f3d78a2fd6ac47598338fcc451631e7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-TestServerAdvancedOps-376905953 Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: f3d78a2fd6ac47598338fcc451631e7a Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-TestServerAdvancedOps-376905953 Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-TestServerAdvancedOps-376905953-project Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: acf97070af494cf285414351986af6ea Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-TestServerAdvancedOps-376905953-project Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 5627b3fb-ef08-42e4-bb2a-bb3b5cd78bc7 could not be found. Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '5627b3fb-ef08-42e4-bb2a-bb3b5cd78bc7'} Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5627b3fb-ef08-42e4-bb2a-bb3b5cd78bc7 could not be found. Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5627b3fb-ef08-42e4-bb2a-bb3b5cd78bc7 could not be found. Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:02:41.768610 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:02:41.774015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:02:41.774015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:02:41.774015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:02:41.774015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 09:02:41.774015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 09:02:41.774015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5627b3fb-ef08-42e4-bb2a-bb3b5cd78bc7 could not be found. Jun 05 09:02:41.774015 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:02:41.774015 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5ceecad9-c333-4164-b2c4-e645f733cb87 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] Returning 404 to user: Instance 5627b3fb-ef08-42e4-bb2a-bb3b5cd78bc7 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 09:02:41.774015 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5ceecad9-c333-4164-b2c4-e645f733cb87 tempest-TestServerAdvancedOps-376905953 tempest-TestServerAdvancedOps-376905953-project] 10.222.0.33 "GET /compute/v2.1/servers/5627b3fb-ef08-42e4-bb2a-bb3b5cd78bc7" status: 404 len: 111 microversion: 2.1 time: 0.029354 Jun 05 09:02:41.774015 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1659/3229] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:02:41 2022] GET /compute/v2.1/servers/5627b3fb-ef08-42e4-bb2a-bb3b5cd78bc7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 09:02:54.596829 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=14 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:02:54.597703 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:02:54.598525 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=48,nova_cell0:UPDATE=30,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=4 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:02:54.720603 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1ffb2fc2-7fbf-4174-b964-298ca981a9f7 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-859296351", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452"}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:02:54.770158 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-1ffb2fc2-7fbf-4174-b964-298ca981a9f7 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] validate_networks() for None {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 09:02:54.959177 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-1ffb2fc2-7fbf-4174-b964-298ca981a9f7 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 09:02:54.959652 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-1ffb2fc2-7fbf-4174-b964-298ca981a9f7 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 09:02:54.960323 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-1ffb2fc2-7fbf-4174-b964-298ca981a9f7 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 09:02:54.960753 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-1ffb2fc2-7fbf-4174-b964-298ca981a9f7 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 09:02:54.961178 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-1ffb2fc2-7fbf-4174-b964-298ca981a9f7 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 09:02:54.970119 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ffb2fc2-7fbf-4174-b964-298ca981a9f7 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:54.970574 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ffb2fc2-7fbf-4174-b964-298ca981a9f7 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:54.971377 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ffb2fc2-7fbf-4174-b964-298ca981a9f7 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:54.971823 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-1ffb2fc2-7fbf-4174-b964-298ca981a9f7 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:54.988560 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-1ffb2fc2-7fbf-4174-b964-298ca981a9f7 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Getting quotas for project ed63df6b21f54b559fe29b9f00173038. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:02:54.994060 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-1ffb2fc2-7fbf-4174-b964-298ca981a9f7 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Getting quotas for user 367cc3ec46ce414ab5522f582094a83f and project ed63df6b21f54b559fe29b9f00173038. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:02:55.006299 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1ffb2fc2-7fbf-4174-b964-298ca981a9f7 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 09:02:55.009010 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-1ffb2fc2-7fbf-4174-b964-298ca981a9f7 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] [instance: e205580f-e3da-4fb7-8854-bb37b6c06e2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 09:02:55.052700 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1ffb2fc2-7fbf-4174-b964-298ca981a9f7 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.457211 Jun 05 09:02:55.054204 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1571/3230] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 09:02:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 09:02:55.064550 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1caa58eb-3c2e-4823-9c3b-ce02453cc7dc tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:02:55.065501 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1caa58eb-3c2e-4823-9c3b-ce02453cc7dc tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] [instance: e205580f-e3da-4fb7-8854-bb37b6c06e2a] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:02:55.070079 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=4 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:02:55.070956 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=12 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:02:55.071745 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:02:55.072609 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=24 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:02:55.130474 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1caa58eb-3c2e-4823-9c3b-ce02453cc7dc tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '367cc3ec46ce414ab5522f582094a83f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed63df6b21f54b559fe29b9f00173038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:02:55.139590 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1caa58eb-3c2e-4823-9c3b-ce02453cc7dc tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] 10.222.0.33 "GET /compute/v2.1/servers/e205580f-e3da-4fb7-8854-bb37b6c06e2a" status: 200 len: 1221 microversion: 2.1 time: 0.077267 Jun 05 09:02:55.139590 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1660/3231] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:02:55 2022] GET /compute/v2.1/servers/e205580f-e3da-4fb7-8854-bb37b6c06e2a => generated 1221 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:02:56.155006 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-920b77af-7cc6-428a-9fa3-e2d499132d59 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:02:56.155635 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-920b77af-7cc6-428a-9fa3-e2d499132d59 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] [instance: e205580f-e3da-4fb7-8854-bb37b6c06e2a] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:02:56.162635 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-920b77af-7cc6-428a-9fa3-e2d499132d59 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:56.163197 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-920b77af-7cc6-428a-9fa3-e2d499132d59 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:56.163870 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-920b77af-7cc6-428a-9fa3-e2d499132d59 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:56.164356 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-920b77af-7cc6-428a-9fa3-e2d499132d59 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:56.195071 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-920b77af-7cc6-428a-9fa3-e2d499132d59 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:56.195526 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-920b77af-7cc6-428a-9fa3-e2d499132d59 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:56.195981 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-920b77af-7cc6-428a-9fa3-e2d499132d59 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Lazy-loading 'fault' on Instance uuid e205580f-e3da-4fb7-8854-bb37b6c06e2a {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 09:02:56.239156 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-920b77af-7cc6-428a-9fa3-e2d499132d59 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '367cc3ec46ce414ab5522f582094a83f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed63df6b21f54b559fe29b9f00173038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:02:56.247083 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-920b77af-7cc6-428a-9fa3-e2d499132d59 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] 10.222.0.33 "GET /compute/v2.1/servers/e205580f-e3da-4fb7-8854-bb37b6c06e2a" status: 200 len: 1294 microversion: 2.1 time: 0.096339 Jun 05 09:02:56.247657 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1572/3232] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:02:56 2022] GET /compute/v2.1/servers/e205580f-e3da-4fb7-8854-bb37b6c06e2a => generated 1294 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:02:56.263720 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-43866e00-7fa4-4d84-b277-99cbc4b529c0 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:02:56.264365 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-43866e00-7fa4-4d84-b277-99cbc4b529c0 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] [instance: e205580f-e3da-4fb7-8854-bb37b6c06e2a] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:02:56.271076 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-43866e00-7fa4-4d84-b277-99cbc4b529c0 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:56.271532 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-43866e00-7fa4-4d84-b277-99cbc4b529c0 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:56.272939 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-43866e00-7fa4-4d84-b277-99cbc4b529c0 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:56.273400 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-43866e00-7fa4-4d84-b277-99cbc4b529c0 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:56.297441 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-43866e00-7fa4-4d84-b277-99cbc4b529c0 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] [instance: e205580f-e3da-4fb7-8854-bb37b6c06e2a] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 09:02:56.345260 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-43866e00-7fa4-4d84-b277-99cbc4b529c0 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] [instance: e205580f-e3da-4fb7-8854-bb37b6c06e2a] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 09:02:56.346055 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-43866e00-7fa4-4d84-b277-99cbc4b529c0 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:56.346503 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-43866e00-7fa4-4d84-b277-99cbc4b529c0 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:56.346956 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-43866e00-7fa4-4d84-b277-99cbc4b529c0 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] [instance: e205580f-e3da-4fb7-8854-bb37b6c06e2a] instance's host None is down, deleting from database Jun 05 09:02:56.351629 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-43866e00-7fa4-4d84-b277-99cbc4b529c0 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] [instance: e205580f-e3da-4fb7-8854-bb37b6c06e2a] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 09:02:56.387567 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-43866e00-7fa4-4d84-b277-99cbc4b529c0 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] [instance: e205580f-e3da-4fb7-8854-bb37b6c06e2a] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 09:02:56.393479 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-43866e00-7fa4-4d84-b277-99cbc4b529c0 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] [instance: e205580f-e3da-4fb7-8854-bb37b6c06e2a] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 09:02:56.535416 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-43866e00-7fa4-4d84-b277-99cbc4b529c0 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e205580f-e3da-4fb7-8854-bb37b6c06e2a" status: 204 len: 0 microversion: 2.1 time: 0.275506 Jun 05 09:02:56.536014 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1661/3233] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 09:02:56 2022] DELETE /compute/v2.1/servers/e205580f-e3da-4fb7-8854-bb37b6c06e2a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 09:02:56.544062 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2124fdf7-6627-4156-ba90-150cd518ce67 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:02:56.544677 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2124fdf7-6627-4156-ba90-150cd518ce67 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] [instance: e205580f-e3da-4fb7-8854-bb37b6c06e2a] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:02:56.550683 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2124fdf7-6627-4156-ba90-150cd518ce67 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:56.551152 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2124fdf7-6627-4156-ba90-150cd518ce67 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:56.551903 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2124fdf7-6627-4156-ba90-150cd518ce67 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:56.552368 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2124fdf7-6627-4156-ba90-150cd518ce67 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:56.568277 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-2124fdf7-6627-4156-ba90-150cd518ce67 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] HTTP exception thrown: Instance e205580f-e3da-4fb7-8854-bb37b6c06e2a could not be found. Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2124fdf7-6627-4156-ba90-150cd518ce67 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Request method failure captured: Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/e205580f-e3da-4fb7-8854-bb37b6c06e2a HTTP/1.1 Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinHE9FwQW87qH8sS2vccn6nMKQUDi2kr67Re_Lm2x2rvwh0gSQ2PO3oNU7IiDwRv1kpTmxYZUnJiUyoz-9jiGwubCBLIll0s6RBUZ0afeLh2kZAx9DpxSwR7RYSIUfOmMQXp5L1uzJnMfzHh6fZ34vaL-vuYlsx8pPu-ihgcJf1SxRXs Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: ed63df6b21f54b559fe29b9f00173038 Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2003516707 Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ed63df6b21f54b559fe29b9f00173038"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ed63df6b21f54b559fe29b9f00173038"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ed63df6b21f54b559fe29b9f00173038", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ed63df6b21f54b559fe29b9f00173038"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2003516707 Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: ed63df6b21f54b559fe29b9f00173038 Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2003516707 Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ServersAdminNegativeTestJSON-2003516707-project Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 367cc3ec46ce414ab5522f582094a83f Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2003516707-project Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance e205580f-e3da-4fb7-8854-bb37b6c06e2a could not be found. Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'e205580f-e3da-4fb7-8854-bb37b6c06e2a'} Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e205580f-e3da-4fb7-8854-bb37b6c06e2a could not be found. Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e205580f-e3da-4fb7-8854-bb37b6c06e2a could not be found. Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:02:56.570436 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:02:56.575396 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:02:56.575396 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:02:56.575396 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:02:56.575396 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:02:56.575396 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 09:02:56.575396 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 09:02:56.575396 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e205580f-e3da-4fb7-8854-bb37b6c06e2a could not be found. Jun 05 09:02:56.575396 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:02:56.575396 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2124fdf7-6627-4156-ba90-150cd518ce67 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] Returning 404 to user: Instance e205580f-e3da-4fb7-8854-bb37b6c06e2a could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 09:02:56.575396 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2124fdf7-6627-4156-ba90-150cd518ce67 tempest-ServersAdminNegativeTestJSON-2003516707 tempest-ServersAdminNegativeTestJSON-2003516707-project] 10.222.0.33 "GET /compute/v2.1/servers/e205580f-e3da-4fb7-8854-bb37b6c06e2a" status: 404 len: 111 microversion: 2.1 time: 0.031684 Jun 05 09:02:56.575396 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1573/3234] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:02:56 2022] GET /compute/v2.1/servers/e205580f-e3da-4fb7-8854-bb37b6c06e2a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 09:02:59.383114 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3af132a9-c8bb-4c58-be80-588fa633724e tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-339947698", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "d1b8ba5c-7a85-49d9-a81e-59a91521c4e5"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:02:59.434967 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-3af132a9-c8bb-4c58-be80-588fa633724e tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] validate_networks() for [('d1b8ba5c-7a85-49d9-a81e-59a91521c4e5', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 09:02:59.774370 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-3af132a9-c8bb-4c58-be80-588fa633724e tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 09:02:59.774809 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-3af132a9-c8bb-4c58-be80-588fa633724e tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 09:02:59.775291 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-3af132a9-c8bb-4c58-be80-588fa633724e tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 09:02:59.775707 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-3af132a9-c8bb-4c58-be80-588fa633724e tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 09:02:59.776186 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-3af132a9-c8bb-4c58-be80-588fa633724e tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 09:02:59.785255 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3af132a9-c8bb-4c58-be80-588fa633724e tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:59.785712 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3af132a9-c8bb-4c58-be80-588fa633724e tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:59.786554 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3af132a9-c8bb-4c58-be80-588fa633724e tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:02:59.786999 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3af132a9-c8bb-4c58-be80-588fa633724e tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:02:59.804758 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-3af132a9-c8bb-4c58-be80-588fa633724e tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Getting quotas for project 4c8a9e94f4f143ccbeb9d1708df79345. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:02:59.811905 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-3af132a9-c8bb-4c58-be80-588fa633724e tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Getting quotas for user 7b742d4a480c4c218a293c04c0b687d0 and project 4c8a9e94f4f143ccbeb9d1708df79345. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:02:59.824154 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3af132a9-c8bb-4c58-be80-588fa633724e tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 09:02:59.826269 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3af132a9-c8bb-4c58-be80-588fa633724e tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] [instance: ef2848b6-6072-4f3f-b3f5-f708dab77d5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 09:02:59.873872 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3af132a9-c8bb-4c58-be80-588fa633724e tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612577 Jun 05 09:02:59.874710 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1662/3235] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 09:02:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 09:02:59.885234 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-39f105e9-32ad-408e-a86e-a7dc2f2a148e tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:02:59.886511 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-39f105e9-32ad-408e-a86e-a7dc2f2a148e tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] [instance: ef2848b6-6072-4f3f-b3f5-f708dab77d5e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:02:59.943213 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-39f105e9-32ad-408e-a86e-a7dc2f2a148e tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b742d4a480c4c218a293c04c0b687d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8a9e94f4f143ccbeb9d1708df79345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:02:59.950725 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-39f105e9-32ad-408e-a86e-a7dc2f2a148e tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] 10.222.0.33 "GET /compute/v2.1/servers/ef2848b6-6072-4f3f-b3f5-f708dab77d5e" status: 200 len: 1214 microversion: 2.1 time: 0.069808 Jun 05 09:02:59.951761 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1574/3236] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:02:59 2022] GET /compute/v2.1/servers/ef2848b6-6072-4f3f-b3f5-f708dab77d5e => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:03:00.968619 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-43b008c5-77a0-464f-a8c3-49c4e5934791 tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:03:00.969251 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-43b008c5-77a0-464f-a8c3-49c4e5934791 tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] [instance: ef2848b6-6072-4f3f-b3f5-f708dab77d5e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:03:00.976635 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-43b008c5-77a0-464f-a8c3-49c4e5934791 tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:00.977118 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-43b008c5-77a0-464f-a8c3-49c4e5934791 tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:00.977915 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-43b008c5-77a0-464f-a8c3-49c4e5934791 tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:00.978360 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-43b008c5-77a0-464f-a8c3-49c4e5934791 tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:01.009147 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-43b008c5-77a0-464f-a8c3-49c4e5934791 tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:01.009603 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-43b008c5-77a0-464f-a8c3-49c4e5934791 tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:01.010061 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-43b008c5-77a0-464f-a8c3-49c4e5934791 tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Lazy-loading 'fault' on Instance uuid ef2848b6-6072-4f3f-b3f5-f708dab77d5e {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 09:03:01.054331 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-43b008c5-77a0-464f-a8c3-49c4e5934791 tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b742d4a480c4c218a293c04c0b687d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8a9e94f4f143ccbeb9d1708df79345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:03:01.061817 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-43b008c5-77a0-464f-a8c3-49c4e5934791 tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] 10.222.0.33 "GET /compute/v2.1/servers/ef2848b6-6072-4f3f-b3f5-f708dab77d5e" status: 200 len: 1287 microversion: 2.1 time: 0.097168 Jun 05 09:03:01.062375 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1663/3237] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:03:00 2022] GET /compute/v2.1/servers/ef2848b6-6072-4f3f-b3f5-f708dab77d5e => generated 1287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:03:01.078666 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-78e06d15-f8f5-4d7f-9b55-a25ad0ef082c tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:03:01.079188 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-78e06d15-f8f5-4d7f-9b55-a25ad0ef082c tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] [instance: ef2848b6-6072-4f3f-b3f5-f708dab77d5e] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:03:01.086984 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-78e06d15-f8f5-4d7f-9b55-a25ad0ef082c tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:01.087440 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-78e06d15-f8f5-4d7f-9b55-a25ad0ef082c tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:01.088255 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-78e06d15-f8f5-4d7f-9b55-a25ad0ef082c tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:01.088704 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-78e06d15-f8f5-4d7f-9b55-a25ad0ef082c tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:01.112600 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-78e06d15-f8f5-4d7f-9b55-a25ad0ef082c tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] [instance: ef2848b6-6072-4f3f-b3f5-f708dab77d5e] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 09:03:01.159996 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-78e06d15-f8f5-4d7f-9b55-a25ad0ef082c tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] [instance: ef2848b6-6072-4f3f-b3f5-f708dab77d5e] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 09:03:01.160818 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-78e06d15-f8f5-4d7f-9b55-a25ad0ef082c tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:01.161292 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-78e06d15-f8f5-4d7f-9b55-a25ad0ef082c tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:01.161730 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-78e06d15-f8f5-4d7f-9b55-a25ad0ef082c tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] [instance: ef2848b6-6072-4f3f-b3f5-f708dab77d5e] instance's host None is down, deleting from database Jun 05 09:03:01.166284 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-78e06d15-f8f5-4d7f-9b55-a25ad0ef082c tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] [instance: ef2848b6-6072-4f3f-b3f5-f708dab77d5e] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 09:03:01.200000 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-78e06d15-f8f5-4d7f-9b55-a25ad0ef082c tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] [instance: ef2848b6-6072-4f3f-b3f5-f708dab77d5e] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 09:03:01.205877 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-78e06d15-f8f5-4d7f-9b55-a25ad0ef082c tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] [instance: ef2848b6-6072-4f3f-b3f5-f708dab77d5e] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 09:03:01.348005 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-78e06d15-f8f5-4d7f-9b55-a25ad0ef082c tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ef2848b6-6072-4f3f-b3f5-f708dab77d5e" status: 204 len: 0 microversion: 2.1 time: 0.273130 Jun 05 09:03:01.348616 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1575/3238] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 09:03:01 2022] DELETE /compute/v2.1/servers/ef2848b6-6072-4f3f-b3f5-f708dab77d5e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 09:03:01.357213 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fecf56a1-421b-474e-b686-b060988d29c7 tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:03:01.357834 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-fecf56a1-421b-474e-b686-b060988d29c7 tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] [instance: ef2848b6-6072-4f3f-b3f5-f708dab77d5e] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:03:01.363858 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fecf56a1-421b-474e-b686-b060988d29c7 tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:01.364344 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fecf56a1-421b-474e-b686-b060988d29c7 tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:01.365107 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fecf56a1-421b-474e-b686-b060988d29c7 tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:01.366206 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-fecf56a1-421b-474e-b686-b060988d29c7 tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:01.379231 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-fecf56a1-421b-474e-b686-b060988d29c7 tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] HTTP exception thrown: Instance ef2848b6-6072-4f3f-b3f5-f708dab77d5e could not be found. Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fecf56a1-421b-474e-b686-b060988d29c7 tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Request method failure captured: Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/ef2848b6-6072-4f3f-b3f5-f708dab77d5e HTTP/1.1 Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinHFDbyP6WqWvoF539b3zVHXsG9AZiCUAYYSHaXFZoa29TEedPdy1q-Pf4DYUBdes2Emp5SxKGPaMXcVQVEhUJOd06gXIgrR1g0D1KenVydzdi8VruMixuYjyGVgXkGN0nZBaeztgp5vEjYXblUwBK0EVGgtZPIExQCeTxLYJNi6g-60 Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 4c8a9e94f4f143ccbeb9d1708df79345 Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-DeleteServersTestJSON-857371337 Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4c8a9e94f4f143ccbeb9d1708df79345"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4c8a9e94f4f143ccbeb9d1708df79345"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4c8a9e94f4f143ccbeb9d1708df79345", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4c8a9e94f4f143ccbeb9d1708df79345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-DeleteServersTestJSON-857371337 Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 4c8a9e94f4f143ccbeb9d1708df79345 Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-DeleteServersTestJSON-857371337 Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-DeleteServersTestJSON-857371337-project Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 7b742d4a480c4c218a293c04c0b687d0 Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-DeleteServersTestJSON-857371337-project Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance ef2848b6-6072-4f3f-b3f5-f708dab77d5e could not be found. Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'ef2848b6-6072-4f3f-b3f5-f708dab77d5e'} Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef2848b6-6072-4f3f-b3f5-f708dab77d5e could not be found. Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef2848b6-6072-4f3f-b3f5-f708dab77d5e could not be found. Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:03:01.380805 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:03:01.385160 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:03:01.385160 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:03:01.385160 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:03:01.385160 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 09:03:01.385160 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 09:03:01.385160 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef2848b6-6072-4f3f-b3f5-f708dab77d5e could not be found. Jun 05 09:03:01.385160 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:03:01.385160 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-fecf56a1-421b-474e-b686-b060988d29c7 tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] Returning 404 to user: Instance ef2848b6-6072-4f3f-b3f5-f708dab77d5e could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 09:03:01.385160 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-fecf56a1-421b-474e-b686-b060988d29c7 tempest-DeleteServersTestJSON-857371337 tempest-DeleteServersTestJSON-857371337-project] 10.222.0.33 "GET /compute/v2.1/servers/ef2848b6-6072-4f3f-b3f5-f708dab77d5e" status: 404 len: 111 microversion: 2.1 time: 0.028915 Jun 05 09:03:01.385160 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1664/3239] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:03:01 2022] GET /compute/v2.1/servers/ef2848b6-6072-4f3f-b3f5-f708dab77d5e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 09:03:03.986161 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-e06650da-1b2b-4680-a0a7-0a8974d15411 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-536402680", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "b783e1fb-d463-450b-baf5-b6e18ab4ef19"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:03:04.037195 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-e06650da-1b2b-4680-a0a7-0a8974d15411 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] validate_networks() for [('b783e1fb-d463-450b-baf5-b6e18ab4ef19', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 09:03:04.387474 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-e06650da-1b2b-4680-a0a7-0a8974d15411 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 09:03:04.387896 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-e06650da-1b2b-4680-a0a7-0a8974d15411 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 09:03:04.388398 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-e06650da-1b2b-4680-a0a7-0a8974d15411 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 09:03:04.388808 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-e06650da-1b2b-4680-a0a7-0a8974d15411 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 09:03:04.389246 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-e06650da-1b2b-4680-a0a7-0a8974d15411 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 09:03:04.397858 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e06650da-1b2b-4680-a0a7-0a8974d15411 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:04.398301 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e06650da-1b2b-4680-a0a7-0a8974d15411 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:04.399089 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e06650da-1b2b-4680-a0a7-0a8974d15411 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:04.399550 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-e06650da-1b2b-4680-a0a7-0a8974d15411 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:04.416217 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-e06650da-1b2b-4680-a0a7-0a8974d15411 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Getting quotas for project c47e0df6033a426d9bcc3b2bf937c395. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:03:04.421064 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-e06650da-1b2b-4680-a0a7-0a8974d15411 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Getting quotas for user 5df0fff606ea4c22995cf947a53231f1 and project c47e0df6033a426d9bcc3b2bf937c395. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:03:04.433419 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e06650da-1b2b-4680-a0a7-0a8974d15411 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 09:03:04.435492 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-e06650da-1b2b-4680-a0a7-0a8974d15411 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] [instance: 9e4d25f0-c42d-45b8-8cf8-b6afc5fc0d2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 09:03:04.485365 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-e06650da-1b2b-4680-a0a7-0a8974d15411 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.624290 Jun 05 09:03:04.492214 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1576/3240] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 09:03:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 09:03:04.497537 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-07bdf270-5425-4692-bc9e-986fa99f3658 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:03:04.498242 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-07bdf270-5425-4692-bc9e-986fa99f3658 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] [instance: 9e4d25f0-c42d-45b8-8cf8-b6afc5fc0d2c] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:03:04.552895 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-07bdf270-5425-4692-bc9e-986fa99f3658 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df0fff606ea4c22995cf947a53231f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e0df6033a426d9bcc3b2bf937c395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:03:04.560556 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-07bdf270-5425-4692-bc9e-986fa99f3658 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] 10.222.0.33 "GET /compute/v2.1/servers/9e4d25f0-c42d-45b8-8cf8-b6afc5fc0d2c" status: 200 len: 1217 microversion: 2.1 time: 0.066750 Jun 05 09:03:04.562264 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1665/3241] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:03:04 2022] GET /compute/v2.1/servers/9e4d25f0-c42d-45b8-8cf8-b6afc5fc0d2c => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:03:05.580149 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-f720525c-0716-474d-aef6-92f627b5a458 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:03:05.580771 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-f720525c-0716-474d-aef6-92f627b5a458 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] [instance: 9e4d25f0-c42d-45b8-8cf8-b6afc5fc0d2c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:03:05.588176 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f720525c-0716-474d-aef6-92f627b5a458 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:05.588633 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f720525c-0716-474d-aef6-92f627b5a458 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:05.589398 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f720525c-0716-474d-aef6-92f627b5a458 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:05.589839 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f720525c-0716-474d-aef6-92f627b5a458 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:05.619835 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f720525c-0716-474d-aef6-92f627b5a458 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:05.620316 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-f720525c-0716-474d-aef6-92f627b5a458 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:05.620767 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-f720525c-0716-474d-aef6-92f627b5a458 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lazy-loading 'fault' on Instance uuid 9e4d25f0-c42d-45b8-8cf8-b6afc5fc0d2c {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 09:03:05.660580 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-f720525c-0716-474d-aef6-92f627b5a458 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df0fff606ea4c22995cf947a53231f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e0df6033a426d9bcc3b2bf937c395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:03:05.668618 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-f720525c-0716-474d-aef6-92f627b5a458 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] 10.222.0.33 "GET /compute/v2.1/servers/9e4d25f0-c42d-45b8-8cf8-b6afc5fc0d2c" status: 200 len: 1290 microversion: 2.1 time: 0.093405 Jun 05 09:03:05.669180 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1577/3242] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:03:05 2022] GET /compute/v2.1/servers/9e4d25f0-c42d-45b8-8cf8-b6afc5fc0d2c => generated 1290 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:03:05.685224 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6a073fa0-26a9-47ba-a063-9940ce031101 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:03:05.685722 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6a073fa0-26a9-47ba-a063-9940ce031101 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] [instance: 9e4d25f0-c42d-45b8-8cf8-b6afc5fc0d2c] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:03:05.692397 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6a073fa0-26a9-47ba-a063-9940ce031101 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:05.692849 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6a073fa0-26a9-47ba-a063-9940ce031101 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:05.693658 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6a073fa0-26a9-47ba-a063-9940ce031101 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:05.694212 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6a073fa0-26a9-47ba-a063-9940ce031101 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:05.718242 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6a073fa0-26a9-47ba-a063-9940ce031101 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] [instance: 9e4d25f0-c42d-45b8-8cf8-b6afc5fc0d2c] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 09:03:05.764812 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6a073fa0-26a9-47ba-a063-9940ce031101 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] [instance: 9e4d25f0-c42d-45b8-8cf8-b6afc5fc0d2c] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 09:03:05.765608 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6a073fa0-26a9-47ba-a063-9940ce031101 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:05.766056 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6a073fa0-26a9-47ba-a063-9940ce031101 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:05.766491 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-6a073fa0-26a9-47ba-a063-9940ce031101 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] [instance: 9e4d25f0-c42d-45b8-8cf8-b6afc5fc0d2c] instance's host None is down, deleting from database Jun 05 09:03:05.769950 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-6a073fa0-26a9-47ba-a063-9940ce031101 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] [instance: 9e4d25f0-c42d-45b8-8cf8-b6afc5fc0d2c] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 09:03:05.803974 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-6a073fa0-26a9-47ba-a063-9940ce031101 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] [instance: 9e4d25f0-c42d-45b8-8cf8-b6afc5fc0d2c] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 09:03:05.810255 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-6a073fa0-26a9-47ba-a063-9940ce031101 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] [instance: 9e4d25f0-c42d-45b8-8cf8-b6afc5fc0d2c] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 09:03:05.959225 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6a073fa0-26a9-47ba-a063-9940ce031101 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9e4d25f0-c42d-45b8-8cf8-b6afc5fc0d2c" status: 204 len: 0 microversion: 2.1 time: 0.277875 Jun 05 09:03:05.959861 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1666/3243] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 09:03:05 2022] DELETE /compute/v2.1/servers/9e4d25f0-c42d-45b8-8cf8-b6afc5fc0d2c => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 09:03:05.968241 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-34b85585-bda8-4ebf-897e-178c60b6a252 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:03:05.968974 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-34b85585-bda8-4ebf-897e-178c60b6a252 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] [instance: 9e4d25f0-c42d-45b8-8cf8-b6afc5fc0d2c] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:03:05.976260 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-34b85585-bda8-4ebf-897e-178c60b6a252 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:05.976721 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-34b85585-bda8-4ebf-897e-178c60b6a252 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:05.977493 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-34b85585-bda8-4ebf-897e-178c60b6a252 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:05.977939 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-34b85585-bda8-4ebf-897e-178c60b6a252 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:05.991905 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-34b85585-bda8-4ebf-897e-178c60b6a252 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] HTTP exception thrown: Instance 9e4d25f0-c42d-45b8-8cf8-b6afc5fc0d2c could not be found. Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-34b85585-bda8-4ebf-897e-178c60b6a252 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Request method failure captured: Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/9e4d25f0-c42d-45b8-8cf8-b6afc5fc0d2c HTTP/1.1 Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinHFH_hZZfoqdAtXhavEbtSZDpCdEBsdsOgLFyfskrTbfn1yv_0PvRva-_smCXkKhU6ki9qb9-PgbnbjwyN3LrTtQt_fQzNYkDPUcg9Jb6Ppk97hcD95qtR7OwRlGFLl_qXkHWb251cehCjJKZeI1VuMch00NmH-dGszOfYu9yJipVq0 Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: c47e0df6033a426d9bcc3b2bf937c395 Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-ServerDiskConfigTestJSON-894297614 Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c47e0df6033a426d9bcc3b2bf937c395"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c47e0df6033a426d9bcc3b2bf937c395"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c47e0df6033a426d9bcc3b2bf937c395", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c47e0df6033a426d9bcc3b2bf937c395"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-ServerDiskConfigTestJSON-894297614 Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: c47e0df6033a426d9bcc3b2bf937c395 Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-894297614 Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-ServerDiskConfigTestJSON-894297614-project Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 5df0fff606ea4c22995cf947a53231f1 Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-ServerDiskConfigTestJSON-894297614-project Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 9e4d25f0-c42d-45b8-8cf8-b6afc5fc0d2c could not be found. Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '9e4d25f0-c42d-45b8-8cf8-b6afc5fc0d2c'} Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e4d25f0-c42d-45b8-8cf8-b6afc5fc0d2c could not be found. Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e4d25f0-c42d-45b8-8cf8-b6afc5fc0d2c could not be found. Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:03:05.993464 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:03:05.997847 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:03:05.997847 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:03:05.997847 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:03:05.997847 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 09:03:05.997847 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 09:03:05.997847 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e4d25f0-c42d-45b8-8cf8-b6afc5fc0d2c could not be found. Jun 05 09:03:05.997847 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:03:05.997847 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-34b85585-bda8-4ebf-897e-178c60b6a252 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Returning 404 to user: Instance 9e4d25f0-c42d-45b8-8cf8-b6afc5fc0d2c could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 09:03:05.997847 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-34b85585-bda8-4ebf-897e-178c60b6a252 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] 10.222.0.33 "GET /compute/v2.1/servers/9e4d25f0-c42d-45b8-8cf8-b6afc5fc0d2c" status: 404 len: 111 microversion: 2.1 time: 0.030536 Jun 05 09:03:05.997847 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1578/3244] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:03:05 2022] GET /compute/v2.1/servers/9e4d25f0-c42d-45b8-8cf8-b6afc5fc0d2c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 09:03:06.045908 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-77965dc6-f11e-4f63-8c4a-3db169a14287 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1227703134", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "b783e1fb-d463-450b-baf5-b6e18ab4ef19"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:03:06.097237 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-77965dc6-f11e-4f63-8c4a-3db169a14287 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] validate_networks() for [('b783e1fb-d463-450b-baf5-b6e18ab4ef19', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 09:03:06.732756 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-77965dc6-f11e-4f63-8c4a-3db169a14287 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 09:03:06.733273 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-77965dc6-f11e-4f63-8c4a-3db169a14287 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 09:03:06.733653 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-77965dc6-f11e-4f63-8c4a-3db169a14287 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 09:03:06.734067 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-77965dc6-f11e-4f63-8c4a-3db169a14287 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 09:03:06.734484 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-77965dc6-f11e-4f63-8c4a-3db169a14287 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 09:03:06.743808 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-77965dc6-f11e-4f63-8c4a-3db169a14287 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:06.744293 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-77965dc6-f11e-4f63-8c4a-3db169a14287 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:06.745093 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-77965dc6-f11e-4f63-8c4a-3db169a14287 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:06.745532 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-77965dc6-f11e-4f63-8c4a-3db169a14287 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:06.751971 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=62,nova_cell0:UPDATE=30,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=4 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:03:06.764701 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-77965dc6-f11e-4f63-8c4a-3db169a14287 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Getting quotas for project c47e0df6033a426d9bcc3b2bf937c395. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:03:06.770299 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-77965dc6-f11e-4f63-8c4a-3db169a14287 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Getting quotas for user 5df0fff606ea4c22995cf947a53231f1 and project c47e0df6033a426d9bcc3b2bf937c395. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:03:06.783771 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-77965dc6-f11e-4f63-8c4a-3db169a14287 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 09:03:06.785950 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-77965dc6-f11e-4f63-8c4a-3db169a14287 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] [instance: 883565f9-f67c-4b4e-a4b8-7e9bc80b64f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 09:03:06.829341 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-77965dc6-f11e-4f63-8c4a-3db169a14287 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.787277 Jun 05 09:03:06.830133 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1667/3245] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 09:03:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 09:03:06.843735 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2048c1c4-991c-412d-a79d-3ffab0aac34d tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:03:06.845014 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2048c1c4-991c-412d-a79d-3ffab0aac34d tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] [instance: 883565f9-f67c-4b4e-a4b8-7e9bc80b64f3] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:03:06.904155 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-2048c1c4-991c-412d-a79d-3ffab0aac34d tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df0fff606ea4c22995cf947a53231f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e0df6033a426d9bcc3b2bf937c395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:03:06.911820 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2048c1c4-991c-412d-a79d-3ffab0aac34d tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] 10.222.0.33 "GET /compute/v2.1/servers/883565f9-f67c-4b4e-a4b8-7e9bc80b64f3" status: 200 len: 1218 microversion: 2.1 time: 0.072033 Jun 05 09:03:06.912457 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1579/3246] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:03:06 2022] GET /compute/v2.1/servers/883565f9-f67c-4b4e-a4b8-7e9bc80b64f3 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:03:07.929952 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-6b5c13a4-28e6-48e0-8a6e-b2d9261641ee tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:03:07.930628 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-6b5c13a4-28e6-48e0-8a6e-b2d9261641ee tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] [instance: 883565f9-f67c-4b4e-a4b8-7e9bc80b64f3] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:03:07.937480 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6b5c13a4-28e6-48e0-8a6e-b2d9261641ee tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:07.937925 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6b5c13a4-28e6-48e0-8a6e-b2d9261641ee tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:07.938735 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6b5c13a4-28e6-48e0-8a6e-b2d9261641ee tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:07.939112 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6b5c13a4-28e6-48e0-8a6e-b2d9261641ee tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:07.968856 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6b5c13a4-28e6-48e0-8a6e-b2d9261641ee tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:07.969298 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-6b5c13a4-28e6-48e0-8a6e-b2d9261641ee tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:07.969745 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-6b5c13a4-28e6-48e0-8a6e-b2d9261641ee tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lazy-loading 'fault' on Instance uuid 883565f9-f67c-4b4e-a4b8-7e9bc80b64f3 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 09:03:08.009556 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-6b5c13a4-28e6-48e0-8a6e-b2d9261641ee tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5df0fff606ea4c22995cf947a53231f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47e0df6033a426d9bcc3b2bf937c395', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:03:08.016862 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-6b5c13a4-28e6-48e0-8a6e-b2d9261641ee tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] 10.222.0.33 "GET /compute/v2.1/servers/883565f9-f67c-4b4e-a4b8-7e9bc80b64f3" status: 200 len: 1291 microversion: 2.1 time: 0.091791 Jun 05 09:03:08.017424 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1668/3247] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:03:07 2022] GET /compute/v2.1/servers/883565f9-f67c-4b4e-a4b8-7e9bc80b64f3 => generated 1291 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:03:08.034569 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a97ca88b-5c33-49a6-ae51-947237a3f9f4 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:03:08.035077 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a97ca88b-5c33-49a6-ae51-947237a3f9f4 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] [instance: 883565f9-f67c-4b4e-a4b8-7e9bc80b64f3] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:03:08.042284 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a97ca88b-5c33-49a6-ae51-947237a3f9f4 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:08.042741 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a97ca88b-5c33-49a6-ae51-947237a3f9f4 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:08.043511 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a97ca88b-5c33-49a6-ae51-947237a3f9f4 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:08.043959 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a97ca88b-5c33-49a6-ae51-947237a3f9f4 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:08.070289 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a97ca88b-5c33-49a6-ae51-947237a3f9f4 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] [instance: 883565f9-f67c-4b4e-a4b8-7e9bc80b64f3] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 09:03:08.115755 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a97ca88b-5c33-49a6-ae51-947237a3f9f4 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] [instance: 883565f9-f67c-4b4e-a4b8-7e9bc80b64f3] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 09:03:08.116563 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a97ca88b-5c33-49a6-ae51-947237a3f9f4 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:08.117012 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-a97ca88b-5c33-49a6-ae51-947237a3f9f4 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:08.117454 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-a97ca88b-5c33-49a6-ae51-947237a3f9f4 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] [instance: 883565f9-f67c-4b4e-a4b8-7e9bc80b64f3] instance's host None is down, deleting from database Jun 05 09:03:08.120911 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-a97ca88b-5c33-49a6-ae51-947237a3f9f4 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] [instance: 883565f9-f67c-4b4e-a4b8-7e9bc80b64f3] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 09:03:08.154855 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-a97ca88b-5c33-49a6-ae51-947237a3f9f4 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] [instance: 883565f9-f67c-4b4e-a4b8-7e9bc80b64f3] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 09:03:08.162141 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-a97ca88b-5c33-49a6-ae51-947237a3f9f4 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] [instance: 883565f9-f67c-4b4e-a4b8-7e9bc80b64f3] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 09:03:08.276976 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=72,nova_cell0:UPDATE=22,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2,nova_cell0:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:03:08.309722 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a97ca88b-5c33-49a6-ae51-947237a3f9f4 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] 10.222.0.33 "DELETE /compute/v2.1/servers/883565f9-f67c-4b4e-a4b8-7e9bc80b64f3" status: 204 len: 0 microversion: 2.1 time: 0.278997 Jun 05 09:03:08.310304 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1580/3248] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 09:03:08 2022] DELETE /compute/v2.1/servers/883565f9-f67c-4b4e-a4b8-7e9bc80b64f3 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 09:03:08.319073 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b6af1cb3-6bb4-4d4f-ada7-149ac3e0cde7 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:03:08.319802 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b6af1cb3-6bb4-4d4f-ada7-149ac3e0cde7 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] [instance: 883565f9-f67c-4b4e-a4b8-7e9bc80b64f3] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:03:08.325841 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b6af1cb3-6bb4-4d4f-ada7-149ac3e0cde7 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:08.326297 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b6af1cb3-6bb4-4d4f-ada7-149ac3e0cde7 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:08.327057 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b6af1cb3-6bb4-4d4f-ada7-149ac3e0cde7 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:08.327494 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b6af1cb3-6bb4-4d4f-ada7-149ac3e0cde7 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:08.340854 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-b6af1cb3-6bb4-4d4f-ada7-149ac3e0cde7 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] HTTP exception thrown: Instance 883565f9-f67c-4b4e-a4b8-7e9bc80b64f3 could not be found. Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b6af1cb3-6bb4-4d4f-ada7-149ac3e0cde7 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Request method failure captured: Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/883565f9-f67c-4b4e-a4b8-7e9bc80b64f3 HTTP/1.1 Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinHFH_hZZfoqdAtXhavEbtSZDpCdEBsdsOgLFyfskrTbfn1yv_0PvRva-_smCXkKhU6ki9qb9-PgbnbjwyN3LrTtQt_fQzNYkDPUcg9Jb6Ppk97hcD95qtR7OwRlGFLl_qXkHWb251cehCjJKZeI1VuMch00NmH-dGszOfYu9yJipVq0 Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: c47e0df6033a426d9bcc3b2bf937c395 Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ServerDiskConfigTestJSON-894297614 Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c47e0df6033a426d9bcc3b2bf937c395"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c47e0df6033a426d9bcc3b2bf937c395"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c47e0df6033a426d9bcc3b2bf937c395", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c47e0df6033a426d9bcc3b2bf937c395"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ServerDiskConfigTestJSON-894297614 Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: c47e0df6033a426d9bcc3b2bf937c395 Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-894297614 Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ServerDiskConfigTestJSON-894297614-project Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 5df0fff606ea4c22995cf947a53231f1 Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ServerDiskConfigTestJSON-894297614-project Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 883565f9-f67c-4b4e-a4b8-7e9bc80b64f3 could not be found. Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '883565f9-f67c-4b4e-a4b8-7e9bc80b64f3'} Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 883565f9-f67c-4b4e-a4b8-7e9bc80b64f3 could not be found. Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 883565f9-f67c-4b4e-a4b8-7e9bc80b64f3 could not be found. Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:03:08.342383 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:03:08.352275 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:03:08.352275 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:03:08.352275 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:03:08.352275 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 09:03:08.352275 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 09:03:08.352275 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 883565f9-f67c-4b4e-a4b8-7e9bc80b64f3 could not be found. Jun 05 09:03:08.352275 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:03:08.352275 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b6af1cb3-6bb4-4d4f-ada7-149ac3e0cde7 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] Returning 404 to user: Instance 883565f9-f67c-4b4e-a4b8-7e9bc80b64f3 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 09:03:08.352275 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b6af1cb3-6bb4-4d4f-ada7-149ac3e0cde7 tempest-ServerDiskConfigTestJSON-894297614 tempest-ServerDiskConfigTestJSON-894297614-project] 10.222.0.33 "GET /compute/v2.1/servers/883565f9-f67c-4b4e-a4b8-7e9bc80b64f3" status: 404 len: 111 microversion: 2.1 time: 0.029244 Jun 05 09:03:08.352275 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1669/3249] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:03:08 2022] GET /compute/v2.1/servers/883565f9-f67c-4b4e-a4b8-7e9bc80b64f3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 09:03:14.006982 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-10a2924b-079d-4df9-80e3-244b2643c3bb tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Action: 'create', calling method: .version_select at 0x7f24337ed160>, body: {"keypair": {"name": "tempest-keypair-544944561", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFK82D6pmOC+3Ur8BHtYSARxlZptVMldcSVMQFXWVFEot9vAHCsCNVWKbyDhEDXEcbrq8ZLmxwcaJTOZWe3o/f2QbUsjUKKWd1TrVLQjWe5eamZMJj4DR4/C0jptfXze1g=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:03:14.023963 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-10a2924b-079d-4df9-80e3-244b2643c3bb tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Getting quotas for project af261ac59cd54721ab38adfbe10c83f2. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:03:14.029601 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-10a2924b-079d-4df9-80e3-244b2643c3bb tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Getting quotas for user 1b66a79e4a054714a4f22a708c7722a0 and project af261ac59cd54721ab38adfbe10c83f2. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:03:14.054298 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-10a2924b-079d-4df9-80e3-244b2643c3bb tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.167789 Jun 05 09:03:14.054907 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1581/3250] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 09:03:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 09:03:15.474129 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5d94315f-f89c-4156-9fb0-7a853cd845d2 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-682836443", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "140eee80-bb89-4c18-ba31-fca65c06677d"}], "security_groups": [{"name": "tempest-securitygroup--1033570156"}], "key_name": "tempest-keypair-544944561", "user_data": "}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:03:15.574905 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-5d94315f-f89c-4156-9fb0-7a853cd845d2 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] validate_networks() for [('140eee80-bb89-4c18-ba31-fca65c06677d', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 09:03:15.952336 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-5d94315f-f89c-4156-9fb0-7a853cd845d2 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 09:03:15.952863 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-5d94315f-f89c-4156-9fb0-7a853cd845d2 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 09:03:15.953233 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-5d94315f-f89c-4156-9fb0-7a853cd845d2 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 09:03:15.953647 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-5d94315f-f89c-4156-9fb0-7a853cd845d2 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 09:03:15.954060 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-5d94315f-f89c-4156-9fb0-7a853cd845d2 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 09:03:15.963128 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5d94315f-f89c-4156-9fb0-7a853cd845d2 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:15.963583 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5d94315f-f89c-4156-9fb0-7a853cd845d2 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:15.964424 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5d94315f-f89c-4156-9fb0-7a853cd845d2 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:15.964869 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5d94315f-f89c-4156-9fb0-7a853cd845d2 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:15.981228 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-5d94315f-f89c-4156-9fb0-7a853cd845d2 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Getting quotas for project af261ac59cd54721ab38adfbe10c83f2. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:03:15.986472 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-5d94315f-f89c-4156-9fb0-7a853cd845d2 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Getting quotas for user 1b66a79e4a054714a4f22a708c7722a0 and project af261ac59cd54721ab38adfbe10c83f2. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:03:15.999196 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5d94315f-f89c-4156-9fb0-7a853cd845d2 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 09:03:16.001456 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5d94315f-f89c-4156-9fb0-7a853cd845d2 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] [instance: f7708671-b54a-4b0c-a0fd-f74c9534fbf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 09:03:16.049278 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5d94315f-f89c-4156-9fb0-7a853cd845d2 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.579561 Jun 05 09:03:16.049928 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1670/3251] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 09:03:15 2022] POST /compute/v2.1/servers => generated 409 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 09:03:16.057386 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=4 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:03:16.063064 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-30f13be1-fa7b-4684-bd11-fdd8f37d7d13 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:03:16.064337 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-30f13be1-fa7b-4684-bd11-fdd8f37d7d13 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] [instance: f7708671-b54a-4b0c-a0fd-f74c9534fbf8] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:03:16.428859 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-30f13be1-fa7b-4684-bd11-fdd8f37d7d13 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b66a79e4a054714a4f22a708c7722a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af261ac59cd54721ab38adfbe10c83f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:03:16.436424 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-30f13be1-fa7b-4684-bd11-fdd8f37d7d13 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] 10.222.0.33 "GET /compute/v2.1/servers/f7708671-b54a-4b0c-a0fd-f74c9534fbf8" status: 200 len: 1237 microversion: 2.1 time: 0.379672 Jun 05 09:03:16.437011 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1582/3252] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:03:16 2022] GET /compute/v2.1/servers/f7708671-b54a-4b0c-a0fd-f74c9534fbf8 => generated 1237 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:03:17.453435 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1ee3a663-9a65-414e-bc0f-b5d14571242e tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:03:17.454368 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1ee3a663-9a65-414e-bc0f-b5d14571242e tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] [instance: f7708671-b54a-4b0c-a0fd-f74c9534fbf8] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:03:17.461554 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1ee3a663-9a65-414e-bc0f-b5d14571242e tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:17.462088 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1ee3a663-9a65-414e-bc0f-b5d14571242e tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:17.462939 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1ee3a663-9a65-414e-bc0f-b5d14571242e tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:17.463385 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1ee3a663-9a65-414e-bc0f-b5d14571242e tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:17.494789 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1ee3a663-9a65-414e-bc0f-b5d14571242e tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:17.495248 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-1ee3a663-9a65-414e-bc0f-b5d14571242e tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:17.495716 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-1ee3a663-9a65-414e-bc0f-b5d14571242e tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Lazy-loading 'fault' on Instance uuid f7708671-b54a-4b0c-a0fd-f74c9534fbf8 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 09:03:17.538347 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1ee3a663-9a65-414e-bc0f-b5d14571242e tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b66a79e4a054714a4f22a708c7722a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af261ac59cd54721ab38adfbe10c83f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:03:17.546298 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1ee3a663-9a65-414e-bc0f-b5d14571242e tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] 10.222.0.33 "GET /compute/v2.1/servers/f7708671-b54a-4b0c-a0fd-f74c9534fbf8" status: 200 len: 1310 microversion: 2.1 time: 0.096843 Jun 05 09:03:17.546895 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1671/3253] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:03:17 2022] GET /compute/v2.1/servers/f7708671-b54a-4b0c-a0fd-f74c9534fbf8 => generated 1310 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:03:17.565243 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c19ad4b4-ab63-4705-b000-d48e090cb41f tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:03:17.565783 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c19ad4b4-ab63-4705-b000-d48e090cb41f tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] [instance: f7708671-b54a-4b0c-a0fd-f74c9534fbf8] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:03:17.574925 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c19ad4b4-ab63-4705-b000-d48e090cb41f tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:17.575382 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c19ad4b4-ab63-4705-b000-d48e090cb41f tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:17.576228 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c19ad4b4-ab63-4705-b000-d48e090cb41f tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:17.576674 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c19ad4b4-ab63-4705-b000-d48e090cb41f tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:17.602616 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c19ad4b4-ab63-4705-b000-d48e090cb41f tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] [instance: f7708671-b54a-4b0c-a0fd-f74c9534fbf8] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 09:03:17.653360 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c19ad4b4-ab63-4705-b000-d48e090cb41f tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] [instance: f7708671-b54a-4b0c-a0fd-f74c9534fbf8] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 09:03:17.654236 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c19ad4b4-ab63-4705-b000-d48e090cb41f tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:17.654703 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c19ad4b4-ab63-4705-b000-d48e090cb41f tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:17.655150 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-c19ad4b4-ab63-4705-b000-d48e090cb41f tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] [instance: f7708671-b54a-4b0c-a0fd-f74c9534fbf8] instance's host None is down, deleting from database Jun 05 09:03:17.658732 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-c19ad4b4-ab63-4705-b000-d48e090cb41f tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] [instance: f7708671-b54a-4b0c-a0fd-f74c9534fbf8] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 09:03:17.694392 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-c19ad4b4-ab63-4705-b000-d48e090cb41f tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] [instance: f7708671-b54a-4b0c-a0fd-f74c9534fbf8] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 09:03:17.700795 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-c19ad4b4-ab63-4705-b000-d48e090cb41f tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] [instance: f7708671-b54a-4b0c-a0fd-f74c9534fbf8] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 09:03:17.854604 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c19ad4b4-ab63-4705-b000-d48e090cb41f tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f7708671-b54a-4b0c-a0fd-f74c9534fbf8" status: 204 len: 0 microversion: 2.1 time: 0.293229 Jun 05 09:03:17.855206 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1583/3254] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 09:03:17 2022] DELETE /compute/v2.1/servers/f7708671-b54a-4b0c-a0fd-f74c9534fbf8 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 09:03:17.863274 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8c7bea03-5165-496d-a3a3-710b0f823219 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:03:17.863896 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-8c7bea03-5165-496d-a3a3-710b0f823219 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] [instance: f7708671-b54a-4b0c-a0fd-f74c9534fbf8] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:03:17.870657 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8c7bea03-5165-496d-a3a3-710b0f823219 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:17.871114 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8c7bea03-5165-496d-a3a3-710b0f823219 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:17.871893 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8c7bea03-5165-496d-a3a3-710b0f823219 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:17.872417 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-8c7bea03-5165-496d-a3a3-710b0f823219 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:17.886744 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-8c7bea03-5165-496d-a3a3-710b0f823219 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] HTTP exception thrown: Instance f7708671-b54a-4b0c-a0fd-f74c9534fbf8 could not be found. Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8c7bea03-5165-496d-a3a3-710b0f823219 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Request method failure captured: Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/f7708671-b54a-4b0c-a0fd-f74c9534fbf8 HTTP/1.1 Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinHFR07z0EWZ8BmalUooKMm76F_COLBQpKyOdUiPenJ2Mwbtx0ao9IYxGtYajXim6L3va_HxZVDL2viThhiZasnznLEqYje_pboutIdyxFzjH4kxqZv_9JFTNhQ8XT2JT0bT4QWNA-yjs6ST0UXiAnCXEgPjs0S7oFDlUl5OlWuL3MUI Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: af261ac59cd54721ab38adfbe10c83f2 Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ServerActionsTestJSON-1353162354 Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/af261ac59cd54721ab38adfbe10c83f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/af261ac59cd54721ab38adfbe10c83f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_af261ac59cd54721ab38adfbe10c83f2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/af261ac59cd54721ab38adfbe10c83f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ServerActionsTestJSON-1353162354 Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: af261ac59cd54721ab38adfbe10c83f2 Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ServerActionsTestJSON-1353162354 Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ServerActionsTestJSON-1353162354-project Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 1b66a79e4a054714a4f22a708c7722a0 Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ServerActionsTestJSON-1353162354-project Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance f7708671-b54a-4b0c-a0fd-f74c9534fbf8 could not be found. Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'f7708671-b54a-4b0c-a0fd-f74c9534fbf8'} Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7708671-b54a-4b0c-a0fd-f74c9534fbf8 could not be found. Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7708671-b54a-4b0c-a0fd-f74c9534fbf8 could not be found. Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:03:17.888337 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:03:17.894089 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:03:17.894089 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:03:17.894089 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:03:17.894089 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 09:03:17.894089 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 09:03:17.894089 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7708671-b54a-4b0c-a0fd-f74c9534fbf8 could not be found. Jun 05 09:03:17.894089 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:03:17.894089 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-8c7bea03-5165-496d-a3a3-710b0f823219 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Returning 404 to user: Instance f7708671-b54a-4b0c-a0fd-f74c9534fbf8 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 09:03:17.894089 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-8c7bea03-5165-496d-a3a3-710b0f823219 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] 10.222.0.33 "GET /compute/v2.1/servers/f7708671-b54a-4b0c-a0fd-f74c9534fbf8" status: 404 len: 111 microversion: 2.1 time: 0.030394 Jun 05 09:03:17.894089 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1672/3255] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:03:17 2022] GET /compute/v2.1/servers/f7708671-b54a-4b0c-a0fd-f74c9534fbf8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 09:03:17.899540 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bc637954-0f6f-47c8-a0b6-af03a33bc2f8 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] Calling method '.version_select at 0x7f2432e46f70>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:03:17.906480 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:UPDATE=3 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:03:17.921170 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bc637954-0f6f-47c8-a0b6-af03a33bc2f8 tempest-ServerActionsTestJSON-1353162354 tempest-ServerActionsTestJSON-1353162354-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-544944561" status: 202 len: 0 microversion: 2.1 time: 0.025683 Jun 05 09:03:17.921958 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1584/3256] 10.222.0.33 () {58 vars in 1217 bytes} [Sun Jun 5 09:03:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-544944561 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 05 09:03:23.751848 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3469c029-5ab7-4a3f-9a69-68eac7fe4f92 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-944296774", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "186540c0-2894-4a00-b189-9358ed5d1619"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:03:23.805009 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-3469c029-5ab7-4a3f-9a69-68eac7fe4f92 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] validate_networks() for [('186540c0-2894-4a00-b189-9358ed5d1619', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 09:03:24.154390 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-3469c029-5ab7-4a3f-9a69-68eac7fe4f92 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 09:03:24.154854 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-3469c029-5ab7-4a3f-9a69-68eac7fe4f92 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 09:03:24.155344 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-3469c029-5ab7-4a3f-9a69-68eac7fe4f92 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 09:03:24.155765 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-3469c029-5ab7-4a3f-9a69-68eac7fe4f92 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 09:03:24.156219 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-3469c029-5ab7-4a3f-9a69-68eac7fe4f92 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 09:03:24.159193 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=9 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:03:24.166906 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3469c029-5ab7-4a3f-9a69-68eac7fe4f92 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:24.167359 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3469c029-5ab7-4a3f-9a69-68eac7fe4f92 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:24.168198 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3469c029-5ab7-4a3f-9a69-68eac7fe4f92 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:24.168645 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-3469c029-5ab7-4a3f-9a69-68eac7fe4f92 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:24.187075 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-3469c029-5ab7-4a3f-9a69-68eac7fe4f92 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Getting quotas for project 3ebe19003884454eac65f2539327afcc. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:03:24.193055 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-3469c029-5ab7-4a3f-9a69-68eac7fe4f92 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Getting quotas for user 9de0fa32fc3f4864991b5d1108fabf24 and project 3ebe19003884454eac65f2539327afcc. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:03:24.205547 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3469c029-5ab7-4a3f-9a69-68eac7fe4f92 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 09:03:24.207681 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-3469c029-5ab7-4a3f-9a69-68eac7fe4f92 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] [instance: 95ba0f7b-8bac-4a46-ab2f-49c56a9853ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 09:03:24.253465 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3469c029-5ab7-4a3f-9a69-68eac7fe4f92 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.624969 Jun 05 09:03:24.254260 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1673/3257] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 09:03:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 09:03:24.264714 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-680ee5c2-ee45-4be9-a9fc-68077d982482 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:03:24.265345 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-680ee5c2-ee45-4be9-a9fc-68077d982482 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] [instance: 95ba0f7b-8bac-4a46-ab2f-49c56a9853ec] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:03:24.322589 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-680ee5c2-ee45-4be9-a9fc-68077d982482 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de0fa32fc3f4864991b5d1108fabf24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebe19003884454eac65f2539327afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:03:24.329615 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-680ee5c2-ee45-4be9-a9fc-68077d982482 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] 10.222.0.33 "GET /compute/v2.1/servers/95ba0f7b-8bac-4a46-ab2f-49c56a9853ec" status: 200 len: 1216 microversion: 2.1 time: 0.069149 Jun 05 09:03:24.330343 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1585/3258] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:03:24 2022] GET /compute/v2.1/servers/95ba0f7b-8bac-4a46-ab2f-49c56a9853ec => generated 1216 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 05 09:03:25.347573 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b989baa5-9e36-494d-889c-beb27f310d1f tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:03:25.348232 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b989baa5-9e36-494d-889c-beb27f310d1f tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] [instance: 95ba0f7b-8bac-4a46-ab2f-49c56a9853ec] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:03:25.355771 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b989baa5-9e36-494d-889c-beb27f310d1f tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:25.356233 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b989baa5-9e36-494d-889c-beb27f310d1f tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:25.357010 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b989baa5-9e36-494d-889c-beb27f310d1f tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:25.357457 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b989baa5-9e36-494d-889c-beb27f310d1f tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:25.388591 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b989baa5-9e36-494d-889c-beb27f310d1f tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:25.389043 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b989baa5-9e36-494d-889c-beb27f310d1f tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:25.389499 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-b989baa5-9e36-494d-889c-beb27f310d1f tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Lazy-loading 'fault' on Instance uuid 95ba0f7b-8bac-4a46-ab2f-49c56a9853ec {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 09:03:25.431061 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-b989baa5-9e36-494d-889c-beb27f310d1f tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9de0fa32fc3f4864991b5d1108fabf24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebe19003884454eac65f2539327afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:03:25.438410 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b989baa5-9e36-494d-889c-beb27f310d1f tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] 10.222.0.33 "GET /compute/v2.1/servers/95ba0f7b-8bac-4a46-ab2f-49c56a9853ec" status: 200 len: 1289 microversion: 2.1 time: 0.095623 Jun 05 09:03:25.438967 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1674/3259] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:03:25 2022] GET /compute/v2.1/servers/95ba0f7b-8bac-4a46-ab2f-49c56a9853ec => generated 1289 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:03:25.454229 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-581bdf02-e00a-46d1-944b-accba05b3a11 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:03:25.454853 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-581bdf02-e00a-46d1-944b-accba05b3a11 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] [instance: 95ba0f7b-8bac-4a46-ab2f-49c56a9853ec] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:03:25.462596 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-581bdf02-e00a-46d1-944b-accba05b3a11 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:25.463056 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-581bdf02-e00a-46d1-944b-accba05b3a11 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:25.463830 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-581bdf02-e00a-46d1-944b-accba05b3a11 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:25.464315 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-581bdf02-e00a-46d1-944b-accba05b3a11 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:25.490783 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-581bdf02-e00a-46d1-944b-accba05b3a11 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] [instance: 95ba0f7b-8bac-4a46-ab2f-49c56a9853ec] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 09:03:25.536530 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-581bdf02-e00a-46d1-944b-accba05b3a11 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] [instance: 95ba0f7b-8bac-4a46-ab2f-49c56a9853ec] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 09:03:25.537323 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-581bdf02-e00a-46d1-944b-accba05b3a11 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:25.537785 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-581bdf02-e00a-46d1-944b-accba05b3a11 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:25.538832 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-581bdf02-e00a-46d1-944b-accba05b3a11 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] [instance: 95ba0f7b-8bac-4a46-ab2f-49c56a9853ec] instance's host None is down, deleting from database Jun 05 09:03:25.542109 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-581bdf02-e00a-46d1-944b-accba05b3a11 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] [instance: 95ba0f7b-8bac-4a46-ab2f-49c56a9853ec] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 09:03:25.578577 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-581bdf02-e00a-46d1-944b-accba05b3a11 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] [instance: 95ba0f7b-8bac-4a46-ab2f-49c56a9853ec] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 09:03:25.584457 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-581bdf02-e00a-46d1-944b-accba05b3a11 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] [instance: 95ba0f7b-8bac-4a46-ab2f-49c56a9853ec] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 09:03:25.728991 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-581bdf02-e00a-46d1-944b-accba05b3a11 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] 10.222.0.33 "DELETE /compute/v2.1/servers/95ba0f7b-8bac-4a46-ab2f-49c56a9853ec" status: 204 len: 0 microversion: 2.1 time: 0.278610 Jun 05 09:03:25.729583 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1586/3260] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 09:03:25 2022] DELETE /compute/v2.1/servers/95ba0f7b-8bac-4a46-ab2f-49c56a9853ec => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 09:03:25.737714 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a2be4740-5741-45a3-bda6-c74455307268 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:03:25.738351 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a2be4740-5741-45a3-bda6-c74455307268 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] [instance: 95ba0f7b-8bac-4a46-ab2f-49c56a9853ec] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:03:25.744958 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a2be4740-5741-45a3-bda6-c74455307268 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:25.745410 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a2be4740-5741-45a3-bda6-c74455307268 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:25.746169 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a2be4740-5741-45a3-bda6-c74455307268 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:25.746607 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a2be4740-5741-45a3-bda6-c74455307268 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:25.761518 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-a2be4740-5741-45a3-bda6-c74455307268 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] HTTP exception thrown: Instance 95ba0f7b-8bac-4a46-ab2f-49c56a9853ec could not be found. Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a2be4740-5741-45a3-bda6-c74455307268 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Request method failure captured: Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/95ba0f7b-8bac-4a46-ab2f-49c56a9853ec HTTP/1.1 Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinHFbi-TiG90tColXXYlOTUQKml6ODHmHyzVGFVQXFAXDFtpZmLkHCy8dZeNnXYkbmYXeuPyrYtmeaK5n9HBvS-MraPz2YoqzNBJRuKEcsfLp_M4UCx3TuZfZl7ckCXGmOQ5sEMj37Fz7l4Yk_mjbgjnIf1ZKz6REJur_UZjDwCKac6U Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 3ebe19003884454eac65f2539327afcc Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-ServersNegativeTestJSON-1787778223 Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3ebe19003884454eac65f2539327afcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3ebe19003884454eac65f2539327afcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3ebe19003884454eac65f2539327afcc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3ebe19003884454eac65f2539327afcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-ServersNegativeTestJSON-1787778223 Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 3ebe19003884454eac65f2539327afcc Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1787778223 Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-ServersNegativeTestJSON-1787778223-project Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 9de0fa32fc3f4864991b5d1108fabf24 Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-ServersNegativeTestJSON-1787778223-project Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 95ba0f7b-8bac-4a46-ab2f-49c56a9853ec could not be found. Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '95ba0f7b-8bac-4a46-ab2f-49c56a9853ec'} Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95ba0f7b-8bac-4a46-ab2f-49c56a9853ec could not be found. Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95ba0f7b-8bac-4a46-ab2f-49c56a9853ec could not be found. Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:03:25.763026 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:03:25.767391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:03:25.767391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:03:25.767391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:03:25.767391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 09:03:25.767391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 09:03:25.767391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95ba0f7b-8bac-4a46-ab2f-49c56a9853ec could not be found. Jun 05 09:03:25.767391 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:03:25.767391 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a2be4740-5741-45a3-bda6-c74455307268 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] Returning 404 to user: Instance 95ba0f7b-8bac-4a46-ab2f-49c56a9853ec could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 09:03:25.767391 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a2be4740-5741-45a3-bda6-c74455307268 tempest-ServersNegativeTestJSON-1787778223 tempest-ServersNegativeTestJSON-1787778223-project] 10.222.0.33 "GET /compute/v2.1/servers/95ba0f7b-8bac-4a46-ab2f-49c56a9853ec" status: 404 len: 111 microversion: 2.1 time: 0.030580 Jun 05 09:03:25.767391 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1675/3261] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:03:25 2022] GET /compute/v2.1/servers/95ba0f7b-8bac-4a46-ab2f-49c56a9853ec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 09:03:37.841403 n-d-844739-1 devstack@n-api.service[119049]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 09:03:37.841910 n-d-844739-1 devstack@n-api.service[119049]: Sun Jun 5 09:03:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 09:03:54.515894 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=24 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:03:54.517238 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:03:54.518122 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:UPDATE=38,nova_cell0:DELETE=6,nova_cell0:SELECT=48,nova_cell0:SAVEPOINT=2,nova_cell0:RELEASE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:03:54.720526 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a3eda986-b0c4-43d9-9471-346bed5fbd17 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Action: 'create', calling method: .version_select at 0x7f24337d2c10>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-584187055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzUSkG5r0c9JKQlPHsmbXYYvzYmvug0fVFamRqiR6H9LuZIg3GuJMxrIuX+BMeL4RT7o2CM10UKFcQcchzET8iV0iqR7cvXhV4sAa+7N1NX+yugKTvs+rOKk0UGaJDyVQ=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:03:54.739786 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-a3eda986-b0c4-43d9-9471-346bed5fbd17 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Getting quotas for project 8acd159bcee6455fb01c9bac3d1e3bf0. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:03:54.745070 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-a3eda986-b0c4-43d9-9471-346bed5fbd17 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Getting quotas for user 7d23c7aa627d4f9ba520ba6217630e0b and project 8acd159bcee6455fb01c9bac3d1e3bf0. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:03:54.768793 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a3eda986-b0c4-43d9-9471-346bed5fbd17 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.254680 Jun 05 09:03:54.769398 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1587/3262] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 09:03:54 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 09:03:54.817688 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-23c52836-2058-48d5-96e1-e7ee7a24642a tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-969235617", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-584187055", "networks": [{"uuid": "3ec796e9-d5bf-4035-87fc-dea2faa10ab4"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:03:54.824828 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=8 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:03:54.825651 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=28 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:03:54.826151 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:03:54.826776 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=34 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:03:54.872607 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-23c52836-2058-48d5-96e1-e7ee7a24642a tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] validate_networks() for [('3ec796e9-d5bf-4035-87fc-dea2faa10ab4', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 09:03:55.249218 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-23c52836-2058-48d5-96e1-e7ee7a24642a tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 09:03:55.249648 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-23c52836-2058-48d5-96e1-e7ee7a24642a tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 09:03:55.250165 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-23c52836-2058-48d5-96e1-e7ee7a24642a tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 09:03:55.250575 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-23c52836-2058-48d5-96e1-e7ee7a24642a tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 09:03:55.251015 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-23c52836-2058-48d5-96e1-e7ee7a24642a tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 09:03:55.267105 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-23c52836-2058-48d5-96e1-e7ee7a24642a tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:55.267560 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-23c52836-2058-48d5-96e1-e7ee7a24642a tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:55.268415 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-23c52836-2058-48d5-96e1-e7ee7a24642a tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:55.268856 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-23c52836-2058-48d5-96e1-e7ee7a24642a tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:55.287213 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-23c52836-2058-48d5-96e1-e7ee7a24642a tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Getting quotas for project 8acd159bcee6455fb01c9bac3d1e3bf0. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:03:55.292509 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-23c52836-2058-48d5-96e1-e7ee7a24642a tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Getting quotas for user 7d23c7aa627d4f9ba520ba6217630e0b and project 8acd159bcee6455fb01c9bac3d1e3bf0. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:03:55.305755 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-23c52836-2058-48d5-96e1-e7ee7a24642a tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 09:03:55.307911 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-23c52836-2058-48d5-96e1-e7ee7a24642a tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] [instance: 62948c6b-ee09-4faa-825b-7ba4f893510b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 09:03:55.358481 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-23c52836-2058-48d5-96e1-e7ee7a24642a tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.544521 Jun 05 09:03:55.359277 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1676/3263] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 09:03:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 09:03:55.369445 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-386ca906-bfa2-4e02-9040-ee618696e736 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:03:55.370150 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-386ca906-bfa2-4e02-9040-ee618696e736 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] [instance: 62948c6b-ee09-4faa-825b-7ba4f893510b] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:03:55.426766 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-386ca906-bfa2-4e02-9040-ee618696e736 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d23c7aa627d4f9ba520ba6217630e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acd159bcee6455fb01c9bac3d1e3bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:03:55.434050 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-386ca906-bfa2-4e02-9040-ee618696e736 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] 10.222.0.33 "GET /compute/v2.1/servers/62948c6b-ee09-4faa-825b-7ba4f893510b" status: 200 len: 1261 microversion: 2.1 time: 0.068523 Jun 05 09:03:55.434717 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1588/3264] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:03:55 2022] GET /compute/v2.1/servers/62948c6b-ee09-4faa-825b-7ba4f893510b => generated 1261 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:03:56.452740 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-7303ed1b-4972-4741-ad12-cb9ba6c6d861 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:03:56.453295 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-7303ed1b-4972-4741-ad12-cb9ba6c6d861 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] [instance: 62948c6b-ee09-4faa-825b-7ba4f893510b] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:03:56.460126 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7303ed1b-4972-4741-ad12-cb9ba6c6d861 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:56.460584 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7303ed1b-4972-4741-ad12-cb9ba6c6d861 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:56.461362 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7303ed1b-4972-4741-ad12-cb9ba6c6d861 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:56.461804 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7303ed1b-4972-4741-ad12-cb9ba6c6d861 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:56.492937 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7303ed1b-4972-4741-ad12-cb9ba6c6d861 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:56.493391 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-7303ed1b-4972-4741-ad12-cb9ba6c6d861 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:56.493848 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-7303ed1b-4972-4741-ad12-cb9ba6c6d861 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lazy-loading 'fault' on Instance uuid 62948c6b-ee09-4faa-825b-7ba4f893510b {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 09:03:56.534410 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-7303ed1b-4972-4741-ad12-cb9ba6c6d861 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d23c7aa627d4f9ba520ba6217630e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acd159bcee6455fb01c9bac3d1e3bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:03:56.543052 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-7303ed1b-4972-4741-ad12-cb9ba6c6d861 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] 10.222.0.33 "GET /compute/v2.1/servers/62948c6b-ee09-4faa-825b-7ba4f893510b" status: 200 len: 1334 microversion: 2.1 time: 0.095108 Jun 05 09:03:56.543632 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1677/3265] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:03:56 2022] GET /compute/v2.1/servers/62948c6b-ee09-4faa-825b-7ba4f893510b => generated 1334 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:03:56.559476 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ffb276e2-e0a2-47d2-a454-9a7703892968 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:03:56.560126 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ffb276e2-e0a2-47d2-a454-9a7703892968 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] [instance: 62948c6b-ee09-4faa-825b-7ba4f893510b] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:03:56.568816 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ffb276e2-e0a2-47d2-a454-9a7703892968 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:56.569519 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ffb276e2-e0a2-47d2-a454-9a7703892968 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:56.571173 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ffb276e2-e0a2-47d2-a454-9a7703892968 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:56.571622 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ffb276e2-e0a2-47d2-a454-9a7703892968 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:56.597083 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ffb276e2-e0a2-47d2-a454-9a7703892968 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] [instance: 62948c6b-ee09-4faa-825b-7ba4f893510b] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 09:03:56.645457 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ffb276e2-e0a2-47d2-a454-9a7703892968 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] [instance: 62948c6b-ee09-4faa-825b-7ba4f893510b] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 09:03:56.646823 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ffb276e2-e0a2-47d2-a454-9a7703892968 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:56.647273 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ffb276e2-e0a2-47d2-a454-9a7703892968 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:56.647714 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-ffb276e2-e0a2-47d2-a454-9a7703892968 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] [instance: 62948c6b-ee09-4faa-825b-7ba4f893510b] instance's host None is down, deleting from database Jun 05 09:03:56.651278 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-ffb276e2-e0a2-47d2-a454-9a7703892968 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] [instance: 62948c6b-ee09-4faa-825b-7ba4f893510b] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 09:03:56.689725 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-ffb276e2-e0a2-47d2-a454-9a7703892968 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] [instance: 62948c6b-ee09-4faa-825b-7ba4f893510b] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 09:03:56.696071 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-ffb276e2-e0a2-47d2-a454-9a7703892968 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] [instance: 62948c6b-ee09-4faa-825b-7ba4f893510b] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 09:03:56.865297 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ffb276e2-e0a2-47d2-a454-9a7703892968 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] 10.222.0.33 "DELETE /compute/v2.1/servers/62948c6b-ee09-4faa-825b-7ba4f893510b" status: 204 len: 0 microversion: 2.1 time: 0.309729 Jun 05 09:03:56.869532 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1589/3266] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 09:03:56 2022] DELETE /compute/v2.1/servers/62948c6b-ee09-4faa-825b-7ba4f893510b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 09:03:56.875033 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-bfbe5003-2e7d-431b-91a5-a20478fecb69 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:03:56.875782 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-bfbe5003-2e7d-431b-91a5-a20478fecb69 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] [instance: 62948c6b-ee09-4faa-825b-7ba4f893510b] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:03:56.883201 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bfbe5003-2e7d-431b-91a5-a20478fecb69 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:56.883916 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bfbe5003-2e7d-431b-91a5-a20478fecb69 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:56.884813 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bfbe5003-2e7d-431b-91a5-a20478fecb69 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:56.885337 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bfbe5003-2e7d-431b-91a5-a20478fecb69 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:56.900383 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-bfbe5003-2e7d-431b-91a5-a20478fecb69 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] HTTP exception thrown: Instance 62948c6b-ee09-4faa-825b-7ba4f893510b could not be found. Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-bfbe5003-2e7d-431b-91a5-a20478fecb69 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Request method failure captured: Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/62948c6b-ee09-4faa-825b-7ba4f893510b HTTP/1.1 Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinHF1CDi87ezwCHkD2A7_4wJeTt0KriUH0fZnGUKa5j40PyenUr-9ss0yuhVhymOiwtH7_X6VC8uV-U3hFS6vGAHl5AJN3oGEwsAwC4taHaRqyZ5s7Z4PfMoGc9SYoVwXf8vKZOlf9owzy2VptgSlPczGIxsrfzO_xSpTrQKNB5UrInU Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 8acd159bcee6455fb01c9bac3d1e3bf0 Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1351234887 Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8acd159bcee6455fb01c9bac3d1e3bf0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8acd159bcee6455fb01c9bac3d1e3bf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8acd159bcee6455fb01c9bac3d1e3bf0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8acd159bcee6455fb01c9bac3d1e3bf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-TestEncryptedCinderVolumes-1351234887 Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 8acd159bcee6455fb01c9bac3d1e3bf0 Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1351234887 Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-TestEncryptedCinderVolumes-1351234887-project Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 7d23c7aa627d4f9ba520ba6217630e0b Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-TestEncryptedCinderVolumes-1351234887-project Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 62948c6b-ee09-4faa-825b-7ba4f893510b could not be found. Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '62948c6b-ee09-4faa-825b-7ba4f893510b'} Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62948c6b-ee09-4faa-825b-7ba4f893510b could not be found. Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62948c6b-ee09-4faa-825b-7ba4f893510b could not be found. Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:03:56.902471 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:03:56.907554 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:03:56.907554 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:03:56.907554 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:03:56.907554 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 09:03:56.907554 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 09:03:56.907554 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62948c6b-ee09-4faa-825b-7ba4f893510b could not be found. Jun 05 09:03:56.907554 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:03:56.909428 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-bfbe5003-2e7d-431b-91a5-a20478fecb69 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Returning 404 to user: Instance 62948c6b-ee09-4faa-825b-7ba4f893510b could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 09:03:56.910646 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-bfbe5003-2e7d-431b-91a5-a20478fecb69 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] 10.222.0.33 "GET /compute/v2.1/servers/62948c6b-ee09-4faa-825b-7ba4f893510b" status: 404 len: 111 microversion: 2.1 time: 0.039874 Jun 05 09:03:56.914518 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1678/3267] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:03:56 2022] GET /compute/v2.1/servers/62948c6b-ee09-4faa-825b-7ba4f893510b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 09:03:56.922542 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6061850d-7168-423d-a4c5-8e12a10fc68d tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Calling method '.version_select at 0x7f24337c6a60>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:03:56.945774 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6061850d-7168-423d-a4c5-8e12a10fc68d tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-584187055" status: 202 len: 0 microversion: 2.1 time: 0.027539 Jun 05 09:03:56.946752 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1590/3268] 10.222.0.33 () {58 vars in 1274 bytes} [Sun Jun 5 09:03:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-584187055 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 09:03:56.962905 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9da051ea-a66d-4c0c-a8c3-36cae88274b5 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Action: 'create', calling method: .version_select at 0x7f24453519d0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-833465789", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHR415yxRv1UEWgu+QjAqHp1EBuSGERgCjB1nKPCtXVrxTnNRoVt+CF2CiISGVSPUvCBOH7/F7irCCkBTv9SBUnToDghQU8rtxBh9+CxwNoGuXB5zCWwobBReGfB76qzA=="}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:03:56.989188 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-9da051ea-a66d-4c0c-a8c3-36cae88274b5 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Getting quotas for project 8acd159bcee6455fb01c9bac3d1e3bf0. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:03:56.996258 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-9da051ea-a66d-4c0c-a8c3-36cae88274b5 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Getting quotas for user 7d23c7aa627d4f9ba520ba6217630e0b and project 8acd159bcee6455fb01c9bac3d1e3bf0. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:03:57.028356 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9da051ea-a66d-4c0c-a8c3-36cae88274b5 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.072055 Jun 05 09:03:57.029009 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1679/3269] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 09:03:56 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 05 09:03:57.084169 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-9a1e9a6b-e86f-4896-ac24-0d299e472550 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-2111512462", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-833465789", "networks": [{"uuid": "3ec796e9-d5bf-4035-87fc-dea2faa10ab4"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:03:57.148549 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-9a1e9a6b-e86f-4896-ac24-0d299e472550 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] validate_networks() for [('3ec796e9-d5bf-4035-87fc-dea2faa10ab4', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 09:03:57.546542 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-9a1e9a6b-e86f-4896-ac24-0d299e472550 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 09:03:57.547049 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-9a1e9a6b-e86f-4896-ac24-0d299e472550 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 09:03:57.547603 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-9a1e9a6b-e86f-4896-ac24-0d299e472550 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 09:03:57.548072 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-9a1e9a6b-e86f-4896-ac24-0d299e472550 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 09:03:57.548494 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-9a1e9a6b-e86f-4896-ac24-0d299e472550 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 09:03:57.558384 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9a1e9a6b-e86f-4896-ac24-0d299e472550 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:57.559115 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9a1e9a6b-e86f-4896-ac24-0d299e472550 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:57.559931 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9a1e9a6b-e86f-4896-ac24-0d299e472550 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:57.560558 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-9a1e9a6b-e86f-4896-ac24-0d299e472550 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:57.578442 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-9a1e9a6b-e86f-4896-ac24-0d299e472550 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Getting quotas for project 8acd159bcee6455fb01c9bac3d1e3bf0. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:03:57.583863 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-9a1e9a6b-e86f-4896-ac24-0d299e472550 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Getting quotas for user 7d23c7aa627d4f9ba520ba6217630e0b and project 8acd159bcee6455fb01c9bac3d1e3bf0. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:03:57.595768 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9a1e9a6b-e86f-4896-ac24-0d299e472550 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 09:03:57.597977 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-9a1e9a6b-e86f-4896-ac24-0d299e472550 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] [instance: c428f71e-289f-4131-b616-baa675a95b44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 09:03:57.645015 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-9a1e9a6b-e86f-4896-ac24-0d299e472550 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.565118 Jun 05 09:03:57.645967 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1591/3270] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 09:03:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 09:03:57.656306 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a999baea-fe88-4c59-9c9e-4ec85a1092e9 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:03:57.657062 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a999baea-fe88-4c59-9c9e-4ec85a1092e9 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] [instance: c428f71e-289f-4131-b616-baa675a95b44] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:03:57.722791 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a999baea-fe88-4c59-9c9e-4ec85a1092e9 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d23c7aa627d4f9ba520ba6217630e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acd159bcee6455fb01c9bac3d1e3bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:03:57.730317 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a999baea-fe88-4c59-9c9e-4ec85a1092e9 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] 10.222.0.33 "GET /compute/v2.1/servers/c428f71e-289f-4131-b616-baa675a95b44" status: 200 len: 1262 microversion: 2.1 time: 0.078323 Jun 05 09:03:57.730892 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1680/3271] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:03:57 2022] GET /compute/v2.1/servers/c428f71e-289f-4131-b616-baa675a95b44 => generated 1262 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:03:58.750884 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-7094eb54-508d-4d34-ae16-de432af3c6f0 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:03:58.751484 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-7094eb54-508d-4d34-ae16-de432af3c6f0 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] [instance: c428f71e-289f-4131-b616-baa675a95b44] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:03:58.758668 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7094eb54-508d-4d34-ae16-de432af3c6f0 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:58.759125 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7094eb54-508d-4d34-ae16-de432af3c6f0 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:58.759910 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7094eb54-508d-4d34-ae16-de432af3c6f0 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:58.760379 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7094eb54-508d-4d34-ae16-de432af3c6f0 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:58.792898 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7094eb54-508d-4d34-ae16-de432af3c6f0 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:58.793301 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-7094eb54-508d-4d34-ae16-de432af3c6f0 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:58.793756 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-7094eb54-508d-4d34-ae16-de432af3c6f0 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lazy-loading 'fault' on Instance uuid c428f71e-289f-4131-b616-baa675a95b44 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 09:03:58.834695 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-7094eb54-508d-4d34-ae16-de432af3c6f0 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d23c7aa627d4f9ba520ba6217630e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acd159bcee6455fb01c9bac3d1e3bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:03:58.842046 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-7094eb54-508d-4d34-ae16-de432af3c6f0 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] 10.222.0.33 "GET /compute/v2.1/servers/c428f71e-289f-4131-b616-baa675a95b44" status: 200 len: 1335 microversion: 2.1 time: 0.097198 Jun 05 09:03:58.842614 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1592/3272] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:03:58 2022] GET /compute/v2.1/servers/c428f71e-289f-4131-b616-baa675a95b44 => generated 1335 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:03:58.858765 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-bd748445-a5c9-4003-9c06-edf2e1b4683e tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:03:58.859270 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-bd748445-a5c9-4003-9c06-edf2e1b4683e tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] [instance: c428f71e-289f-4131-b616-baa675a95b44] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:03:58.866356 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bd748445-a5c9-4003-9c06-edf2e1b4683e tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:58.866812 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bd748445-a5c9-4003-9c06-edf2e1b4683e tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:58.867575 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bd748445-a5c9-4003-9c06-edf2e1b4683e tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:58.868014 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bd748445-a5c9-4003-9c06-edf2e1b4683e tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:58.891354 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-bd748445-a5c9-4003-9c06-edf2e1b4683e tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] [instance: c428f71e-289f-4131-b616-baa675a95b44] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 09:03:58.940414 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-bd748445-a5c9-4003-9c06-edf2e1b4683e tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] [instance: c428f71e-289f-4131-b616-baa675a95b44] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 09:03:58.941227 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bd748445-a5c9-4003-9c06-edf2e1b4683e tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:58.941698 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bd748445-a5c9-4003-9c06-edf2e1b4683e tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:58.942121 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-bd748445-a5c9-4003-9c06-edf2e1b4683e tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] [instance: c428f71e-289f-4131-b616-baa675a95b44] instance's host None is down, deleting from database Jun 05 09:03:58.945947 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-bd748445-a5c9-4003-9c06-edf2e1b4683e tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] [instance: c428f71e-289f-4131-b616-baa675a95b44] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 09:03:58.980986 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-bd748445-a5c9-4003-9c06-edf2e1b4683e tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] [instance: c428f71e-289f-4131-b616-baa675a95b44] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 09:03:58.987570 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-bd748445-a5c9-4003-9c06-edf2e1b4683e tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] [instance: c428f71e-289f-4131-b616-baa675a95b44] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 09:03:59.143888 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-bd748445-a5c9-4003-9c06-edf2e1b4683e tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c428f71e-289f-4131-b616-baa675a95b44" status: 204 len: 0 microversion: 2.1 time: 0.288893 Jun 05 09:03:59.144502 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1681/3273] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 09:03:58 2022] DELETE /compute/v2.1/servers/c428f71e-289f-4131-b616-baa675a95b44 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 09:03:59.153082 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b6e8658e-a908-4044-a871-98c7080e8290 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:03:59.153705 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-b6e8658e-a908-4044-a871-98c7080e8290 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] [instance: c428f71e-289f-4131-b616-baa675a95b44] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:03:59.159817 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b6e8658e-a908-4044-a871-98c7080e8290 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:59.160315 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b6e8658e-a908-4044-a871-98c7080e8290 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:59.161083 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b6e8658e-a908-4044-a871-98c7080e8290 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:03:59.161527 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-b6e8658e-a908-4044-a871-98c7080e8290 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:03:59.175236 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-b6e8658e-a908-4044-a871-98c7080e8290 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] HTTP exception thrown: Instance c428f71e-289f-4131-b616-baa675a95b44 could not be found. Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b6e8658e-a908-4044-a871-98c7080e8290 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Request method failure captured: Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/c428f71e-289f-4131-b616-baa675a95b44 HTTP/1.1 Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinHF1CDi87ezwCHkD2A7_4wJeTt0KriUH0fZnGUKa5j40PyenUr-9ss0yuhVhymOiwtH7_X6VC8uV-U3hFS6vGAHl5AJN3oGEwsAwC4taHaRqyZ5s7Z4PfMoGc9SYoVwXf8vKZOlf9owzy2VptgSlPczGIxsrfzO_xSpTrQKNB5UrInU Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 8acd159bcee6455fb01c9bac3d1e3bf0 Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1351234887 Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8acd159bcee6455fb01c9bac3d1e3bf0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8acd159bcee6455fb01c9bac3d1e3bf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8acd159bcee6455fb01c9bac3d1e3bf0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8acd159bcee6455fb01c9bac3d1e3bf0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-TestEncryptedCinderVolumes-1351234887 Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 8acd159bcee6455fb01c9bac3d1e3bf0 Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1351234887 Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-TestEncryptedCinderVolumes-1351234887-project Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 7d23c7aa627d4f9ba520ba6217630e0b Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-TestEncryptedCinderVolumes-1351234887-project Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance c428f71e-289f-4131-b616-baa675a95b44 could not be found. Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'c428f71e-289f-4131-b616-baa675a95b44'} Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c428f71e-289f-4131-b616-baa675a95b44 could not be found. Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c428f71e-289f-4131-b616-baa675a95b44 could not be found. Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:03:59.176794 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:03:59.181773 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:03:59.181773 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:03:59.181773 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:03:59.181773 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 09:03:59.181773 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 09:03:59.181773 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c428f71e-289f-4131-b616-baa675a95b44 could not be found. Jun 05 09:03:59.181773 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:03:59.181773 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-b6e8658e-a908-4044-a871-98c7080e8290 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Returning 404 to user: Instance c428f71e-289f-4131-b616-baa675a95b44 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 09:03:59.181773 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-b6e8658e-a908-4044-a871-98c7080e8290 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] 10.222.0.33 "GET /compute/v2.1/servers/c428f71e-289f-4131-b616-baa675a95b44" status: 404 len: 111 microversion: 2.1 time: 0.029954 Jun 05 09:03:59.181773 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1593/3274] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:03:59 2022] GET /compute/v2.1/servers/c428f71e-289f-4131-b616-baa675a95b44 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 09:03:59.188227 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0947b109-a183-4d6b-bc26-6fddc1ebde76 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] Calling method '.version_select at 0x7f24453a7e50>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:03:59.205614 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0947b109-a183-4d6b-bc26-6fddc1ebde76 tempest-TestEncryptedCinderVolumes-1351234887 tempest-TestEncryptedCinderVolumes-1351234887-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-833465789" status: 202 len: 0 microversion: 2.1 time: 0.021162 Jun 05 09:03:59.206160 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1682/3275] 10.222.0.33 () {58 vars in 1274 bytes} [Sun Jun 5 09:03:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-833465789 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 09:04:26.710273 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-bf84c2b2-c643-4337-aa7a-fa5d12097302 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Action: 'create', calling method: .version_select at 0x7f2432e464c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-628949815", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6NU9zbHXcyYcz6MRUuXvHVIH6L7M353Y3p7Rr8EEXMqoLyaTYGOVyXlLOmCROo2QYfcPJavjlzmeFckZQZ7Ok0+1Igw+9nNjt2mPSePM3/riKcKG2CFM+sjW720Ocq2g=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:04:26.715605 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:04:26.716351 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=12 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:04:26.716972 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:04:26.717574 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=36,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:04:26.733172 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-bf84c2b2-c643-4337-aa7a-fa5d12097302 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Getting quotas for project fb33ad009c9841ddb7fea5e0c51f8457. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:04:26.739743 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-bf84c2b2-c643-4337-aa7a-fa5d12097302 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Getting quotas for user 01ae2e8f3a024091a6b80b8585c9bce2 and project fb33ad009c9841ddb7fea5e0c51f8457. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:04:26.764057 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-bf84c2b2-c643-4337-aa7a-fa5d12097302 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.058487 Jun 05 09:04:26.764672 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1594/3276] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 09:04:26 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 09:04:26.822934 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:04:26.823773 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=12 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:04:26.824557 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=36,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:04:26.825190 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:04:26.829518 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-efaa1aad-8b60-4cbd-8c6f-87f1d76141aa tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1883821", "imageRef": "1e807266-e7c0-4b8b-b032-7a7ca978db47", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-628949815", "networks": [{"uuid": "b7fd040e-9d02-45e9-a879-212958457c23"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:04:26.883894 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-efaa1aad-8b60-4cbd-8c6f-87f1d76141aa tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] validate_networks() for [('b7fd040e-9d02-45e9-a879-212958457c23', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 09:04:27.247598 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-efaa1aad-8b60-4cbd-8c6f-87f1d76141aa tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 09:04:27.248031 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-efaa1aad-8b60-4cbd-8c6f-87f1d76141aa tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 09:04:27.248546 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-efaa1aad-8b60-4cbd-8c6f-87f1d76141aa tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 09:04:27.248963 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-efaa1aad-8b60-4cbd-8c6f-87f1d76141aa tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 09:04:27.249384 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-efaa1aad-8b60-4cbd-8c6f-87f1d76141aa tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 09:04:27.258538 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-efaa1aad-8b60-4cbd-8c6f-87f1d76141aa tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:04:27.258995 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-efaa1aad-8b60-4cbd-8c6f-87f1d76141aa tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:04:27.259798 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-efaa1aad-8b60-4cbd-8c6f-87f1d76141aa tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:04:27.260296 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-efaa1aad-8b60-4cbd-8c6f-87f1d76141aa tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:04:27.277853 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-efaa1aad-8b60-4cbd-8c6f-87f1d76141aa tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Getting quotas for project fb33ad009c9841ddb7fea5e0c51f8457. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:04:27.283074 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-efaa1aad-8b60-4cbd-8c6f-87f1d76141aa tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Getting quotas for user 01ae2e8f3a024091a6b80b8585c9bce2 and project fb33ad009c9841ddb7fea5e0c51f8457. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:04:27.295257 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-efaa1aad-8b60-4cbd-8c6f-87f1d76141aa tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 09:04:27.297329 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-efaa1aad-8b60-4cbd-8c6f-87f1d76141aa tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] [instance: a74e154a-a144-4c4c-953d-f6796d0a144a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e807266-e7c0-4b8b-b032-7a7ca978db47',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 09:04:27.341780 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-efaa1aad-8b60-4cbd-8c6f-87f1d76141aa tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520456 Jun 05 09:04:27.342634 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1683/3277] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 09:04:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 09:04:27.352376 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-dc7ff439-acc8-4c6f-8261-fdba3cb14805 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:04:27.353141 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-dc7ff439-acc8-4c6f-8261-fdba3cb14805 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] [instance: a74e154a-a144-4c4c-953d-f6796d0a144a] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:04:27.414420 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-dc7ff439-acc8-4c6f-8261-fdba3cb14805 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ae2e8f3a024091a6b80b8585c9bce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb33ad009c9841ddb7fea5e0c51f8457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:04:27.422538 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-dc7ff439-acc8-4c6f-8261-fdba3cb14805 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] 10.222.0.33 "GET /compute/v2.1/servers/a74e154a-a144-4c4c-953d-f6796d0a144a" status: 200 len: 1255 microversion: 2.1 time: 0.074167 Jun 05 09:04:27.423099 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1595/3278] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:04:27 2022] GET /compute/v2.1/servers/a74e154a-a144-4c4c-953d-f6796d0a144a => generated 1255 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:04:28.441195 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a6342402-7344-477c-a196-10b47fe2e81b tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:04:28.441813 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a6342402-7344-477c-a196-10b47fe2e81b tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] [instance: a74e154a-a144-4c4c-953d-f6796d0a144a] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:04:28.448484 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a6342402-7344-477c-a196-10b47fe2e81b tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:04:28.448976 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a6342402-7344-477c-a196-10b47fe2e81b tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:04:28.449753 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a6342402-7344-477c-a196-10b47fe2e81b tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:04:28.450198 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a6342402-7344-477c-a196-10b47fe2e81b tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:04:28.482571 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a6342402-7344-477c-a196-10b47fe2e81b tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:04:28.483030 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a6342402-7344-477c-a196-10b47fe2e81b tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:04:28.483489 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-a6342402-7344-477c-a196-10b47fe2e81b tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Lazy-loading 'fault' on Instance uuid a74e154a-a144-4c4c-953d-f6796d0a144a {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 09:04:28.524498 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-a6342402-7344-477c-a196-10b47fe2e81b tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ae2e8f3a024091a6b80b8585c9bce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb33ad009c9841ddb7fea5e0c51f8457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:04:28.532205 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a6342402-7344-477c-a196-10b47fe2e81b tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] 10.222.0.33 "GET /compute/v2.1/servers/a74e154a-a144-4c4c-953d-f6796d0a144a" status: 200 len: 1328 microversion: 2.1 time: 0.095860 Jun 05 09:04:28.532778 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1684/3279] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:04:28 2022] GET /compute/v2.1/servers/a74e154a-a144-4c4c-953d-f6796d0a144a => generated 1328 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:04:28.548598 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c96c5aa2-6030-4645-b2d5-283bd11dbad4 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:04:28.549133 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c96c5aa2-6030-4645-b2d5-283bd11dbad4 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] [instance: a74e154a-a144-4c4c-953d-f6796d0a144a] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:04:28.555656 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c96c5aa2-6030-4645-b2d5-283bd11dbad4 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:04:28.556138 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c96c5aa2-6030-4645-b2d5-283bd11dbad4 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:04:28.556896 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c96c5aa2-6030-4645-b2d5-283bd11dbad4 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:04:28.557336 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c96c5aa2-6030-4645-b2d5-283bd11dbad4 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:04:28.581480 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c96c5aa2-6030-4645-b2d5-283bd11dbad4 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] [instance: a74e154a-a144-4c4c-953d-f6796d0a144a] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 09:04:28.628772 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c96c5aa2-6030-4645-b2d5-283bd11dbad4 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] [instance: a74e154a-a144-4c4c-953d-f6796d0a144a] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 09:04:28.629564 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c96c5aa2-6030-4645-b2d5-283bd11dbad4 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:04:28.630005 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c96c5aa2-6030-4645-b2d5-283bd11dbad4 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:04:28.631583 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-c96c5aa2-6030-4645-b2d5-283bd11dbad4 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] [instance: a74e154a-a144-4c4c-953d-f6796d0a144a] instance's host None is down, deleting from database Jun 05 09:04:28.635130 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-c96c5aa2-6030-4645-b2d5-283bd11dbad4 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] [instance: a74e154a-a144-4c4c-953d-f6796d0a144a] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 09:04:28.668954 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-c96c5aa2-6030-4645-b2d5-283bd11dbad4 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] [instance: a74e154a-a144-4c4c-953d-f6796d0a144a] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 09:04:28.674764 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-c96c5aa2-6030-4645-b2d5-283bd11dbad4 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] [instance: a74e154a-a144-4c4c-953d-f6796d0a144a] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 09:04:28.812538 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c96c5aa2-6030-4645-b2d5-283bd11dbad4 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a74e154a-a144-4c4c-953d-f6796d0a144a" status: 204 len: 0 microversion: 2.1 time: 0.267968 Jun 05 09:04:28.813125 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1596/3280] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 09:04:28 2022] DELETE /compute/v2.1/servers/a74e154a-a144-4c4c-953d-f6796d0a144a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 09:04:28.822102 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-201ddb6c-901b-43f8-ba0d-9391d552eeb0 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:04:28.822746 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-201ddb6c-901b-43f8-ba0d-9391d552eeb0 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] [instance: a74e154a-a144-4c4c-953d-f6796d0a144a] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:04:28.828808 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-201ddb6c-901b-43f8-ba0d-9391d552eeb0 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:04:28.829263 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-201ddb6c-901b-43f8-ba0d-9391d552eeb0 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:04:28.830028 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-201ddb6c-901b-43f8-ba0d-9391d552eeb0 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:04:28.830468 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-201ddb6c-901b-43f8-ba0d-9391d552eeb0 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:04:28.844380 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-201ddb6c-901b-43f8-ba0d-9391d552eeb0 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] HTTP exception thrown: Instance a74e154a-a144-4c4c-953d-f6796d0a144a could not be found. Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-201ddb6c-901b-43f8-ba0d-9391d552eeb0 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Request method failure captured: Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/a74e154a-a144-4c4c-953d-f6796d0a144a HTTP/1.1 Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinHGM2P1WvUxW7iRLJ9HR3RS0rIftRStu63C5AG8vzIhk443pMKKljf_2oTuU4oskqupT6x1hIQubJHPwJUBMJvTmHHT0bg7FDzF-DKHPxrE4PVrshEhjDRu0Br84_gEA0bNHxAl5TXq4h9JgSqaIhZhnOgZ64NlMsEbjs2q0hNQ0B-4 Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: fb33ad009c9841ddb7fea5e0c51f8457 Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-TestMinimumBasicScenario-1911341162 Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fb33ad009c9841ddb7fea5e0c51f8457"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb33ad009c9841ddb7fea5e0c51f8457"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fb33ad009c9841ddb7fea5e0c51f8457", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb33ad009c9841ddb7fea5e0c51f8457"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-TestMinimumBasicScenario-1911341162 Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: fb33ad009c9841ddb7fea5e0c51f8457 Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1911341162 Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-TestMinimumBasicScenario-1911341162-project Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 01ae2e8f3a024091a6b80b8585c9bce2 Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-TestMinimumBasicScenario-1911341162-project Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance a74e154a-a144-4c4c-953d-f6796d0a144a could not be found. Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'a74e154a-a144-4c4c-953d-f6796d0a144a'} Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a74e154a-a144-4c4c-953d-f6796d0a144a could not be found. Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a74e154a-a144-4c4c-953d-f6796d0a144a could not be found. Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:04:28.845916 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:04:28.851324 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:04:28.851324 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:04:28.851324 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:04:28.851324 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 09:04:28.851324 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 09:04:28.851324 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a74e154a-a144-4c4c-953d-f6796d0a144a could not be found. Jun 05 09:04:28.851324 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:04:28.851324 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-201ddb6c-901b-43f8-ba0d-9391d552eeb0 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Returning 404 to user: Instance a74e154a-a144-4c4c-953d-f6796d0a144a could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 09:04:28.851324 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-201ddb6c-901b-43f8-ba0d-9391d552eeb0 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] 10.222.0.33 "GET /compute/v2.1/servers/a74e154a-a144-4c4c-953d-f6796d0a144a" status: 404 len: 111 microversion: 2.1 time: 0.029860 Jun 05 09:04:28.851324 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1685/3281] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:04:28 2022] GET /compute/v2.1/servers/a74e154a-a144-4c4c-953d-f6796d0a144a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 09:04:28.858545 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ee76d863-1767-4360-9ea9-94ee95756a85 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] Calling method '.version_select at 0x7f2433835ee0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:04:28.876987 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ee76d863-1767-4360-9ea9-94ee95756a85 tempest-TestMinimumBasicScenario-1911341162 tempest-TestMinimumBasicScenario-1911341162-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-628949815" status: 202 len: 0 microversion: 2.1 time: 0.022171 Jun 05 09:04:28.877558 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1597/3282] 10.222.0.33 () {58 vars in 1268 bytes} [Sun Jun 5 09:04:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-628949815 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 09:04:37.883399 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:04:37.884288 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=6 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:04:38.045419 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-74becccf-9057-455e-b4c8-fa93093f7ea5 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Action: 'create', calling method: .version_select at 0x7f244547c700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-33362839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLncxCOOmCtWxgyeKYQx0o8IF/xXP/pYrKJEKO2RkW7AQVGYGq7IxkyDHtkQV0YPjrZiELAM3ItS73TD6Vlgn2yBznDgO8u/k6WKkX5bHqSO1bqboVkj2OigUDCB659m/w=="}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:04:38.059913 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-74becccf-9057-455e-b4c8-fa93093f7ea5 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Getting quotas for project 182b07c9aded489cb0021e9df14bb674. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:04:38.065693 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-74becccf-9057-455e-b4c8-fa93093f7ea5 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Getting quotas for user 2909d99d6aed4ddb89eb9d1b1740e493 and project 182b07c9aded489cb0021e9df14bb674. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:04:38.089719 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-74becccf-9057-455e-b4c8-fa93093f7ea5 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.211841 Jun 05 09:04:38.090305 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1686/3283] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 09:04:37 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 09:04:43.859062 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-283a0b1c-e5a3-4933-81fd-2c3820a6a925 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-945226857", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "bb4c3ac2-e3aa-46ea-8eb4-4c698bea25a3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-33362839", "security_groups": [{"name": "tempest-secgroup-smoke-26249477"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:04:43.867015 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=6 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:04:43.868187 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:04:43.869087 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:04:43.987979 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-283a0b1c-e5a3-4933-81fd-2c3820a6a925 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] validate_networks() for [('bb4c3ac2-e3aa-46ea-8eb4-4c698bea25a3', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 09:04:44.425079 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-283a0b1c-e5a3-4933-81fd-2c3820a6a925 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 09:04:44.425517 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-283a0b1c-e5a3-4933-81fd-2c3820a6a925 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 09:04:44.426026 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-283a0b1c-e5a3-4933-81fd-2c3820a6a925 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 09:04:44.426465 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-283a0b1c-e5a3-4933-81fd-2c3820a6a925 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 09:04:44.426887 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-283a0b1c-e5a3-4933-81fd-2c3820a6a925 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 09:04:44.435862 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-283a0b1c-e5a3-4933-81fd-2c3820a6a925 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:04:44.436334 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-283a0b1c-e5a3-4933-81fd-2c3820a6a925 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:04:44.437245 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-283a0b1c-e5a3-4933-81fd-2c3820a6a925 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:04:44.438036 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-283a0b1c-e5a3-4933-81fd-2c3820a6a925 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:04:44.456953 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-283a0b1c-e5a3-4933-81fd-2c3820a6a925 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Getting quotas for project 182b07c9aded489cb0021e9df14bb674. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:04:44.463136 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-283a0b1c-e5a3-4933-81fd-2c3820a6a925 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Getting quotas for user 2909d99d6aed4ddb89eb9d1b1740e493 and project 182b07c9aded489cb0021e9df14bb674. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:04:44.475367 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-283a0b1c-e5a3-4933-81fd-2c3820a6a925 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 09:04:44.477549 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-283a0b1c-e5a3-4933-81fd-2c3820a6a925 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 01e7233c-568f-4a1c-87c3-8c08cf69ed30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 09:04:44.527583 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-283a0b1c-e5a3-4933-81fd-2c3820a6a925 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.672545 Jun 05 09:04:44.528864 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1598/3284] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 09:04:43 2022] POST /compute/v2.1/servers => generated 404 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 09:04:44.535664 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=12 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:04:44.541413 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-004aea33-0cea-42e4-aba4-50fd0ee62029 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:04:44.542121 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-004aea33-0cea-42e4-aba4-50fd0ee62029 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 01e7233c-568f-4a1c-87c3-8c08cf69ed30] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:04:44.613752 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-004aea33-0cea-42e4-aba4-50fd0ee62029 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2909d99d6aed4ddb89eb9d1b1740e493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b07c9aded489cb0021e9df14bb674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:04:44.624079 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-004aea33-0cea-42e4-aba4-50fd0ee62029 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "GET /compute/v2.1/servers/01e7233c-568f-4a1c-87c3-8c08cf69ed30" status: 200 len: 1264 microversion: 2.1 time: 0.086765 Jun 05 09:04:44.624079 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1687/3285] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:04:44 2022] GET /compute/v2.1/servers/01e7233c-568f-4a1c-87c3-8c08cf69ed30 => generated 1264 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:04:45.639538 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-34674bb1-dccf-4a02-8082-081718e43dba tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:04:45.640215 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-34674bb1-dccf-4a02-8082-081718e43dba tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 01e7233c-568f-4a1c-87c3-8c08cf69ed30] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:04:45.648392 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-34674bb1-dccf-4a02-8082-081718e43dba tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:04:45.648847 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-34674bb1-dccf-4a02-8082-081718e43dba tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:04:45.649609 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-34674bb1-dccf-4a02-8082-081718e43dba tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:04:45.650041 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-34674bb1-dccf-4a02-8082-081718e43dba tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:04:45.685464 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-34674bb1-dccf-4a02-8082-081718e43dba tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:04:45.685831 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-34674bb1-dccf-4a02-8082-081718e43dba tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:04:45.686285 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-34674bb1-dccf-4a02-8082-081718e43dba tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lazy-loading 'fault' on Instance uuid 01e7233c-568f-4a1c-87c3-8c08cf69ed30 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 09:04:45.728661 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-34674bb1-dccf-4a02-8082-081718e43dba tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2909d99d6aed4ddb89eb9d1b1740e493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b07c9aded489cb0021e9df14bb674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:04:45.737346 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-34674bb1-dccf-4a02-8082-081718e43dba tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "GET /compute/v2.1/servers/01e7233c-568f-4a1c-87c3-8c08cf69ed30" status: 200 len: 1337 microversion: 2.1 time: 0.101668 Jun 05 09:04:45.738020 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1599/3286] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:04:45 2022] GET /compute/v2.1/servers/01e7233c-568f-4a1c-87c3-8c08cf69ed30 => generated 1337 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:04:45.753980 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-a95002f4-65c7-47b2-8eb7-e4868285cf18 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:04:45.754512 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a95002f4-65c7-47b2-8eb7-e4868285cf18 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 01e7233c-568f-4a1c-87c3-8c08cf69ed30] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:04:45.762200 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a95002f4-65c7-47b2-8eb7-e4868285cf18 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:04:45.762660 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a95002f4-65c7-47b2-8eb7-e4868285cf18 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:04:45.763434 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a95002f4-65c7-47b2-8eb7-e4868285cf18 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:04:45.763880 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a95002f4-65c7-47b2-8eb7-e4868285cf18 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:04:45.788293 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a95002f4-65c7-47b2-8eb7-e4868285cf18 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 01e7233c-568f-4a1c-87c3-8c08cf69ed30] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 09:04:45.836457 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-a95002f4-65c7-47b2-8eb7-e4868285cf18 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 01e7233c-568f-4a1c-87c3-8c08cf69ed30] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 09:04:45.837194 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a95002f4-65c7-47b2-8eb7-e4868285cf18 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:04:45.837685 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-a95002f4-65c7-47b2-8eb7-e4868285cf18 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:04:45.838126 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-a95002f4-65c7-47b2-8eb7-e4868285cf18 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 01e7233c-568f-4a1c-87c3-8c08cf69ed30] instance's host None is down, deleting from database Jun 05 09:04:45.841632 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-a95002f4-65c7-47b2-8eb7-e4868285cf18 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 01e7233c-568f-4a1c-87c3-8c08cf69ed30] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 09:04:45.878723 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-a95002f4-65c7-47b2-8eb7-e4868285cf18 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 01e7233c-568f-4a1c-87c3-8c08cf69ed30] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 09:04:45.885059 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-a95002f4-65c7-47b2-8eb7-e4868285cf18 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 01e7233c-568f-4a1c-87c3-8c08cf69ed30] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 09:04:46.049711 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-a95002f4-65c7-47b2-8eb7-e4868285cf18 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "DELETE /compute/v2.1/servers/01e7233c-568f-4a1c-87c3-8c08cf69ed30" status: 204 len: 0 microversion: 2.1 time: 0.296005 Jun 05 09:04:46.049711 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1688/3287] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 09:04:45 2022] DELETE /compute/v2.1/servers/01e7233c-568f-4a1c-87c3-8c08cf69ed30 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 09:04:46.059728 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-43a7c3d3-6d73-4da3-87b9-030eb11d37a0 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:04:46.071563 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-43a7c3d3-6d73-4da3-87b9-030eb11d37a0 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 01e7233c-568f-4a1c-87c3-8c08cf69ed30] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:04:46.078793 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-43a7c3d3-6d73-4da3-87b9-030eb11d37a0 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:04:46.079255 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-43a7c3d3-6d73-4da3-87b9-030eb11d37a0 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:04:46.080072 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-43a7c3d3-6d73-4da3-87b9-030eb11d37a0 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:04:46.080508 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-43a7c3d3-6d73-4da3-87b9-030eb11d37a0 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:04:46.106102 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-43a7c3d3-6d73-4da3-87b9-030eb11d37a0 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] HTTP exception thrown: Instance 01e7233c-568f-4a1c-87c3-8c08cf69ed30 could not be found. Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-43a7c3d3-6d73-4da3-87b9-030eb11d37a0 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Request method failure captured: Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/01e7233c-568f-4a1c-87c3-8c08cf69ed30 HTTP/1.1 Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinHGl3xMHqTBxNFyBHKbfpEpRpqIK9-io6WxAoQC_8SE-_K3Aaikg1HaGVxQTII0L4gCxMGobqbZ8geQzuGD9XgH7PJ5mw3_znRHRtYCm3VjzRlCq3j-WuJENL1H6i368jW6BJW-h75Z85lqWYUCqZqi6Gafin8JyA9SBhRt7NYTTlsU Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 182b07c9aded489cb0021e9df14bb674 Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-82727815 Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/182b07c9aded489cb0021e9df14bb674"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/182b07c9aded489cb0021e9df14bb674"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_182b07c9aded489cb0021e9df14bb674", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/182b07c9aded489cb0021e9df14bb674"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-TestNetworkAdvancedServerOps-82727815 Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 182b07c9aded489cb0021e9df14bb674 Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-82727815 Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-TestNetworkAdvancedServerOps-82727815-project Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 2909d99d6aed4ddb89eb9d1b1740e493 Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-TestNetworkAdvancedServerOps-82727815-project Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 01e7233c-568f-4a1c-87c3-8c08cf69ed30 could not be found. Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '01e7233c-568f-4a1c-87c3-8c08cf69ed30'} Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01e7233c-568f-4a1c-87c3-8c08cf69ed30 could not be found. Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01e7233c-568f-4a1c-87c3-8c08cf69ed30 could not be found. Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:04:46.107672 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:04:46.112228 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:04:46.112228 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:04:46.112228 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:04:46.112228 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 09:04:46.112228 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 09:04:46.112228 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01e7233c-568f-4a1c-87c3-8c08cf69ed30 could not be found. Jun 05 09:04:46.112228 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:04:46.112228 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-43a7c3d3-6d73-4da3-87b9-030eb11d37a0 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Returning 404 to user: Instance 01e7233c-568f-4a1c-87c3-8c08cf69ed30 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 09:04:46.112228 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-43a7c3d3-6d73-4da3-87b9-030eb11d37a0 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "GET /compute/v2.1/servers/01e7233c-568f-4a1c-87c3-8c08cf69ed30" status: 404 len: 111 microversion: 2.1 time: 0.055032 Jun 05 09:04:46.112228 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1600/3288] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:04:46 2022] GET /compute/v2.1/servers/01e7233c-568f-4a1c-87c3-8c08cf69ed30 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 09:04:49.446611 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5938866b-dc16-4d31-97ce-e12c4daca6b2 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Calling method '.version_select at 0x7f2433ab2a60>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:04:49.472418 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5938866b-dc16-4d31-97ce-e12c4daca6b2 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-33362839" status: 202 len: 0 microversion: 2.1 time: 0.042962 Jun 05 09:04:49.473007 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1689/3289] 10.222.0.33 () {58 vars in 1277 bytes} [Sun Jun 5 09:04:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-33362839 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 09:04:49.487381 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-09609a10-48a8-40a3-82c7-c0a45819e7cc tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Action: 'create', calling method: .version_select at 0x7f243392ae50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-11405776", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9emKcjb9gQ40PllKX0bcIR7eq6EbQVOk7GIGul434nT9PzNdeJ1CRLkAaUdZyFmnPbvCXypwZ4Go+AVB1lo20/saVyPFe18yiA5Tcxh6x0D/EPAJCXLSd11+Z7JHa9Tg=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:04:49.502944 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-09609a10-48a8-40a3-82c7-c0a45819e7cc tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Getting quotas for project 182b07c9aded489cb0021e9df14bb674. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:04:49.509201 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-09609a10-48a8-40a3-82c7-c0a45819e7cc tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Getting quotas for user 2909d99d6aed4ddb89eb9d1b1740e493 and project 182b07c9aded489cb0021e9df14bb674. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:04:49.532820 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-09609a10-48a8-40a3-82c7-c0a45819e7cc tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.049315 Jun 05 09:04:49.533352 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1601/3290] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 09:04:49 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 09:04:55.316491 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-bee5793b-9e4f-4a25-a5a4-4bfd76ba5d06 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1401214687", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "d5545c4a-2d76-4fb1-9efc-38d80245ec88"}], "key_name": "tempest-TestNetworkAdvancedServerOps-11405776", "security_groups": [{"name": "tempest-secgroup-smoke-1104685649"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:04:55.329528 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=6 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:04:55.479162 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-bee5793b-9e4f-4a25-a5a4-4bfd76ba5d06 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] validate_networks() for [('d5545c4a-2d76-4fb1-9efc-38d80245ec88', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 09:04:55.910632 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-bee5793b-9e4f-4a25-a5a4-4bfd76ba5d06 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 09:04:55.911225 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-bee5793b-9e4f-4a25-a5a4-4bfd76ba5d06 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 09:04:55.911707 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-bee5793b-9e4f-4a25-a5a4-4bfd76ba5d06 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 09:04:55.912151 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-bee5793b-9e4f-4a25-a5a4-4bfd76ba5d06 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 09:04:55.912572 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-bee5793b-9e4f-4a25-a5a4-4bfd76ba5d06 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 09:04:55.922610 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bee5793b-9e4f-4a25-a5a4-4bfd76ba5d06 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:04:55.923063 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bee5793b-9e4f-4a25-a5a4-4bfd76ba5d06 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:04:55.923883 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bee5793b-9e4f-4a25-a5a4-4bfd76ba5d06 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:04:55.924345 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-bee5793b-9e4f-4a25-a5a4-4bfd76ba5d06 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:04:55.942887 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-bee5793b-9e4f-4a25-a5a4-4bfd76ba5d06 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Getting quotas for project 182b07c9aded489cb0021e9df14bb674. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:04:55.948393 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-bee5793b-9e4f-4a25-a5a4-4bfd76ba5d06 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Getting quotas for user 2909d99d6aed4ddb89eb9d1b1740e493 and project 182b07c9aded489cb0021e9df14bb674. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:04:55.961637 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-bee5793b-9e4f-4a25-a5a4-4bfd76ba5d06 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 09:04:55.963799 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-bee5793b-9e4f-4a25-a5a4-4bfd76ba5d06 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 495cf210-6097-43ed-9e37-033cd4f687c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 09:04:56.013210 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-bee5793b-9e4f-4a25-a5a4-4bfd76ba5d06 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.700361 Jun 05 09:04:56.014289 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1690/3291] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 09:04:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 09:04:56.031577 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a9c75ad5-4abd-4354-8056-91327eedb0bb tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:04:56.032386 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-a9c75ad5-4abd-4354-8056-91327eedb0bb tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 495cf210-6097-43ed-9e37-033cd4f687c2] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:04:56.045476 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:04:56.086765 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=12 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:04:56.104159 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-a9c75ad5-4abd-4354-8056-91327eedb0bb tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2909d99d6aed4ddb89eb9d1b1740e493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b07c9aded489cb0021e9df14bb674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:04:56.114911 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a9c75ad5-4abd-4354-8056-91327eedb0bb tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "GET /compute/v2.1/servers/495cf210-6097-43ed-9e37-033cd4f687c2" status: 200 len: 1265 microversion: 2.1 time: 0.090582 Jun 05 09:04:56.115508 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1602/3292] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:04:56 2022] GET /compute/v2.1/servers/495cf210-6097-43ed-9e37-033cd4f687c2 => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:04:57.135075 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-06ebc44c-0038-432a-b260-7511a770297b tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:04:57.136636 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-06ebc44c-0038-432a-b260-7511a770297b tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 495cf210-6097-43ed-9e37-033cd4f687c2] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:04:57.143518 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:04:57.145436 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-06ebc44c-0038-432a-b260-7511a770297b tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:04:57.146267 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-06ebc44c-0038-432a-b260-7511a770297b tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:04:57.147437 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-06ebc44c-0038-432a-b260-7511a770297b tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:04:57.149275 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-06ebc44c-0038-432a-b260-7511a770297b tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:04:57.189343 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-06ebc44c-0038-432a-b260-7511a770297b tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:04:57.189997 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-06ebc44c-0038-432a-b260-7511a770297b tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:04:57.190624 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-06ebc44c-0038-432a-b260-7511a770297b tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lazy-loading 'fault' on Instance uuid 495cf210-6097-43ed-9e37-033cd4f687c2 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 09:04:57.244086 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-06ebc44c-0038-432a-b260-7511a770297b tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2909d99d6aed4ddb89eb9d1b1740e493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b07c9aded489cb0021e9df14bb674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:04:57.251957 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-06ebc44c-0038-432a-b260-7511a770297b tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "GET /compute/v2.1/servers/495cf210-6097-43ed-9e37-033cd4f687c2" status: 200 len: 1338 microversion: 2.1 time: 0.122848 Jun 05 09:04:57.253038 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1691/3293] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:04:57 2022] GET /compute/v2.1/servers/495cf210-6097-43ed-9e37-033cd4f687c2 => generated 1338 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:04:57.270924 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4e04a56c-915d-4559-80e4-5b14bc958a46 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:04:57.273253 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4e04a56c-915d-4559-80e4-5b14bc958a46 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 495cf210-6097-43ed-9e37-033cd4f687c2] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:04:57.282487 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4e04a56c-915d-4559-80e4-5b14bc958a46 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:04:57.283374 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4e04a56c-915d-4559-80e4-5b14bc958a46 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:04:57.284205 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4e04a56c-915d-4559-80e4-5b14bc958a46 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:04:57.284649 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4e04a56c-915d-4559-80e4-5b14bc958a46 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:04:57.311595 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4e04a56c-915d-4559-80e4-5b14bc958a46 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 495cf210-6097-43ed-9e37-033cd4f687c2] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 09:04:57.364133 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4e04a56c-915d-4559-80e4-5b14bc958a46 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 495cf210-6097-43ed-9e37-033cd4f687c2] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 09:04:57.365204 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4e04a56c-915d-4559-80e4-5b14bc958a46 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:04:57.365791 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-4e04a56c-915d-4559-80e4-5b14bc958a46 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:04:57.366975 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-4e04a56c-915d-4559-80e4-5b14bc958a46 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 495cf210-6097-43ed-9e37-033cd4f687c2] instance's host None is down, deleting from database Jun 05 09:04:57.371919 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-4e04a56c-915d-4559-80e4-5b14bc958a46 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 495cf210-6097-43ed-9e37-033cd4f687c2] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 09:04:57.408697 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-4e04a56c-915d-4559-80e4-5b14bc958a46 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 495cf210-6097-43ed-9e37-033cd4f687c2] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 09:04:57.415645 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-4e04a56c-915d-4559-80e4-5b14bc958a46 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 495cf210-6097-43ed-9e37-033cd4f687c2] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 09:04:57.603187 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4e04a56c-915d-4559-80e4-5b14bc958a46 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "DELETE /compute/v2.1/servers/495cf210-6097-43ed-9e37-033cd4f687c2" status: 204 len: 0 microversion: 2.1 time: 0.336778 Jun 05 09:04:57.603785 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1603/3294] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 09:04:57 2022] DELETE /compute/v2.1/servers/495cf210-6097-43ed-9e37-033cd4f687c2 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 09:04:57.620110 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-09bd37eb-2a4d-42d2-880d-d2db235b05c2 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:04:57.620979 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-09bd37eb-2a4d-42d2-880d-d2db235b05c2 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 495cf210-6097-43ed-9e37-033cd4f687c2] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:04:57.627934 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-09bd37eb-2a4d-42d2-880d-d2db235b05c2 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:04:57.628542 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-09bd37eb-2a4d-42d2-880d-d2db235b05c2 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:04:57.629553 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-09bd37eb-2a4d-42d2-880d-d2db235b05c2 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:04:57.629994 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-09bd37eb-2a4d-42d2-880d-d2db235b05c2 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:04:57.645778 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-09bd37eb-2a4d-42d2-880d-d2db235b05c2 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] HTTP exception thrown: Instance 495cf210-6097-43ed-9e37-033cd4f687c2 could not be found. Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-09bd37eb-2a4d-42d2-880d-d2db235b05c2 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Request method failure captured: Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/495cf210-6097-43ed-9e37-033cd4f687c2 HTTP/1.1 Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinHGl3xMHqTBxNFyBHKbfpEpRpqIK9-io6WxAoQC_8SE-_K3Aaikg1HaGVxQTII0L4gCxMGobqbZ8geQzuGD9XgH7PJ5mw3_znRHRtYCm3VjzRlCq3j-WuJENL1H6i368jW6BJW-h75Z85lqWYUCqZqi6Gafin8JyA9SBhRt7NYTTlsU Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 182b07c9aded489cb0021e9df14bb674 Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-82727815 Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/182b07c9aded489cb0021e9df14bb674"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/182b07c9aded489cb0021e9df14bb674"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_182b07c9aded489cb0021e9df14bb674", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/182b07c9aded489cb0021e9df14bb674"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-TestNetworkAdvancedServerOps-82727815 Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 182b07c9aded489cb0021e9df14bb674 Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-82727815 Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-TestNetworkAdvancedServerOps-82727815-project Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 2909d99d6aed4ddb89eb9d1b1740e493 Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-TestNetworkAdvancedServerOps-82727815-project Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance 495cf210-6097-43ed-9e37-033cd4f687c2 could not be found. Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': '495cf210-6097-43ed-9e37-033cd4f687c2'} Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 495cf210-6097-43ed-9e37-033cd4f687c2 could not be found. Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 495cf210-6097-43ed-9e37-033cd4f687c2 could not be found. Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:04:57.647196 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:04:57.656973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:04:57.656973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:04:57.656973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:04:57.656973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 09:04:57.656973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 09:04:57.656973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 495cf210-6097-43ed-9e37-033cd4f687c2 could not be found. Jun 05 09:04:57.656973 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:04:57.656973 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-09bd37eb-2a4d-42d2-880d-d2db235b05c2 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Returning 404 to user: Instance 495cf210-6097-43ed-9e37-033cd4f687c2 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 09:04:57.656973 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-09bd37eb-2a4d-42d2-880d-d2db235b05c2 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "GET /compute/v2.1/servers/495cf210-6097-43ed-9e37-033cd4f687c2" status: 404 len: 111 microversion: 2.1 time: 0.040716 Jun 05 09:04:57.656973 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1692/3295] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:04:57 2022] GET /compute/v2.1/servers/495cf210-6097-43ed-9e37-033cd4f687c2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 09:05:01.113060 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2098898c-c7d0-48aa-ad06-6d2c1065a1f3 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Calling method '.version_select at 0x7f243377b280>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:05:01.136156 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2098898c-c7d0-48aa-ad06-6d2c1065a1f3 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-11405776" status: 202 len: 0 microversion: 2.1 time: 0.027407 Jun 05 09:05:01.137199 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1604/3296] 10.222.0.33 () {58 vars in 1277 bytes} [Sun Jun 5 09:05:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-11405776 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 09:05:01.153274 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-3ccb8fab-5924-4c64-b0ff-a5836c421d0b tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Action: 'create', calling method: .version_select at 0x7f24337aeca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-884623241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwiRtQj3KLySo8yZ6RwJqMs0tTiLXhY/l/M0Z9rcAlroW7V9bjnF032gnk1H61hmITKv+2eLbnEJ9lD1iryi4XgV/ligoD24uBerfbov62eD0SjeByu19GFttXWV63X0A=="}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:05:01.169205 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-3ccb8fab-5924-4c64-b0ff-a5836c421d0b tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Getting quotas for project 182b07c9aded489cb0021e9df14bb674. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:05:01.174596 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-3ccb8fab-5924-4c64-b0ff-a5836c421d0b tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Getting quotas for user 2909d99d6aed4ddb89eb9d1b1740e493 and project 182b07c9aded489cb0021e9df14bb674. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:05:01.200718 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-3ccb8fab-5924-4c64-b0ff-a5836c421d0b tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.052658 Jun 05 09:05:01.201315 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1693/3297] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 09:05:01 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 09:05:06.842160 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6b544198-67f2-46b7-9426-3c5caada2871 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1546743413", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "093e36ef-a637-4f52-839f-894a974b02b5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-884623241", "security_groups": [{"name": "tempest-secgroup-smoke-94751318"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:05:06.855164 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=12 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:05:06.968611 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-6b544198-67f2-46b7-9426-3c5caada2871 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] validate_networks() for [('093e36ef-a637-4f52-839f-894a974b02b5', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 09:05:07.400839 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-6b544198-67f2-46b7-9426-3c5caada2871 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 09:05:07.401353 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-6b544198-67f2-46b7-9426-3c5caada2871 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 09:05:07.401903 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-6b544198-67f2-46b7-9426-3c5caada2871 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 09:05:07.402387 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-6b544198-67f2-46b7-9426-3c5caada2871 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 09:05:07.402900 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-6b544198-67f2-46b7-9426-3c5caada2871 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 09:05:07.412194 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6b544198-67f2-46b7-9426-3c5caada2871 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:07.412648 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6b544198-67f2-46b7-9426-3c5caada2871 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:07.414040 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6b544198-67f2-46b7-9426-3c5caada2871 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:07.414475 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6b544198-67f2-46b7-9426-3c5caada2871 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:07.431133 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-6b544198-67f2-46b7-9426-3c5caada2871 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Getting quotas for project 182b07c9aded489cb0021e9df14bb674. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:05:07.436109 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-6b544198-67f2-46b7-9426-3c5caada2871 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Getting quotas for user 2909d99d6aed4ddb89eb9d1b1740e493 and project 182b07c9aded489cb0021e9df14bb674. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:05:07.448680 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6b544198-67f2-46b7-9426-3c5caada2871 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 09:05:07.450821 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6b544198-67f2-46b7-9426-3c5caada2871 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 302cad95-2233-4a65-b5f5-1e6328a2be8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 09:05:07.497129 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6b544198-67f2-46b7-9426-3c5caada2871 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.660349 Jun 05 09:05:07.502929 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1605/3298] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 09:05:06 2022] POST /compute/v2.1/servers => generated 404 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 09:05:07.508855 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ba918f20-d567-4250-ae55-83273862bcc9 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:05:07.509631 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ba918f20-d567-4250-ae55-83273862bcc9 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 302cad95-2233-4a65-b5f5-1e6328a2be8a] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:05:07.513486 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:05:07.578576 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-ba918f20-d567-4250-ae55-83273862bcc9 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2909d99d6aed4ddb89eb9d1b1740e493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b07c9aded489cb0021e9df14bb674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:05:07.592665 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ba918f20-d567-4250-ae55-83273862bcc9 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "GET /compute/v2.1/servers/302cad95-2233-4a65-b5f5-1e6328a2be8a" status: 200 len: 1266 microversion: 2.1 time: 0.084370 Jun 05 09:05:07.592665 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1694/3299] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:05:07 2022] GET /compute/v2.1/servers/302cad95-2233-4a65-b5f5-1e6328a2be8a => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:05:08.606406 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ad52f013-67ee-498b-86a0-54c1116d5bd6 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:05:08.607768 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ad52f013-67ee-498b-86a0-54c1116d5bd6 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 302cad95-2233-4a65-b5f5-1e6328a2be8a] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:05:08.617862 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ad52f013-67ee-498b-86a0-54c1116d5bd6 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:08.618594 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ad52f013-67ee-498b-86a0-54c1116d5bd6 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:08.619383 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ad52f013-67ee-498b-86a0-54c1116d5bd6 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:08.619833 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ad52f013-67ee-498b-86a0-54c1116d5bd6 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:08.654609 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ad52f013-67ee-498b-86a0-54c1116d5bd6 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:08.655098 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ad52f013-67ee-498b-86a0-54c1116d5bd6 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:08.655558 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-ad52f013-67ee-498b-86a0-54c1116d5bd6 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lazy-loading 'fault' on Instance uuid 302cad95-2233-4a65-b5f5-1e6328a2be8a {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 09:05:08.706570 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ad52f013-67ee-498b-86a0-54c1116d5bd6 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2909d99d6aed4ddb89eb9d1b1740e493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b07c9aded489cb0021e9df14bb674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:05:08.714760 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ad52f013-67ee-498b-86a0-54c1116d5bd6 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "GET /compute/v2.1/servers/302cad95-2233-4a65-b5f5-1e6328a2be8a" status: 200 len: 1339 microversion: 2.1 time: 0.112344 Jun 05 09:05:08.715335 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1606/3300] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:05:08 2022] GET /compute/v2.1/servers/302cad95-2233-4a65-b5f5-1e6328a2be8a => generated 1339 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:05:08.732858 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-38acd70f-cae7-41a7-9f72-85c838637d42 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:05:08.733372 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-38acd70f-cae7-41a7-9f72-85c838637d42 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 302cad95-2233-4a65-b5f5-1e6328a2be8a] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:05:08.735282 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=36,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:05:08.741591 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-38acd70f-cae7-41a7-9f72-85c838637d42 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:08.742075 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-38acd70f-cae7-41a7-9f72-85c838637d42 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:08.742854 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-38acd70f-cae7-41a7-9f72-85c838637d42 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:08.743295 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-38acd70f-cae7-41a7-9f72-85c838637d42 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:08.770065 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-38acd70f-cae7-41a7-9f72-85c838637d42 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 302cad95-2233-4a65-b5f5-1e6328a2be8a] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 09:05:08.819350 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-38acd70f-cae7-41a7-9f72-85c838637d42 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 302cad95-2233-4a65-b5f5-1e6328a2be8a] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 09:05:08.820190 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-38acd70f-cae7-41a7-9f72-85c838637d42 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:08.820640 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-38acd70f-cae7-41a7-9f72-85c838637d42 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:08.821083 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-38acd70f-cae7-41a7-9f72-85c838637d42 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 302cad95-2233-4a65-b5f5-1e6328a2be8a] instance's host None is down, deleting from database Jun 05 09:05:08.825111 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-38acd70f-cae7-41a7-9f72-85c838637d42 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 302cad95-2233-4a65-b5f5-1e6328a2be8a] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 09:05:08.861481 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-38acd70f-cae7-41a7-9f72-85c838637d42 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 302cad95-2233-4a65-b5f5-1e6328a2be8a] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 09:05:08.868669 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-38acd70f-cae7-41a7-9f72-85c838637d42 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 302cad95-2233-4a65-b5f5-1e6328a2be8a] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 09:05:09.067234 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-38acd70f-cae7-41a7-9f72-85c838637d42 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "DELETE /compute/v2.1/servers/302cad95-2233-4a65-b5f5-1e6328a2be8a" status: 204 len: 0 microversion: 2.1 time: 0.338531 Jun 05 09:05:09.068283 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1695/3301] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 09:05:08 2022] DELETE /compute/v2.1/servers/302cad95-2233-4a65-b5f5-1e6328a2be8a => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 09:05:09.076728 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-42b33f5e-3621-4582-bc3f-0f6178ef50be tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:05:09.077346 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-42b33f5e-3621-4582-bc3f-0f6178ef50be tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: 302cad95-2233-4a65-b5f5-1e6328a2be8a] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:05:09.087197 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42b33f5e-3621-4582-bc3f-0f6178ef50be tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:09.087648 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42b33f5e-3621-4582-bc3f-0f6178ef50be tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:09.088458 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42b33f5e-3621-4582-bc3f-0f6178ef50be tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:09.088896 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-42b33f5e-3621-4582-bc3f-0f6178ef50be tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:09.105254 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-42b33f5e-3621-4582-bc3f-0f6178ef50be tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] HTTP exception thrown: Instance 302cad95-2233-4a65-b5f5-1e6328a2be8a could not be found. Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-42b33f5e-3621-4582-bc3f-0f6178ef50be tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Request method failure captured: Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/302cad95-2233-4a65-b5f5-1e6328a2be8a HTTP/1.1 Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinHGl3xMHqTBxNFyBHKbfpEpRpqIK9-io6WxAoQC_8SE-_K3Aaikg1HaGVxQTII0L4gCxMGobqbZ8geQzuGD9XgH7PJ5mw3_znRHRtYCm3VjzRlCq3j-WuJENL1H6i368jW6BJW-h75Z85lqWYUCqZqi6Gafin8JyA9SBhRt7NYTTlsU Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 182b07c9aded489cb0021e9df14bb674 Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-82727815 Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/182b07c9aded489cb0021e9df14bb674"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/182b07c9aded489cb0021e9df14bb674"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_182b07c9aded489cb0021e9df14bb674", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/182b07c9aded489cb0021e9df14bb674"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-TestNetworkAdvancedServerOps-82727815 Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 182b07c9aded489cb0021e9df14bb674 Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-82727815 Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-TestNetworkAdvancedServerOps-82727815-project Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 2909d99d6aed4ddb89eb9d1b1740e493 Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-TestNetworkAdvancedServerOps-82727815-project Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 302cad95-2233-4a65-b5f5-1e6328a2be8a could not be found. Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '302cad95-2233-4a65-b5f5-1e6328a2be8a'} Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 302cad95-2233-4a65-b5f5-1e6328a2be8a could not be found. Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 302cad95-2233-4a65-b5f5-1e6328a2be8a could not be found. Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:05:09.106805 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:05:09.111038 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:05:09.111038 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:05:09.111038 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:05:09.111038 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 09:05:09.111038 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 09:05:09.111038 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 302cad95-2233-4a65-b5f5-1e6328a2be8a could not be found. Jun 05 09:05:09.111038 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:05:09.111038 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-42b33f5e-3621-4582-bc3f-0f6178ef50be tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Returning 404 to user: Instance 302cad95-2233-4a65-b5f5-1e6328a2be8a could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 09:05:09.111038 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-42b33f5e-3621-4582-bc3f-0f6178ef50be tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "GET /compute/v2.1/servers/302cad95-2233-4a65-b5f5-1e6328a2be8a" status: 404 len: 111 microversion: 2.1 time: 0.035470 Jun 05 09:05:09.111038 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1607/3302] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:05:09 2022] GET /compute/v2.1/servers/302cad95-2233-4a65-b5f5-1e6328a2be8a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 05 09:05:12.646146 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ce64edae-4ea6-4187-a62f-676e1072513a tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Calling method '.version_select at 0x7f2432d62160>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:05:12.665512 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ce64edae-4ea6-4187-a62f-676e1072513a tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-884623241" status: 202 len: 0 microversion: 2.1 time: 0.024042 Jun 05 09:05:12.666109 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1696/3303] 10.222.0.33 () {58 vars in 1280 bytes} [Sun Jun 5 09:05:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-884623241 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 09:05:12.685709 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-a8cba3b9-c6ec-42d2-ba21-3be3d55ebc54 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Action: 'create', calling method: .version_select at 0x7f24339b0d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1663477789", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDgPrpIiDbCfIkhkdmtXww2IrkksQwPMg73eNfBU3sOVHxQYx36NHl9DamcD/E4RzZjTO2R3qB9U9P6msjoQRvfijnug5y9WHaAv7CNDtSA9FkPMbrq1MH2DnMpqHYyHQ=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:05:12.701522 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-a8cba3b9-c6ec-42d2-ba21-3be3d55ebc54 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Getting quotas for project 182b07c9aded489cb0021e9df14bb674. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:05:12.710158 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-a8cba3b9-c6ec-42d2-ba21-3be3d55ebc54 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Getting quotas for user 2909d99d6aed4ddb89eb9d1b1740e493 and project 182b07c9aded489cb0021e9df14bb674. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:05:12.736010 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-a8cba3b9-c6ec-42d2-ba21-3be3d55ebc54 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.059612 Jun 05 09:05:12.736648 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1608/3304] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 09:05:12 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 09:05:18.103499 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=12 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:05:18.108825 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-838ad2d6-fa7d-483b-8190-686bc38b84bf tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-236018897", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "30f93985-bfe8-4a60-aadd-14cfab2484cd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1663477789", "security_groups": [{"name": "tempest-secgroup-smoke-1475063058"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:05:18.218838 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-838ad2d6-fa7d-483b-8190-686bc38b84bf tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] validate_networks() for [('30f93985-bfe8-4a60-aadd-14cfab2484cd', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 09:05:18.647003 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-838ad2d6-fa7d-483b-8190-686bc38b84bf tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 09:05:18.647425 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-838ad2d6-fa7d-483b-8190-686bc38b84bf tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 09:05:18.647937 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-838ad2d6-fa7d-483b-8190-686bc38b84bf tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 09:05:18.648729 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-838ad2d6-fa7d-483b-8190-686bc38b84bf tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 09:05:18.649187 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-838ad2d6-fa7d-483b-8190-686bc38b84bf tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 09:05:18.675589 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-838ad2d6-fa7d-483b-8190-686bc38b84bf tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:18.676058 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-838ad2d6-fa7d-483b-8190-686bc38b84bf tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:18.676945 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-838ad2d6-fa7d-483b-8190-686bc38b84bf tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:18.677389 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-838ad2d6-fa7d-483b-8190-686bc38b84bf tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:18.708069 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-838ad2d6-fa7d-483b-8190-686bc38b84bf tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Getting quotas for project 182b07c9aded489cb0021e9df14bb674. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:05:18.714907 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-838ad2d6-fa7d-483b-8190-686bc38b84bf tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Getting quotas for user 2909d99d6aed4ddb89eb9d1b1740e493 and project 182b07c9aded489cb0021e9df14bb674. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:05:18.733633 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-838ad2d6-fa7d-483b-8190-686bc38b84bf tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 09:05:18.735792 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-838ad2d6-fa7d-483b-8190-686bc38b84bf tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: fed09584-0be9-40b2-aad0-dcb66d01c15d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 09:05:18.795057 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-838ad2d6-fa7d-483b-8190-686bc38b84bf tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.689856 Jun 05 09:05:18.795896 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1697/3305] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 09:05:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 09:05:18.803800 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:05:18.809877 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-736bf050-7dac-46db-b52f-d39b699fb76f tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:05:18.810516 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-736bf050-7dac-46db-b52f-d39b699fb76f tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: fed09584-0be9-40b2-aad0-dcb66d01c15d] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:05:18.812444 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=8,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:05:18.895632 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-736bf050-7dac-46db-b52f-d39b699fb76f tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2909d99d6aed4ddb89eb9d1b1740e493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b07c9aded489cb0021e9df14bb674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:05:18.903773 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-736bf050-7dac-46db-b52f-d39b699fb76f tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "GET /compute/v2.1/servers/fed09584-0be9-40b2-aad0-dcb66d01c15d" status: 200 len: 1266 microversion: 2.1 time: 0.101477 Jun 05 09:05:18.904421 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1609/3306] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:05:18 2022] GET /compute/v2.1/servers/fed09584-0be9-40b2-aad0-dcb66d01c15d => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:05:19.922244 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0ec7d704-4c28-4446-a70f-a502eb213ed4 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:05:19.930455 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0ec7d704-4c28-4446-a70f-a502eb213ed4 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: fed09584-0be9-40b2-aad0-dcb66d01c15d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:05:19.938352 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0ec7d704-4c28-4446-a70f-a502eb213ed4 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:19.938807 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0ec7d704-4c28-4446-a70f-a502eb213ed4 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:19.939574 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0ec7d704-4c28-4446-a70f-a502eb213ed4 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:19.940014 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0ec7d704-4c28-4446-a70f-a502eb213ed4 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:19.983538 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0ec7d704-4c28-4446-a70f-a502eb213ed4 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:19.984236 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0ec7d704-4c28-4446-a70f-a502eb213ed4 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:19.996624 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-0ec7d704-4c28-4446-a70f-a502eb213ed4 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lazy-loading 'fault' on Instance uuid fed09584-0be9-40b2-aad0-dcb66d01c15d {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 09:05:20.066436 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0ec7d704-4c28-4446-a70f-a502eb213ed4 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2909d99d6aed4ddb89eb9d1b1740e493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b07c9aded489cb0021e9df14bb674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:05:20.078901 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0ec7d704-4c28-4446-a70f-a502eb213ed4 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "GET /compute/v2.1/servers/fed09584-0be9-40b2-aad0-dcb66d01c15d" status: 200 len: 1339 microversion: 2.1 time: 0.161804 Jun 05 09:05:20.079906 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1698/3307] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:05:19 2022] GET /compute/v2.1/servers/fed09584-0be9-40b2-aad0-dcb66d01c15d => generated 1339 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:05:20.097191 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-6943022f-c533-4369-ac4f-e24c84a17bd4 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:05:20.098321 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6943022f-c533-4369-ac4f-e24c84a17bd4 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: fed09584-0be9-40b2-aad0-dcb66d01c15d] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:05:20.100506 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=36,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:05:20.109485 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6943022f-c533-4369-ac4f-e24c84a17bd4 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:20.110242 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6943022f-c533-4369-ac4f-e24c84a17bd4 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:20.111413 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6943022f-c533-4369-ac4f-e24c84a17bd4 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:20.112409 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6943022f-c533-4369-ac4f-e24c84a17bd4 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:20.144746 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6943022f-c533-4369-ac4f-e24c84a17bd4 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: fed09584-0be9-40b2-aad0-dcb66d01c15d] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 09:05:20.201155 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-6943022f-c533-4369-ac4f-e24c84a17bd4 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: fed09584-0be9-40b2-aad0-dcb66d01c15d] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 09:05:20.201976 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6943022f-c533-4369-ac4f-e24c84a17bd4 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:20.202431 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-6943022f-c533-4369-ac4f-e24c84a17bd4 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:20.202875 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-6943022f-c533-4369-ac4f-e24c84a17bd4 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: fed09584-0be9-40b2-aad0-dcb66d01c15d] instance's host None is down, deleting from database Jun 05 09:05:20.206845 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-6943022f-c533-4369-ac4f-e24c84a17bd4 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: fed09584-0be9-40b2-aad0-dcb66d01c15d] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 09:05:20.248190 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-6943022f-c533-4369-ac4f-e24c84a17bd4 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: fed09584-0be9-40b2-aad0-dcb66d01c15d] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 09:05:20.254405 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-6943022f-c533-4369-ac4f-e24c84a17bd4 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: fed09584-0be9-40b2-aad0-dcb66d01c15d] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 09:05:20.442914 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-6943022f-c533-4369-ac4f-e24c84a17bd4 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fed09584-0be9-40b2-aad0-dcb66d01c15d" status: 204 len: 0 microversion: 2.1 time: 0.349709 Jun 05 09:05:20.443518 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1610/3308] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 09:05:20 2022] DELETE /compute/v2.1/servers/fed09584-0be9-40b2-aad0-dcb66d01c15d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 09:05:20.452397 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-034734cc-f22c-4b4e-a674-5b4f1fb06122 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:05:20.453017 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-034734cc-f22c-4b4e-a674-5b4f1fb06122 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: fed09584-0be9-40b2-aad0-dcb66d01c15d] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:05:20.459106 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-034734cc-f22c-4b4e-a674-5b4f1fb06122 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:20.459559 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-034734cc-f22c-4b4e-a674-5b4f1fb06122 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:20.461552 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-034734cc-f22c-4b4e-a674-5b4f1fb06122 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:20.461992 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-034734cc-f22c-4b4e-a674-5b4f1fb06122 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:20.478570 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-034734cc-f22c-4b4e-a674-5b4f1fb06122 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] HTTP exception thrown: Instance fed09584-0be9-40b2-aad0-dcb66d01c15d could not be found. Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-034734cc-f22c-4b4e-a674-5b4f1fb06122 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Request method failure captured: Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/fed09584-0be9-40b2-aad0-dcb66d01c15d HTTP/1.1 Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinHGl3xMHqTBxNFyBHKbfpEpRpqIK9-io6WxAoQC_8SE-_K3Aaikg1HaGVxQTII0L4gCxMGobqbZ8geQzuGD9XgH7PJ5mw3_znRHRtYCm3VjzRlCq3j-WuJENL1H6i368jW6BJW-h75Z85lqWYUCqZqi6Gafin8JyA9SBhRt7NYTTlsU Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 182b07c9aded489cb0021e9df14bb674 Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-82727815 Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/182b07c9aded489cb0021e9df14bb674"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/182b07c9aded489cb0021e9df14bb674"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_182b07c9aded489cb0021e9df14bb674", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/182b07c9aded489cb0021e9df14bb674"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-TestNetworkAdvancedServerOps-82727815 Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 182b07c9aded489cb0021e9df14bb674 Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-82727815 Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-TestNetworkAdvancedServerOps-82727815-project Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 2909d99d6aed4ddb89eb9d1b1740e493 Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-TestNetworkAdvancedServerOps-82727815-project Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance fed09584-0be9-40b2-aad0-dcb66d01c15d could not be found. Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'fed09584-0be9-40b2-aad0-dcb66d01c15d'} Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fed09584-0be9-40b2-aad0-dcb66d01c15d could not be found. Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fed09584-0be9-40b2-aad0-dcb66d01c15d could not be found. Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:05:20.480200 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:05:20.485195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:05:20.485195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:05:20.485195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:05:20.485195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 09:05:20.485195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 09:05:20.485195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fed09584-0be9-40b2-aad0-dcb66d01c15d could not be found. Jun 05 09:05:20.485195 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:05:20.485195 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-034734cc-f22c-4b4e-a674-5b4f1fb06122 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Returning 404 to user: Instance fed09584-0be9-40b2-aad0-dcb66d01c15d could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 09:05:20.485195 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-034734cc-f22c-4b4e-a674-5b4f1fb06122 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "GET /compute/v2.1/servers/fed09584-0be9-40b2-aad0-dcb66d01c15d" status: 404 len: 111 microversion: 2.1 time: 0.033159 Jun 05 09:05:20.485195 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1699/3309] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:05:20 2022] GET /compute/v2.1/servers/fed09584-0be9-40b2-aad0-dcb66d01c15d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 09:05:23.817803 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-0647bb22-164c-49ac-8d25-7598638e9684 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Calling method '.version_select at 0x7f2433907a60>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:05:23.837941 n-d-844739-1 devstack@n-api.service[119050]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 09:05:23.838532 n-d-844739-1 devstack@n-api.service[119050]: Sun Jun 5 09:05:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 09:05:23.846255 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-0647bb22-164c-49ac-8d25-7598638e9684 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1663477789" status: 202 len: 0 microversion: 2.1 time: 0.032320 Jun 05 09:05:23.846853 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1611/3310] 10.222.0.33 () {58 vars in 1283 bytes} [Sun Jun 5 09:05:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1663477789 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 09:05:23.862038 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5eec9422-3b1f-4ad6-b692-5da81e33011f tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Action: 'create', calling method: .version_select at 0x7f2432ecc550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1950070909", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxzBpc/14bq7HUz5NdDAOC/4FiQEhI7/Lt/NaCEpB1xtUyKFtsDZrTjI4KvbJUyvRFDZG35SGHgh/rmpl7gRmm/Q9skFa9FbLfJ1tiUNAv/wOf2edQY/1DA+36dXk7nqA=="}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:05:23.879209 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-5eec9422-3b1f-4ad6-b692-5da81e33011f tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Getting quotas for project 182b07c9aded489cb0021e9df14bb674. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:05:23.885091 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-5eec9422-3b1f-4ad6-b692-5da81e33011f tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Getting quotas for user 2909d99d6aed4ddb89eb9d1b1740e493 and project 182b07c9aded489cb0021e9df14bb674. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:05:23.909193 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5eec9422-3b1f-4ad6-b692-5da81e33011f tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051396 Jun 05 09:05:23.909783 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1700/3311] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 09:05:23 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 09:05:29.768310 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=12 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:05:29.775092 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c6e2ebc4-9fac-4ebe-84bd-41d72fcdc496 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1535829207", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "networks": [{"uuid": "8b59a19c-3c58-405c-8230-9e7426c636e1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1950070909", "security_groups": [{"name": "tempest-secgroup-smoke-125891723"}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:05:30.104743 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-c6e2ebc4-9fac-4ebe-84bd-41d72fcdc496 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] validate_networks() for [('8b59a19c-3c58-405c-8230-9e7426c636e1', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 09:05:30.436474 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:05:30.502708 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-c6e2ebc4-9fac-4ebe-84bd-41d72fcdc496 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 09:05:30.503144 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-c6e2ebc4-9fac-4ebe-84bd-41d72fcdc496 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 09:05:30.503656 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-c6e2ebc4-9fac-4ebe-84bd-41d72fcdc496 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 09:05:30.504094 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-c6e2ebc4-9fac-4ebe-84bd-41d72fcdc496 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 09:05:30.504548 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-c6e2ebc4-9fac-4ebe-84bd-41d72fcdc496 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 09:05:30.514174 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c6e2ebc4-9fac-4ebe-84bd-41d72fcdc496 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:30.514626 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c6e2ebc4-9fac-4ebe-84bd-41d72fcdc496 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:30.515432 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c6e2ebc4-9fac-4ebe-84bd-41d72fcdc496 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:30.515879 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c6e2ebc4-9fac-4ebe-84bd-41d72fcdc496 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:30.532774 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-c6e2ebc4-9fac-4ebe-84bd-41d72fcdc496 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Getting quotas for project 182b07c9aded489cb0021e9df14bb674. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:05:30.538063 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-c6e2ebc4-9fac-4ebe-84bd-41d72fcdc496 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Getting quotas for user 2909d99d6aed4ddb89eb9d1b1740e493 and project 182b07c9aded489cb0021e9df14bb674. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:05:30.550506 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c6e2ebc4-9fac-4ebe-84bd-41d72fcdc496 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 09:05:30.552664 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c6e2ebc4-9fac-4ebe-84bd-41d72fcdc496 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: ddbe5c02-5b1d-4f3d-a2b7-c3d5710ff6d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 09:05:30.599438 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c6e2ebc4-9fac-4ebe-84bd-41d72fcdc496 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.832701 Jun 05 09:05:30.600315 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1612/3312] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 09:05:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 09:05:30.608067 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:05:30.609340 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=36,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:05:30.613132 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-1d52aebb-1102-4427-a8e5-d1757755940c tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:05:30.613787 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-1d52aebb-1102-4427-a8e5-d1757755940c tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: ddbe5c02-5b1d-4f3d-a2b7-c3d5710ff6d4] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:05:30.615783 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:05:30.755745 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-1d52aebb-1102-4427-a8e5-d1757755940c tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2909d99d6aed4ddb89eb9d1b1740e493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b07c9aded489cb0021e9df14bb674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:05:30.763397 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-1d52aebb-1102-4427-a8e5-d1757755940c tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "GET /compute/v2.1/servers/ddbe5c02-5b1d-4f3d-a2b7-c3d5710ff6d4" status: 200 len: 1267 microversion: 2.1 time: 0.157189 Jun 05 09:05:30.763964 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1701/3313] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:05:30 2022] GET /compute/v2.1/servers/ddbe5c02-5b1d-4f3d-a2b7-c3d5710ff6d4 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:05:31.782031 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-fea97104-2529-4e48-9305-5e15c6af0307 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:05:31.782822 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-fea97104-2529-4e48-9305-5e15c6af0307 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: ddbe5c02-5b1d-4f3d-a2b7-c3d5710ff6d4] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:05:31.789768 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fea97104-2529-4e48-9305-5e15c6af0307 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:31.790228 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fea97104-2529-4e48-9305-5e15c6af0307 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:31.790991 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fea97104-2529-4e48-9305-5e15c6af0307 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:31.791433 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fea97104-2529-4e48-9305-5e15c6af0307 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:31.823183 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fea97104-2529-4e48-9305-5e15c6af0307 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:31.823635 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-fea97104-2529-4e48-9305-5e15c6af0307 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:31.824142 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-fea97104-2529-4e48-9305-5e15c6af0307 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lazy-loading 'fault' on Instance uuid ddbe5c02-5b1d-4f3d-a2b7-c3d5710ff6d4 {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 09:05:31.870100 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-fea97104-2529-4e48-9305-5e15c6af0307 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2909d99d6aed4ddb89eb9d1b1740e493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b07c9aded489cb0021e9df14bb674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:05:31.878872 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-fea97104-2529-4e48-9305-5e15c6af0307 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "GET /compute/v2.1/servers/ddbe5c02-5b1d-4f3d-a2b7-c3d5710ff6d4" status: 200 len: 1340 microversion: 2.1 time: 0.101652 Jun 05 09:05:31.880178 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1613/3314] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:05:31 2022] GET /compute/v2.1/servers/ddbe5c02-5b1d-4f3d-a2b7-c3d5710ff6d4 => generated 1340 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:05:31.896411 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5a15d1fd-990c-4d09-b58f-191df241321b tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:05:31.897028 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5a15d1fd-990c-4d09-b58f-191df241321b tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: ddbe5c02-5b1d-4f3d-a2b7-c3d5710ff6d4] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:05:31.908197 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5a15d1fd-990c-4d09-b58f-191df241321b tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:31.908671 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5a15d1fd-990c-4d09-b58f-191df241321b tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:31.909478 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5a15d1fd-990c-4d09-b58f-191df241321b tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:31.909928 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5a15d1fd-990c-4d09-b58f-191df241321b tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:31.946053 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5a15d1fd-990c-4d09-b58f-191df241321b tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: ddbe5c02-5b1d-4f3d-a2b7-c3d5710ff6d4] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 09:05:32.017334 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5a15d1fd-990c-4d09-b58f-191df241321b tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: ddbe5c02-5b1d-4f3d-a2b7-c3d5710ff6d4] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 09:05:32.018081 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5a15d1fd-990c-4d09-b58f-191df241321b tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:32.018538 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5a15d1fd-990c-4d09-b58f-191df241321b tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:32.018990 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-5a15d1fd-990c-4d09-b58f-191df241321b tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: ddbe5c02-5b1d-4f3d-a2b7-c3d5710ff6d4] instance's host None is down, deleting from database Jun 05 09:05:32.024402 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-5a15d1fd-990c-4d09-b58f-191df241321b tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: ddbe5c02-5b1d-4f3d-a2b7-c3d5710ff6d4] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 09:05:32.073999 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-5a15d1fd-990c-4d09-b58f-191df241321b tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: ddbe5c02-5b1d-4f3d-a2b7-c3d5710ff6d4] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 09:05:32.080975 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-5a15d1fd-990c-4d09-b58f-191df241321b tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: ddbe5c02-5b1d-4f3d-a2b7-c3d5710ff6d4] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 09:05:32.238036 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5a15d1fd-990c-4d09-b58f-191df241321b tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ddbe5c02-5b1d-4f3d-a2b7-c3d5710ff6d4" status: 204 len: 0 microversion: 2.1 time: 0.346390 Jun 05 09:05:32.238615 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1702/3315] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 09:05:31 2022] DELETE /compute/v2.1/servers/ddbe5c02-5b1d-4f3d-a2b7-c3d5710ff6d4 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 09:05:32.247040 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c1e5513b-5558-47db-a07e-722434ba91d0 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:05:32.247674 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-c1e5513b-5558-47db-a07e-722434ba91d0 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] [instance: ddbe5c02-5b1d-4f3d-a2b7-c3d5710ff6d4] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:05:32.254002 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c1e5513b-5558-47db-a07e-722434ba91d0 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:32.254462 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c1e5513b-5558-47db-a07e-722434ba91d0 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:32.255247 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c1e5513b-5558-47db-a07e-722434ba91d0 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:32.255693 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-c1e5513b-5558-47db-a07e-722434ba91d0 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:32.270678 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-c1e5513b-5558-47db-a07e-722434ba91d0 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] HTTP exception thrown: Instance ddbe5c02-5b1d-4f3d-a2b7-c3d5710ff6d4 could not be found. Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c1e5513b-5558-47db-a07e-722434ba91d0 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Request method failure captured: Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/ddbe5c02-5b1d-4f3d-a2b7-c3d5710ff6d4 HTTP/1.1 Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinHGl3xMHqTBxNFyBHKbfpEpRpqIK9-io6WxAoQC_8SE-_K3Aaikg1HaGVxQTII0L4gCxMGobqbZ8geQzuGD9XgH7PJ5mw3_znRHRtYCm3VjzRlCq3j-WuJENL1H6i368jW6BJW-h75Z85lqWYUCqZqi6Gafin8JyA9SBhRt7NYTTlsU Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 182b07c9aded489cb0021e9df14bb674 Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-82727815 Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/182b07c9aded489cb0021e9df14bb674"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/182b07c9aded489cb0021e9df14bb674"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_182b07c9aded489cb0021e9df14bb674", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/182b07c9aded489cb0021e9df14bb674"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-TestNetworkAdvancedServerOps-82727815 Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 182b07c9aded489cb0021e9df14bb674 Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-82727815 Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-TestNetworkAdvancedServerOps-82727815-project Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 2909d99d6aed4ddb89eb9d1b1740e493 Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-TestNetworkAdvancedServerOps-82727815-project Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance ddbe5c02-5b1d-4f3d-a2b7-c3d5710ff6d4 could not be found. Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': 'ddbe5c02-5b1d-4f3d-a2b7-c3d5710ff6d4'} Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddbe5c02-5b1d-4f3d-a2b7-c3d5710ff6d4 could not be found. Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddbe5c02-5b1d-4f3d-a2b7-c3d5710ff6d4 could not be found. Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:05:32.272311 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:05:32.278221 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:05:32.278221 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:05:32.278221 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:05:32.278221 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 09:05:32.278221 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 09:05:32.278221 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddbe5c02-5b1d-4f3d-a2b7-c3d5710ff6d4 could not be found. Jun 05 09:05:32.278221 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:05:32.278221 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-c1e5513b-5558-47db-a07e-722434ba91d0 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Returning 404 to user: Instance ddbe5c02-5b1d-4f3d-a2b7-c3d5710ff6d4 could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 09:05:32.278221 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-c1e5513b-5558-47db-a07e-722434ba91d0 tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "GET /compute/v2.1/servers/ddbe5c02-5b1d-4f3d-a2b7-c3d5710ff6d4" status: 404 len: 111 microversion: 2.1 time: 0.031445 Jun 05 09:05:32.278221 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1614/3316] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:05:32 2022] GET /compute/v2.1/servers/ddbe5c02-5b1d-4f3d-a2b7-c3d5710ff6d4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 09:05:35.634484 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-010c0ccc-8d4e-4676-8926-37723d747cee tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] Calling method '.version_select at 0x7f24453a7670>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:05:35.663743 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-010c0ccc-8d4e-4676-8926-37723d747cee tempest-TestNetworkAdvancedServerOps-82727815 tempest-TestNetworkAdvancedServerOps-82727815-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1950070909" status: 202 len: 0 microversion: 2.1 time: 0.032458 Jun 05 09:05:35.664543 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1703/3317] 10.222.0.33 () {58 vars in 1283 bytes} [Sun Jun 5 09:05:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1950070909 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 05 09:05:46.612251 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:05:46.613358 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=6 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:05:46.614069 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:05:46.614780 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=12 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:05:46.800217 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-1d663ac8-5c06-4ded-af31-fc67596b2f66 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Action: 'create', calling method: .version_select at 0x7f24337c6430>, body: {"keypair": {"name": "tempest-TestShelveInstance-226375746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWIBrd0SUAt4Wz/dQZhkf+TJqcnE/9TnCvCmkrpK6UbC2HCXVzZ4bnL8FUPgqMoIcHcn+eW3mylumxUG047J5AzB3JyhqrOOHQANOUc0hHzojcCJim06hZXMQjz6ZUtvQ=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:05:46.815283 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-1d663ac8-5c06-4ded-af31-fc67596b2f66 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Getting quotas for project 7e6813e79bb74450b222595966fdde27. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:05:46.820405 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-1d663ac8-5c06-4ded-af31-fc67596b2f66 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Getting quotas for user 317fbc5ba549493b970b7157b6eb3220 and project 7e6813e79bb74450b222595966fdde27. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:05:46.845857 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-1d663ac8-5c06-4ded-af31-fc67596b2f66 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.239093 Jun 05 09:05:46.846622 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1615/3318] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 09:05:46 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 09:05:47.947049 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=12 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:05:47.947898 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:05:47.948578 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:05:47.952995 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-44c318e6-2ed5-4cae-bcb1-77b5a217f154 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1542561675", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-226375746", "security_groups": [{"name": "tempest-secgroup-smoke-1600076704"}], "networks": [{"uuid": "47d47a2f-3cb0-44c9-b0ee-2553d947456d"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:05:48.057441 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-44c318e6-2ed5-4cae-bcb1-77b5a217f154 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] validate_networks() for [('47d47a2f-3cb0-44c9-b0ee-2553d947456d', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 09:05:48.551727 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-44c318e6-2ed5-4cae-bcb1-77b5a217f154 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 09:05:48.552428 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-44c318e6-2ed5-4cae-bcb1-77b5a217f154 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 09:05:48.552936 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-44c318e6-2ed5-4cae-bcb1-77b5a217f154 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 09:05:48.553429 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-44c318e6-2ed5-4cae-bcb1-77b5a217f154 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 09:05:48.553911 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-44c318e6-2ed5-4cae-bcb1-77b5a217f154 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 09:05:48.563644 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-44c318e6-2ed5-4cae-bcb1-77b5a217f154 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:48.564222 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-44c318e6-2ed5-4cae-bcb1-77b5a217f154 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:48.565090 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-44c318e6-2ed5-4cae-bcb1-77b5a217f154 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:48.565591 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-44c318e6-2ed5-4cae-bcb1-77b5a217f154 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:48.584111 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-44c318e6-2ed5-4cae-bcb1-77b5a217f154 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Getting quotas for project 7e6813e79bb74450b222595966fdde27. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:05:48.589260 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-44c318e6-2ed5-4cae-bcb1-77b5a217f154 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Getting quotas for user 317fbc5ba549493b970b7157b6eb3220 and project 7e6813e79bb74450b222595966fdde27. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:05:48.602024 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-44c318e6-2ed5-4cae-bcb1-77b5a217f154 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 09:05:48.604208 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-44c318e6-2ed5-4cae-bcb1-77b5a217f154 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] [instance: fcde2cbd-453e-4c4c-9d05-140f1cd00ac1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 09:05:48.651463 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-44c318e6-2ed5-4cae-bcb1-77b5a217f154 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.705894 Jun 05 09:05:48.652079 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1704/3319] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 09:05:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 09:05:48.662653 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ac81b7d4-1125-42ea-9401-d1e301e0035d tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:05:48.664560 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ac81b7d4-1125-42ea-9401-d1e301e0035d tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] [instance: fcde2cbd-453e-4c4c-9d05-140f1cd00ac1] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:05:48.733247 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-ac81b7d4-1125-42ea-9401-d1e301e0035d tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317fbc5ba549493b970b7157b6eb3220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6813e79bb74450b222595966fdde27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:05:48.739993 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ac81b7d4-1125-42ea-9401-d1e301e0035d tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] 10.222.0.33 "GET /compute/v2.1/servers/fcde2cbd-453e-4c4c-9d05-140f1cd00ac1" status: 200 len: 1246 microversion: 2.1 time: 0.081670 Jun 05 09:05:48.740633 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1616/3320] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:05:48 2022] GET /compute/v2.1/servers/fcde2cbd-453e-4c4c-9d05-140f1cd00ac1 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:05:49.758714 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-0a46373c-0306-4e34-aad0-5ed735f7ab63 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:05:49.759341 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-0a46373c-0306-4e34-aad0-5ed735f7ab63 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] [instance: fcde2cbd-453e-4c4c-9d05-140f1cd00ac1] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:05:49.765622 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0a46373c-0306-4e34-aad0-5ed735f7ab63 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:49.766205 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0a46373c-0306-4e34-aad0-5ed735f7ab63 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:49.766884 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0a46373c-0306-4e34-aad0-5ed735f7ab63 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:49.767328 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0a46373c-0306-4e34-aad0-5ed735f7ab63 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:49.799685 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0a46373c-0306-4e34-aad0-5ed735f7ab63 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:49.800196 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-0a46373c-0306-4e34-aad0-5ed735f7ab63 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:49.800666 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-0a46373c-0306-4e34-aad0-5ed735f7ab63 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lazy-loading 'fault' on Instance uuid fcde2cbd-453e-4c4c-9d05-140f1cd00ac1 {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 09:05:49.841538 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-0a46373c-0306-4e34-aad0-5ed735f7ab63 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317fbc5ba549493b970b7157b6eb3220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6813e79bb74450b222595966fdde27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:05:49.848931 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-0a46373c-0306-4e34-aad0-5ed735f7ab63 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] 10.222.0.33 "GET /compute/v2.1/servers/fcde2cbd-453e-4c4c-9d05-140f1cd00ac1" status: 200 len: 1319 microversion: 2.1 time: 0.095097 Jun 05 09:05:49.849717 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1705/3321] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:05:49 2022] GET /compute/v2.1/servers/fcde2cbd-453e-4c4c-9d05-140f1cd00ac1 => generated 1319 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:05:49.865551 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2e1cf555-a505-4a1d-94fa-dd13acc41193 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:05:49.866098 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2e1cf555-a505-4a1d-94fa-dd13acc41193 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] [instance: fcde2cbd-453e-4c4c-9d05-140f1cd00ac1] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:05:49.876295 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2e1cf555-a505-4a1d-94fa-dd13acc41193 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:49.876744 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2e1cf555-a505-4a1d-94fa-dd13acc41193 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:49.877520 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2e1cf555-a505-4a1d-94fa-dd13acc41193 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:49.877955 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2e1cf555-a505-4a1d-94fa-dd13acc41193 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:49.902257 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2e1cf555-a505-4a1d-94fa-dd13acc41193 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] [instance: fcde2cbd-453e-4c4c-9d05-140f1cd00ac1] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 09:05:49.950865 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-2e1cf555-a505-4a1d-94fa-dd13acc41193 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] [instance: fcde2cbd-453e-4c4c-9d05-140f1cd00ac1] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 09:05:49.951686 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2e1cf555-a505-4a1d-94fa-dd13acc41193 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:49.952172 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-2e1cf555-a505-4a1d-94fa-dd13acc41193 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:49.952621 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-2e1cf555-a505-4a1d-94fa-dd13acc41193 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] [instance: fcde2cbd-453e-4c4c-9d05-140f1cd00ac1] instance's host None is down, deleting from database Jun 05 09:05:49.956177 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-2e1cf555-a505-4a1d-94fa-dd13acc41193 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] [instance: fcde2cbd-453e-4c4c-9d05-140f1cd00ac1] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 09:05:49.990432 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-2e1cf555-a505-4a1d-94fa-dd13acc41193 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] [instance: fcde2cbd-453e-4c4c-9d05-140f1cd00ac1] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 09:05:49.998219 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-2e1cf555-a505-4a1d-94fa-dd13acc41193 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] [instance: fcde2cbd-453e-4c4c-9d05-140f1cd00ac1] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 09:05:50.277666 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2e1cf555-a505-4a1d-94fa-dd13acc41193 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fcde2cbd-453e-4c4c-9d05-140f1cd00ac1" status: 204 len: 0 microversion: 2.1 time: 0.415782 Jun 05 09:05:50.278332 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1617/3322] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 09:05:49 2022] DELETE /compute/v2.1/servers/fcde2cbd-453e-4c4c-9d05-140f1cd00ac1 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 09:05:50.286492 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ab7a51e2-96ba-47ae-b274-3e944dfb7b86 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:05:50.287109 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-ab7a51e2-96ba-47ae-b274-3e944dfb7b86 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] [instance: fcde2cbd-453e-4c4c-9d05-140f1cd00ac1] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:05:50.293548 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ab7a51e2-96ba-47ae-b274-3e944dfb7b86 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:50.293997 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ab7a51e2-96ba-47ae-b274-3e944dfb7b86 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:50.294765 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ab7a51e2-96ba-47ae-b274-3e944dfb7b86 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:05:50.295200 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-ab7a51e2-96ba-47ae-b274-3e944dfb7b86 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:05:50.309307 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-ab7a51e2-96ba-47ae-b274-3e944dfb7b86 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] HTTP exception thrown: Instance fcde2cbd-453e-4c4c-9d05-140f1cd00ac1 could not be found. Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ab7a51e2-96ba-47ae-b274-3e944dfb7b86 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Request method failure captured: Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/fcde2cbd-453e-4c4c-9d05-140f1cd00ac1 HTTP/1.1 Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinHHlx9vouYIA0_Dzqfd71z5lu363s_rl6o9-G36b5kzNZC37oHORO3jRq4e2QUERZWr1q4u8UjFyqeAnFebqf5NwbB1UeUVGS2nRX1CAHHtP4nPY1W6P0pvep-Si2Toxh-0mnSSeKhl-Djro8LDTwb1sVNB5x5f43US8ALOg-1DJdj8 Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 7e6813e79bb74450b222595966fdde27 Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-TestShelveInstance-111521027 Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7e6813e79bb74450b222595966fdde27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e6813e79bb74450b222595966fdde27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7e6813e79bb74450b222595966fdde27", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e6813e79bb74450b222595966fdde27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-TestShelveInstance-111521027 Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 7e6813e79bb74450b222595966fdde27 Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-TestShelveInstance-111521027 Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-TestShelveInstance-111521027-project Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: 317fbc5ba549493b970b7157b6eb3220 Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-TestShelveInstance-111521027-project Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance fcde2cbd-453e-4c4c-9d05-140f1cd00ac1 could not be found. Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'fcde2cbd-453e-4c4c-9d05-140f1cd00ac1'} Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcde2cbd-453e-4c4c-9d05-140f1cd00ac1 could not be found. Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcde2cbd-453e-4c4c-9d05-140f1cd00ac1 could not be found. Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:05:50.311025 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:05:50.315970 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:05:50.315970 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:05:50.315970 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:05:50.315970 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 09:05:50.315970 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 09:05:50.315970 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcde2cbd-453e-4c4c-9d05-140f1cd00ac1 could not be found. Jun 05 09:05:50.315970 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:05:50.315970 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-ab7a51e2-96ba-47ae-b274-3e944dfb7b86 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Returning 404 to user: Instance fcde2cbd-453e-4c4c-9d05-140f1cd00ac1 could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 09:05:50.315970 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-ab7a51e2-96ba-47ae-b274-3e944dfb7b86 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] 10.222.0.33 "GET /compute/v2.1/servers/fcde2cbd-453e-4c4c-9d05-140f1cd00ac1" status: 404 len: 111 microversion: 2.1 time: 0.029719 Jun 05 09:05:50.315970 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1706/3323] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:05:50 2022] GET /compute/v2.1/servers/fcde2cbd-453e-4c4c-9d05-140f1cd00ac1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 09:05:50.492889 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-2e69a8f0-063c-4330-99b0-427cb9098864 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Calling method '.version_select at 0x7f24339928b0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:05:50.520070 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-2e69a8f0-063c-4330-99b0-427cb9098864 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-226375746" status: 202 len: 0 microversion: 2.1 time: 0.030440 Jun 05 09:05:50.521376 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1618/3324] 10.222.0.33 () {58 vars in 1250 bytes} [Sun Jun 5 09:05:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-226375746 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 09:05:50.535767 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-2a2e5b9b-e679-43e6-9e00-885c256b1083 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Action: 'create', calling method: .version_select at 0x7f2432dc2670>, body: {"keypair": {"name": "tempest-TestShelveInstance-1714394284", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+qia13pJ6YM07k8/krhJH6B7dpC8mYzFyFXRvaOjOniBHgIhyMzaWMEgL2g/eG8jGjhLSpl/FID1fUEVq8vk1KMELeNMVkg5MpqrWxtnIMHIgGsKzrIo/98HpN1x8oMg=="}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:05:50.552121 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-2a2e5b9b-e679-43e6-9e00-885c256b1083 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Getting quotas for project 7e6813e79bb74450b222595966fdde27. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:05:50.558563 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-2a2e5b9b-e679-43e6-9e00-885c256b1083 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Getting quotas for user 317fbc5ba549493b970b7157b6eb3220 and project 7e6813e79bb74450b222595966fdde27. Resources: {'key_pairs'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:05:50.588102 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-2a2e5b9b-e679-43e6-9e00-885c256b1083 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.056069 Jun 05 09:05:50.588870 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1707/3325] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 09:05:50 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 09:06:12.219854 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-adffe55c-96a6-463a-90ac-90574dc77ad2 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-331519524", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1714394284", "security_groups": [{"name": "tempest-secgroup-smoke-350374926"}], "networks": [{"uuid": "47d47a2f-3cb0-44c9-b0ee-2553d947456d"}], "block_device_mapping_v2": [{"uuid": "9d793166-89a6-4dc6-a855-6ddd968bf493", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:06:12.228758 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=6 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:06:12.229504 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:06:12.230495 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:06:12.337529 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-adffe55c-96a6-463a-90ac-90574dc77ad2 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] validate_networks() for [('47d47a2f-3cb0-44c9-b0ee-2553d947456d', None, None, None, None, None)] {{(pid=119049) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 09:06:12.746767 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-adffe55c-96a6-463a-90ac-90574dc77ad2 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Flavor limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 09:06:12.747217 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-adffe55c-96a6-463a-90ac-90574dc77ad2 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Image limits 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 09:06:12.747694 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-adffe55c-96a6-463a-90ac-90574dc77ad2 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Flavor pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 09:06:12.748146 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-adffe55c-96a6-463a-90ac-90574dc77ad2 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Image pref 0:0:0 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 09:06:12.748564 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.virt.hardware [None req-adffe55c-96a6-463a-90ac-90574dc77ad2 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 09:06:12.758187 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-adffe55c-96a6-463a-90ac-90574dc77ad2 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:06:12.758846 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-adffe55c-96a6-463a-90ac-90574dc77ad2 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:06:12.760706 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-adffe55c-96a6-463a-90ac-90574dc77ad2 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:06:12.760706 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-adffe55c-96a6-463a-90ac-90574dc77ad2 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:06:12.783012 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-adffe55c-96a6-463a-90ac-90574dc77ad2 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Getting quotas for project 7e6813e79bb74450b222595966fdde27. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:06:12.788140 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-adffe55c-96a6-463a-90ac-90574dc77ad2 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Getting quotas for user 317fbc5ba549493b970b7157b6eb3220 and project 7e6813e79bb74450b222595966fdde27. Resources: {'ram', 'instances', 'cores'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:06:12.845253 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-adffe55c-96a6-463a-90ac-90574dc77ad2 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Going to run 1 instances... {{(pid=119049) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 09:06:12.847289 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-adffe55c-96a6-463a-90ac-90574dc77ad2 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] [instance: 788b67c7-0e6c-4ade-ab94-f3c88fea98ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9d793166-89a6-4dc6-a855-6ddd968bf493',volume_size=None,volume_type=None)] {{(pid=119049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 09:06:12.970901 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-adffe55c-96a6-463a-90ac-90574dc77ad2 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.754823 Jun 05 09:06:12.971669 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1619/3326] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 09:06:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 09:06:12.981979 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-9d74c71d-d686-4f27-b6c3-b0835877cbb2 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:06:12.982598 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-9d74c71d-d686-4f27-b6c3-b0835877cbb2 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] [instance: 788b67c7-0e6c-4ade-ab94-f3c88fea98ed] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:06:12.986409 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell1:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:06:12.987303 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=12 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:06:12.991437 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=10 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:06:12.992776 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=4 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:06:13.054309 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-9d74c71d-d686-4f27-b6c3-b0835877cbb2 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317fbc5ba549493b970b7157b6eb3220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6813e79bb74450b222595966fdde27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:06:13.062320 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-9d74c71d-d686-4f27-b6c3-b0835877cbb2 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] 10.222.0.33 "GET /compute/v2.1/servers/788b67c7-0e6c-4ade-ab94-f3c88fea98ed" status: 200 len: 1088 microversion: 2.1 time: 0.084107 Jun 05 09:06:13.062900 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1708/3327] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:06:12 2022] GET /compute/v2.1/servers/788b67c7-0e6c-4ade-ab94-f3c88fea98ed => generated 1088 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:06:14.081306 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-19956933-e2ba-49f1-adef-4fb4c5587ac5 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:06:14.081925 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-19956933-e2ba-49f1-adef-4fb4c5587ac5 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] [instance: 788b67c7-0e6c-4ade-ab94-f3c88fea98ed] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:06:14.089024 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-19956933-e2ba-49f1-adef-4fb4c5587ac5 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:06:14.089480 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-19956933-e2ba-49f1-adef-4fb4c5587ac5 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:06:14.090243 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-19956933-e2ba-49f1-adef-4fb4c5587ac5 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:06:14.090684 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-19956933-e2ba-49f1-adef-4fb4c5587ac5 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:06:14.119888 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-19956933-e2ba-49f1-adef-4fb4c5587ac5 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:06:14.120371 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-19956933-e2ba-49f1-adef-4fb4c5587ac5 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:06:14.120821 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.objects.instance [None req-19956933-e2ba-49f1-adef-4fb4c5587ac5 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lazy-loading 'fault' on Instance uuid 788b67c7-0e6c-4ade-ab94-f3c88fea98ed {{(pid=119049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 09:06:14.160985 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-19956933-e2ba-49f1-adef-4fb4c5587ac5 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317fbc5ba549493b970b7157b6eb3220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e6813e79bb74450b222595966fdde27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:06:14.169029 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-19956933-e2ba-49f1-adef-4fb4c5587ac5 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] 10.222.0.33 "GET /compute/v2.1/servers/788b67c7-0e6c-4ade-ab94-f3c88fea98ed" status: 200 len: 1207 microversion: 2.1 time: 0.092516 Jun 05 09:06:14.169601 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1620/3328] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:06:14 2022] GET /compute/v2.1/servers/788b67c7-0e6c-4ade-ab94-f3c88fea98ed => generated 1207 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:06:14.185652 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-f6413c5a-0431-4488-8f58-6001326c3400 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:06:14.186168 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f6413c5a-0431-4488-8f58-6001326c3400 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] [instance: 788b67c7-0e6c-4ade-ab94-f3c88fea98ed] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:06:14.193392 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f6413c5a-0431-4488-8f58-6001326c3400 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:06:14.193850 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f6413c5a-0431-4488-8f58-6001326c3400 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:06:14.194623 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f6413c5a-0431-4488-8f58-6001326c3400 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:06:14.195103 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f6413c5a-0431-4488-8f58-6001326c3400 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:06:14.219525 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f6413c5a-0431-4488-8f58-6001326c3400 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] [instance: 788b67c7-0e6c-4ade-ab94-f3c88fea98ed] Going to try to terminate instance {{(pid=119050) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 09:06:14.264720 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-f6413c5a-0431-4488-8f58-6001326c3400 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] [instance: 788b67c7-0e6c-4ade-ab94-f3c88fea98ed] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119050) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 09:06:14.265507 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f6413c5a-0431-4488-8f58-6001326c3400 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:06:14.265953 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-f6413c5a-0431-4488-8f58-6001326c3400 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:06:14.266395 n-d-844739-1 devstack@n-api.service[119050]: WARNING nova.compute.api [None req-f6413c5a-0431-4488-8f58-6001326c3400 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] [instance: 788b67c7-0e6c-4ade-ab94-f3c88fea98ed] instance's host None is down, deleting from database Jun 05 09:06:14.270794 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-f6413c5a-0431-4488-8f58-6001326c3400 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] [instance: 788b67c7-0e6c-4ade-ab94-f3c88fea98ed] deallocate_for_instance() {{(pid=119050) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 09:06:14.304235 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-f6413c5a-0431-4488-8f58-6001326c3400 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] [instance: 788b67c7-0e6c-4ade-ab94-f3c88fea98ed] Instance cache missing network info. {{(pid=119050) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 09:06:14.310802 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-f6413c5a-0431-4488-8f58-6001326c3400 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] [instance: 788b67c7-0e6c-4ade-ab94-f3c88fea98ed] Updating instance_info_cache with network_info: [] {{(pid=119050) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 09:06:14.647176 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-f6413c5a-0431-4488-8f58-6001326c3400 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] 10.222.0.33 "DELETE /compute/v2.1/servers/788b67c7-0e6c-4ade-ab94-f3c88fea98ed" status: 204 len: 0 microversion: 2.1 time: 0.465344 Jun 05 09:06:14.651721 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1709/3329] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 09:06:14 2022] DELETE /compute/v2.1/servers/788b67c7-0e6c-4ade-ab94-f3c88fea98ed => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 09:06:14.657063 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d87242bf-f1f3-4180-8335-b91c6872e92f tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:06:14.657708 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-d87242bf-f1f3-4180-8335-b91c6872e92f tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] [instance: 788b67c7-0e6c-4ade-ab94-f3c88fea98ed] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:06:14.665024 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d87242bf-f1f3-4180-8335-b91c6872e92f tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:06:14.665498 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d87242bf-f1f3-4180-8335-b91c6872e92f tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:06:14.666283 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d87242bf-f1f3-4180-8335-b91c6872e92f tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:06:14.666728 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-d87242bf-f1f3-4180-8335-b91c6872e92f tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:06:14.681209 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.wsgi [None req-d87242bf-f1f3-4180-8335-b91c6872e92f tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] HTTP exception thrown: Instance 788b67c7-0e6c-4ade-ab94-f3c88fea98ed could not be found. Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d87242bf-f1f3-4180-8335-b91c6872e92f tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Request method failure captured: Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: request: GET /compute/v2.1/servers/788b67c7-0e6c-4ade-ab94-f3c88fea98ed HTTP/1.1 Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: Accept: application/json Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: Accept-Encoding: identity Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: Connection: close Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: Content-Length: 0 Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: Content-Type: application/json Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: Host: 10.222.0.33 Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: Openstack-System-Scope: None Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: User-Agent: python-urllib3/1.26.9 Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: X-Auth-Token: gAAAAABinHHlx9vouYIA0_Dzqfd71z5lu363s_rl6o9-G36b5kzNZC37oHORO3jRq4e2QUERZWr1q4u8UjFyqeAnFebqf5NwbB1UeUVGS2nRX1CAHHtP4nPY1W6P0pvep-Si2Toxh-0mnSSeKhl-Djro8LDTwb1sVNB5x5f43US8ALOg-1DJdj8 Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Id: None Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: X-Domain-Name: None Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: X-Identity-Status: Confirmed Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: X-Is-Admin-Project: True Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Id: default Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Domain-Name: Default Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Id: 7e6813e79bb74450b222595966fdde27 Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: X-Project-Name: tempest-TestShelveInstance-111521027 Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: X-Role: reader,member Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: X-Roles: reader,member Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7e6813e79bb74450b222595966fdde27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e6813e79bb74450b222595966fdde27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7e6813e79bb74450b222595966fdde27", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e6813e79bb74450b222595966fdde27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant: tempest-TestShelveInstance-111521027 Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Id: 7e6813e79bb74450b222595966fdde27 Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: X-Tenant-Name: tempest-TestShelveInstance-111521027 Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: X-User: tempest-TestShelveInstance-111521027-project Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Id: default Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: X-User-Domain-Name: Default Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: X-User-Id: 317fbc5ba549493b970b7157b6eb3220 Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: X-User-Name: tempest-TestShelveInstance-111521027-project Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: method: > Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: exception: Instance 788b67c7-0e6c-4ade-ab94-f3c88fea98ed could not be found. Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: action_args: {'id': '788b67c7-0e6c-4ade-ab94-f3c88fea98ed'} Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 788b67c7-0e6c-4ade-ab94-f3c88fea98ed could not be found. Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 788b67c7-0e6c-4ade-ab94-f3c88fea98ed could not be found. Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:06:14.682922 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:06:14.691225 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:06:14.691225 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:06:14.691225 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:06:14.691225 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 09:06:14.691225 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 09:06:14.691225 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 788b67c7-0e6c-4ade-ab94-f3c88fea98ed could not be found. Jun 05 09:06:14.691225 n-d-844739-1 devstack@n-api.service[119049]: ERROR nova.api.openstack.wsgi Jun 05 09:06:14.691225 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-d87242bf-f1f3-4180-8335-b91c6872e92f tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Returning 404 to user: Instance 788b67c7-0e6c-4ade-ab94-f3c88fea98ed could not be found. {{(pid=119049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 09:06:14.691225 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-d87242bf-f1f3-4180-8335-b91c6872e92f tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] 10.222.0.33 "GET /compute/v2.1/servers/788b67c7-0e6c-4ade-ab94-f3c88fea98ed" status: 404 len: 111 microversion: 2.1 time: 0.031797 Jun 05 09:06:14.691225 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1621/3330] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:06:14 2022] GET /compute/v2.1/servers/788b67c7-0e6c-4ade-ab94-f3c88fea98ed => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 09:06:14.854527 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-20d127e5-a991-454d-8f8b-fe25981a9395 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] Calling method '.version_select at 0x7f2433a953a0>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:06:14.877151 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-20d127e5-a991-454d-8f8b-fe25981a9395 tempest-TestShelveInstance-111521027 tempest-TestShelveInstance-111521027-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1714394284" status: 202 len: 0 microversion: 2.1 time: 0.027400 Jun 05 09:06:14.878039 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1710/3331] 10.222.0.33 () {58 vars in 1253 bytes} [Sun Jun 5 09:06:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1714394284 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 09:06:32.487661 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell1:SELECT=2 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:06:32.488895 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=6 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:06:32.489690 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:06:32.490328 n-d-844739-1 devstack@n-api.service[119049]: DEBUG dbcounter [-] [119049] Writing DB stats nova_cell0:SELECT=12 {{(pid=119049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:06:32.665035 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-59dd621d-9f35-43ae-b01f-e071b71dde89 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Action: 'create', calling method: .version_select at 0x7f24337ed160>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-700235681", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQAqHVBvj9DpBN1SDexwFTfRyURCFuCVQf8+7S7ggG1a5YKMqL6N7QEJ1LMFxSJJqcigeqOMveszD9ciBZ+6iv5Fe40jVi5XcaLSN52sjLeOoFfs5FzNCIMoo1/KGWXag=="}} {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:06:32.678684 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-59dd621d-9f35-43ae-b01f-e071b71dde89 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Getting quotas for project 44b8a44120a248a2acf0de71ded83a7d. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:06:32.685296 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.quota [None req-59dd621d-9f35-43ae-b01f-e071b71dde89 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Getting quotas for user b71b929b55ff4a529d6cc7696c10b6c3 and project 44b8a44120a248a2acf0de71ded83a7d. Resources: {'key_pairs'} {{(pid=119049) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:06:32.715206 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-59dd621d-9f35-43ae-b01f-e071b71dde89 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.232360 Jun 05 09:06:32.715814 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1622/3332] 10.222.0.33 () {60 vars in 1158 bytes} [Sun Jun 5 09:06:32 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 05 09:06:33.824229 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-b49a1761-46c3-4719-850e-70306d633a94 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-639233861", "imageRef": "1241bde3-ef1f-41a5-b0fa-6f409216229a", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-700235681", "security_groups": [{"name": "tempest-secgroup-smoke-1672046944"}], "networks": [{"uuid": "ede9e256-7f6c-4c0e-b15a-21a2aacda5ef"}]}} {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 05 09:06:33.832415 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:06:33.833280 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_cell0:SELECT=24,nova_cell0:UPDATE=15,nova_cell0:SAVEPOINT=1,nova_cell0:RELEASE=1,nova_cell0:DELETE=2 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:06:33.833883 n-d-844739-1 devstack@n-api.service[119050]: DEBUG dbcounter [-] [119050] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119050) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 05 09:06:33.943605 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.network.neutron [None req-b49a1761-46c3-4719-850e-70306d633a94 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] validate_networks() for [('ede9e256-7f6c-4c0e-b15a-21a2aacda5ef', None, None, None, None, None)] {{(pid=119050) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 05 09:06:34.327874 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-b49a1761-46c3-4719-850e-70306d633a94 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Flavor limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 05 09:06:34.328330 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-b49a1761-46c3-4719-850e-70306d633a94 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Image limits 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 05 09:06:34.328812 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-b49a1761-46c3-4719-850e-70306d633a94 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Flavor pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 05 09:06:34.329226 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-b49a1761-46c3-4719-850e-70306d633a94 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Image pref 0:0:0 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 05 09:06:34.329644 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.virt.hardware [None req-b49a1761-46c3-4719-850e-70306d633a94 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 05 09:06:34.339637 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b49a1761-46c3-4719-850e-70306d633a94 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:06:34.340161 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b49a1761-46c3-4719-850e-70306d633a94 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:06:34.341362 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b49a1761-46c3-4719-850e-70306d633a94 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:06:34.341971 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-b49a1761-46c3-4719-850e-70306d633a94 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Lock "ceb8701a-c729-4596-86e5-c56dbc5a8933" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:06:34.363050 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-b49a1761-46c3-4719-850e-70306d633a94 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Getting quotas for project 44b8a44120a248a2acf0de71ded83a7d. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 05 09:06:34.368595 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.quota [None req-b49a1761-46c3-4719-850e-70306d633a94 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Getting quotas for user b71b929b55ff4a529d6cc7696c10b6c3 and project 44b8a44120a248a2acf0de71ded83a7d. Resources: {'ram', 'instances', 'cores'} {{(pid=119050) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 05 09:06:34.381211 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b49a1761-46c3-4719-850e-70306d633a94 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Going to run 1 instances... {{(pid=119050) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 05 09:06:34.384019 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-b49a1761-46c3-4719-850e-70306d633a94 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] [instance: bc838be0-6bf8-41b3-be9a-20b577651fdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1241bde3-ef1f-41a5-b0fa-6f409216229a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 05 09:06:34.432674 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-b49a1761-46c3-4719-850e-70306d633a94 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.612837 Jun 05 09:06:34.433327 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1711/3333] 10.222.0.33 () {60 vars in 1146 bytes} [Sun Jun 5 09:06:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 05 09:06:34.443968 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-4e5fd498-0ea9-4ada-8312-55795ca36bd0 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:06:34.444619 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-4e5fd498-0ea9-4ada-8312-55795ca36bd0 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] [instance: bc838be0-6bf8-41b3-be9a-20b577651fdf] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:06:34.500247 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.policy [None req-4e5fd498-0ea9-4ada-8312-55795ca36bd0 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71b929b55ff4a529d6cc7696c10b6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b8a44120a248a2acf0de71ded83a7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119049) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:06:34.506844 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-4e5fd498-0ea9-4ada-8312-55795ca36bd0 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] 10.222.0.33 "GET /compute/v2.1/servers/bc838be0-6bf8-41b3-be9a-20b577651fdf" status: 200 len: 1247 microversion: 2.1 time: 0.067604 Jun 05 09:06:34.508100 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1623/3334] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:06:34 2022] GET /compute/v2.1/servers/bc838be0-6bf8-41b3-be9a-20b577651fdf => generated 1247 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:06:35.526513 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-83c66f3b-5965-4a6a-bbd9-c99e7091294f tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:06:35.527930 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-83c66f3b-5965-4a6a-bbd9-c99e7091294f tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] [instance: bc838be0-6bf8-41b3-be9a-20b577651fdf] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:06:35.535186 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-83c66f3b-5965-4a6a-bbd9-c99e7091294f tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:06:35.535920 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-83c66f3b-5965-4a6a-bbd9-c99e7091294f tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:06:35.536738 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-83c66f3b-5965-4a6a-bbd9-c99e7091294f tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:06:35.544674 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-83c66f3b-5965-4a6a-bbd9-c99e7091294f tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:06:35.581304 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-83c66f3b-5965-4a6a-bbd9-c99e7091294f tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:06:35.581760 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-83c66f3b-5965-4a6a-bbd9-c99e7091294f tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:06:35.582242 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.objects.instance [None req-83c66f3b-5965-4a6a-bbd9-c99e7091294f tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Lazy-loading 'fault' on Instance uuid bc838be0-6bf8-41b3-be9a-20b577651fdf {{(pid=119050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 05 09:06:35.638998 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.policy [None req-83c66f3b-5965-4a6a-bbd9-c99e7091294f tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b71b929b55ff4a529d6cc7696c10b6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44b8a44120a248a2acf0de71ded83a7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119050) authorize /opt/stack/nova/nova/policy.py:199}} Jun 05 09:06:35.649026 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-83c66f3b-5965-4a6a-bbd9-c99e7091294f tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] 10.222.0.33 "GET /compute/v2.1/servers/bc838be0-6bf8-41b3-be9a-20b577651fdf" status: 200 len: 1320 microversion: 2.1 time: 0.127586 Jun 05 09:06:35.652202 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1712/3335] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:06:35 2022] GET /compute/v2.1/servers/bc838be0-6bf8-41b3-be9a-20b577651fdf => generated 1320 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 05 09:06:35.668271 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-ff8f705f-1dfb-4d3b-a51b-49d82166dd52 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Calling method '>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:06:35.669741 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ff8f705f-1dfb-4d3b-a51b-49d82166dd52 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] [instance: bc838be0-6bf8-41b3-be9a-20b577651fdf] Fetching instance by UUID {{(pid=119049) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:06:35.678542 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ff8f705f-1dfb-4d3b-a51b-49d82166dd52 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:06:35.679862 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ff8f705f-1dfb-4d3b-a51b-49d82166dd52 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:06:35.689127 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ff8f705f-1dfb-4d3b-a51b-49d82166dd52 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:06:35.689957 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ff8f705f-1dfb-4d3b-a51b-49d82166dd52 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:06:35.728406 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ff8f705f-1dfb-4d3b-a51b-49d82166dd52 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] [instance: bc838be0-6bf8-41b3-be9a-20b577651fdf] Going to try to terminate instance {{(pid=119049) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 05 09:06:35.780668 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.compute.api [None req-ff8f705f-1dfb-4d3b-a51b-49d82166dd52 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] [instance: bc838be0-6bf8-41b3-be9a-20b577651fdf] Doing local delete in cell 00000000-0000-0000-0000-000000000000(cell0) {{(pid=119049) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 05 09:06:35.781396 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ff8f705f-1dfb-4d3b-a51b-49d82166dd52 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:06:35.782092 n-d-844739-1 devstack@n-api.service[119049]: DEBUG oslo_concurrency.lockutils [None req-ff8f705f-1dfb-4d3b-a51b-49d82166dd52 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:06:35.782529 n-d-844739-1 devstack@n-api.service[119049]: WARNING nova.compute.api [None req-ff8f705f-1dfb-4d3b-a51b-49d82166dd52 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] [instance: bc838be0-6bf8-41b3-be9a-20b577651fdf] instance's host None is down, deleting from database Jun 05 09:06:35.785979 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-ff8f705f-1dfb-4d3b-a51b-49d82166dd52 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] [instance: bc838be0-6bf8-41b3-be9a-20b577651fdf] deallocate_for_instance() {{(pid=119049) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 05 09:06:35.825349 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-ff8f705f-1dfb-4d3b-a51b-49d82166dd52 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] [instance: bc838be0-6bf8-41b3-be9a-20b577651fdf] Instance cache missing network info. {{(pid=119049) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3286}} Jun 05 09:06:35.831758 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.network.neutron [None req-ff8f705f-1dfb-4d3b-a51b-49d82166dd52 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] [instance: bc838be0-6bf8-41b3-be9a-20b577651fdf] Updating instance_info_cache with network_info: [] {{(pid=119049) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 05 09:06:35.997289 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-ff8f705f-1dfb-4d3b-a51b-49d82166dd52 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bc838be0-6bf8-41b3-be9a-20b577651fdf" status: 204 len: 0 microversion: 2.1 time: 0.333382 Jun 05 09:06:35.998114 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1624/3336] 10.222.0.33 () {58 vars in 1238 bytes} [Sun Jun 5 09:06:35 2022] DELETE /compute/v2.1/servers/bc838be0-6bf8-41b3-be9a-20b577651fdf => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 05 09:06:36.006534 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5a74e43e-5eba-40d4-882d-506cb4276dc8 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Calling method '>' {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:06:36.007580 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.compute.api [None req-5a74e43e-5eba-40d4-882d-506cb4276dc8 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] [instance: bc838be0-6bf8-41b3-be9a-20b577651fdf] Fetching instance by UUID {{(pid=119050) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 05 09:06:36.014029 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5a74e43e-5eba-40d4-882d-506cb4276dc8 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:06:36.014578 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5a74e43e-5eba-40d4-882d-506cb4276dc8 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:06:36.015454 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5a74e43e-5eba-40d4-882d-506cb4276dc8 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 05 09:06:36.016284 n-d-844739-1 devstack@n-api.service[119050]: DEBUG oslo_concurrency.lockutils [None req-5a74e43e-5eba-40d4-882d-506cb4276dc8 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 05 09:06:36.034949 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.wsgi [None req-5a74e43e-5eba-40d4-882d-506cb4276dc8 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] HTTP exception thrown: Instance bc838be0-6bf8-41b3-be9a-20b577651fdf could not be found. Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5a74e43e-5eba-40d4-882d-506cb4276dc8 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Request method failure captured: Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: request: GET /compute/v2.1/servers/bc838be0-6bf8-41b3-be9a-20b577651fdf HTTP/1.1 Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: Accept: application/json Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: Accept-Encoding: identity Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: Connection: close Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: Content-Length: 0 Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: Content-Type: application/json Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: Host: 10.222.0.33 Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: Openstack-System-Scope: None Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: User-Agent: python-urllib3/1.26.9 Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: X-Auth-Token: gAAAAABinHITIk0fgyqn-QxTu5zP6FVtWnV1H3Rr45gOyUnU0QPsLW4aTdO9_GbLbhKoNfvKtcAXakc-dwb6LjZ15s6sGuydjZMRdlR2Jl6FFES5z_Xt3Ts03btypYcITQws0CQhGmIlhZ86pJzBq3lcsMSgcwBpYA8PQ8_DE8hWiJQeBS9ku40 Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Id: None Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: X-Domain-Name: None Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: X-Identity-Status: Confirmed Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: X-Is-Admin-Project: True Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Id: default Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Domain-Name: Default Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Id: 44b8a44120a248a2acf0de71ded83a7d Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: X-Project-Name: tempest-TestSnapshotPattern-142185867 Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: X-Role: reader,member Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: X-Roles: reader,member Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/44b8a44120a248a2acf0de71ded83a7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44b8a44120a248a2acf0de71ded83a7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_44b8a44120a248a2acf0de71ded83a7d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44b8a44120a248a2acf0de71ded83a7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant: tempest-TestSnapshotPattern-142185867 Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Id: 44b8a44120a248a2acf0de71ded83a7d Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: X-Tenant-Name: tempest-TestSnapshotPattern-142185867 Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: X-User: tempest-TestSnapshotPattern-142185867-project Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Id: default Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: X-User-Domain-Name: Default Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: X-User-Id: b71b929b55ff4a529d6cc7696c10b6c3 Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: X-User-Name: tempest-TestSnapshotPattern-142185867-project Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: method: > Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: exception: Instance bc838be0-6bf8-41b3-be9a-20b577651fdf could not be found. Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: action_args: {'id': 'bc838be0-6bf8-41b3-be9a-20b577651fdf'} Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: {{(pid=119050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc838be0-6bf8-41b3-be9a-20b577651fdf could not be found. Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc838be0-6bf8-41b3-be9a-20b577651fdf could not be found. Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 05 09:06:36.036781 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:06:36.042357 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 05 09:06:36.042357 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 05 09:06:36.042357 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 05 09:06:36.042357 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 05 09:06:36.042357 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 05 09:06:36.042357 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc838be0-6bf8-41b3-be9a-20b577651fdf could not be found. Jun 05 09:06:36.042357 n-d-844739-1 devstack@n-api.service[119050]: ERROR nova.api.openstack.wsgi Jun 05 09:06:36.044435 n-d-844739-1 devstack@n-api.service[119050]: DEBUG nova.api.openstack.wsgi [None req-5a74e43e-5eba-40d4-882d-506cb4276dc8 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Returning 404 to user: Instance bc838be0-6bf8-41b3-be9a-20b577651fdf could not be found. {{(pid=119050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 05 09:06:36.045566 n-d-844739-1 devstack@n-api.service[119050]: INFO nova.api.openstack.requestlog [None req-5a74e43e-5eba-40d4-882d-506cb4276dc8 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] 10.222.0.33 "GET /compute/v2.1/servers/bc838be0-6bf8-41b3-be9a-20b577651fdf" status: 404 len: 111 microversion: 2.1 time: 0.043001 Jun 05 09:06:36.048968 n-d-844739-1 devstack@n-api.service[119050]: [pid: 119050|app: 0|req: 1713/3337] 10.222.0.33 () {58 vars in 1235 bytes} [Sun Jun 5 09:06:36 2022] GET /compute/v2.1/servers/bc838be0-6bf8-41b3-be9a-20b577651fdf => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 05 09:06:36.253556 n-d-844739-1 devstack@n-api.service[119049]: DEBUG nova.api.openstack.wsgi [None req-3c9ef4b2-6325-47a9-add2-25c49486fa26 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] Calling method '.version_select at 0x7f24339b0ee0>' {{(pid=119049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 05 09:06:36.303554 n-d-844739-1 devstack@n-api.service[119049]: INFO nova.api.openstack.requestlog [None req-3c9ef4b2-6325-47a9-add2-25c49486fa26 tempest-TestSnapshotPattern-142185867 tempest-TestSnapshotPattern-142185867-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-700235681" status: 202 len: 0 microversion: 2.1 time: 0.053651 Jun 05 09:06:36.305162 n-d-844739-1 devstack@n-api.service[119049]: [pid: 119049|app: 0|req: 1625/3338] 10.222.0.33 () {58 vars in 1253 bytes} [Sun Jun 5 09:06:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-700235681 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 05 09:06:57.850514 n-d-844739-1 devstack@n-api.service[119049]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 09:06:57.851120 n-d-844739-1 devstack@n-api.service[119049]: Sun Jun 5 09:06:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 09:08:43.848638 n-d-844739-1 devstack@n-api.service[119050]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 09:08:43.849258 n-d-844739-1 devstack@n-api.service[119050]: Sun Jun 5 09:08:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 09:10:17.859292 n-d-844739-1 devstack@n-api.service[119049]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 09:10:17.859875 n-d-844739-1 devstack@n-api.service[119049]: Sun Jun 5 09:10:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 09:11:37.467549 n-d-844739-1 devstack@n-api.service[119049]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 09:11:37.468291 n-d-844739-1 devstack@n-api.service[119049]: Sun Jun 5 09:11:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 09:11:37.473671 n-d-844739-1 devstack@n-api.service[119049]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 09:11:37.474465 n-d-844739-1 devstack@n-api.service[119049]: Sun Jun 5 09:11:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 09:11:38.043890 n-d-844739-1 devstack@n-api.service[119050]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 09:11:38.044476 n-d-844739-1 devstack@n-api.service[119050]: Sun Jun 5 09:11:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 09:11:38.103506 n-d-844739-1 devstack@n-api.service[119050]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 09:11:38.103682 n-d-844739-1 devstack@n-api.service[119050]: Sun Jun 5 09:11:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 05 09:12:03.857579 n-d-844739-1 devstack@n-api.service[119050]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 05 09:12:03.858282 n-d-844739-1 devstack@n-api.service[119050]: Sun Jun 5 09:12:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!